The rewards come from a pool, which is shared between all users.
An upvote assigns a portion of that pool to one post and all the others get a little bit less.
A downvote assigns a portion of the pool to everyone else and the downvoted post gets less.