All of the payouts come from a pool that is a fixed size at any point in time. When one post gets less, others get more. Downvoting one post is equivalent to upvoting every other post getting a payout by a small amount, assuming it were actually feasible to do that.