I thought that it's a little like "stealing" rewards.

Yes, that is the biggest stigma with the downvotes, people think that you are "stealing" their rewards. But those rewards are not theirs until the payout in the first place.