It really doesn't and many downvotes on disagreement of rewards are often cast later on to avoid the trending "attention". Of course those who are against downvotes will use this to their defense too "they downvoting late so people can't counter vote due to penalty or not seeing it".

tl;dr, there's no winning with authors of posts you downvote, so having to explain to each and everyone why leads to endless arguments and discussions wasting everyone time. 99% of the time it's always about the rewards and not about any form of "censorship".