It is the nature of the system that downvotes aren't incentivized in any way

Except that they shift those rewards that are being removed right up to the top-earning posts, correct?

Or is that just an untrue thing that lots of people on here say? I haven't seen a technical breakdown of that, and can't read the code myself - but I've seen many folks explain it this way, and never seen anyone correcting them.