If you explain why, in some cases you can achieve a change in behavior.

Let me give you a real example: Hurtlocker gave some negative votes in the Rising Star community a while ago.
The Rising Star Discord chat discussed it.
What I mean is that if downvotes are going to be discussed, the reasons can also be addressed, especially if an explanation is provided.

It's simple: "This in particular bothered me." And you usually have a valid reason for giving the downvote.