I see that this retaliation is a problem but if some of the big guys help out, the small guys don't need to downvote.
I would not recommend to downvote this guy if you don't have at least 30k HP.
But anyone can make some noise and make a comment to the big guys to fight this abuse.