What you said is actually right and I agree downvote should not be scraped as it is created for a reason.

Getting to warn people who use it is another thing which we may not know the actual reason for them to take such action against a fellow participant.

I think a lot have to be factored in on the topic of this downvote and I think a system of reporting people to hivewatcher or discord platform is advice or warn the person.