Honestly one way or the other I agree with you that at times down vote are used in a more malicious way at times, it is very bad to see that it serves as a means of oppressing one another, maybe as a result of conflict in opinion.
More need to be looked into that structure