but not who specifically the votes come from and not how much from the single voters

Peakd shows this data.

Anonymity would lead to more problems.
Transparency has issues, but at least we can see who is causing them.

We just need to establish our customs as a community and enforce them with mob actions.
Games have rules because without rules there is no game.
Games that have rules that are not enforced quickly degrade into chaos.

There has never been more than a handful of people that monitor the 'anti-abuse' crowd, but everybody has an opinion, mostly negative.
IF more people paid attention to what hw's and the others are doing on a daily basis they would not have the opinions they have, imo.
When you don't see what is happening on a day to day basis, but only speak out when emotions run high, then your viewpoint is skewed, you don't have the full data set.
I've been watching this crowd for years, I have seen very few authors that didn't exacerbate their case with emotional outbursts.
Almost all were guilty of some small rules violation, but didn't want to admit it, nor bend the knee to hw's.