We actually also try to counter abusive downvotes when a post or comment is made invisible.

You don't see it because we do it using a trail. It's something similar to how @smartmarket works. And that, we work with @freezepeach and other larger stakeholders to soften the blow.

All you need to do is ask.