I don't know. I want the ability to disincentivize bad behavior to remain because it's an essential part of curation. But it is also undeniable that there are downvote abusers.

EDIT

What if we create a Community built around reposting unfairly-targeted posts? I think we could vet people we trust to vet downvotes and only authorize them to post in the Community.