they have (or at least should have) no rights to dictate to anyone how they use their stake...

That's kinda funny as you then go on to say that choosing to use your stake to downvote is an egregious misuse of power.