Interestingly, if you keep your upvote manabar at max, I think you can do like 12 "full power" downvotes at the same time, which just about exhausts the downvote manabar completely. At which time you can wait for the downvote manabar to go back or dip into the main bar.
RE: Complete guide to understand rewards in HF21 [Part 1]