A rule like skipping downvotes if the post rewards < $N may prevent unnecessary downvotes. No need to spend downvote mana if post is not visible already. (Unless you want to destroy reputation of the target.)

Great start, looking forward seeing its progress.