When you downvoting a lot, your Downvote Power can go down even to 0. I think that we can't use regular Upvote Power for downvoting.