Up to you. You have unvoted me a while ago. I am assuming you wanted that. There's absolutely no problem with it. Everyone can vote for what they like.

Votes on witnesses are like toggle switches. You click on it to vote, and then it stays voted until you unvote. Just in case you didn't understand what you did.