This is the issue with these communities, not Hivewatchers. If they removed you from some curation then I guess they must have made some judgement based on what they have seen.

It's best to talk to them and show the conversations on the blog so they can make up a judgement.

Downvoting Hivewatchers is unlikely going to bring back lost curators and is more likely to attract negative votes.