Not sure what the situation is here. Perhaps @louis88 can shed light on why he did that.

Ignore your haters and keep building your value in the ecosystem is all I can say without looking into the situation. Downvotes only impact your Hive rewards as usually the people downvoting don't actually own any LEO.

i.e. Louis only has 800 LEO so he's not impacting your LEO Rewards