I don't know the user you mention or the reason why he is downvoting you. Have you tried to discuss it with him?
I do see some people using downvotes in a non-ethical way and it really annoys me. But I do think that without them there would be no way to moderate the content on chain.