I think the point here is that if simple name-calling is a "crime" then all name-calling should be downvoted.

And on the other hand, if there "are-no-rules" and "might-makes-right", then JUST SAY THAT and stop pretending downvotes are "justified".