I've spoken about the Golden Rule before and also pointed out there will be some outliers.

What about someone who is a masochist? (Inflict pain upon others so they will inflict pain unto me)

What about suicidal person that wants society to take them out?

As with virtually everything there are still ways to spin such a rule to the negative. Fortunately they don't seem to be that common.