I very much comprehend the intricacies of this.
The problem in my mind is probably my own thought process of trying to avoid conflict and explaining myself to others.

Even if it's not being brought up it's in my mind, so it's mostly a perceptual problem that I have to deal with.