It's harmful when it involves abuse, control, shaming, guilt, or taking advantage of someone sexually or financially or some other way. Or if one person is trying to isolate the other person or turn them against their family.