Of course it shouldn't be allowed. That is why intricate to human nature is the understanding and proper interpretation of social interactions, therefore the individual is supposed to know when to abstain, refrain, respond etc.
Just that the most important aspect i.e developing the proper understanding of individual behaviour is what we as a society is neglecting. And it deserves adequate attention, like you're giving to it.