Perhaps I shouldn't have read this before heading to bed? 😂. I had some similar experiences in the home I grew up in. You are probably correct that the history of the area has something to with what's going on at home but it might also even be a previous owner (assuming there was one) of the property itself. You could try asking (either in your head or out loud) for the person who is trying to get your attention to please leave or at the very least not bother or scare your kids as much. I've actually done this and it's worked in the past.. just a thought :)