It's very easy for people to make assumptions and talk about others they don't even know, and the worst part is that they don't think about the consequences of their actions. Fortunately, as you say, your sisters know you, but what if those comments are made in front of someone who doesn't know you? We should be careful with our words and not judge people we don't know.