All you need is a couple of nice people. Make friends with them and ignore the gossips. Sounds like a great place with a normal mix of irritating and pleasant people.

Keep baking. People will love your goodies.:)