It's totally fine to get angry at situations like that where people are rude even they're the ones in the wrong. If I was in your situation, I might have escalated the situation, even more, so don't feel too bad.