I also don't like someone add me in such a thing which has no relation with me. Rather than waiting for someone to leave the chat, You can be the first. And I guess, at the present time whatsapp don't show notification if someone leave. You can double check if it's still the same. Or DLMMQB already suggested you a solution also.