That is the problem — it creates unfairness and can put athletes at risk. The concern is not opposition to transgender people, but the impact on non-trans competitors.