Sure there is a moral argument, but where does that ultimately end up? One group claims it is moral and the other group is not, and the other group claims the exact same thing.

Live and let live works for me. Neither is taking any sort of violent action against anyone.