While many affected are not ultra-wealthy, and inequities in the state deserve attention, eliminating private property rights would be harmful for everyone