The only downside is definitely they'd be outskirt or just in the suburb.

This downside can be temporary depending on your time horizon. I used to see the change within a decade but give it 2 or 3 ahead, generational level of being old and passing down some inheritance schtick and you'll see some changes within your place that work and opportunities reach out to the outskirts. Remote work and facilities being built slowly overtime which changes how people seek opportunities from city to suburban areas. But long term view points don't really feed us now so people take the options where they can work and has the best opportunities and so they compete for properties within cities.

Just what I noticed after wondering why there are lots of big houses away from the urban areas where the silent rich sleeps.