You are right, the infrastructure is not in the hands of the people. However, it is not in the hands of governments either. Instead, it is controlled by corporations that operate to make money. They do this by asserting control over their systems, which includes keep the governments at bay. Sure there will be a few cases here and there but, for the most part, what was done to Microsoft, Facebook, Google, and Apple over the decades? Basically nothing.

Plus you argument presumes you can get all the governments of the world on the same page. For example, with Bitcoin being legal tender in El Salvador, regardless of the legality around the world, there is a leak in the boat: anyone can convert BTC to USD in that country since both are legal tender.