I think they really only start to get concerned when people are truly transacting peer to peer in a black market style economy.

Just after I wrote this, I got a popup from an article (I think on blockfolio) warning that if the governments don't legislate soon, they will be giving rise to a shadow economy. I think it is further along than they think it is.