TPUs are cool but I wouldn't say they were built to replace GPUs. They servee different purposes because the TPU is a ASIC designed for high volume low precision work.
But then you also have the DPU, but I am going off on a tangent now :)

But as someone who works in the AI field, what I tell everyone who genuinely wants to know that there is going to be a bubble and a sort of collapse of all these NEO clouds that are buying hundreds of million of dollars worth of GPUs with backing from all these investors trying to get rich quick. It is going to be interesting