Does not have to be a good product (for now). This is a demonstrator.

These can scale up to multiples of 30kW machines, I believe, with several of these cards inside.

For now its just to try to prove how fast from code to ASIC things can be done and work on the economics of the production (more or less like bitcoin miners started to appear).

Then, these might evolve with some better form of programable Models. Maybe more advanced ASICs that can carry the logic for more than 1 LLM model, and do inference depending on firmware switches.

Similar to how Mellanox/Nvidia did with VPI cards that work both on Infiniband and Ethernet protocols (one port at a time), for example.

Either way, these things usually involve patents, and that's why they buy these companies... to either monopolise the market or prevent it from being too easy to explore. That was the point of my snap :D