Inference Compute: More Important Than Neural Networks

There is a lot of focus on companies that are achieving GPUs like Meta, Xai, and Tesla. These are obviously required for the training of neural networks.

In this video I discuss how, over the next few years, there will be something that outpaces it. We are going to see the need for inference explode. This is something that Tesla is working upon. Musk understands how there is a major need for this and how Tesla has access to millions of computers.

Here is the article mentioned in the video:\

https://www.nextbigfuture.com/2024/06/distributed-ai-inference-will-capture-most-of-the-llm-value.html

▶️ 3Speak