2025-01-27 15:17
Major misunderstanding about AI infrastructure investments:
Much of those billions are going into infrastructure for *inference*, not training.
Running AI assistant services for billions of people requires a lot of compute.
Once you put video understanding, reasoning, large-scale memory, and other capabilities in AI systems, inference costs are going to increase.
The only real question is whether users will be willing to pay enough (directly or not) to justify the capex and opex.