One thing that people don't see about the inference market is I actually think in the long term there is so much gross margin opportunity in the space, because you can build all these things around it: all the sandboxes, all the agentic stuff, workflows, post-training, reinforcement learning.
← 2 November 202620VC with Harry Stebbings
Modal CEO: Has Open-Source LLM Inference Peaked? | What Happens to the Cost of Compute
Modal CEO Erik argues inference is the new cloud, that it will fragment into specialized products best served by a broad platform, and that demand for compute and software will keep growing despite pullbacks.
Watch on YouTube ↗Word for word
Do more with Charlie
Analyze any YouTube videoPaste a link — get its key points and best quotes in minutes. 10 videos a day.Paste a YouTube link →Your own podcast feedAdd up to 10 YouTube channels you follow. Charlie reads their new episodes for you.Add your channels →
Free — sign in with your email, no password.