CharlieKey takeaways from your favorite podcasts
← 2 November 202620VC with Harry Stebbings

Modal CEO: Has Open-Source LLM Inference Peaked? | What Happens to the Cost of Compute

Modal CEO Erik argues inference is the new cloud, that it will fragment into specialized products best served by a broad platform, and that demand for compute and software will keep growing despite pullbacks.

Watch on YouTube ↗

Word for word

One thing that people don't see about the inference market is I actually think in the long term there is so much gross margin opportunity in the space, because you can build all these things around it: all the sandboxes, all the agentic stuff, workflows, post-training, reinforcement learning.

Do more with Charlie

Free — sign in with your email, no password.