CharlieKey takeaways from your favorite podcasts
← 18 October 2026Lenny's Podcast

How do AI models actually work? | The scientist looking inside Claude's mind

Emanuel, an Anthropic interpretability researcher, argues that language models are grown rather than built, that looking inside them reveals concepts and planning, and that studying them is essential to alignment.

Watch on YouTube ↗

Word for word

If you get better at that, and language models got better at predicting the next word than humans in around 2019, if you keep getting better at that, you start running out of easy words. So initially you just had to predict simple sentence structure. Later on, the model has to predict simple facts about the world, like if I complete a sentence like « the capital of France is », it has to be like, okay, that's Paris. And once it's good at that and it keeps improving, the only thing that's left is predicting the answer of some complex physics equation.
★ In the digest▶ 8:29
One of the most important things to realize if you use language models or think about them is just this very bizarre fact that to make them is not to understand them. You make them by building this architecture, which is like a scaffold, and then you pass a bunch of data through them and they grow in inscrutable ways.
★ In the digest▶ 1:55
If you think about the model that has to predict… the one example I always like to use is: the capital of the state that contains Dallas is… it'll say Austin. Well, to do that, at least for you and me, you have to have a mental model of the geography at play, right? You have to be like, oh, Dallas is in Texas. States have capitals. The capital of Texas is Austin, and so on. And so as these models get better at the seemingly simple task, the best way to solve it, at least for us, is to just understand the underlying structure of the world. And in fact, some of the stuff that we look at inside models shows that they do understand that, and they do manipulate these concepts like we do.

Give your email to unlock the rest of the quotes — for every episode.

Do more with Charlie

Free — sign in with your email, no password.