Giving Everyone AI Tools Isn’t Enough
Bringing AI into established companies means aiming past faster work, extracting tacit human knowledge, measuring value with evals, and driving adoption through good products and concrete demos rather than mandates.
Watch on YouTube ↗Charlie's summary
- ▶ 5:03
Failure of ambition: don't just plug AI into today's process, reinvent it and let AI own whole systems
Jeremy says customers often settle for slightly optimizing how things work now. Old wisdom says never fully rewrite a production system, but Bun rewrote its 1 million line codebase in Rust autonomously in about a week, plus a few weeks of verification. Anthropic also rewrote its first-party API in Rust with engineers who don't know Rust. Push clients past their first idea.
- ▶ 7:04
Most AI transformations fail on change management, because human processes are full of implicit knowledge
Hugh notes that a Bun rewrite is an ideal problem since tests define the behavior exactly. Human workflows are different: experts give a list covering about half of what is in their head. Hugh's team sits with people, watches them work, and asks why they ignored a document. Agents can then review traces for signals nobody knew to look for.
- ▶ 9:05
Run in shadow mode first, then pre-fill work for human approval, and track every correction
Hugh describes a staged path even if the goal is removing people from the loop. First a system runs in shadow mode, then it pre-does work and humans approve it. Every interaction and correction is tracked, and smart models read the transcripts instead of a fixed observability setup.
- ▶ 10:38
You know a use case is mature when you have evals, extracted knowledge, outcome metrics and guardrails
Jeremy says you're never done, but mature use cases have unsaturated evals that show how much each new model adds. They also have human knowledge put into context the model can read. Cost per task is measured against value, such as a government agency cutting a compliance process from months and millions of dollars to about a week. Guardrails are pressure-tested.
Give your email to unlock the rest of the key points — for every episode.
Do more with Charlie
Free — sign in with your email, no password.