Human in the loop - 4 levels of automation
Kieran live-codes a work autonomy board to sort ten kinds of business work into four levels of AI involvement, concluding that most work moves toward automation while human ideas and human-to-human contact stay.
Watch on YouTube ↗Charlie's summary
- ▶ 15:49
Knowing when to be in the loop matters because human attention is getting more expensive as AI gets cheaper.
Kieran says there are so many things you can do that attention is pulled “from left to right.” Human time becomes the costly part, so the question is where to put your focus. He does not think everything should be automated, and he wants a clear map of what to automate, orchestrate or keep human-in-the-loop.
- ▶ 12:10
Four levels of automation: human with no AI, human in the loop, orchestrate, and automate.
Kieran's framework: no AI means purely human work. Human in the loop means iterating back and forth with the AI in real time. Orchestrate means you delegate a task and decide when to trigger it, such as finishing a feature with LFG. Automate means the agent also decides when to orchestrate, so no human has to do anything. He later suggests delegate may be a better word than orchestrate.
- ▶ 30:01
Coding can only be automated if debugging, maintenance and QA are automated first.
Kieran puts coding and building in automate, but only because the verification side is automated too. Crashes, stack traces and alerts go to agents that fix problems as safely and quickly as possible. Without the stack to validate and check things in production, he says, “I would not automate coding and building.” Review and QA must be automated for the same reason.
- ▶ 35:18
Human-to-human coordination stays human because people want people, not AI slop.
Kieran moves specs, tickets and triage toward automation, and his sweep skill already scans Slack, GitHub and email into plans. But he keeps the human side of coordination, such as calls and one-on-ones, as the only category with no AI. His reason: “people want people.” He doubts we would enjoy one-on-ones with AI.
Give your email to unlock the rest of the key points — for every episode.
Do more with Charlie
Free — sign in with your email, no password.