01
AI course production
United Way Worldwide
Expert review was the slowest part of building a course. When I brought AI agents into course production, I wrote the rules they work under: what they draft from, who reviews their work and who can reject a draft. Every change an expert made went into the agent’s instructions and examples, so drafts came to sound like the expert. The experts were skeptical at first, and over time they made fewer edits to each first draft.
- 78%
- less subject-expert review time per course
Averaged across 11 courses built in 2026.
An AI agent that keeps what the expert changes
Every review goes into the agent’s instructions and examples, so each draft starts closer to what the expert wants. The expert keeps the final say. Used on 11 courses in 2026.
A feedback loop. Frameworks and a procedure Kyle set feed an agent that updates the draft from the expert’s meeting notes. AI checks review it first, the way that expert would. The subject expert reviews every draft and can reject it. Each review goes into the agent’s instructions and examples, not the AI itself, so each round starts closer to the expert and the loop gets smaller. Once the expert approves, the learning team checks quality before the course is published. Expert review time per course fell 78%.