Focus on documenting answers to the questions students actually ask — not everything you know about your topic. Start with your most-asked support questions, your course FAQs, and your key framework definitions. A lean, well-organised knowledge base outperforms a large, disorganised dump of information every time.
Quality Over Volume in Knowledge Base Building
There’s a common misconception that a conversational agent gets smarter by having access to more raw content. In practice, the opposite is often true. A knowledge base stuffed with every slide deck, rough transcript, and unedited session recording produces confused, inconsistent answers because the agent has too many conflicting or redundant sources to synthesise from.
Think of it like briefing a new hire. Handing them a hard drive full of company files and saying “figure it out” produces a confused employee. Giving them a well-written onboarding guide, a clear FAQ document, and access to a structured knowledge base produces someone who can represent the company accurately from day one. Your conversational agent needs the same kind of curated, intentional input.
The Three-Tier Information Hierarchy
A useful framework for deciding what goes in your agent’s knowledge base: Tier 1 is your core FAQ — the twenty to fifty questions students ask most often, each with a clear, complete answer. This content should be in BetterDocs as published articles. Tier 2 is your course structure documentation — module descriptions, weekly objectives, homework requirements, and access instructions. This gives the agent context about your program’s architecture. Tier 3 is your framework and terminology glossary — the specific language you use, the concepts unique to your teaching, the distinctions that define your approach. Without this, the agent answers in generic language rather than yours.
Everything below those three tiers — raw transcripts, early draft documents, promotional copy, social media posts — generally adds noise rather than signal. Feed the agent your best, most intentional writing. That’s what produces the best answers.
What This Means for Educators
For coaches and consultants, the discipline of curating your knowledge base has a useful side effect: it forces you to articulate things you’ve been teaching implicitly. When you have to write a clear, complete answer to “what makes a good learning objective?” for your agent’s knowledge base, you clarify your own thinking in the process. The knowledge base becomes a written representation of your intellectual framework — which has value well beyond the agent itself.
Start small. Pick your top twenty most-asked questions. Write clear, complete answers. Publish them in BetterDocs. Test your agent against those twenty questions and see where the gaps are. Then fill the gaps. Iterate. A knowledge base built this way — incrementally, from real student questions — consistently outperforms one assembled all at once from existing materials.
The Simple Rule
Give your agent your best twenty answers before you give it anything else. Curated and complete beats comprehensive and messy. Build from actual student questions outward, adding documentation only when the agent demonstrably needs it to answer something students are actually asking.