Level 3 · 01
Assistants and copilots
An AI assistant, sometimes called a copilot, is a tool that answers questions or drafts text by combining a language model with a company's own information. A good one quotes the document it relied on, so the person reading can check it. It does not know anything outside the material it has been given, and it can still misread that material.
Inside it
- Document ingestion that keeps access permissions
- Retrieval with cited sources
- Refusal when no source is found
- Feedback capture from users
- A written list of known limits
Measured by The share of test questions answered correctly with the right source cited, and how often the assistant correctly says it does not know.
Deliverable · Level 4→ Retrieval assistant over internal docsRetrieval assistant over internal docs: a working assistant, the test question set and a page of known limits written for its users.