How to test an AI assistant’s answers Worksheet · Lyntev https://lyntev.com/en/guides/test-ai-assistant-answers Turn the evaluation into a version decision Task and scope of the evaluation: Versions of the model, instructions, sources and tools: Development set and held-out set: Case, question and context: Expected source and mandatory conditions: Statements or actions not permitted: Answer, retrieved data and actions observed: Criteria met / failed / inconclusive: Severity, evidence and person responsible for review: Number of runs and results per case: Time, usage and manual review: Version decision and trials to repeat: