Section 185 · Companion Reference, Testing AI
Appendix: Templates for AI Quality Work
Templates make AI quality repeatable without pretending every system has the same risks.
rubrictemplates quality work
What to do
- Define runnable checks that exercise rubric and templates quality work.
- Set acceptable outcomes and blocker failures for rubric and templates quality work before running the evaluation.
- Run representative cases for rubric and templates quality work and preserve the failures that would change the decision.
Evidence to preserve
- Preserve the inputs, versions, configurations, raw outcomes, and results for rubric, templates quality work needed to reproduce work on Appendix: Templates for AI Quality Work.
- Report results for rubric, templates quality work by relevant slice, separate blocker failures from averages, state uncertainty and blind spots, and connect the result to a release decision.
Expert note
When the system matters, templates should be machine-readable where possible. Structured release records make it easier to audit, compare, automate, and mine past decisions.
Continue the conversation
Apply this to your context.
Save your product context once, then open a focused conversation that combines it with this concept.
Cite this page
Jason Arbon. "Appendix: Templates for AI Quality Work." Testing AI Knowledge Edition, section 185.
https://jarbon.ai/testing-ai/knowledge/ch185-templates-quality-work.html