How should accuracy and task success metrics be applied effectively in Model Evaluation?

For production use, define requirements first, choose the simplest appropriate design, validate edge cases, automate repeatable behavior, add security and observability, test failure paths, and document important tradeoffs for accuracy and task success metrics.