What is latency and cost evaluation in Model Evaluation?

latency and cost evaluation is an important concept in Model Evaluation. Understand its purpose, how it works, when to use it, and the tradeoffs it introduces before applying it in a production system.