Artificial Intelligence · LLMs
How would you answer an interview scenario involving Model selection and routing?
For an interview scenario involving Model selection and routing, I would first clarify the business goal, scale, constraints, and the failure or quality attribute the interviewer wants to explore. Model selection chooses an appropriate model for a task, while routing sends requests to different models based on quality, latency, cost, or capability needs. I would then explain the main alternatives and tradeoffs, identify likely failure modes, and describe how I would validate the solution through testing, observability, security controls, and recovery or rollback planning.