How should observability be applied in a production system?

Propagate trace context, define SLIs and SLOs, centralize important telemetry, sample intelligently, and alert on user impact. The implementation should be justified by measurable requirements, kept as simple as the problem allows, and validated with realistic tests, telemetry, failure handling, and documented tradeoffs.