Aug 23, 2026·5 min readLLM observability: what to log, alert onCardinality, sampling, replay from logs, and PII handling for an LLM system. What to log unconditionally, what to sample, and what to leave alone.