Tag
#llm-observability
2 posts tagged llm-observability.
- monitoring
OpenAI Tops Gartner's Coding-Agent Quadrant. Now You Own a Production ML System.
Gartner named OpenAI a Leader in its first Magic Quadrant for Enterprise AI Coding Agents. The operational story is the part the press release skips: a
- monitoring
Model Monitoring for LLM Inference: Metrics Your APM Can't See
Model monitoring for LLM APIs requires a different metric set than traditional ML. Here's the signal hierarchy — TTFT, KV cache hit rate, output length