Tag
#observability
9 posts tagged observability.
- monitoring
The ML Monitoring Metrics Taxonomy: Drift, Data Quality, and Model Decay
A reference taxonomy of the signals that actually tell you a production ML system is failing — input drift, prediction drift, concept drift, data quality
- monitoring
OpenTelemetry GenAI Semantic Conventions: Instrument LLM Apps
How the OpenTelemetry GenAI semantic conventions standardize spans, metrics, and events for LLM apps, what they skip, and how to instrument without rework.
- monitoring
LLM Testing: A Guide to Evals, Metrics, and Production Monitoring
LLM testing spans offline evals, CI gate checks, and live production monitoring — three distinct jobs that need different tools.
- deep-dive
When Embedding-Based Defenses Fail in Multi-Agent LLMs
A new arXiv paper shows that embedding-distance detectors miss three classes of adversarial agent. The fix lives in your observability stack, not your
- tooling
Model Monitoring Tools: A Technical Comparison for ML Teams
Evidently, Arize, WhyLabs, Fiddler, NannyML, Alibi Detect — how each tool actually detects drift, what it costs to run, and which one fits your stack.
- monitoring
Model Monitoring in Production: What to Track and When to Act
A practical guide to model monitoring for ML engineers: drift types, the metrics that actually matter, handling the no-ground-truth problem, and which
- deep-dive
OpenAI's DeployCo Pushes the Observability Problem Onto You
OpenAI's new $10B deployment subsidiary will build production AI systems inside enterprises. What that means for ML platform teams who inherit the runbook
- monitoring
A Lean 4 Stability Proof for Tool-Mediated LLM Agents
A new arXiv paper certifies controllability and ISS robustness for an LLM-driven SOC agent using Lean 4. The MLOps takeaway is simpler than the math
- infra
Local Coding Assistants Crossed the Quality Bar: Now Observe Them
A practitioner's Reddit report on running Qwen3.6-27B locally signals a real inflection point. But moving off managed cloud APIs shifts monitoring