AI Terminology
/Advanced
Observability
Definition
While Monitoring tells you THAT something broke, Observability is the deep architectural instrumentation that allows you to understand WHY it broke by analyzing logs, traces, and internal model states.
Explain Like I'm New
Monitoring is the 'Check Engine' light on your dashboard. Observability is plugging a mechanic's computer into the car to see the exact spark plug that misfired.
Real World Example
A user complains the AI gave a terrible answer. Using LangSmith (an observability tool), the engineer opens the specific trace for that chat session. They can see exactly what the User Prompt was, exactly what chunks the RAG Vector Database retrieved, and exactly how the System Prompt was formatted. They see the Vector Database grabbed the wrong file.
Common Use Cases
- •Debugging RAG
- •Prompt optimization
Interview Questions
basic
- Does Observability focus more on the final Output of the AI, or the internal intermediate steps?
intermediate
- Why is tracing highly critical in an Agentic workflow?