As LLMs move into production, visibility becomes essential. This webinar takes a practical, hands-on look at LLM observability using Elastic and OpenTelemetry.
We’ll show how targeted instrumentation reveals LLM behavior and performance, and how that data can be analyzed in Elastic alongside the rest of your system—clearly separating what requires manual instrumentation from what comes out of the box.
- Manually instrument LLM calls with OpenTelemetry to capture spans, attributes, and relevant request metadata.
- Prompts and responses can be captured intentionally through code, with options for redaction, sampling, and data control.
- LLM requests surface naturally within distributed traces, showing their relationship to APIs, databases, and downstream services.
- Kibana dashboards and trace views make it easy to explore LLM latency, errors, and usage patterns alongside the rest of your system.
We’ll walk through a realistic LLM-enabled application with intentional OpenTelemetry instrumentation at key points, showing how LLM requests flow through the system and into Elastic for analysis and troubleshooting.
This reflects how teams are adopting LLM observability in production today—incrementally, with clear control over what data is captured.
- Elastic and OpenTelemetry provide strong defaults, but capturing prompts, responses, and domain-specific data requires explicit instrumentation.
- Token usage and request metadata can be analyzed without hard-coding assumptions about cost or pricing models.
- LLM telemetry integrates naturally with logs, metrics, and traces, enabling AI behavior to be analyzed in the context of the entire system.
Speakers
Vishal is a seasoned Elastic Stack expert with over five years of hands-on experience. As a 3x Elastic Certified professional, he has successfully managed large-scale Elastic deployments and led significant retail search projects. His comprehensive expertise spans all use cases of the Elastic Stack—including Observability, Search, and SIEM.
Ploy Wongtaladkwon is a Marketing Coordinator at Hyperflex with a background in social media marketing, content strategy and B2B marketing. Ploy’s career spans marketing strategy, content creation, and event coordination. She holds a MS in Marketing Analysis from DePaul University, Chicago, IL, United States.