Linga Reddy Alva

Engineering Enterprise-Grade AI Agents on Databricks: From Vector Search to Autonomous Intelligence

Abstract:

The emergence of large language models (LLMs) has driven growing interest in AI agents capable of autonomous reasoning, planning, and action. However, operationalizing AI agents in enterprise environments remains challenging due to fragmented data architectures, limited governance, and deployment complexity. This talk presents a practical, end-to-end approach to building and deploying enterprise-grade AI agents using the Databricks Data Intelligence Platform.

The session demonstrates how Databricks Vector Search enables semantic retrieval over enterprise data stored in Delta Lake, grounding LLM-driven agents with trusted and up-to-date context through retrieval-augmented generation (RAG). It further explores the use of Agent Bricks to orchestrate multi-step reasoning, tool execution, and decision-making, enabling modular, composable, and scalable AI agent architectures.

Attendees will learn how to design, deploy, and govern AI agents by integrating LLMs, vector databases, and Databricks-native services such as MLflow, Unity Catalog, and Databricks Workflows. Real-world examples—including autonomous analytics and intelligent decision support—illustrate how AI agents can be safely and reliably operated at scale. The session concludes with best practices for ensuring observability, security, and responsible AI adoption in production environments.

Profile:

Linga Reddy Alva is a Sr Data Engineer and IEEE Senior Member specializing in cloud-native enterprise data engineering, real-time analytics, and advanced AI/ML integration. With over a decade of experience in designing and delivering large-scale data platforms across industries, he has deep expertise in Spark, Databricks, Kafka, and modern data lakehouse architectures. His work focuses on bridging data engineering with AI innovation, particularly in Generative AI, Agentic AI, and AI-driven automation for enterprise transformation. He has contributed extensively to the Databricks community, published technical articles, and served as a speaker and mentor in professional forums. Linga Reddy Alvahas a proven track record in architecting scalable and responsible AI systems that enhance decision-making, optimize operations, and unlock business value. He is passionate about advancing trustworthy AI practices and mentoring the next generation of data and AI professionals.