Join our dynamic team as a Databricks AI & Data Engineer focused on building cutting-edge Agentic AI solutions. You will be instrumental in automating critical data management processes, including governance, quality, metadata, and lineage.

This role involves leveraging Large Language Models (LLMs) and Retrieval Augmented Generation (RAG) to create scalable AI agents. You'll collaborate closely with various stakeholders to identify governance use cases and align technical solutions with the enterprise data strategy.

Your expertise will be crucial in developing autonomous and human-in-the-loop agents to enhance data cataloging, glossary management, policy validation, and issue remediation. Integration with a wide range of enterprise platforms and governance technologies is a key aspect of this position.

Design, develop, and deploy Agentic AI solutions for data governance automation. Build scalable AI agents using LLMs and RAG to support data management and compliance. Collaborate with engineering teams and business stakeholders to define agent capabilities and align architecture. Develop autonomous and human-in-the-loop agents for data cataloging, glossary management, and workflow orchestration. Integrate AI agents with enterprise platforms like data catalogs, MDM, and cloud data platforms. Create proof-of-value demonstrations and pilot implementations. Refine governance backlogs and prioritize agent development initiatives. Implement monitoring, observability, and governance controls for AI solutions. Support proposal development and client presentations. Contribute to reusable frameworks for enterprise-scale AI implementations.

Requires a minimum of 8+ years in Data Management, Data Engineering, Data Governance, Metadata Management, or Enterprise Data Architecture. A minimum of 5+ years of experience in designing and implementing enterprise data governance, MDM, metadata management, data quality, or compliance solutions. Possess at least 3+ years of experience developing AI/ML, Generative AI, or Agentic AI solutions using LLMs and orchestration frameworks. Minimum 3+ years of hands-on experience with Python and modern AI development frameworks (e.g., LangChain, LangGraph, AutoGen). 3+ years of experience with cloud platforms such as Azure, AWS, or GCP is essential. 2+ years of experience integrating governance platforms like Collibra or Databricks Unity Catalog. Minimum 2+ years of experience designing APIs, workflow orchestration, or event-driven architectures. Demonstrated experience in defining governance policies, lineage workflows, and stewardship processes. Familiarity with Agile delivery environments and strong client-facing communication skills are required.