Databricks AI & Data Engineer
NTT DATA
NTT DATA
Seeking a skilled AI & Data Engineer to architect and implement advanced Agentic AI solutions. This role focuses on automating data governance, quality, and metadata management using cutting-edge technologies like LLMs and RAG. You will collaborate with diverse teams to integrate these solutions across enterprise data platforms, ensuring robust data management and regulatory compliance.
This position offers the opportunity to drive innovation in data governance modernization, contribute to reusable frameworks, and work with leading cloud platforms and governance tools. You'll play a key role in developing autonomous and human-in-the-loop agents, enhancing data cataloging, policy validation, and issue remediation.
Ideal candidates possess a strong background in data management and AI development, with proven experience in designing and deploying scalable AI solutions. Excellent client-facing communication and a passion for pioneering AI in data governance are essential for success in this dynamic role.
Design, develop, and deploy Agentic AI solutions for data governance automation, including data quality, metadata, and lineage.
Build scalable AI agents leveraging LLMs and RAG for data management and compliance.
Collaborate with stakeholders to define use cases and align solution architecture with enterprise data strategy.
Develop and maintain autonomous and human-in-the-loop agents for data cataloging, glossary management, and policy validation.
Integrate AI agents with enterprise platforms like data catalogs, MDM, and cloud data platforms.
Create proof-of-value demonstrations and pilot implementations.
Refine governance backlogs and prioritize agent development initiatives.
Implement monitoring, observability, and governance controls for AI solutions.
Support proposal development, solution architecture, and client presentations.
Minimum 8+ years in Data Management, Data Engineering, Data Governance, or Enterprise Data Architecture.
Minimum 5+ years designing and implementing data governance, MDM, metadata management, or data quality solutions.
Minimum 3+ years developing AI/ML, Generative AI, or Agentic AI solutions using LLMs.
Minimum 3+ years hands-on experience with Python and AI frameworks like LangChain, AutoGen, or OpenAI.
Minimum 3+ years experience with cloud platforms (Azure, AWS, GCP).
Minimum 2+ years integrating governance platforms such as Collibra or Databricks Unity Catalog.
Minimum 2+ years designing APIs, workflow orchestration, or event-driven architectures.
Experience defining governance policies, lineage workflows, and data quality controls.
Experience working in Agile delivery environments.
Strong client-facing communication skills.
NTT DATA
IT Consulting