Databricks AI & Data Engineer

NTT DATA

8+ yrs Hyderabad Full Time Hybrid (office + remote)
NTT DATA logo
Posted : yesterday
Actively hiring

Job description

Seeking a skilled AI & Data Engineer to architect and implement advanced Agentic AI solutions. This role focuses on automating data governance, quality, and metadata management using cutting-edge technologies like LLMs and RAG. You will collaborate with diverse teams to integrate these solutions across enterprise data platforms, ensuring robust data management and regulatory compliance.

This position offers the opportunity to drive innovation in data governance modernization, contribute to reusable frameworks, and work with leading cloud platforms and governance tools. You'll play a key role in developing autonomous and human-in-the-loop agents, enhancing data cataloging, policy validation, and issue remediation.

Ideal candidates possess a strong background in data management and AI development, with proven experience in designing and deploying scalable AI solutions. Excellent client-facing communication and a passion for pioneering AI in data governance are essential for success in this dynamic role.

Responsibilities

Design, develop, and deploy Agentic AI solutions for data governance automation, including data quality, metadata, and lineage.

Build scalable AI agents leveraging LLMs and RAG for data management and compliance.

Collaborate with stakeholders to define use cases and align solution architecture with enterprise data strategy.

Develop and maintain autonomous and human-in-the-loop agents for data cataloging, glossary management, and policy validation.

Integrate AI agents with enterprise platforms like data catalogs, MDM, and cloud data platforms.

Create proof-of-value demonstrations and pilot implementations.

Refine governance backlogs and prioritize agent development initiatives.

Implement monitoring, observability, and governance controls for AI solutions.

Support proposal development, solution architecture, and client presentations.

Qualifications

Minimum 8+ years in Data Management, Data Engineering, Data Governance, or Enterprise Data Architecture.

Minimum 5+ years designing and implementing data governance, MDM, metadata management, or data quality solutions.

Minimum 3+ years developing AI/ML, Generative AI, or Agentic AI solutions using LLMs.

Minimum 3+ years hands-on experience with Python and AI frameworks like LangChain, AutoGen, or OpenAI.

Minimum 3+ years experience with cloud platforms (Azure, AWS, GCP).

Minimum 2+ years integrating governance platforms such as Collibra or Databricks Unity Catalog.

Minimum 2+ years designing APIs, workflow orchestration, or event-driven architectures.

Experience defining governance policies, lineage workflows, and data quality controls.

Experience working in Agile delivery environments.

Strong client-facing communication skills.

Essential Skills

Data GovernanceData QualityMetadata ManagementLineage AnalysisPolicy EnforcementLLMsRAGOrchestration FrameworksPythonLangChainLangGraphSemantic KernelAutoGenCrewAIOpenAIAzure AI FoundryAmazon BedrockAzureAWSGCPCollibraDatabricks Unity CatalogAPIsWorkflow OrchestrationEvent-Driven ArchitecturesEnterprise System IntegrationsAgile MethodologiesClient Communication

Highlights

  • Actively hiring

More Details

RoleDatabricks AI & Data Engineer
DepartmentData Engineering, AI / Machine Learning
Employment TypeFull Time, Hybrid (office + remote)

About the Company

NTT DATA logo

NTT DATA

IT Consulting

Databricks AI & Data Engineer at NTT DATA | SkillMX | SkillMX