Data Engineer Advisor

NTT DATA

3+ yrs Bengaluru Full Time Hybrid (office + remote)
NTT DATA logo
Posted : today
Actively hiring

Job description

Join NTT DATA as a Data Engineer Advisor, contributing to innovative data solutions within the dynamic Databricks Lakehouse platform. This role focuses on building and maintaining scalable data pipelines and products, ensuring efficient data ingestion, transformation, and governance. You will collaborate with cross-functional teams to support advanced analytics, reporting, and AI initiatives.

As a key member of our team, you will leverage the latest Databricks capabilities to design and implement robust data processing frameworks. Your expertise will be crucial in creating reliable and reusable data products that adhere to best engineering practices and platform standards.

Responsibilities

Design, build, and maintain scalable data pipelines and data products using the Databricks Lakehouse platform. Develop ingestion frameworks for both batch and streaming data workloads. Implement and optimize data processing using Delta Lake and Lakehouse best practices. Support deployment automation through Terraform and CI/CD pipelines, managing code repositories and release processes. Ensure data quality, support data lineage and governance, and produce comprehensive technical documentation.

Qualifications

A minimum of 3 years of experience in Data Engineering roles is required. Demonstrated strong hands-on experience with Databricks, including a relevant Databricks engineering certification. Proficiency in essential technical skills such as Databricks, PySpark, SQL, Delta Lake, AWS, Terraform, Git, and CI/CD. Experience with modern ETL/ELT development methodologies and working on AWS. Familiarity with Infrastructure-as-Code principles, ideally through Terraform.

Essential Skills

DatabricksPySparkSQLDelta LakeAWSTerraformGitCI/CD

Good to Have

Unity CatalogKafkaStreaming TechnologiesData Quality FrameworksMachine Learning Pipelines

Highlights

  • Actively hiring

More Details

RoleData Engineer Advisor
IndustryInformation Technology & Services
DepartmentData Engineering, Software Development
Employment TypeFull Time, Hybrid (office + remote)

About the Company

NTT DATA logo

NTT DATA

Information Technology & Services

Data Engineer Advisor at NTT DATA | SkillMX | SkillMX