Data Engineer Advisor

NTT DATA

3+ yrs Bengaluru Full Time Hybrid (office + remote)
NTT DATA logo
Posted : today
Actively hiring

Job description

NTT DATA is seeking a skilled Databricks Data Engineer Advisor to join our dynamic team in Bangalore. This role involves designing, building, and maintaining robust data pipelines and products within the Databricks Lakehouse platform. You will be instrumental in optimizing data ingestion, transformation, and governance, ensuring adherence to engineering best practices.

Collaborate closely with architects, analysts, and business stakeholders to deliver high-quality data solutions that support critical analytics, reporting, and AI initiatives. This is an excellent opportunity to contribute to a leading global technology services company known for its innovation and commitment to accelerating client success.

Responsibilities

As a Data Engineer Advisor, your core responsibilities will include:

- Building and maintaining scalable data pipelines using Databricks. - Developing efficient ingestion frameworks for both batch and streaming data. - Creating reliable, reusable data products and implementing medallion architecture patterns. - Designing and optimizing Databricks notebooks, workflows, and jobs for performance and cost. - Supporting deployment automation with Terraform and CI/CD pipelines. - Implementing data quality controls and supporting data lineage and governance efforts. - Producing comprehensive technical documentation.

Qualifications

To be successful in this role, you should possess:

- A minimum of 3 years of experience in Data Engineering. - A Databricks engineering certification is highly desirable. - Strong, hands-on experience with Databricks and the AWS platform. - Proven experience with Terraform or other Infrastructure-as-Code tools. - Expertise in modern ETL/ELT development methodologies. - Essential technical skills include Databricks, PySpark, SQL, Delta Lake, AWS, Terraform, Git, and CI/CD.

Essential Skills

DatabricksPySparkSQLDelta LakeAWSTerraformGitCI/CD

Good to Have

Unity CatalogKafkaStreaming TechnologiesData Quality FrameworksMachine Learning Pipelines

Highlights

  • Actively hiring

More Details

RoleData Engineer Advisor
Employment TypeFull Time, Hybrid (office + remote)

About the Company

NTT DATA logo

NTT DATA

IT Consulting

Data Engineer Advisor at NTT DATA | SkillMX | SkillMX