Data Engineer Advisor
NTT DATA
NTT DATA
Join NTT DATA as a Data Engineer Advisor, contributing to innovative data solutions within the dynamic Databricks Lakehouse platform. This role focuses on building and maintaining scalable data pipelines and products, ensuring efficient data ingestion, transformation, and governance. You will collaborate with cross-functional teams to support advanced analytics, reporting, and AI initiatives.
As a key member of our team, you will leverage the latest Databricks capabilities to design and implement robust data processing frameworks. Your expertise will be crucial in creating reliable and reusable data products that adhere to best engineering practices and platform standards.
Design, build, and maintain scalable data pipelines and data products using the Databricks Lakehouse platform. Develop ingestion frameworks for both batch and streaming data workloads. Implement and optimize data processing using Delta Lake and Lakehouse best practices. Support deployment automation through Terraform and CI/CD pipelines, managing code repositories and release processes. Ensure data quality, support data lineage and governance, and produce comprehensive technical documentation.
A minimum of 3 years of experience in Data Engineering roles is required. Demonstrated strong hands-on experience with Databricks, including a relevant Databricks engineering certification. Proficiency in essential technical skills such as Databricks, PySpark, SQL, Delta Lake, AWS, Terraform, Git, and CI/CD. Experience with modern ETL/ELT development methodologies and working on AWS. Familiarity with Infrastructure-as-Code principles, ideally through Terraform.
NTT DATA
Information Technology & Services