Data Engineer Advisor
NTT DATA
NTT DATA
NTT DATA is seeking a skilled Databricks Data Engineer Advisor to join our dynamic team in Bangalore. This role involves designing, building, and maintaining robust data pipelines and products within the Databricks Lakehouse platform. You will be instrumental in optimizing data ingestion, transformation, and governance, ensuring adherence to engineering best practices.
Collaborate closely with architects, analysts, and business stakeholders to deliver high-quality data solutions that support critical analytics, reporting, and AI initiatives. This is an excellent opportunity to contribute to a leading global technology services company known for its innovation and commitment to accelerating client success.
As a Data Engineer Advisor, your core responsibilities will include:
- Building and maintaining scalable data pipelines using Databricks. - Developing efficient ingestion frameworks for both batch and streaming data. - Creating reliable, reusable data products and implementing medallion architecture patterns. - Designing and optimizing Databricks notebooks, workflows, and jobs for performance and cost. - Supporting deployment automation with Terraform and CI/CD pipelines. - Implementing data quality controls and supporting data lineage and governance efforts. - Producing comprehensive technical documentation.
To be successful in this role, you should possess:
- A minimum of 3 years of experience in Data Engineering. - A Databricks engineering certification is highly desirable. - Strong, hands-on experience with Databricks and the AWS platform. - Proven experience with Terraform or other Infrastructure-as-Code tools. - Expertise in modern ETL/ELT development methodologies. - Essential technical skills include Databricks, PySpark, SQL, Delta Lake, AWS, Terraform, Git, and CI/CD.
NTT DATA
IT Consulting