Join NTT DATA as a Data Engineer Advisor in Pune, India. This role focuses on leveraging the Databricks Lakehouse platform to design, build, and maintain robust data pipelines and products. You will be instrumental in ingesting, transforming, and optimizing data, ensuring adherence to engineering best practices and platform standards. Collaborate with architects, analysts, and business stakeholders to deliver high-quality data solutions that drive analytics, reporting, and AI initiatives.

NTT DATA is a global leader in business and technology services, committed to client success and societal impact through innovation. We are at the forefront of AI and digital infrastructure, offering extensive capabilities in enterprise-scale AI, cloud, security, and application services. Our mission is to guide organizations into a sustainable digital future.

Key responsibilities include building and maintaining data pipelines within Databricks, developing ingestion frameworks for batch and streaming data, and creating reliable, scalable data products. You will implement the medallion architecture and optimize Databricks workflows, notebooks, and jobs. Additionally, you will focus on implementing Delta Lake best practices, optimizing performance and cost, and supporting platform monitoring and troubleshooting.

Further responsibilities involve supporting deployment automation using Terraform and CI/CD pipelines, managing code repositories, and contributing to platform automation. You will also implement data quality controls, support data lineage and governance, ensure compliance with security standards, and produce comprehensive technical documentation.

The ideal candidate possesses 3+ years of experience in Data Engineering roles, with strong hands-on experience in Databricks and a Databricks engineering certification. Proficiency in AWS and experience with Terraform or other Infrastructure-as-Code tools are essential. A solid understanding of modern ETL/ELT development practices is required.

Essential technical skills include Databricks, PySpark, SQL, Delta Lake, AWS, Terraform, Git, and CI/CD. Desirable skills encompass Unity Catalog, Kafka, streaming technologies, data quality frameworks, and machine learning pipelines. Experience with cloud environments and DevOps practices is highly valued for this role.