Technology and Transformation - Engineering - Consultant - GCP Data Engineer - Pune
Deloitte
Deloitte
Join Deloitte's Technology & Transformation practice as a GCP Data Engineer Consultant. You will play a key role in unlocking the value within vast datasets, guiding companies to manage data from diverse sources and convert it into actionable insights. Our practice focuses on business intelligence, data management, performance management, and cutting-edge analytics technologies including big data, cloud, cognitive, and machine learning.
This role involves designing, developing, and maintaining cloud-native data engineering solutions specifically on the Google Cloud Platform (GCP).
Develop and maintain robust cloud-native data engineering solutions on Google Cloud Platform. Build and optimize efficient ETL/ELT pipelines using tools like BigQuery, Dataproc, and PySpark. Create data processing and automation scripts leveraging Python programming. Manage workflow orchestration through Cloud Composer for seamless data operations. Write high-performance SQL and PL/SQL queries for data manipulation. Collaborate effectively with both business and technical teams to understand requirements and deliver solutions. Troubleshoot data pipeline issues diligently to ensure data integrity and quality. Contribute to performance optimization initiatives and drive continuous improvement in data processes.
A minimum of 3-5 years of hands-on experience in data engineering is required. Proficiency in Google Cloud Platform (GCP) is essential, with a strong understanding of its services. Expertise in BigQuery for data warehousing and analytics is critical. Experience with Cloud Composer for managing complex workflows is necessary. Hands-on experience with Dataproc for big data processing is expected. Strong programming skills in Python are a must. Demonstrated proficiency in SQL and PL/SQL for database interactions. Experience in developing data pipelines using Spark or PySpark is required. A solid understanding of data warehousing and ETL/ELT concepts is fundamental. Excellent analytical and problem-solving abilities are needed to tackle complex challenges.
Deloitte
Technology