T&T | EAID | Engineering | GCP Data Engineer Manager | Hyderabad
Deloitte
Deloitte
Join Deloitte's Technology & Transformation practice to leverage vast amounts of data and drive insight-driven advantages. We specialize in business intelligence, data management, and next-generation analytics, including cloud and machine learning technologies.
This role focuses on designing, building, and operating scalable, secure, and analytics-ready data pipelines and models, primarily utilizing GCP BigQuery. You will be instrumental in developing batch and streaming pipelines, orchestrating workflows with Airflow, and implementing automation.
Your contributions will involve solving daily operational issues for robotics processes and providing prompt resolutions. Maintaining comprehensive documentation for solutions and testing procedures throughout the UAT and Production phases is also a key aspect of this position.
Design, build, and operate scalable, secure, and analytics-ready data pipelines and models on GCP BigQuery. Develop batch and streaming pipelines, along with Airflow-orchestrated workflows and automation. Address and resolve day-to-day issues arising from robotics processes, ensuring timely solutions. Maintain thorough documentation for implemented solutions, test procedures, and validation scenarios during UAT and Production. Collaborate effectively with analytics, product, and platform teams to ensure seamless integration and data flow.
Demonstrated proficiency in data transformations, testing, and data governance. Experience with CI/CD practices and Infrastructure as Code deployments. Proven ability in performance optimization across data pipelines. Skills in documentation, production support, and incident response. Strong collaboration capabilities with cross-functional teams. Exposure to cloud platforms, particularly GCP and BigQuery. Expertise in advanced SQL, Airflow workflows, and dbt for data transformation, including models, tests, macros, incremental models, and SCD implementation. Proficiency in Python for data modeling (facts, dimensions, SCDs). Familiarity with DevOps and IaC tools such as Git (GitHub/Bitbucket).
Deloitte
Technology