T&T | EAID | Engineering | GCP Data Engineer | Hyderabad/Gurgaon
Deloitte
Deloitte
Join our Technology & Transformation practice, where we help organizations harness the power of their data. We provide strategic guidance and implementation services to manage data from various sources, transforming it into actionable insights for informed decision-making. Our expertise spans business intelligence, data management, performance management, and cutting-edge analytics technologies like big data, cloud, cognitive computing, and machine learning.
Design, construct, and maintain scalable, secure, and analytics-ready data pipelines and models, primarily utilizing GCP BigQuery and DBT. Develop batch and streaming pipelines, and implement automation through Airflow-orchestrated workflows. Address and resolve daily operational issues for robotics processes, ensuring timely solutions. Maintain comprehensive documentation for solutions, testing procedures, and scenarios throughout UAT and Production phases.
Key skills include proficiency in DBT, Airflow, and GCP (specifically BigQuery). Experience with data transformations, testing, and governance is essential. Familiarity with CI/CD and Infrastructure as Code deployments, along with performance optimization across pipelines, is required. Strong capabilities in documentation, production support, and incident response are necessary. Collaboration with analytics, product, and platform teams is crucial. Advanced SQL and Python for data modeling (facts, dimensions, SCDs) are also vital. Experience with CI/CD tools and Git (GitHub/Bitbucket) is expected.
Deloitte
IT Consulting