T&T | EAID | Engineering | GCP Data Engineer | Senior Consultant | Hyderabad
Deloitte
Deloitte
Join our Technology & Transformation practice, where we help organizations harness the power of data. We provide strategic guidance and implementation services to manage diverse data sources and transform them into actionable insights for data-driven decision-making. Our expertise spans business intelligence, data management, performance management, and advanced technologies like big data, cloud, cognitive computing, and machine learning.
This role focuses on building and managing robust data pipelines and models within the Google Cloud Platform (GCP), specifically using BigQuery. You will be instrumental in developing batch and streaming data solutions, orchestrated by Airflow, and ensuring automation for efficient operations.
Design, construct, and maintain scalable, secure, and analytics-ready data pipelines and models on GCP BigQuery. Develop batch and streaming pipelines, along with Airflow-orchestrated workflows and automation. Address and resolve daily operational issues for robotics processes promptly. Ensure comprehensive documentation for solutions, testing procedures, and scenarios throughout UAT and production phases.
Proven experience in data transformations, testing, and governance. Familiarity with CI/CD and Infrastructure as Code deployments. Ability to optimize pipeline performance. Strong skills in documentation, production support, and incident response. Effective collaboration with analytics, product, and platform teams. Significant exposure to cloud platforms, particularly GCP BigQuery. Experience in designing and implementing data models, including facts, dimensions, and Slowly Changing Dimensions (SCDs). Proficiency with dbt for data transformation, including models, tests, and macros. Experience with Python for data modeling. Familiarity with DevOps practices and CI/CD tools like Git (GitHub/Bitbucket).
Deloitte
IT Consulting