T&T | EAID | Engineering | GCP Data Engineer | Senior Consultant | Hyderabad

Deloitte

5–9 yrs Hyderabad Full Time Work from office
Deloitte logo
Posted : yesterday
Actively hiring

Job description

Join our Technology & Transformation practice, where we help organizations harness the power of data. We provide strategic guidance and implementation services to manage diverse data sources and transform them into actionable insights for data-driven decision-making. Our expertise spans business intelligence, data management, performance management, and advanced technologies like big data, cloud, cognitive computing, and machine learning.

This role focuses on building and managing robust data pipelines and models within the Google Cloud Platform (GCP), specifically using BigQuery. You will be instrumental in developing batch and streaming data solutions, orchestrated by Airflow, and ensuring automation for efficient operations.

Responsibilities

Design, construct, and maintain scalable, secure, and analytics-ready data pipelines and models on GCP BigQuery. Develop batch and streaming pipelines, along with Airflow-orchestrated workflows and automation. Address and resolve daily operational issues for robotics processes promptly. Ensure comprehensive documentation for solutions, testing procedures, and scenarios throughout UAT and production phases.

Qualifications

Proven experience in data transformations, testing, and governance. Familiarity with CI/CD and Infrastructure as Code deployments. Ability to optimize pipeline performance. Strong skills in documentation, production support, and incident response. Effective collaboration with analytics, product, and platform teams. Significant exposure to cloud platforms, particularly GCP BigQuery. Experience in designing and implementing data models, including facts, dimensions, and Slowly Changing Dimensions (SCDs). Proficiency with dbt for data transformation, including models, tests, and macros. Experience with Python for data modeling. Familiarity with DevOps practices and CI/CD tools like Git (GitHub/Bitbucket).

Essential Skills

Data transformationstestinggovernanceCI/CDInfrastructure as CodePerformance optimizationDocumentationproduction supportincident responseCollaborationGCPBigQueryAdvanced SQLAirflowdbtData modelingPythonGitGitHubBitbucket

Highlights

  • Actively hiring

More Details

RoleT&T | EAID | Engineering | GCP Data Engineer | Senior Consultant | Hyderabad
Employment TypeFull Time, Work from office

About the Company

Deloitte logo

Deloitte

IT Consulting

T&T | EAID | Engineering | GCP Data Engineer | Senior Consultant | Hyderabad at Deloitte | SkillMX | SkillMX