Senior Engineer - Data Engineering

Altimetrik

6+ yrs Chennai Full Time Work from office
Altimetrik logo
Posted : 1 week ago
Actively hiring

Job description

Join our team as a Senior Data Engineer and play a pivotal role in shaping our data engineering strategy. This position focuses on the design, implementation, and ongoing maintenance of our data infrastructure, leveraging Google Cloud Platform (GCP).

You will utilize your expertise in GCP services such as Data Engineering Pipelines, BigQuery, and DataFlow to build and refine our data platforms. The goal is to ensure these systems are scalable, highly reliable, and adaptable to our future needs.

Responsibilities

Key responsibilities include leading GCP data setup with a focus on integrity, scalability, and performance.

You will design, develop, and maintain robust data pipelines using GCP services like BigQuery, DataFlow, and Batch processing, incorporating reusable components and best practices.

Experience with automated data lineage is essential for this role.

Additional duties involve implementing and maintaining data governance and security within the GCP environment, integrating data pipelines into CI/CD workflows, and continuously optimizing performance.

Troubleshooting and debugging data-related issues to ensure continuous data flow, along with generating performance and quality reports for analysis, are also crucial aspects of this position.

Qualifications

This role requires a minimum of 6 years in IT, with at least 4 years dedicated to development. Proficiency in at least two coding languages or advanced practical experience in one is necessary.

Candidates should possess practical experience with at least two coding languages or advanced practical experience in one language.

Demonstrated experience in Google Cloud Platform (GCP), BigQuery, and Airflow is highly valued. Experience with any ETL technology is also considered beneficial.

Essential Skills

Google Cloud PlatformBigQueryData FlowDataprocData FusionTERRAFORMTektonCloud SQLAIRFLOWPOSTGRESAirflow PySparkPythonAPIData EngineeringDevOps

Good to Have

Big QueryAIRFLOWGCPAstronomer

Highlights

  • Actively hiring

More Details

RoleSenior Engineer - Data Engineering
DepartmentData Engineering
Employment TypeFull Time, Work from office

About the Company

Altimetrik logo

Altimetrik

IT Consulting

Senior Engineer - Data Engineering at Altimetrik | SkillMX | SkillMX