Senior Engineer - Data Engineering

Altimetrik

4–30 yrs Chennai Full Time Work from office
Altimetrik logo
Posted : today
Actively hiring

Job description

Join our team as a Senior Data Engineer and play a pivotal role in shaping our data engineering strategy. You will focus on designing, implementing, and maintaining our data infrastructure on Google Cloud Platform (GCP). Leverage your expertise in GCP services like Data Engineering Pipeline, BigQuery, and DataFlow to build and enhance scalable, reliable data pipelines and platforms that adapt to our evolving needs.

Responsibilities

Key responsibilities include leading platform migration and modernization to GCP, ensuring data integrity and designing for performance. You will develop and maintain robust data pipelines using GCP services, incorporating reusable components and best practices. Experience with automated data lineage is crucial.

Further responsibilities encompass implementing data governance and security best practices within GCP, integrating data pipelines into CI/CD pipelines, and continuously optimizing performance for fast, reliable data processing. You will also troubleshoot and debug issues, and generate reports on pipeline performance and data quality to identify areas for improvement.

Qualifications

We are seeking a candidate with at least 4 years of dedicated development experience and 6+ years in IT. Proficiency in at least two coding languages or advanced practice in one is required. A Bachelor's Degree is essential.

Your technical acumen should include extensive experience with Google Cloud Platform services such as BigQuery, DataFlow, Dataproc, Data Fusion, and Cloud SQL. Familiarity with Terraform, Tekton, Airflow, Postgres, Airflow PySpark, Python, and APIs is also necessary. Experience in Data Engineering and DevOps practices is key to success in this role.

Essential Skills

Google Cloud PlatformBigQueryDataFlowDataprocData FusionTERRAFORMTektonCloud SQLAIRFLOWPOSTGRESAirflow PySparkPythonAPIData EngineeringDevOps

Good to Have

BigQueryAIRFLOWGCPAstronomerETL

Highlights

  • Actively hiring

More Details

RoleSenior Engineer - Data Engineering
DepartmentData Engineering
Employment TypeFull Time, Work from office

About the Company

Altimetrik logo

Altimetrik

IT Consulting

Senior Engineer - Data Engineering at Altimetrik | SkillMX | SkillMX