Senior Engineer - Data Engineering

Altimetrik

4–30 yrs Chennai Full Time Work from office
Altimetrik logo
Posted : today
Actively hiring

Job description

Join our team as a Senior Data Engineer and play a pivotal role in shaping our data engineering strategy. You'll be instrumental in designing, building, and maintaining a robust data infrastructure on Google Cloud Platform (GCP). This role requires extensive experience with GCP services such as Data Engineering Pipeline, BigQuery, and DataFlow to construct and optimize scalable and reliable data pipelines that adapt to our dynamic business requirements.

Your expertise will be crucial in ensuring our data platforms are not only efficient but also secure and compliant, supporting our continuous growth and innovation. We are looking for a proactive individual eager to contribute to a data-driven environment.

Responsibilities

Your primary responsibilities will involve leading platform migration and modernization efforts within GCP, focusing on data integrity and designing for peak performance and scalability.

You will design, develop, and maintain sophisticated data pipelines using core GCP services like BigQuery, DataFlow, and batch processing. This includes creating reusable components, implementing industry best practices, and ensuring the maintainability and extensibility of your work. Proficiency in automated data lineage is a must.

Furthermore, you will implement and uphold stringent data governance and security protocols within the GCP ecosystem, ensuring adherence to all relevant regulations. Integrating data pipelines into our CI/CD pipeline and continuously optimizing pipeline performance for speed and reliability are also key aspects of this role. You will be responsible for troubleshooting complex issues and generating detailed reports on performance and data quality.

Qualifications

We are seeking a Senior Data Engineer with practical experience in at least two coding languages or advanced proficiency in one, coupled with a minimum of 6 years in IT and 4 years specifically in development.

Essential skills include comprehensive knowledge of Google Cloud Platform services such as BigQuery, DataFlow, Dataproc, Data Fusion, TERRAFORM, Tekton, Cloud SQL, AIRFLOW, POSTGRES, Airflow PySpark, Python, and API integration.

Additionally, practical experience in Air Flow, Data Engineering, Dev Ops, and GCP is required. A Bachelor's Degree is mandatory for this position, and candidates should possess between 7 to 30 years of relevant experience.

Essential Skills

Google Cloud PlatformBigQueryDataFlowDataprocData FusionTERRAFORMTektonCloud SQLAIRFLOWPOSTGRESAirflow PySparkPythonAPIAir FlowData EngineeringDev OpsGCP

Good to Have

Big QueryAIRFLOWGCPBig-QueryAstronomerETL

Highlights

  • Actively hiring

More Details

RoleSenior Engineer - Data Engineering
DepartmentData Engineering
Employment TypeFull Time, Work from office

About the Company

Altimetrik logo

Altimetrik

IT Consulting

Senior Engineer - Data Engineering at Altimetrik | SkillMX | SkillMX