We are seeking a skilled Data Engineer to design, develop, and maintain robust data solutions for data generation, collection, and processing. This role involves creating efficient data pipelines, ensuring data quality, and implementing ETL processes for seamless data migration and deployment across systems.

As a Data Engineer, your daily activities will focus on building and optimizing data infrastructure, collaborating with teams to meet data requirements, and ensuring the reliability and accessibility of data for organizational needs. Continuous improvement of data handling processes and contributing to team discussions will be key aspects of the role.

Take ownership of data solutions and become a subject matter expert. Actively participate in team discussions and contribute to problem-solving. Collaborate with cross-functional teams to understand data needs and deliver scalable solutions. Monitor and enhance data pipelines for optimal performance and reliability. Document data processes and workflows to facilitate knowledge sharing. Provide guidance and support to junior team members.

A strong command of PySpark is essential for this position. Candidates should possess experience in building and managing data pipelines and workflows. A solid understanding of data processing frameworks and distributed computing is required. The ability to troubleshoot and optimize large-scale data processing jobs is crucial. Familiarity with data storage solutions and integration techniques, along with knowledge of data quality assurance and validation methods, is expected.

Candidates must have a minimum of 3 years of experience with PySpark. This role requires 15 years of full-time education and is based in our Bengaluru office.