Drive the design, development, and maintenance of robust data solutions for efficient data generation, collection, and processing. Focus on constructing advanced data pipelines, upholding stringent data quality standards, and implementing comprehensive ETL processes for seamless data migration and deployment across systems.

Independently perform duties and develop into a Subject Matter Expert (SME). Actively participate and contribute to team discussions and problem-solving sessions. Collaborate with cross-functional teams to understand diverse data requirements and deliver scalable solutions. Monitor and optimize data workflows to enhance performance and reliability. Document all data processes thoroughly and maintain clear communication channels with stakeholders. Share knowledge and provide guidance to junior team members.

A minimum of 3 years of experience is mandatory. Essential skills include proficiency in PySpark. Demonstrated experience in building and managing data pipelines and ETL workflows. Solid understanding of distributed computing principles and big data frameworks. Capability to troubleshoot and optimize data processing jobs for maximum efficiency. Familiarity with various data storage solutions and data modeling concepts. A foundational knowledge of data quality assurance and validation techniques is required.