Join our team as a Data Engineer, focusing on the design, development, and maintenance of sophisticated data solutions. This role is central to optimizing data generation, collection, and processing workflows. You will be instrumental in building resilient data pipelines, upholding stringent data quality standards, and implementing robust ETL processes for seamless data migration and deployment across diverse systems. This position emphasizes collaborative efforts to refine data management practices and fulfill organizational data objectives.

As a Data Engineer, your day-to-day activities will involve architecting and implementing scalable data solutions. Key responsibilities include creating efficient data pipelines for smooth data flow, ensuring data integrity and accuracy, and managing the entire ETL lifecycle. You will work closely with various teams to understand their data needs and deliver effective, high-performance solutions.

- Take ownership of tasks and develop expertise to become a subject matter expert. - Actively participate and contribute to team discussions and problem-solving. - Develop and implement innovative solutions to address project-related challenges. - Collaborate with cross-functional teams to grasp data requirements and deliver scalable solutions. - Monitor and troubleshoot data pipelines to ensure optimal reliability and performance. - Document data processes and workflows to foster knowledge sharing and maintain clarity. - Support and guide junior team members, providing mentorship and assistance.

- Minimum of 3 years of professional experience with PySpark is essential. - Proven experience in constructing and optimizing data pipelines and workflows using PySpark. - Solid understanding of data processing frameworks and distributed computing principles. - Familiarity with various data storage solutions and data modeling strategies. - Capability to manage and process large datasets while ensuring data quality and integrity. - Demonstrated ability to troubleshoot and debug complex data processing issues. - A minimum of 15 years of full-time education is a prerequisite for this role.