As a Data Engineer, you will be instrumental in designing, developing, and maintaining robust data solutions. Your responsibilities will span the entire data lifecycle, from generation and collection to intricate processing. This role involves crafting efficient data pipelines and ensuring the meticulous migration and deployment of data across diverse systems, with a strong emphasis on maintaining high data quality standards through the implementation of ETL processes.

This position offers the opportunity to become a subject matter expert and contribute significantly to team discussions and problem-solving initiatives. You will collaborate with various departments to gather data requirements and deliver scalable, effective solutions that drive business insights.

Design, develop, and maintain comprehensive data solutions for data generation, collection, and processing. Create efficient data pipelines and ensure the migration and deployment of data across systems. Implement ETL processes to facilitate seamless data flow and integration. Ensure high data quality and perform continuous monitoring and optimization of data workflows. Collaborate with cross-functional teams to understand data needs and deliver scalable solutions. Troubleshoot and resolve data integration challenges effectively. Document data processes and maintain clear communication with stakeholders.

A strong foundation in data engineering principles, including the design and implementation of data pipelines and ETL workflows. Proficiency in AWS Glue is mandatory, with a minimum of 3 years of experience specifically with this technology. Solid understanding of cloud-based data processing and storage solutions. Ability to effectively troubleshoot and resolve data integration issues. Familiarity with data quality assurance and validation techniques. Experience with scripting and automation to enhance data operations is beneficial. A commitment to independent work and becoming a subject matter expert within the team. Active participation and contribution in team discussions and problem-solving.