As a Data Engineer, you will architect, build, and maintain robust data solutions crucial for data generation, collection, and processing. Your responsibilities include developing efficient data pipelines, ensuring data integrity, and implementing ETL processes for seamless data migration and deployment across diverse systems. This role emphasizes proactive data infrastructure management and collaborative efforts to meet organizational data objectives.

This position offers an opportunity to become a subject matter expert, actively contributing to team discussions and problem-solving. You will collaborate with various departments to understand data needs and deliver scalable, high-performance solutions. Monitoring and optimizing data workflows for enhanced reliability and performance are key aspects of this role, alongside documenting processes and maintaining clear team communication.

- Design, develop, and maintain data generation, collection, and processing solutions. - Create and manage efficient data pipelines and ETL processes. - Ensure data quality and integrity throughout the data lifecycle. - Collaborate with cross-functional teams to gather data requirements and deliver solutions. - Monitor and optimize data workflows for performance and reliability. - Document data processes and maintain team communication. - Provide guidance and support to junior team members.

- Minimum 3 years of experience, specifically with the Databricks Unified Data Analytics Platform. - Proven experience in building and managing scalable data pipelines and ETL processes. - Strong understanding of data integration, transformation, and migration techniques. - Familiarity with cloud-based data platforms and distributed computing frameworks. - Ability to effectively troubleshoot and resolve data quality and pipeline issues. - Knowledge of data governance and security best practices. - Completed 15 years of full-time education is a prerequisite.