Join Optum, a global leader in health services, as a Data Engineering Consultant. We are dedicated to improving health outcomes through technology, connecting individuals with essential care, pharmacy benefits, data, and resources.

Our inclusive culture fosters collaboration with talented peers and offers comprehensive benefits and career growth. Contribute to advancing health optimization on a global scale and be part of a team that Cares, Connects, and Grows together.

This role focuses on leveraging your expertise in Python, PySpark, or Scala on cloud platforms like Azure to build and maintain scalable Big Data solutions.

Design, develop, and implement robust Big Data solutions using PySpark and Scala Spark on Azure cloud.

Create and maintain analytics rule engines and predictive algorithms, ensuring quality through unit testing frameworks like PyTest.

Research, evaluate, and deploy new automation tools and frameworks for sustainable batch and streaming data platforms, integrating technologies like Kafka.

Identify and address gaps in existing solutions, ensuring code quality through tools like Sonar and writing comprehensive technical documentation.

Schedule deployed pipelines using Airflow, managing job dependencies, and participating in production support.

Optimize performance and manage application migrations, contributing to the development of AI-powered solutions using various platforms.

A Bachelor's or Master's degree in Computer Science, Information Technology, or a related field, coupled with over 7 years of professional experience, is required.

Proficiency in programming languages such as Python, PySpark, and Scala is essential.

Experience with job schedulers like Airflow and working within cloud environments, particularly Azure, is expected.

Demonstrated expertise in Azure services including Azure Kubernetes, Azure Data Lake, Azure Databricks, and CI/CD pipelines using Jenkins or GitHub Actions is crucial.

Strong SQL and PL/SQL query writing skills, along with experience in Shell scripting and Snowflake, are necessary.

Familiarity with BigData frameworks like Spark and foundational knowledge of Hadoop concepts are important for this role.