Join Optum, a global leader dedicated to improving health outcomes through technology. As a Data Engineering Consultant specializing in Azure Databricks, you will be instrumental in developing innovative solutions that connect people with the care they need. Our inclusive culture fosters collaboration and provides ample opportunities for career growth. Contribute to advancing health optimization on a global scale and make a tangible impact on the communities we serve.

Design and implement scalable data pipelines using Azure Databricks, Apache Spark, and Python. Build cloud-native solutions incorporating Azure Data Lake, Azure Data Factory, and Delta Lake. Partner with Data Science and AI teams to deploy ML models into production. Develop and maintain feature stores, input pipelines, and streaming frameworks. Ensure data quality, governance, and security throughout the data lifecycle. Create reusable frameworks and automation scripts to boost engineering efficiency. Optimize the performance, scalability, and reliability of data workflows. Participate actively in Agile development, code reviews, and CI/CD. Provide essential production support and on-call coverage to maintain system stability.

We are seeking candidates with a Bachelor's or Master's degree and a minimum of 6 years of experience in Data Engineering. A strong command of SQL/PL-SQL is essential, along with at least 6 years of hands-on experience with Azure services like ADF, ADLS, and Databricks. Proficiency in Python/PySpark and building ETL/ELT pipelines with Databricks is required, complemented by experience in Agile environments. Familiarity with Databricks Delta Live Tables (DLT), cloud migration (on-prem to Azure), and testing frameworks is necessary. Exposure to secure coding practices, medallion architecture, and GenAI tools is highly beneficial.