Join Optum, a global leader in health technology dedicated to improving lives through innovative solutions. We foster a culture of inclusion, collaboration, and growth, offering comprehensive benefits and career development. As a Senior Data Engineer, you will play a pivotal role in advancing health optimization by developing and maintaining cutting-edge data infrastructure. Make a significant impact on communities and help us build a healthier future.

This role is based in Hyderabad, Telangana, India, and operates on a hybrid work model, offering a dynamic and supportive environment for talented professionals seeking to drive meaningful change in healthcare.

Design and build robust, scalable data pipelines utilizing Databricks (Spark/PySpark) and orchestrate complex workflows with Apache Airflow. Optimize ELT processes within Snowflake to ensure peak performance and cost-effectiveness. Develop high-quality Python code for data processing and integration. Create and manage APIs and data services using modern Python frameworks and deploy them efficiently on Azure.

Implement best practices for Azure cloud services, focusing on security, scalability, and cost management. Establish comprehensive data quality checks, logging, and monitoring for production systems. Collaborate closely with cross-functional teams to facilitate data access and consumption. Actively participate in architectural discussions and code reviews while resolving critical production issues.

A Bachelor's degree in a relevant field (B.Tech, MCA) and a minimum of 4 years of professional experience are required. Demonstrated expertise in Databricks (Spark/PySpark) within production settings is essential, alongside hands-on experience building and hosting REST APIs using Python frameworks.

Strong proficiency in Microsoft Azure, cloud-native architectures, and best practices is a must. Solid experience with Snowflake, including data modeling and performance tuning, is critical. A deep understanding of data warehousing, ELT patterns, and modern cloud data architectures, coupled with proven expertise in Apache Airflow for workflow management, is expected. Advanced Python programming skills for data engineering and API development are also key requirements.