Associate Data Engineering - Databricks

UnitedHealth Group

Fresher Bengaluru Full Time Hybrid (office + remote)
UnitedHealth Group logo
Posted : today
Actively hiring

Job description

Join Optum, a global leader dedicated to improving health outcomes through innovative technology. Our mission is to empower individuals to lead healthier lives by connecting them with essential care, pharmacy benefits, data, and resources. At Optum, you'll discover an inclusive culture, collaborate with exceptional peers, and benefit from comprehensive development opportunities.

Advance health optimization on a global scale and make a tangible impact on the communities we serve. Embrace our values of Caring, Connecting, and Growing together as you contribute to our vital work.

Responsibilities

Key responsibilities include designing and developing scalable data pipelines using Databricks (Spark/PySpark), orchestrating workflows with Apache Airflow, and building/optimizing ELT pipelines in Snowflake. You will develop production-quality Python code for data transformations and AI/ML workloads, and design, build, and host APIs, AI services, and data products using modern Python frameworks.

Further duties involve deploying and managing APIs and ML models with Azure-native services, designing and implementing AI/ML and Generative AI solutions (including prompt engineering and RAG), and building vector databases and semantic search capabilities. You will also develop and operationalize ML pipelines, leverage LLMs for automation, and apply Azure cloud best practices for security, scalability, and governance. Implementing data quality checks, lineage tracking, and collaborating with cross-functional teams to build AI-powered products are also core aspects of this role.

Qualifications

Required qualifications include a graduate degree or equivalent experience, with solid hands-on expertise in Databricks (Spark/PySpark) within production environments. Proven experience in building and hosting REST APIs, AI services, and microservices using Python frameworks is essential.

Candidates must possess experience with Azure AI Services, Azure OpenAI, or equivalent AI platforms, and familiarity with Large Language Models (LLMs), Generative AI, RAG architectures, vector databases, and prompt engineering. Experience with AI governance, model evaluation, privacy, security, and responsible AI practices is crucial. Proficiency in CI/CD, Git, Infrastructure as Code, and deployment automation, along with solid working experience in Snowflake and Microsoft Azure, are also required. Knowledge of Agentic AI frameworks is a plus.

Essential Skills

DatabricksSparkPySparkApache AirflowSnowflakePythonREST APIsAI ServicesAzure FunctionsApp ServicesAPI ManagementAzure AI ServicesLLMsGenerative AIRAGVector DatabasesPrompt EngineeringMLOpsCI/CDGitInfrastructure as CodeMicrosoft AzureCloud-native architecture

Good to Have

Semantic KernelLangChainAutoGenCrewAI

Highlights

  • Actively hiring

More Details

RoleAssociate Data Engineering - Databricks
IndustryHealthcare
DepartmentData Engineering, AI / Machine Learning
Employment TypeFull Time, Hybrid (office + remote)

About the Company

UnitedHealth logo

UnitedHealth

Healthcare

Associate Data Engineering - Databricks at UnitedHealth Group | SkillMX | SkillMX