Data Engineering Lead
UnitedHealth Group
UnitedHealth Group
Join Optum, a global leader dedicated to enhancing health outcomes through innovative technology. Our team focuses on connecting individuals with the care, pharmacy benefits, data, and resources essential for their well-being. We foster an inclusive culture where talented peers, comprehensive benefits, and career development opportunities thrive. Contribute to advancing health optimization globally and experience a culture of Caring, Connecting, and Growing together.
This role is central to designing, developing, and maintaining sophisticated data-intensive applications. You will collaborate with architects and engineers to deliver high-quality, creative solutions, ensuring our data platform is resilient, scalable, and secure. Embrace continuous improvement and automation, driving efficiency and innovation within the data engineering space.
As a Data Engineering Lead, you will collaborate closely with solution architects and fellow software engineers to meticulously evaluate requirements, both functional and non-functional, and subsequently deliver inventive, top-tier solutions. Your core duties will involve the design, development, testing, and ongoing maintenance of data-intensive applications, encompassing ETL processes, relational and non-relational data storage, and data application development.
Leverage cutting-edge AIDLC and design Agentic data engineering solutions by utilizing available Gen AI & LLM models. Uphold and refine processes essential for continuous delivery and DevOps practices within your team. Build and maintain configuration management and automation tools, deployment strategies/processes, and monitoring tools. Contribute actively to quality strategies, ensuring our data platform consistently meets standards for correctness, resilience, scalability, and security. Participate in system analysis, design walkthroughs, and code reviews, and provide valuable input. Engage in defect review and triage processes, and rigorously adhere to design/coding standards, constantly seeking to enhance software development and delivery methodologies.
Conduct technical analysis of existing reporting solutions to identify areas for enhancement, focusing on both best practices and improvements in quality and performance. Champion continuous improvement and automation solutions and processes. Maintain production products, solutions, documentation, and environments to ensure optimal health, which includes resolving production issues and responding swiftly to priority problems. Ensure compliance with all applicable Company policies, procedures, and business directives, including those pertaining to work location, team assignments, work schedules, and flexible work arrangements.
We are seeking a B.Tech graduate in Computer Science or a related field, with a minimum of 5 years of experience in Data Engineering. A strong background of at least 1 year in leveraging Gen AI LLM models to design agentic solutions within data engineering is essential.
Proficiency is required in ETL/Pipeline Development using tools such as Azure Databricks/Apache Spark and Azure Data Factory, with demonstrated development expertise in both batch and real-time data integration. You should possess strong programming skills in Python and experience with data ingestion, preparation, integration, and operationalization techniques to effectively meet data requirements.
Experience with cloud data warehouses like Azure Synapse and Snowflake, along with orchestration tools, Azure DevOps, and GitHub, is crucial. The ability to build end-to-end architecture for Data Lakes, Data Warehouses, and Data Marts is expected. Familiarity with relational data processing technologies like MS SQL, Delta Lake, and Spark SQL is necessary.
This role demands end-to-end development ownership, including coding, testing, debugging, and deployment. You should be experienced in software engineering practices such as Reliability Engineering, Deployment planning, Fault Tolerant architecture, and Test Automation. Extensive knowledge of ETL and Data Warehousing concepts, strategies, and methodologies is required, alongside the capability to provide forward-thinking solutions in data and analytics.
Proven team-oriented individuals with strong collaboration, prioritization, and adaptability skills are sought. Excellent written and verbal communication skills, including presentation abilities, are a must. Familiarity with Azure services like Azure Functions, Azure Data Lake Store, and Azure Cosmos, as well as an understanding of Healthcare business data models, would be beneficial.
UnitedHealth
Technology