Lead Data Engineer

Persistent

8–12 yrs Pune Full Time Hybrid (office + remote)
Persistent logo
Posted : today
Actively hiring

Job description

Join us as a Lead Data Engineer, a pivotal role in shaping our AI-led, platform-driven digital engineering and enterprise modernization initiatives. You will be instrumental in designing, building, and maintaining sophisticated data platforms and pipelines that empower business intelligence, reporting, and advanced analytics.

This position offers a unique opportunity to collaborate with industry leaders and contribute to cutting-edge solutions. You will leverage your expertise in Python, SQL, and AWS cloud technologies to drive impactful business outcomes in a dynamic and agile environment.

Responsibilities

Architect and develop robust, scalable ETL/ELT workflows and data pipelines for enterprise data platforms. Implement cloud-based data solutions using AWS services like S3, Lambda, Glue, and RDS. Create reusable Python-based solutions for data processing, transformation, and automation. Write and optimize complex SQL queries for data extraction, reporting, and analysis. Design and implement data integration strategies across diverse source and target systems. Collaborate with business stakeholders and analysts to translate requirements into technical designs and JIRA user stories. Ensure adherence to data quality, integrity, governance, and compliance standards. Monitor, troubleshoot, and optimize production workloads and ETL pipelines. Support data migration, platform modernization, and cloud transformation projects. Develop comprehensive technical documentation, design specifications, and operational runbooks. Mentor junior engineers and champion engineering best practices and continuous improvement.

Qualifications

Possess 8 to 12 years of comprehensive experience in Data Engineering, Data Integration, and Analytics solutions. Demonstrate strong programming proficiency in Python for data engineering tasks and automation. Exhibit advanced SQL skills with a solid understanding of relational database concepts and data modeling. Showcase hands-on experience in designing and implementing scalable ETL/ELT pipelines. Bring extensive experience with AWS cloud services, including S3, Lambda, Glue, and RDS. Have a proven track record of building reliable, high-performance data engineering solutions. Understand data modeling, transformation, and integration best practices, along with data warehousing principles. Familiarity with data governance, quality, metadata management, and compliance frameworks is advantageous. Experience with Agile methodologies and tools like JIRA is essential. Possess strong analytical, problem-solving, and troubleshooting capabilities. Exhibit excellent communication, presentation, and stakeholder management skills. Demonstrate leadership in technical workstreams and ownership of delivery. Experience mentoring junior engineers and fostering knowledge sharing is highly valued. Familiarity with cloud-native data architectures and modern data engineering practices is beneficial. Life Sciences, Healthcare, or regulated industry experience is a plus. Exceptional attention to detail and a commitment to delivering high-quality data solutions are paramount.

Essential Skills

PythonSQLAWSETLData EngineeringData IntegrationData WarehousingAgile Methodologies

Good to Have

Cloud TransformationData GovernanceData QualityMetadata ManagementLife SciencesHealthcareRegulated Industries

Highlights

  • Actively hiring

More Details

RoleLead Data Engineer
DepartmentData Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Persistent Systems logo

Persistent Systems

IT Consulting

Lead Data Engineer at Persistent | SkillMX | SkillMX