Azure Data Engineer

Persistent

6–8 yrs Pune Full Time Hybrid (office + remote)
Persistent logo
Posted : today
Actively hiring

Job description

Join our dynamic data and analytics team as an experienced Azure Data Engineer. You will play a key role in architecting, building, and maintaining robust, scalable data platforms and pipelines. This position offers the chance to work with cutting-edge technologies like Databricks, Snowflake, and PySpark, ensuring operational excellence across enterprise data solutions.

We are a leading digital engineering and modernization partner, empowering clients with AI-led strategies and platform-driven innovation. Our commitment to client success and a disruptive mindset have fueled consistent growth, supported by a global team of over 27,500 professionals across 18 countries.

Persistent Systems is recognized for its innovation and leadership in IT services, with a strong focus on diversity, inclusion, and employee development. We offer a values-driven, people-centric work environment with competitive benefits and opportunities for career advancement.

Responsibilities

Design, develop, and maintain scalable data pipelines using Azure Databricks, PySpark, and Snowflake. Build and optimize ETL/ELT workflows for processing large volumes of structured and unstructured data. Investigate and resolve data quality issues, pipeline failures, and production incidents. Perform root cause analysis for framework and infrastructure failures. Monitor, troubleshoot, and optimize Spark workloads for performance, reliability, and scalability.

Collaborate with stakeholders, architects, analysts, and development teams to gather requirements and deliver data solutions. Support production deployments and provide L2/L3 production support for critical data platforms. Implement data validation, monitoring, and governance practices. Establish and enforce engineering best practices for coding, testing, and operational excellence. Develop reusable data engineering frameworks and automation capabilities.

Qualifications

We are seeking candidates with 6-8 years of experience in Data Engineering and Big Data technologies. Essential skills include strong hands-on experience with Azure Databricks and Snowflake, extensive development of complex ETL/ELT pipelines, and proficiency in PySpark and SQL. Proven expertise in troubleshooting production issues, framework failures, and data inconsistencies is crucial.

Candidates should possess a strong understanding of data modeling, performance tuning, and optimization techniques, along with experience in Azure cloud services and modern data platform architectures. Excellent problem-solving, debugging, and communication skills are vital for collaborating with cross-functional teams. Familiarity with data governance, data quality, and security best practices is also expected.

Essential Skills

Azure DatabricksSnowflakePySparkSQLData EngineeringBig DataETL/ELTData ModelingPerformance TuningAzure Cloud Services

Good to Have

Python

Highlights

  • Actively hiring

More Details

RoleAzure Data Engineer
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Persistent Systems logo

Persistent Systems

IT Consulting

Azure Data Engineer at Persistent | SkillMX | SkillMX