Azure Data Engineer
Persistent
Persistent
Join our dynamic data and analytics team as an experienced Azure Data Engineer. You will play a key role in architecting, building, and maintaining robust, scalable data platforms and pipelines. This position offers the chance to work with cutting-edge technologies like Databricks, Snowflake, and PySpark, ensuring operational excellence across enterprise data solutions.
We are a leading digital engineering and modernization partner, empowering clients with AI-led strategies and platform-driven innovation. Our commitment to client success and a disruptive mindset have fueled consistent growth, supported by a global team of over 27,500 professionals across 18 countries.
Persistent Systems is recognized for its innovation and leadership in IT services, with a strong focus on diversity, inclusion, and employee development. We offer a values-driven, people-centric work environment with competitive benefits and opportunities for career advancement.
Design, develop, and maintain scalable data pipelines using Azure Databricks, PySpark, and Snowflake. Build and optimize ETL/ELT workflows for processing large volumes of structured and unstructured data. Investigate and resolve data quality issues, pipeline failures, and production incidents. Perform root cause analysis for framework and infrastructure failures. Monitor, troubleshoot, and optimize Spark workloads for performance, reliability, and scalability.
Collaborate with stakeholders, architects, analysts, and development teams to gather requirements and deliver data solutions. Support production deployments and provide L2/L3 production support for critical data platforms. Implement data validation, monitoring, and governance practices. Establish and enforce engineering best practices for coding, testing, and operational excellence. Develop reusable data engineering frameworks and automation capabilities.
We are seeking candidates with 6-8 years of experience in Data Engineering and Big Data technologies. Essential skills include strong hands-on experience with Azure Databricks and Snowflake, extensive development of complex ETL/ELT pipelines, and proficiency in PySpark and SQL. Proven expertise in troubleshooting production issues, framework failures, and data inconsistencies is crucial.
Candidates should possess a strong understanding of data modeling, performance tuning, and optimization techniques, along with experience in Azure cloud services and modern data platform architectures. Excellent problem-solving, debugging, and communication skills are vital for collaborating with cross-functional teams. Familiarity with data governance, data quality, and security best practices is also expected.
Persistent Systems
IT Consulting