Azure Data Engineer
Persistent
Persistent
Join Persistent as an experienced Azure Data Engineer and contribute to cutting-edge data solutions. This role focuses on designing, building, and maintaining scalable data platforms and pipelines within the Azure cloud environment. You will leverage modern data engineering practices and technologies like Snowflake and PySpark to drive critical business initiatives. Collaborate with a team of experts to deliver robust, secure, and high-performance data solutions.
This position offers an opportunity to work with industry leaders and be part of a dynamic, growth-oriented organization. Persistent is recognized for its innovation, leadership, and inclusive work culture, providing a supportive environment for talent development and career advancement. We are committed to diversity and welcome applicants from all backgrounds.
Design and implement scalable data pipelines and integration solutions on Azure Cloud. Build and optimize batch and real-time data processing using PySpark and modern techniques. Develop robust data ingestion, transformation, and loading processes. Create and maintain Snowflake-based data warehouse solutions. Develop reusable data processing frameworks, APIs, and automation. Enhance data workflows for business reporting and analytics. Translate business requirements into technical data solutions. Implement data quality, validation, monitoring, and governance. Perform code reviews, testing, debugging, and performance tuning. Troubleshoot and resolve production issues, ensuring platform stability. Build and support CI/CD pipelines for deployment and automation. Optimize data processing for performance, scalability, and cost efficiency. Collaborate with DevOps, Security, QA, and business teams. Create and maintain technical documentation and data models. Contribute to engineering best practices and continuous improvement.
Possess 5-8 years of experience in Data Engineering and Cloud Data Platform development. Demonstrate strong hands-on expertise in Azure Cloud services and data engineering solutions. Have extensive experience with Snowflake Data Warehouse and related architecture concepts. Showcase strong programming and data processing skills using PySpark and Python. Experience building scalable batch and real-time data processing solutions is essential. Proficiency in data ingestion, transformation, and ETL/ELT frameworks. Experience working with Kafka and event-driven data architectures is required. Solid knowledge of SQL and data modeling techniques. Understanding of distributed computing and big data processing frameworks. Familiarity with CI/CD pipelines, deployment automation, and DevOps practices. Knowledge of data governance, data quality, security, and compliance best practices. Experience working with version control systems like Git. Exhibit strong analytical, troubleshooting, and problem-solving skills. Ability to optimize data pipelines for performance, scalability, and maintainability. Experience working in Agile and Scrum delivery environments. Excellent communication and stakeholder management skills. Ability to collaborate effectively with cross-functional and global teams.
Persistent Systems
IT Consulting