Azure Data Engineer
Persistent
Persistent
Join Persistent as an experienced Azure Data Engineer and contribute to our dynamic data engineering team. You will leverage your expertise in Azure Cloud, Databricks, PySpark, Python, and Kafka to build robust, scalable data platforms.
This role offers a chance to design and implement enterprise-grade data solutions that drive business intelligence, analytics, and digital transformation initiatives. We are a leading Digital Engineering partner focused on AI and platform-driven modernization, working with industry giants worldwide.
Key responsibilities include designing, developing, and maintaining scalable data engineering solutions on Azure Cloud. You will build and optimize batch and real-time data pipelines using Databricks and PySpark, and develop robust data ingestion and transformation frameworks.
Your role will involve translating business requirements into secure, maintainable data solutions, implementing streaming data solutions with Kafka, and performing code reviews and testing. You'll also optimize data pipelines for performance and collaborate with various teams to ensure data quality and governance.
We are seeking candidates with 8-12 years of experience in Data Engineering or Cloud Data Platform development. Essential expertise includes strong hands-on experience with Azure Cloud services, Azure Databricks, PySpark, and Python programming for data processing.
Candidates should also have experience with real-time/batch data pipelines, Kafka, event-streaming architectures, data modeling, and ETL/ELT concepts. A good understanding of software development best practices, Agile environments, and strong analytical and problem-solving skills are crucial for this position.
Persistent Systems
IT Consulting