Azure Data Engineer
Persistent
Persistent
Persistent is a global digital engineering partner focused on AI-led platform solutions, helping clients anticipate future trends. We empower businesses across various industries with a competitive edge through innovative solutions and deep technical expertise. Our consistent growth and recognition highlight our commitment to client success and agility in a dynamic market. Join our team of over 27,500 professionals worldwide and contribute to transforming industries with cutting-edge technology.
As an Azure Data Engineer, you will architect, develop, and maintain robust, scalable data solutions on Azure Cloud. This includes building and optimizing batch and real-time data pipelines using Databricks and PySpark, and developing comprehensive data ingestion, transformation, and integration frameworks. You will implement streaming solutions with Kafka, support data processing workflows with Python, and ensure data quality, governance, and compliance throughout the lifecycle.
Key duties involve collaborating with cross-functional teams, conducting code reviews, performing testing and debugging, optimizing pipeline performance, and supporting CI/CD automation. You will also create essential technical documentation and contribute to engineering best practices and innovation.
We are seeking a seasoned Azure Data Engineer with 5-8 years of experience in data engineering and cloud data platforms. Essential technical skills include strong hands-on experience with Azure Cloud services, Azure Databricks, PySpark, and Python for data processing. Proficiency in building and supporting real-time and batch data pipelines, along with practical experience in Kafka and event-streaming architectures, is required.
Candidates should possess a solid understanding of data modeling, data warehousing, and ETL/ELT concepts, as well as experience with API integration and cloud-native architectures. Familiarity with software development best practices, version control, testing, deployment methodologies, and Agile environments is crucial. Strong analytical, problem-solving, and communication skills are necessary to thrive in this role.
Persistent Systems
IT Consulting