Azure Data Engineer

Persistent

5–8 yrs Pune Full Time Hybrid (office + remote)
Persistent logo
Posted : today
Actively hiring

Job description

Persistent is a global digital engineering partner focused on AI-led platform solutions, helping clients anticipate future trends. We empower businesses across various industries with a competitive edge through innovative solutions and deep technical expertise. Our consistent growth and recognition highlight our commitment to client success and agility in a dynamic market. Join our team of over 27,500 professionals worldwide and contribute to transforming industries with cutting-edge technology.

Responsibilities

As an Azure Data Engineer, you will architect, develop, and maintain robust, scalable data solutions on Azure Cloud. This includes building and optimizing batch and real-time data pipelines using Databricks and PySpark, and developing comprehensive data ingestion, transformation, and integration frameworks. You will implement streaming solutions with Kafka, support data processing workflows with Python, and ensure data quality, governance, and compliance throughout the lifecycle.

Key duties involve collaborating with cross-functional teams, conducting code reviews, performing testing and debugging, optimizing pipeline performance, and supporting CI/CD automation. You will also create essential technical documentation and contribute to engineering best practices and innovation.

Qualifications

We are seeking a seasoned Azure Data Engineer with 5-8 years of experience in data engineering and cloud data platforms. Essential technical skills include strong hands-on experience with Azure Cloud services, Azure Databricks, PySpark, and Python for data processing. Proficiency in building and supporting real-time and batch data pipelines, along with practical experience in Kafka and event-streaming architectures, is required.

Candidates should possess a solid understanding of data modeling, data warehousing, and ETL/ELT concepts, as well as experience with API integration and cloud-native architectures. Familiarity with software development best practices, version control, testing, deployment methodologies, and Agile environments is crucial. Strong analytical, problem-solving, and communication skills are necessary to thrive in this role.

Essential Skills

AzureDatabricksPySparkPythonKafkaData ModelingData WarehousingETLELTAPI IntegrationCloud-Native ArchitecturesDevOpsAgile

Highlights

  • Actively hiring

More Details

RoleAzure Data Engineer
DepartmentData Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Persistent Systems logo

Persistent Systems

IT Consulting

Azure Data Engineer at Persistent | SkillMX | SkillMX