Azure Data Engineer

Persistent

5–8 yrs Pune Full Time Hybrid (office + remote)
Persistent logo
Posted : today
Actively hiring

Job description

Persistent is an AI-led digital engineering partner focused on helping clients navigate future challenges. With a strong track record and global presence, we empower industry leaders through innovative solutions. We are currently seeking a skilled Azure Data Engineer to enhance our data engineering capabilities. This role demands expertise in Azure, Databricks, PySpark, Python, and Kafka to build robust and scalable data platforms.

The ideal candidate will leverage technical acumen and collaborative spirit to develop cutting-edge data solutions for business intelligence and digital transformation. Join us to work with pioneering technologies and contribute to a dynamic, growth-oriented environment.

Responsibilities

Design, develop, and maintain scalable data engineering solutions on Azure Cloud, utilizing Databricks and PySpark for efficient data processing.

Build and optimize real-time and batch data pipelines, developing robust frameworks for data ingestion, transformation, and integration.

Implement streaming data solutions with Kafka and modern event-driven architectures, ensuring data quality and governance throughout the lifecycle.

Collaborate with cross-functional teams, including architects, product owners, and DevOps, to translate requirements into secure and maintainable data solutions.

Support CI/CD automation, perform code reviews, testing, and production support to ensure high performance and reliability.

Qualifications

Possess 5-8 years of experience in Data Engineering, Big Data, or Cloud Data Platform development, with strong hands-on expertise in Azure Cloud services.

Demonstrate extensive experience with Azure Databricks, PySpark, and Python for data processing and automation.

Showcase hands-on experience in building and supporting real-time and batch data pipelines, including proficiency with Kafka and event-streaming architectures.

Exhibit a solid understanding of data modeling, data warehousing, ETL/ELT concepts, API integration, and cloud-native architectures.

Bring strong knowledge of software development best practices, version control, testing, and deployment methodologies, coupled with excellent analytical and problem-solving skills.

Essential Skills

Azure CloudDatabricksPySparkPythonKafkaData ModelingData WarehousingETL/ELTAPI IntegrationCloud-Native ArchitecturesCI/CDAgile Methodologies

Highlights

  • Actively hiring

More Details

RoleAzure Data Engineer
DepartmentData Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Persistent Systems logo

Persistent Systems

IT Consulting

Azure Data Engineer at Persistent | SkillMX | SkillMX