Senior Azure Data Engineer

Persistent

6–10 yrs Pune Full Time Hybrid (office + remote)
Persistent logo
Posted : today
Actively hiring

Job description

Join our dynamic team as a Senior Azure Data Engineer, contributing to the development of robust data platforms for critical healthcare solutions. This role offers a unique chance to engage in large-scale data processing, real-time analytics, and cloud-native data engineering initiatives, working with cutting-edge Azure technologies.

We are an AI-led digital engineering partner dedicated to empowering clients with innovative solutions. Our collaborations span across industry leaders, including major financial institutions, technology firms, and healthcare innovators. Recognized for our commitment to client success and agility, we consistently drive growth and deliver exceptional value.

Responsibilities

Collaborate with cross-functional teams, including product owners and architects, to define and implement an agile data roadmap. Design, develop, and maintain high-quality, data-intensive applications leveraging Java, Azure, Databricks, Spark, and various data storage solutions. Enhance continuous delivery and DevOps processes, ensuring efficient software development lifecycles. Build and maintain software using configuration management and automation tools, focusing on deployment strategies and monitoring.

Apply software engineering best practices in Reliability Engineering, Deployment Planning, and Fault Tolerant Architecture. Implement Data as a Service and Container as a Service models effectively. Utilize incident ticket tracking tools and processes to manage and resolve issues. Contribute to quality strategies that ensure data platform correctness, resilience, scalability, and security.

Qualifications

We seek candidates with 6-10 years of extensive experience in Data Engineering and cloud-based platforms, including 6+ years with Azure or AWS. Proven expertise in Databricks and Kafka (5+ years), along with strong proficiency in Apache Spark for distributed data processing, is essential. Experience in designing and maintaining data pipelines using Apache Airflow and working knowledge of Snowflake and modern data warehousing are required.

Demonstrated experience with RESTful APIs and application integration patterns is necessary. You should possess strong skills in both relational and non-relational databases, proficiency in SQL, data modeling, and performance optimization. Familiarity with Agile methodologies, DevOps practices, containerization, and Data-as-a-Service architectures is expected. Experience with monitoring, deployment automation, production support, and incident management platforms like ServiceNow is a plus. A Bachelor's degree in Engineering, Computer Science, or equivalent practical experience is required.

Essential Skills

AzureDatabricksKafkaSparkAirflowSnowflakeSQLData ModelingDevOpsAgile

Good to Have

AWSRESTful APIsServiceNowContainerization

Highlights

  • Actively hiring

More Details

RoleSenior Azure Data Engineer
DepartmentData Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Persistent Systems logo

Persistent Systems

IT Consulting

Senior Azure Data Engineer at Persistent | SkillMX | SkillMX