Senior Azure Data Engineer
Persistent
Persistent
Join our dynamic team as a Senior Azure Data Engineer, contributing to the development of robust data platforms for critical healthcare solutions. This role offers a unique chance to engage in large-scale data processing, real-time analytics, and cloud-native data engineering initiatives, working with cutting-edge Azure technologies.
We are an AI-led digital engineering partner dedicated to empowering clients with innovative solutions. Our collaborations span across industry leaders, including major financial institutions, technology firms, and healthcare innovators. Recognized for our commitment to client success and agility, we consistently drive growth and deliver exceptional value.
Collaborate with cross-functional teams, including product owners and architects, to define and implement an agile data roadmap. Design, develop, and maintain high-quality, data-intensive applications leveraging Java, Azure, Databricks, Spark, and various data storage solutions. Enhance continuous delivery and DevOps processes, ensuring efficient software development lifecycles. Build and maintain software using configuration management and automation tools, focusing on deployment strategies and monitoring.
Apply software engineering best practices in Reliability Engineering, Deployment Planning, and Fault Tolerant Architecture. Implement Data as a Service and Container as a Service models effectively. Utilize incident ticket tracking tools and processes to manage and resolve issues. Contribute to quality strategies that ensure data platform correctness, resilience, scalability, and security.
We seek candidates with 6-10 years of extensive experience in Data Engineering and cloud-based platforms, including 6+ years with Azure or AWS. Proven expertise in Databricks and Kafka (5+ years), along with strong proficiency in Apache Spark for distributed data processing, is essential. Experience in designing and maintaining data pipelines using Apache Airflow and working knowledge of Snowflake and modern data warehousing are required.
Demonstrated experience with RESTful APIs and application integration patterns is necessary. You should possess strong skills in both relational and non-relational databases, proficiency in SQL, data modeling, and performance optimization. Familiarity with Agile methodologies, DevOps practices, containerization, and Data-as-a-Service architectures is expected. Experience with monitoring, deployment automation, production support, and incident management platforms like ServiceNow is a plus. A Bachelor's degree in Engineering, Computer Science, or equivalent practical experience is required.
Persistent Systems
IT Consulting