Senior Azure Data Engineer
Persistent
Persistent
Join Persistent as a Senior Azure Data Engineer, contributing to a high-performing team dedicated to constructing robust and scalable data platforms for critical healthcare solutions. This role offers a significant opportunity to engage in large-scale data processing, real-time analytics, and cloud-native data engineering initiatives, working with leading technologies.
This position is integral to designing, developing, and optimizing modern cloud-based data solutions. You will collaborate closely with architects, product owners, and fellow engineers, leveraging your expertise to drive innovation and deliver impactful results in a dynamic environment.
Engage with product owners, systems analysts, and software engineers to execute an agile roadmap. Collaborate with architects and peers to assess requirements and develop innovative, high-quality solutions. Design, develop, test, and maintain data-intensive applications using Java, Azure/AWS, Databricks, Spark, and various data storage solutions. Uphold and enhance continuous delivery and DevOps processes within the team. Build and manage software employing configuration management, automation tools, deployment strategies, and monitoring. Apply Software Engineering practices such as Reliability Engineering, Deployment Planning, Fault-Tolerant Architectures, and Test Automation. Gain experience in Data-as-a-Service and Container-as-a-Service models. Utilize incident ticket tracking tools and processes like ServiceNow. Contribute to quality strategies ensuring data platform correctness, resilience, scalability, and security.
Possess 6 to 10 years of experience in Data Engineering and cloud-based data platforms. Demonstrate 6+ years of hands-on experience with Azure or AWS cloud services. Showcase 5+ years of experience with Databricks and Kafka. Exhibit strong expertise in Apache Spark and distributed data processing. Proven experience designing and maintaining data pipelines using Apache Airflow. Working knowledge of Snowflake and modern data warehousing concepts. Familiarity with RESTful APIs and application integration patterns. Extensive experience with both relational and non-relational databases. Proficiency in SQL, data modeling, and performance optimization. Experience with Agile delivery methodologies and DevOps practices. Knowledge of containerization technologies and Data-as-a-Service architectures. Experience with monitoring, deployment automation, and production support processes. Hands-on experience with ServiceNow or similar incident management platforms. A Bachelor's degree in Engineering, Computer Science, or equivalent practical experience is required.
Persistent Systems
IT Consulting