Senior Azure Data Engineer
Persistent
Persistent
Join Persistent as a Senior Azure Data Engineer and be a key contributor to building robust, scalable data platforms for critical healthcare solutions. This role offers a dynamic environment to work on large-scale data processing, real-time analytics, and cutting-edge cloud-native data engineering initiatives.
You will collaborate closely with architects, product owners, and engineering teams to design, develop, and optimize modern cloud-based data solutions leveraging Azure, Databricks, Kafka, Spark, and Airflow.
Collaborate with product owners, systems analysts, and software engineers to execute an agile roadmap. Work with architects and fellow engineers to assess functional and non-functional requirements, delivering innovative, high-quality solutions. Design, develop, test, and maintain data-intensive applications, including those using Java, Azure or AWS, Databricks, Spark, and various data storage solutions. Contribute to and enhance processes for continuous delivery and DevOps within the team. Build and maintain software using configuration management and automation tools, deployment strategies, and monitoring systems. Apply Software Engineering best practices such as Reliability Engineering, Deployment Planning, Fault Tolerant Architecture, and Test Automation. Gain experience in Data as a Service and Container as a Service models. Utilize incident ticket tracking tools and processes like ServiceNow. Participate in quality strategy development to ensure a correct, resilient, scalable, and secure data platform.
Possess 6 to 10 years of experience in Data Engineering and cloud-based data platforms, with a minimum of 6 years of hands-on experience with Azure or AWS cloud services. Have 5+ years of experience working with Databricks and Kafka, coupled with strong expertise in Apache Spark and distributed data processing. Demonstrate experience designing and maintaining data pipelines using Apache Airflow and working knowledge of Snowflake and modern data warehousing concepts. Familiarity with RESTful APIs and application integration patterns is essential, alongside strong experience with relational and non-relational databases. Proficiency in SQL, data modeling, and performance optimization is required, as is experience with Agile delivery methodologies and DevOps practices. Knowledge of containerization technologies and Data-as-a-Service architectures is expected. Experience with monitoring, deployment automation, and production support processes, including hands-on experience with ServiceNow or similar incident management platforms, is crucial. A Bachelor's degree in Engineering, Computer Science, or equivalent practical experience is required.
Persistent Systems
Healthcare