Senior Azure Data Engineer - Snowflake & Databricks
Persistent
Persistent
Join our dynamic team as a Senior Azure Data Engineer, a pivotal role in shaping enterprise-scale data platforms. This position leverages cutting-edge technologies like Azure Databricks and Snowflake to drive advanced analytics and digital transformation. You will be instrumental in designing and optimizing robust data solutions, ensuring scalability, security, and high performance across complex Azure and Snowflake environments.
We are an AI-led digital engineering partner committed to client success and innovation. With a global presence and a proven track record of growth, we offer a stimulating environment to develop your expertise. Our culture emphasizes talent development, offering opportunities for continuous learning and career advancement.
Design, develop, and maintain scalable data pipelines utilizing Azure Databricks and PySpark. Build and refine ETL/ELT workflows for diverse data types and sources, integrating them into Azure Data Lake and Snowflake environments. Develop and manage Snowflake data warehouse solutions, focusing on data modeling, transformation, and performance tuning.
Implement frameworks for data ingestion, orchestration, validation, and transformation. Create reusable components and enforce enterprise data quality, governance, monitoring, and security controls. Optimize data processing for performance, scalability, reliability, and cost-efficiency. Support business intelligence and analytics through scalable data models. Collaborate with architects, stakeholders, and analytics teams to deliver data-driven solutions.
A minimum of 8-14 years of experience in Data Engineering, Analytics, and Data Warehousing is essential. Demonstrable expertise in Azure Databricks, PySpark, Spark SQL, and Delta Lake is required. Proficiency in Snowflake, including data loading, transformation, optimization, clustering, and data sharing, is critical.
Strong SQL development and query optimization skills are a must. Experience in designing and implementing large-scale ETL/ELT pipelines and a solid understanding of data warehousing concepts and dimensional modeling are expected. Familiarity with Azure services like Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Key Vault, and Azure DevOps is necessary. Experience with Git, CI/CD, and DevOps practices for data engineering solutions is also required.
Persistent Systems
IT