Azure Data Engineer - (Snowflake & ADB)
Persistent
Persistent
Join a leading AI-driven digital engineering partner focused on enterprise modernization. We leverage deep technical expertise and industry insights to empower clients with cutting-edge solutions and competitive advantages. Our collaborations span numerous industry leaders, including Fortune 50 companies and top financial institutions in the US and India.
We are seeking a skilled Azure Data Engineer with extensive experience in Azure Databricks, Snowflake, PySpark, and SQL. This role is integral to designing, developing, and optimizing robust cloud-based data platforms that drive enterprise analytics, business intelligence, and informed decision-making. You will engage in modern data engineering projects involving large-scale data processing, ETL/ELT development, data warehousing, and Lakehouse architectures across Azure and Snowflake.
Key responsibilities include designing and developing scalable data pipelines using Azure Databricks and PySpark. You will build and optimize ETL/ELT workflows for diverse data volumes, and develop/manage Snowflake data warehouse solutions, focusing on performance and data loading.
Further duties involve creating reusable frameworks for data ingestion, orchestration, validation, and transformation. You will integrate data from various enterprise systems, databases, APIs, and cloud platforms into Azure Data Lake and Snowflake. The role also encompasses designing and implementing modern Lakehouse architectures with Azure Databricks and Delta Lake, and optimizing data processing for efficiency, scalability, and cost.
Ideal candidates possess 3-8 years of experience in Data Engineering and Cloud Data Platform development, with strong hands-on proficiency in Azure Databricks, PySpark, Spark SQL, and Delta Lake. Proven experience with Snowflake, including data loading, transformations, sharing, and performance tuning, is essential.
Strong SQL skills are required, along with experience in Azure services like ADF, ADLS Gen2, Key Vault, and DevOps. A solid understanding of Data Warehousing, Dimensional Modeling, ETL/ELT, and Lakehouse Architectures is expected. Experience with Git, CI/CD, source control, and Agile methodologies, coupled with excellent problem-solving and communication skills, will be key to success in this role.
Persistent Systems
IT Consulting