Senior Azure Data Engineer - Snowflake & Databricks

Persistent

8–14 yrs Pune, Hyderabad, Chennai Full Time Hybrid (office + remote)
Persistent logo
Posted : today
Actively hiring

Job description

Join our dynamic team as a Senior Azure Data Engineer, a pivotal role in shaping enterprise-scale data platforms. This position leverages cutting-edge technologies like Azure Databricks and Snowflake to drive advanced analytics and digital transformation. You will be instrumental in designing and optimizing robust data solutions, ensuring scalability, security, and high performance across complex Azure and Snowflake environments.

We are an AI-led digital engineering partner committed to client success and innovation. With a global presence and a proven track record of growth, we offer a stimulating environment to develop your expertise. Our culture emphasizes talent development, offering opportunities for continuous learning and career advancement.

Responsibilities

Design, develop, and maintain scalable data pipelines utilizing Azure Databricks and PySpark. Build and refine ETL/ELT workflows for diverse data types and sources, integrating them into Azure Data Lake and Snowflake environments. Develop and manage Snowflake data warehouse solutions, focusing on data modeling, transformation, and performance tuning.

Implement frameworks for data ingestion, orchestration, validation, and transformation. Create reusable components and enforce enterprise data quality, governance, monitoring, and security controls. Optimize data processing for performance, scalability, reliability, and cost-efficiency. Support business intelligence and analytics through scalable data models. Collaborate with architects, stakeholders, and analytics teams to deliver data-driven solutions.

Qualifications

A minimum of 8-14 years of experience in Data Engineering, Analytics, and Data Warehousing is essential. Demonstrable expertise in Azure Databricks, PySpark, Spark SQL, and Delta Lake is required. Proficiency in Snowflake, including data loading, transformation, optimization, clustering, and data sharing, is critical.

Strong SQL development and query optimization skills are a must. Experience in designing and implementing large-scale ETL/ELT pipelines and a solid understanding of data warehousing concepts and dimensional modeling are expected. Familiarity with Azure services like Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Key Vault, and Azure DevOps is necessary. Experience with Git, CI/CD, and DevOps practices for data engineering solutions is also required.

Essential Skills

Azure DatabricksSnowflakePySparkSpark SQLDelta LakeSQLETLELTData WarehousingDimensional ModelingData ArchitectureAzure Data FactoryADFAzure Data Lake StorageADLSAzure Key VaultAzure DevOpsLakehouse ArchitectureData GovernanceMetadata ManagementData QualityCloud SecurityGitCI/CDDevOpsAgileScrum

Good to Have

Cloud Cost ManagementMonitoringLogging

Highlights

  • Actively hiring

More Details

RoleSenior Azure Data Engineer - Snowflake & Databricks
IndustryIT, Data Science, Technology
DepartmentData Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Persistent Systems logo

Persistent Systems

IT

Senior Azure Data Engineer - Snowflake & Databricks at Persistent | SkillMX | SkillMX