Seeking a seasoned Azure Databricks Specialist to architect, build, and optimize advanced data platforms and analytics solutions on Azure. This role focuses on creating robust enterprise-grade data pipelines for seamless data ingestion from diverse sources, complex transformations, and scalable analytics.

Ideal candidates possess strong practical expertise in Databricks, PySpark, Azure Data Factory (ADF), and SQL, driving the development of modern data architectures. The position involves hands-on experience in building and maintaining data ingestion frameworks and implementing data transformation layers.

Key responsibilities include developing and managing data ingestion frameworks using ADF and Databricks/Spark, and implementing Bronze to Silver data transformations according to architectural guidelines.

Build and optimize high-throughput ELT/ETL pipelines to ingest, transform, and curate data from various on-premise and cloud systems, APIs, and third-party sources. Develop scalable transformation scripts in PySpark on Databricks, applying advanced optimizations and implementing Delta Lake features like ACID transactions and schema evolution. Utilize Databricks Genie and build orchestration workflows in ADF, including pipelines, triggers, and linked services. Collaborate with IT and business teams to define data requirements and deliver production-ready solutions, while also working with architects and engineering teams to align technical delivery with business goals.

A minimum of 4 years in data engineering, with significant hands-on experience in the Azure data ecosystem, is essential.

Requires at least 3 years of real project experience with Databricks and the Azure data platform (ADF, ADLS, Azure SQL, DLT, Delta Lake, Spark, Workflows, Unity Catalog).

Candidates must have at least 2 years of experience building data pipelines with Azure Data Factory and developing PySpark transformations within Databricks.

Proficiency in SQL, including writing complex queries, performance tuning, and handling large datasets, is mandatory. Knowledge of CI/CD pipelines, preferably Azure DevOps, for automated deployment is a plus.