ADF (Azure Data Factory) + Databricks+ Snowflake
Infosys
Infosys
Lead the design and delivery of modern, scalable data platforms within a high-impact data engineering team. This role focuses on building robust pipelines and production-grade data products using Azure Data Factory (ADF), Databricks, and Snowflake to drive analytics and business decisions. Collaborate closely with stakeholders and engineers to shape end-to-end solutions, enhance performance, and optimize costs. If you thrive on solving complex data challenges, mentoring teams, and building cloud-native solutions with a focus on quality and excellence, this is a significant opportunity for leadership growth in a supportive, learning-focused environment.
Spearhead the end-to-end implementation of data ingestion and orchestration workflows utilizing ADF, managing scheduling, dependencies, and error handling. Design and develop scalable data processing pipelines in Databricks with Spark for batch and incremental loads. Build and optimize ELT/ETL patterns with Snowflake as a source/target, ensuring performance and cost efficiency. Establish and enforce data pipeline standards and engineering best practices. Implement robust monitoring, alerting, and operational runbooks for production pipelines, leading incident triage and root-cause analysis. Collaborate with stakeholders on technical designs and delivery plans, managing risks. Conduct code reviews, mentor engineers, and guide technical decisions for maintainable and secure solutions. Optimize pipeline performance through tuning and efficient data processing strategies.
Possess a B.Tech, M.Tech, MCA, or MSc degree. Bring 7-9 years of overall experience with deep hands-on expertise in ADF and Databricks for building production-grade data pipelines. Demonstrate proven experience in designing and supporting reliable ETL/ELT workflows, including scheduling and failure recovery. Strong SQL skills and experience with large datasets and data quality considerations are essential. Proven ability to collaborate with cross-functional teams and lead technical delivery with a strong sense of ownership.
Infosys
IT Consulting