Azure Datafactory
Infosys
Infosys
Join a dynamic data engineering team focused on powering analytics and informed business decisions. This role involves building and optimizing cloud-based data pipelines using Azure Data Factory and Databricks, transforming raw data into valuable insights with speed and reliability.
You'll collaborate with stakeholders, data engineers, and platform teams to understand data needs, architect scalable solutions, and ensure seamless, automated data movement. If you thrive on solving complex data challenges, enhancing performance, and structuring intricate datasets in a supportive, learning-conducive environment, this position offers significant growth and expertise development in modern Azure data platforms.
Key responsibilities include designing, developing, and maintaining end-to-end data pipelines for batch and scheduled workloads using Azure Data Factory.
Orchestrate data transformations and processing workflows with Databricks, aligning with business objectives. Implement robust monitoring, alerting, and failure handling for reliable pipeline executions.
Perform data validation and reconciliation to guarantee accuracy and consistency. Optimize pipeline performance through ADF tuning and Databricks streamlining. Collaborate on requirements gathering and timely solution delivery.
Maintain comprehensive technical documentation and support deployments with structured change management practices.
We seek candidates with a BTECH, MTECH, MCA, or MSC education and 3-5 years of experience in data engineering or data integration.
Essential hands-on experience includes Azure Data Factory (pipeline development, scheduling, triggers) and Databricks for data processing. A proven ability to troubleshoot pipeline failures and analyze logs is required.
Familiarity with Azure Synapse Analytics, ADLS, PySpark, Delta Lake, and CI/CD for data pipelines is advantageous. Experience with scalable ADF orchestration patterns, Databricks transformation best practices, and building data quality checks is also desired.
Strong collaboration skills to translate business needs into technical designs and experience with performance tuning for cloud data pipelines are beneficial.
Infosys
Information Technology & Services