Azure Datafactory

Infosys

3–5 yrs Bengaluru Full Time Hybrid (office + remote)
Infosys logo
Posted : today
Actively hiring

Job description

Join a dynamic data engineering team focused on powering analytics and informed business decisions. This role involves building and optimizing cloud-based data pipelines using Azure Data Factory and Databricks, transforming raw data into valuable insights with speed and reliability.

You'll collaborate with stakeholders, data engineers, and platform teams to understand data needs, architect scalable solutions, and ensure seamless, automated data movement. If you thrive on solving complex data challenges, enhancing performance, and structuring intricate datasets in a supportive, learning-conducive environment, this position offers significant growth and expertise development in modern Azure data platforms.

Responsibilities

Key responsibilities include designing, developing, and maintaining end-to-end data pipelines for batch and scheduled workloads using Azure Data Factory.

Orchestrate data transformations and processing workflows with Databricks, aligning with business objectives. Implement robust monitoring, alerting, and failure handling for reliable pipeline executions.

Perform data validation and reconciliation to guarantee accuracy and consistency. Optimize pipeline performance through ADF tuning and Databricks streamlining. Collaborate on requirements gathering and timely solution delivery.

Maintain comprehensive technical documentation and support deployments with structured change management practices.

Qualifications

We seek candidates with a BTECH, MTECH, MCA, or MSC education and 3-5 years of experience in data engineering or data integration.

Essential hands-on experience includes Azure Data Factory (pipeline development, scheduling, triggers) and Databricks for data processing. A proven ability to troubleshoot pipeline failures and analyze logs is required.

Familiarity with Azure Synapse Analytics, ADLS, PySpark, Delta Lake, and CI/CD for data pipelines is advantageous. Experience with scalable ADF orchestration patterns, Databricks transformation best practices, and building data quality checks is also desired.

Strong collaboration skills to translate business needs into technical designs and experience with performance tuning for cloud data pipelines are beneficial.

Essential Skills

Azure Data FactoryDatabricksData PipelinesData EngineeringSQLCloud Computing

Good to Have

Azure Synapse AnalyticsAzure Data Lake StorageADLSPySparkDelta LakeCI/CDData QualityPerformance Tuning

Highlights

  • Actively hiring

More Details

RoleAzure Datafactory
IndustryInformation Technology & Services, Data Analytics
DepartmentData Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Infosys logo

Infosys

Information Technology & Services

Azure Datafactory at Infosys | SkillMX | SkillMX