Sr Technical Lead-Data Engg
Birlasoft
Birlasoft
Seeking a Senior Technical Lead specializing in Data Engineering. This role focuses on designing, developing, and operationalizing robust batch processing systems within the Azure ecosystem.
Ideal candidates possess deep expertise in enterprise batch frameworks and a strong understanding of architectural best practices for scalable data solutions.
Lead the design and implementation of core batch processing jobs using Spring Batch, ensuring efficient partitioning and parallel execution.
Develop and manage data pipelines within Azure, leveraging Azure Data Factory for orchestration and Azure Batch for compute.
Implement CI/CD practices using Azure DevOps and ensure comprehensive monitoring of data pipelines through Azure Monitor and Log Analytics.
Demonstrate strong expertise in Spring Batch, including job design, partitioning, and parallel processing.
Possess in-depth knowledge of Azure services like Data Factory, Batch, Storage (ADLS Gen2/Blob), and SQL.
Have experience designing distributed, scalable batch processing systems and a solid understanding of ETL frameworks and multi-layer architecture. Familiarity with Azure Container Apps or VM-based runtimes is essential.
Birlasoft
IT Consulting