Python - Data Processing

Infosys

3–5 yrs Bengaluru Full Time Work from office
Infosys logo
Posted : today
Actively hiring

Job description

Join a dynamic team where data is treated as a core product and engineering excellence is paramount. This role focuses on developing and enhancing robust data processing solutions. You will transform raw, complex data into clean, reliable datasets essential for analytics and various applications. Collaboration with engineers, analysts, and stakeholders is key to understanding data requirements, improving data quality, and building scalable, maintainable pipelines. If you thrive on solving intricate data challenges, writing elegant Python code, and owning end-to-end data workflows from ingestion to delivery, this is an excellent opportunity to significantly expand your impact in a supportive environment that champions learning and continuous improvement.

Responsibilities

Design, develop, and maintain Python-based data processing workflows for diverse datasets. Build and optimize ETL processes for data ingestion, transformation, validation, and publication. Develop and manage reliable, scalable, and performant data pipelines. Write efficient SQL queries for data extraction, transformation, and reporting. Implement data quality checks, validation rules, and monitoring systems. Troubleshoot pipeline failures, identify root causes, and implement preventive measures. Collaborate with cross-functional teams to define data needs and deliver well-documented solutions. Maintain comprehensive technical documentation for pipelines and operational procedures. Adhere to best practices in code quality, version control, testing, and peer reviews for maintainable delivery.

Qualifications

Possess a B.Tech, M.Tech, MCA, or MSc in Computer Science, Information Technology, Data/Software Engineering, or a related discipline. Bring 3-5 years of experience in Python development, specifically with data processing and transformation use cases. Demonstrate hands-on experience in building ETL workflows and managing production-grade data pipelines. Exhibit strong SQL skills, including writing complex queries and optimizing performance. Show a practical understanding of core data processing concepts like batching, partitioning, schema handling, and data validation.

Essential Skills

PythonData ProcessingDataPipelineETLPandasNumPySQLData Quality Frameworks

Good to Have

Apache AirflowPySparkincremental loadsCDC-style approachesidempotent processingperformance tuning

Highlights

  • Actively hiring

More Details

RolePython - Data Processing
DepartmentData Engineering
Employment TypeFull Time, Work from office

About the Company

Infosys logo

Infosys

IT Consulting

Python - Data Processing at Infosys | SkillMX | SkillMX