Python - Data Processing
Infosys
Infosys
Join a collaborative engineering team where your Python skills are central to creating reliable, high-quality data movement solutions. You will contribute to designing and building scalable data processing systems that accelerate insights and improve operational efficiency. This role involves close collaboration with stakeholders to grasp data requirements, translate them into robust pipelines, and continuously enhance system performance and stability.
This is an excellent opportunity for individuals passionate about solving practical data challenges, committed to writing clean, maintainable code, and dedicated to delivering dependable systems. If you thrive in an environment that fosters ownership, teamwork, and the creation of trustworthy data workflows, you'll find this position highly rewarding.
- Develop and maintain Python-based data processing components for various data formats. - Create and support ETL workflows for data ingestion, transformation, validation, and loading. - Design and optimize SQL queries for data extraction, transformation, reconciliation, and reporting. - Implement resilient data pipelines with comprehensive logging, error handling, and monitoring. - Conduct data quality checks, anomaly detection, and reconciliation for accuracy. - Troubleshoot pipeline issues and performance bottlenecks, driving root-cause analysis and resolution. - Partner with cross-functional teams to gather requirements and implement incremental improvements. - Maintain detailed technical documentation for pipeline designs, data mappings, and operational procedures.
- Bachelor's degree in Engineering, Computer Science, IT, or a related field (B.Tech/B.E./B.Sc. or equivalent). - 2-3 years of practical experience in Python for data processing and automation. - Demonstrated experience in building end-to-end ETL processes and data pipelines. - Proficient SQL skills, including complex joins, aggregations, subqueries, and performance optimization. - Ability to write clean, maintainable code and adhere to software engineering best practices (version control, code reviews, testing). - Experience with designing scalable pipeline patterns (e.g., incremental loads, CDC, partitioning). - Familiarity with Python data libraries and batch processing patterns (e.g., Pandas). - Exposure to pipeline orchestration and operationalizing for reliability and observability. - Experience optimizing end-to-end pipeline performance for large datasets. - Proven ability to collaborate with stakeholders and deliver technical solutions effectively.
Infosys
IT Consulting