Python - Data Processing
Infosys
Infosys
Join a dynamic team where data is treated as a core product and engineering excellence is paramount. This role focuses on developing and enhancing robust data processing solutions. You will transform raw, complex data into clean, reliable datasets essential for analytics and various applications. Collaboration with engineers, analysts, and stakeholders is key to understanding data requirements, improving data quality, and building scalable, maintainable pipelines. If you thrive on solving intricate data challenges, writing elegant Python code, and owning end-to-end data workflows from ingestion to delivery, this is an excellent opportunity to significantly expand your impact in a supportive environment that champions learning and continuous improvement.
Design, develop, and maintain Python-based data processing workflows for diverse datasets. Build and optimize ETL processes for data ingestion, transformation, validation, and publication. Develop and manage reliable, scalable, and performant data pipelines. Write efficient SQL queries for data extraction, transformation, and reporting. Implement data quality checks, validation rules, and monitoring systems. Troubleshoot pipeline failures, identify root causes, and implement preventive measures. Collaborate with cross-functional teams to define data needs and deliver well-documented solutions. Maintain comprehensive technical documentation for pipelines and operational procedures. Adhere to best practices in code quality, version control, testing, and peer reviews for maintainable delivery.
Possess a B.Tech, M.Tech, MCA, or MSc in Computer Science, Information Technology, Data/Software Engineering, or a related discipline. Bring 3-5 years of experience in Python development, specifically with data processing and transformation use cases. Demonstrate hands-on experience in building ETL workflows and managing production-grade data pipelines. Exhibit strong SQL skills, including writing complex queries and optimizing performance. Show a practical understanding of core data processing concepts like batching, partitioning, schema handling, and data validation.
Infosys
IT Consulting