Pyspark Developer
Infosys
Infosys
Join Infosys as a Consultant in our Data & Analytics Unit, focusing on cutting-edge data engineering and analytics initiatives for global clients. This role offers the chance to work with cloud-native platforms, modern analytics ecosystems, and AI-driven solutions as part of large-scale enterprise data modernization programs.
As a global leader, Infosys provides continuous learning, certifications, and significant career growth opportunities within our data and analytics practice. If you're passionate about leveraging data to drive business value and eager to stay ahead of industry trends, this is an ideal opportunity.
Develop and build scalable solutions leveraging PySpark and associated technologies. Design and implement large-scale, distributed data processing pipelines, incorporating expertise in Spark Core, Spark SQL, Batch processing, and Spark Streaming.
Engage with business stakeholders and SMEs to grasp high-level business requirements. Collaborate with Solution Designers on project plans, including scoping and estimation. Apply technical, business, and system knowledge to elicit detailed system requirements.
Work within an Agile environment, actively participating in daily stand-ups, sprint planning, reviews, and retrospectives. Translate project requirements into robust technical solutions that meet quality standards. Troubleshoot and resolve data issues by collaborating effectively with upstream and downstream teams in a multi-stakeholder setting.
We are seeking a PySpark Developer with 5-7 years of hands-on experience in designing and developing distributed data processing pipelines. A strong command of PySpark, Spark Core, Spark SQL, Batch processing, and Spark Streaming is essential.
Proficiency in Hadoop, HDFS, and Hive, along with familiarity in Data Warehousing and ETL concepts, is required. Experience with UNIX shell scripting is considered an advantage for job scheduling and execution.
Candidates should possess good knowledge of Spark architecture and transformations. Strong problem-solving and analytical skills are crucial, complemented by excellent verbal and written communication abilities. Experience working in a global delivery environment and a desire to stay updated with new technologies are also valued.
Infosys
Information Technology & Services