Pyspark Developer
Infosys
Infosys
Infosys is a global leader in digital services and consulting, seeking a Lead Consultant for its Data & Analytics Unit. This role focuses on cutting-edge data engineering and analytics initiatives for diverse clients, utilizing cloud-native platforms and modern ecosystems. Opportunities include working with AI-driven solutions and large-scale enterprise data modernization programs, supported by continuous learning and career growth within Infosys.
Develop and design large-scale, distributed data processing pipelines using PySpark, Hadoop, and Spark technologies. Collaborate with business stakeholders and solution designers to understand requirements and contribute to project planning. Elicit system requirements by applying technical and business knowledge. Work within an Agile framework, participating in scrums, sprint planning, and retrospectives. Translate project requirements into high-quality technical solutions and troubleshoot data issues with cross-functional teams.
Requires 9-11 years of experience in designing and developing scalable solutions with PySpark and Hadoop. Essential skills include Spark Core, Spark SQL, Batch processing, Spark Streaming, HDFS, Hive, and BigData technologies. Proficiency in SQL and experience with ETL concepts are necessary. Familiarity with UNIX shell scripting is advantageous for job scheduling. Must have at least 5 years of experience in project lifecycle activities. Strong analytical, problem-solving, and communication skills are vital. Experience in a global delivery environment and a desire to stay updated with new technologies are preferred. Educational qualifications include Bachelor's or Master's degrees in relevant fields like Computer Applications, Science, Engineering, or Technology.
Infosys
Information Technology & Services