Pyspark Developer
Infosys
Infosys
Infosys is a global leader in next-generation digital services and consulting. Join our Data & Analytics unit to work on cutting-edge data engineering and analytics initiatives for global clients. This role offers opportunities to engage with cloud-native data platforms, modern analytics ecosystems, AI-driven solutions, and large-scale enterprise data modernization programs. Benefit from continuous learning, certifications, and career growth within our dynamic data and analytics practice.
As a Senior Associate Consultant, you will be instrumental in shaping and implementing advanced data solutions. We are looking for individuals passionate about leveraging data to drive business value and innovation for our esteemed clientele.
Design and develop scalable, distributed data processing pipelines using PySpark, Hadoop, and associated technologies, with at least 3 years of hands-on experience. Implement solutions leveraging Spark Core, Spark SQL, Batch Processing, and Spark Streaming. Work with Hadoop, HDFS, and Hive, applying data warehousing and ETL concepts. Utilize UNIX shell scripting for job scheduling and execution. Engage with business stakeholders to understand high-level requirements and collaborate with Solution Designers on project planning and estimation. Translate project requirements into robust technical solutions adhering to quality standards.
Participate actively in an Agile environment, contributing to daily stand-ups, sprint planning, reviews, and retrospectives. Apply technical and business knowledge to define system requirements. Demonstrate strong problem-solving and analytical skills, along with excellent verbal and written communication. Thrive in a global delivery setting and stay current with emerging development technologies and industry trends.
We are seeking a skilled PySpark Developer with 3-5 years of experience in building scalable solutions. A strong foundation in PySpark, Spark, Hadoop, and exposure to SQL, Hive, and Sqoop is essential. Proficiency in Spark Core, Spark SQL, Batch Processing, and Spark Streaming is required. Familiarity with Hadoop, HDFS, Hive, and other Big Data technologies is crucial. Understanding of Data Warehousing and ETL concepts is expected. UNIX shell scripting skills are considered an advantage for job scheduling.
Candidates should possess at least 3 years of experience in project development lifecycle activities. Experience working in a global delivery environment and a desire to stay updated with new technologies and industry trends are highly valued. A Bachelor's or Master's degree in Computer Applications, Science, Engineering, or Technology is required for this role.
Infosys
Information Technology & Services