Pyspark Developer

Infosys

3–5 yrs Pune Full Time Hybrid (office + remote)
Infosys logo
Posted : today
Actively hiring

Job description

Infosys is a global leader in next-generation digital services and consulting. Join our Data & Analytics unit to work on cutting-edge data engineering and analytics initiatives for global clients. This role offers opportunities to engage with cloud-native data platforms, modern analytics ecosystems, AI-driven solutions, and large-scale enterprise data modernization programs. Benefit from continuous learning, certifications, and career growth within our dynamic data and analytics practice.

As a Senior Associate Consultant, you will be instrumental in shaping and implementing advanced data solutions. We are looking for individuals passionate about leveraging data to drive business value and innovation for our esteemed clientele.

Responsibilities

Design and develop scalable, distributed data processing pipelines using PySpark, Hadoop, and associated technologies, with at least 3 years of hands-on experience. Implement solutions leveraging Spark Core, Spark SQL, Batch Processing, and Spark Streaming. Work with Hadoop, HDFS, and Hive, applying data warehousing and ETL concepts. Utilize UNIX shell scripting for job scheduling and execution. Engage with business stakeholders to understand high-level requirements and collaborate with Solution Designers on project planning and estimation. Translate project requirements into robust technical solutions adhering to quality standards.

Participate actively in an Agile environment, contributing to daily stand-ups, sprint planning, reviews, and retrospectives. Apply technical and business knowledge to define system requirements. Demonstrate strong problem-solving and analytical skills, along with excellent verbal and written communication. Thrive in a global delivery setting and stay current with emerging development technologies and industry trends.

Qualifications

We are seeking a skilled PySpark Developer with 3-5 years of experience in building scalable solutions. A strong foundation in PySpark, Spark, Hadoop, and exposure to SQL, Hive, and Sqoop is essential. Proficiency in Spark Core, Spark SQL, Batch Processing, and Spark Streaming is required. Familiarity with Hadoop, HDFS, Hive, and other Big Data technologies is crucial. Understanding of Data Warehousing and ETL concepts is expected. UNIX shell scripting skills are considered an advantage for job scheduling.

Candidates should possess at least 3 years of experience in project development lifecycle activities. Experience working in a global delivery environment and a desire to stay updated with new technologies and industry trends are highly valued. A Bachelor's or Master's degree in Computer Applications, Science, Engineering, or Technology is required for this role.

Essential Skills

PySparkHadoopSpark CoreSpark SQLBatch ProcessingSpark StreamingHDFSHiveBig Data TechnologiesUNIX Shell ScriptingData WarehousingETLAgile MethodologiesScrum

Highlights

  • Actively hiring

More Details

RolePyspark Developer
IndustryInformation Technology & Services, Data Analytics
DepartmentData Engineering, Software Development
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Infosys logo

Infosys

Information Technology & Services

Pyspark Developer at Infosys | SkillMX | SkillMX