Pyspark Developer

Infosys

9–11 yrs Bengaluru Full Time Hybrid (office + remote)
Infosys logo
Posted : today
Actively hiring

Job description

Infosys is a global leader in digital services and consulting, seeking a Lead Consultant for its Data & Analytics Unit. This role focuses on cutting-edge data engineering and analytics initiatives for diverse clients, utilizing cloud-native platforms and modern ecosystems. Opportunities include working with AI-driven solutions and large-scale enterprise data modernization programs, supported by continuous learning and career growth within Infosys.

Responsibilities

Develop and design large-scale, distributed data processing pipelines using PySpark, Hadoop, and Spark technologies. Collaborate with business stakeholders and solution designers to understand requirements and contribute to project planning. Elicit system requirements by applying technical and business knowledge. Work within an Agile framework, participating in scrums, sprint planning, and retrospectives. Translate project requirements into high-quality technical solutions and troubleshoot data issues with cross-functional teams.

Qualifications

Requires 9-11 years of experience in designing and developing scalable solutions with PySpark and Hadoop. Essential skills include Spark Core, Spark SQL, Batch processing, Spark Streaming, HDFS, Hive, and BigData technologies. Proficiency in SQL and experience with ETL concepts are necessary. Familiarity with UNIX shell scripting is advantageous for job scheduling. Must have at least 5 years of experience in project lifecycle activities. Strong analytical, problem-solving, and communication skills are vital. Experience in a global delivery environment and a desire to stay updated with new technologies are preferred. Educational qualifications include Bachelor's or Master's degrees in relevant fields like Computer Applications, Science, Engineering, or Technology.

Essential Skills

PySparkHadoopSpark CoreSpark SQLBatch ProcessingSpark StreamingHDFSHiveBigData TechnologiesUNIX Shell ScriptingSQL

Good to Have

Sqoop

Highlights

  • Actively hiring

More Details

RolePyspark Developer
IndustryInformation Technology & Services
DepartmentData Engineering, Software Development
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Infosys logo

Infosys

Information Technology & Services

Pyspark Developer at Infosys | SkillMX | SkillMX