Pyspark Developer

Infosys

5–7 yrs Hyderabad Full Time Hybrid (office + remote)
Infosys logo
Posted : today
Actively hiring

Job description

Join Infosys as a Consultant in our Data & Analytics Unit, focusing on cutting-edge data engineering and analytics initiatives for global clients. This role offers the chance to work with cloud-native platforms, modern analytics ecosystems, and AI-driven solutions as part of large-scale enterprise data modernization programs.

As a global leader, Infosys provides continuous learning, certifications, and significant career growth opportunities within our data and analytics practice. If you're passionate about leveraging data to drive business value and eager to stay ahead of industry trends, this is an ideal opportunity.

Responsibilities

Develop and build scalable solutions leveraging PySpark and associated technologies. Design and implement large-scale, distributed data processing pipelines, incorporating expertise in Spark Core, Spark SQL, Batch processing, and Spark Streaming.

Engage with business stakeholders and SMEs to grasp high-level business requirements. Collaborate with Solution Designers on project plans, including scoping and estimation. Apply technical, business, and system knowledge to elicit detailed system requirements.

Work within an Agile environment, actively participating in daily stand-ups, sprint planning, reviews, and retrospectives. Translate project requirements into robust technical solutions that meet quality standards. Troubleshoot and resolve data issues by collaborating effectively with upstream and downstream teams in a multi-stakeholder setting.

Qualifications

We are seeking a PySpark Developer with 5-7 years of hands-on experience in designing and developing distributed data processing pipelines. A strong command of PySpark, Spark Core, Spark SQL, Batch processing, and Spark Streaming is essential.

Proficiency in Hadoop, HDFS, and Hive, along with familiarity in Data Warehousing and ETL concepts, is required. Experience with UNIX shell scripting is considered an advantage for job scheduling and execution.

Candidates should possess good knowledge of Spark architecture and transformations. Strong problem-solving and analytical skills are crucial, complemented by excellent verbal and written communication abilities. Experience working in a global delivery environment and a desire to stay updated with new technologies are also valued.

Essential Skills

PySparkHadoopSpark CoreSpark SQLBatch ProcessingSpark StreamingHDFSHiveBigData TechnologiesSQLUNIX Shell ScriptingETLData WarehousingProblem SolvingAnalytical SkillsAgile MethodologiesScrum

Good to Have

Sqoop

Highlights

  • Actively hiring

More Details

RolePyspark Developer
IndustryInformation Technology & Services, Data Analytics
DepartmentData Engineering, Software Development
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Infosys logo

Infosys

Information Technology & Services

Pyspark Developer at Infosys | SkillMX | SkillMX