Pyspark Developer
Infosys
Infosys
Seeking a skilled PySpark Developer with 5-9 years of experience to build scalable data solutions. This role offers an opportunity to work on cutting-edge big data technologies within a dynamic consulting environment.
Join our Data & Analytics Unit at Infosys Limited and contribute to innovative projects that drive business value through data. You will collaborate with diverse teams and stakeholders to deliver high-quality solutions.
Design and develop large-scale, distributed data processing pipelines using PySpark and Hadoop.
Implement batch and streaming data processing using Spark Core, Spark SQL, and Spark Streaming.
Collaborate with business stakeholders to understand requirements and translate them into technical solutions.
Participate actively in Agile ceremonies, including daily stand-ups, sprint planning, and retrospectives.
Troubleshoot and resolve data issues in collaboration with upstream and downstream teams.
Apply technical expertise and business knowledge to elicit and define system requirements.
Minimum 5-9 years of hands-on experience in designing and developing data processing pipelines with PySpark and Hadoop.
Strong proficiency in Spark Core, Spark SQL, Batch processing, and Spark Streaming.
Experience with Big Data technologies such as Hadoop, HDFS, and Hive is essential.
Familiarity with data warehousing and ETL concepts and techniques is required.
Possess strong analytical, problem-solving, and communication skills.
A Bachelor of Engineering degree is required. Experience with UNIX shell scripting is a plus.
Infosys
Information Technology & Services