Scala Spark Developer

Capgemini

3–10 yrs Chennai, Hyderabad, Bengaluru Full Time Hybrid (office + remote)
Capgemini logo
Posted : today
Actively hiring

Job description

Join a leading global transformation partner to shape your career and contribute to unlocking technology's value for major organizations. This role focuses on building advanced data pipelines and reimagining what's possible with data.

As an experienced Scala Developer, you'll be instrumental in developing Spark-based data solutions. You will manage big data workflows, conduct sophisticated data engineering tasks, and actively participate in Agile development cycles. This position offers a dynamic environment for impactful data engineering projects.

Responsibilities

Design and develop robust Spark-based data pipelines using Scala.

Perform advanced data engineering tasks, including data modeling and optimization.

Manage and optimize big data workflows within the HDFS ecosystem.

Contribute to data analysis, profiling, and ensuring data lineage is maintained.

Collaborate effectively within an Agile development framework.

Qualifications

Proven hands-on experience as a Scala Spark Developer with a strong project portfolio.

Proficiency in Scala and Spark is essential, alongside strong SQL skills, particularly with DB2.

Experience working with diverse data formats such as JSON, Parquet, AVRO, ORC, and XML is required.

Demonstrated experience in HDFS platform development, data analysis, profiling, and lineage.

Excellent oral and written communication skills are a must. Experience in Agile project environments is expected.

Essential Skills

ScalaSparkSQLDB2HDFSData AnalysisData ProfilingData LineageAgile

Good to Have

JSONParquetAVROORCXML

Highlights

  • Actively hiring

More Details

RoleScala Spark Developer
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Capgemini logo

Capgemini

IT Consulting

Scala Spark Developer at Capgemini | SkillMX | SkillMX