Scala Spark Developer
Capgemini
Capgemini
Join a leading global transformation partner to shape your career and contribute to unlocking technology's value for major organizations. This role focuses on building advanced data pipelines and reimagining what's possible with data.
As an experienced Scala Developer, you'll be instrumental in developing Spark-based data solutions. You will manage big data workflows, conduct sophisticated data engineering tasks, and actively participate in Agile development cycles. This position offers a dynamic environment for impactful data engineering projects.
Design and develop robust Spark-based data pipelines using Scala.
Perform advanced data engineering tasks, including data modeling and optimization.
Manage and optimize big data workflows within the HDFS ecosystem.
Contribute to data analysis, profiling, and ensuring data lineage is maintained.
Collaborate effectively within an Agile development framework.
Proven hands-on experience as a Scala Spark Developer with a strong project portfolio.
Proficiency in Scala and Spark is essential, alongside strong SQL skills, particularly with DB2.
Experience working with diverse data formats such as JSON, Parquet, AVRO, ORC, and XML is required.
Demonstrated experience in HDFS platform development, data analysis, profiling, and lineage.
Excellent oral and written communication skills are a must. Experience in Agile project environments is expected.
Capgemini
IT Consulting