Senior Apache Spark Technical Lead - Scala, Python (IN)

HCLTech

Fresher India Full Time Work from office
HCLTech logo
Posted : today
Actively hiring

Job description

Quantexa is seeking a seasoned Senior Apache Spark Technical Lead proficient in Scala and Python. This role involves extensive hands-on development within the Hadoop ecosystem, focusing on platform operations and utilizing Quantexa certified experience.

The position requires expertise in data integration using ETL tools such as IBM Datastage and Informatica, alongside ingestion mechanisms like Flume and Kafka. You will be involved in data modeling using RDBMS, NoSQL, and Big Data technologies, and will leverage your knowledge of the Hadoop ecosystem, including distributions like Cloudera/Hortonworks, Pig, and Hive.

Responsibilities

As a Technical Lead, you will guide technical teams in architecting and implementing robust solutions centered around Apache Spark, Scala, and Python. Your role involves providing critical technical guidance and support to team members to overcome complex challenges.

You will collaborate closely with stakeholders to precisely define project requirements and scope. Ensuring adherence to best practices in coding, thorough testing, and efficient deployment processes is paramount. Further responsibilities include conducting code reviews, optimizing performance, troubleshooting technical issues to guarantee smooth project delivery, and staying abreast of the latest advancements in Apache Spark, Scala, and Python technologies. Mentoring team members and fostering knowledge sharing are also key aspects of this leadership position.

Qualifications

This role demands strong, hands-on proficiency in Apache Spark, Scala, and Python. Candidates must possess proven experience in leading technical teams and managing projects successfully. Essential skills include excellent problem-solving capabilities and a critical thinking approach.

A solid understanding of the software development lifecycle is required, complemented by strong communication and interpersonal skills. The ability to thrive in a collaborative team setting is crucial. Demonstrated leadership and organizational abilities are highly valued. Experience in performance tuning and optimization techniques is essential. A foundational knowledge of big data concepts and associated tools is considered a significant advantage.

Essential Skills

Apache SparkScalaPythonHadoopData IntegrationETLData ModelingRDBMSNoSQLBig DataKafkaFlumeClouderaHortonworksPigHiveOracleMS SQL ServerHBaseCassandraMongoDBData Platform AdministrationElasticContainersKubernetesLoad BalancingLoggingPrometheusPerformance TuningSoftware Development Life Cycle

Good to Have

Quantexa CertifiedIBM DatastageInformatica

Highlights

  • Actively hiring

More Details

RoleSenior Apache Spark Technical Lead - Scala, Python (IN)
DepartmentTechnical Lead
Employment TypeFull Time, Work from office

About the Company

HCLTech logo

HCLTech

IT Consulting

Senior Apache Spark Technical Lead - Scala, Python (IN) at HCLTech | SkillMX | SkillMX