Senior Apache Spark Technical Lead - Scala, Python (IN)
HCLTech
HCLTech
Quantexa is seeking a seasoned Senior Apache Spark Technical Lead proficient in Scala and Python. This role involves extensive hands-on development within the Hadoop ecosystem, focusing on platform operations and utilizing Quantexa certified experience.
The position requires expertise in data integration using ETL tools such as IBM Datastage and Informatica, alongside ingestion mechanisms like Flume and Kafka. You will be involved in data modeling using RDBMS, NoSQL, and Big Data technologies, and will leverage your knowledge of the Hadoop ecosystem, including distributions like Cloudera/Hortonworks, Pig, and Hive.
As a Technical Lead, you will guide technical teams in architecting and implementing robust solutions centered around Apache Spark, Scala, and Python. Your role involves providing critical technical guidance and support to team members to overcome complex challenges.
You will collaborate closely with stakeholders to precisely define project requirements and scope. Ensuring adherence to best practices in coding, thorough testing, and efficient deployment processes is paramount. Further responsibilities include conducting code reviews, optimizing performance, troubleshooting technical issues to guarantee smooth project delivery, and staying abreast of the latest advancements in Apache Spark, Scala, and Python technologies. Mentoring team members and fostering knowledge sharing are also key aspects of this leadership position.
This role demands strong, hands-on proficiency in Apache Spark, Scala, and Python. Candidates must possess proven experience in leading technical teams and managing projects successfully. Essential skills include excellent problem-solving capabilities and a critical thinking approach.
A solid understanding of the software development lifecycle is required, complemented by strong communication and interpersonal skills. The ability to thrive in a collaborative team setting is crucial. Demonstrated leadership and organizational abilities are highly valued. Experience in performance tuning and optimization techniques is essential. A foundational knowledge of big data concepts and associated tools is considered a significant advantage.
HCLTech
IT Consulting