Apache Spark Technical Specialist - Scala, Python (IN)
HCLTech
HCLTech
Quantexa is seeking a highly skilled Apache Spark Technical Specialist proficient in Scala and Python. This role involves hands-on development, platform operations, and expertise within the Quantexa ecosystem. You will engage with data integration, modeling, and processing across various big data technologies and databases.
Key focus areas include leveraging Hadoop distributions like Cloudera/Hortonworks, and working with data processing frameworks. Exposure to containerization, Kubernetes, and application setup is also valuable.
Design and build robust data processing applications using Apache Spark, Scala, and Python. Develop and manage scalable data pipelines for efficient processing of large datasets. Conduct in-depth data analysis and optimization to boost performance. Collaborate with diverse teams to translate business needs into effective technical solutions. Proactively troubleshoot and resolve data processing and quality issues. Continuously explore and integrate the latest advancements in Spark, Scala, and Python to enhance data processing capabilities.
Demonstrate advanced proficiency in Apache Spark for big data processing and analytics. Exhibit strong programming capabilities in Scala for building scalable applications. Possess expert knowledge of Python for sophisticated data manipulation and analysis. Have practical experience with data processing frameworks and tools within the Apache Spark ecosystem. Understand the fundamental principles of distributed computing and parallel data processing. Apply excellent problem-solving acumen in a dynamic, fast-paced environment. Showcase strong communication and collaboration skills to work effectively with team members.
HCLTech
IT Consulting