Apache Spark Technical Specialist - Scala, Python (IN)

HCLTech

Fresher India Full Time Work from office
HCLTech logo
Posted : today
Actively hiring

Job description

Quantexa is seeking a highly skilled Apache Spark Technical Specialist proficient in Scala and Python. This role involves hands-on development, platform operations, and expertise within the Quantexa ecosystem. You will engage with data integration, modeling, and processing across various big data technologies and databases.

Key focus areas include leveraging Hadoop distributions like Cloudera/Hortonworks, and working with data processing frameworks. Exposure to containerization, Kubernetes, and application setup is also valuable.

Responsibilities

Design and build robust data processing applications using Apache Spark, Scala, and Python. Develop and manage scalable data pipelines for efficient processing of large datasets. Conduct in-depth data analysis and optimization to boost performance. Collaborate with diverse teams to translate business needs into effective technical solutions. Proactively troubleshoot and resolve data processing and quality issues. Continuously explore and integrate the latest advancements in Spark, Scala, and Python to enhance data processing capabilities.

Qualifications

Demonstrate advanced proficiency in Apache Spark for big data processing and analytics. Exhibit strong programming capabilities in Scala for building scalable applications. Possess expert knowledge of Python for sophisticated data manipulation and analysis. Have practical experience with data processing frameworks and tools within the Apache Spark ecosystem. Understand the fundamental principles of distributed computing and parallel data processing. Apply excellent problem-solving acumen in a dynamic, fast-paced environment. Showcase strong communication and collaboration skills to work effectively with team members.

Essential Skills

Apache SparkScalaPythonHadoopData IntegrationETLData ModelingRDBMSNoSQLBig DataHDFSFlumeKafkaHivePigOracleMS SQL ServerHBaseCassandraMongoDBElasticsearchKubernetesPrometheus

Highlights

  • Actively hiring

More Details

RoleApache Spark Technical Specialist - Scala, Python (IN)
Employment TypeFull Time, Work from office

About the Company

HCLTech logo

HCLTech

IT Consulting

Apache Spark Technical Specialist - Scala, Python (IN) at HCLTech | SkillMX | SkillMX