Spark-Java, DBX

Infosys

3–5 yrs Bengaluru Full Time Work from office
Infosys logo
Posted : today
Actively hiring

Job description

Join a dynamic engineering team focused on developing and optimizing data-driven solutions that drive significant business value. This role sits at the nexus of Java engineering and big data processing with Spark, utilizing DBX to create scalable and dependable pipelines and services. You will collaborate with data engineers, platform teams, and stakeholders to transform requirements into robust implementations, enhancing performance and data integrity.

This is an excellent opportunity for individuals passionate about solving complex challenges, working with cutting-edge data platforms, and managing projects from conception to completion. Grow your career and expertise within a supportive and collaborative team environment.

Responsibilities

Design, develop, and maintain Java-based Spark data processing jobs according to business and technical specifications. Build and refine ETL workflows, ensuring data accuracy, completeness, and consistency. Implement integrations and workflows using DBX for scalable execution and operational reliability. Optimize Spark jobs for improved performance, cost efficiency, and tuning (partitioning, caching, shuffle). Produce clean, maintainable code with comprehensive logging, error handling, and unit/integration tests. Troubleshoot production issues, conduct root-cause analyses, and implement preventative solutions. Partner with cross-functional teams to clarify requirements, plan releases, and ensure smooth deployments. Create thorough documentation for technical designs, data flows, and operational procedures.

Qualifications

Possess 3-5 years of hands-on experience in software or data engineering. Hold a Bachelor's or Master's degree (BTECH, MTECH, MCA, MSC). Demonstrate strong Java programming skills with a firm grasp of OOP and coding best practices. Have practical experience with Apache Spark for batch data processing. Experience in building and supporting ETL pipelines and data transformations. Possess working knowledge of DBX for developing and executing data workflows.

Essential Skills

JavaApache SparkDatabricksETL

Highlights

  • Actively hiring

More Details

RoleSpark-Java, DBX
DepartmentData Engineering
Employment TypeFull Time, Work from office

About the Company

Infosys logo

Infosys

IT Consulting

Spark-Java, DBX at Infosys | SkillMX | SkillMX