Spark-Java, DBX
Infosys
Infosys
Join a dynamic engineering team focused on developing and optimizing data-driven solutions that drive significant business value. This role sits at the nexus of Java engineering and big data processing with Spark, utilizing DBX to create scalable and dependable pipelines and services. You will collaborate with data engineers, platform teams, and stakeholders to transform requirements into robust implementations, enhancing performance and data integrity.
This is an excellent opportunity for individuals passionate about solving complex challenges, working with cutting-edge data platforms, and managing projects from conception to completion. Grow your career and expertise within a supportive and collaborative team environment.
Design, develop, and maintain Java-based Spark data processing jobs according to business and technical specifications. Build and refine ETL workflows, ensuring data accuracy, completeness, and consistency. Implement integrations and workflows using DBX for scalable execution and operational reliability. Optimize Spark jobs for improved performance, cost efficiency, and tuning (partitioning, caching, shuffle). Produce clean, maintainable code with comprehensive logging, error handling, and unit/integration tests. Troubleshoot production issues, conduct root-cause analyses, and implement preventative solutions. Partner with cross-functional teams to clarify requirements, plan releases, and ensure smooth deployments. Create thorough documentation for technical designs, data flows, and operational procedures.
Possess 3-5 years of hands-on experience in software or data engineering. Hold a Bachelor's or Master's degree (BTECH, MTECH, MCA, MSC). Demonstrate strong Java programming skills with a firm grasp of OOP and coding best practices. Have practical experience with Apache Spark for batch data processing. Experience in building and supporting ETL pipelines and data transformations. Possess working knowledge of DBX for developing and executing data workflows.
Infosys
IT Consulting