This role involves analyzing, designing, coding, and testing various application components. You will be responsible for maintenance, enhancements, and development work on existing and new software features. The position focuses on contributing to multiple client projects, ensuring high-quality code and efficient system performance.

As a Custom Software Engineer, your typical day will include dissecting application components, architecting solutions that meet client specifications, and writing robust code. You'll also be involved in comprehensive testing to guarantee functionality and reliability. Maintaining and improving existing applications, whether by fixing bugs or introducing new functionalities, is a key aspect of this role. Effective collaboration with team members and adapting to project changes will be crucial for success.

Take ownership of tasks and evolve into a Subject Matter Expert (SME). Actively participate and contribute during team discussions and problem-solving sessions. Collaborate with cross-functional teams to gather project requirements and deliver high-quality software modules. Maintain clear documentation of development procedures and communicate project status and any encountered challenges. Support and mentor junior team members by sharing knowledge and offering guidance. Continuously review and refine existing codebases to enhance system speed and stability.

Proven experience in developing scalable data processing pipelines using PySpark. Deep understanding of distributed computing principles and big data technologies. Skills in optimizing PySpark jobs for peak performance and efficient resource management. Familiarity with data transformation, cleaning, and aggregation techniques within the PySpark environment. Experience in debugging and resolving issues in PySpark applications, particularly in production. A minimum of 3 years of hands-on experience with PySpark is mandatory. Full-time education spanning 15 years is required.