Join Deloitte's Regulatory & Financial Risk team in Chennai as a Manager Data Engineer. This role is crucial for designing, building, and maintaining robust data processing solutions within a leading professional services firm.

Deloitte's Strategy, Risk & Transaction services empower entities to manage risks and seize value-generating opportunities. Our expertise spans from strategic risk management to financial and environmental policy balancing, and cybersecurity threat mitigation.

Key responsibilities include designing and optimizing large-scale data pipelines using PySpark, building and maintaining ETL/ELT workflows, and working with big data technologies like Hadoop, Spark, and Impala. You will collaborate with cross-functional teams, ensure code quality through best practices, and optimize Spark job performance.

Further duties involve data modeling, pipeline orchestration, participating in the full SDLC, troubleshooting data processing issues, and contributing to automation, monitoring, and logging frameworks.

We seek a skilled Data Engineer with 5-8 years of hands-on PySpark experience and a Bachelor's degree. Essential qualifications include strong Python and PySpark proficiency, advanced SQL skills, and experience with distributed systems like Hadoop and Spark. Familiarity with ETL, data warehousing concepts, and version control systems such as Git is also required.

Experience with relational databases, SDLC methodologies, and cloud platforms (Azure, AWS, GCP) is a plus. Strong analytical, problem-solving, and communication skills are vital for success in this fast-paced, collaborative environment.