Manager | Data Engineer | Chennai | Regulatory & Financial Risk
Deloitte
Deloitte
Join a leading team focused on mitigating risk and uncovering value for clients. This role involves designing, building, and maintaining robust data processing solutions within the Regulatory & Financial Risk domain.
As a Senior Developer, you will leverage your expertise in PySpark and the broader data engineering landscape to contribute to critical projects. You will work on scalable backend systems, APIs, and infrastructure, driving innovation in a fast-paced environment.
This is an excellent opportunity to shape complex data pipelines and collaborate with cross-functional experts in a dynamic consulting setting.
Key responsibilities include designing and optimizing large-scale data pipelines using PySpark, building and maintaining ETL/ELT workflows, and working with big data technologies like Hadoop and Spark.
You will collaborate with data scientists and analysts, ensure code quality through best practices and reviews, and optimize job performance for efficiency.
Additional duties involve data modeling, pipeline orchestration, end-to-end SDLC participation, troubleshooting production issues, and contributing to automation and monitoring frameworks.
We are seeking a Senior Developer with 5-8 years of hands-on PySpark experience and a Bachelor's degree in any specialization. Strong proficiency in Python, SQL, and distributed data systems (Hadoop, Spark) is essential.
Candidates should possess experience with ETL pipeline development, data warehousing concepts, and SDLC methodologies. Familiarity with version control systems like Git and cloud platforms (Azure, AWS, GCP) is also required.
Excellent analytical, problem-solving, and communication skills are crucial for success in this role. Experience with workflow orchestration tools and an understanding of data lakes and governance frameworks are considered advantageous.
Deloitte
Financial Services