Deputy Manager | Data Engineer | Hyderabad | Regulatory & Financial Risk (Hyderabad, IN)
Deloitte
Deloitte
Join our dynamic Regulatory & Financial Risk team in Hyderabad as a Deputy Manager specializing in Data Engineering. You will play a crucial role in designing, building, and maintaining robust data processing solutions within Deloitte's Strategy, Risk & Transaction practice. This is an opportunity to leverage your expertise in data engineering to mitigate risk and uncover new avenues for value creation.
Our team focuses on a comprehensive range of risk services, from strategic risk management at the C-suite level to enhancing board oversight and addressing complex financial and cyber threats. Become part of a leading organization dedicated to excellence in risk advisory.
Key responsibilities include designing, developing, and optimizing large-scale data pipelines using PySpark. You will build and maintain ETL/ELT workflows for structured and unstructured data, working with big data technologies like Hadoop, Spark, and Impala. Collaboration with cross-functional teams, ensuring code quality through best practices and reviews, and optimizing Spark job performance are integral to this role. You will also be involved in data modeling, transformation, pipeline orchestration, and end-to-end SDLC activities, including troubleshooting production incidents and contributing to automation frameworks.
We are seeking a seasoned professional with 5-8 years of hands-on experience as a PySpark developer, demonstrating a strong track record in real-time project delivery. Essential skills include proficiency in Python and PySpark, strong SQL capabilities with advanced querying and performance tuning, and experience with distributed data systems like the Hadoop ecosystem and Spark. A solid understanding of data structures, algorithms, and performance optimization, coupled with experience in ETL pipeline development and data warehousing concepts, is required. Familiarity with Git and SDLC methodologies like Agile/Scrum is also important. Experience with cloud platforms (Azure, AWS, GCP) and workflow orchestration tools (Airflow, Oozie) is highly desirable. A Bachelor's degree in any specialization is a prerequisite.
Deloitte
Financial Services