Manager | Data Engineer | Chennai | Regulatory & Financial Risk

Deloitte

5–8 yrs Chennai Full Time Work from office
Deloitte logo
Posted : yesterday
Actively hiring

Job description

Join a leading team focused on mitigating risk and uncovering value for clients. This role involves designing, building, and maintaining robust data processing solutions within the Regulatory & Financial Risk domain.

As a Senior Developer, you will leverage your expertise in PySpark and the broader data engineering landscape to contribute to critical projects. You will work on scalable backend systems, APIs, and infrastructure, driving innovation in a fast-paced environment.

This is an excellent opportunity to shape complex data pipelines and collaborate with cross-functional experts in a dynamic consulting setting.

Responsibilities

Key responsibilities include designing and optimizing large-scale data pipelines using PySpark, building and maintaining ETL/ELT workflows, and working with big data technologies like Hadoop and Spark.

You will collaborate with data scientists and analysts, ensure code quality through best practices and reviews, and optimize job performance for efficiency.

Additional duties involve data modeling, pipeline orchestration, end-to-end SDLC participation, troubleshooting production issues, and contributing to automation and monitoring frameworks.

Qualifications

We are seeking a Senior Developer with 5-8 years of hands-on PySpark experience and a Bachelor's degree in any specialization. Strong proficiency in Python, SQL, and distributed data systems (Hadoop, Spark) is essential.

Candidates should possess experience with ETL pipeline development, data warehousing concepts, and SDLC methodologies. Familiarity with version control systems like Git and cloud platforms (Azure, AWS, GCP) is also required.

Excellent analytical, problem-solving, and communication skills are crucial for success in this role. Experience with workflow orchestration tools and an understanding of data lakes and governance frameworks are considered advantageous.

Essential Skills

PySparkPythonSQLHadoopSparkETLData WarehousingGitCI/CDData ModelingData Pipelines

Good to Have

C#AzureAWSGCPAirflowOozieData LakesData GovernanceData QualityImpalaHiveSQL Server

Highlights

  • Actively hiring

More Details

RoleManager | Data Engineer | Chennai | Regulatory & Financial Risk
IndustryFinancial Services, Management Consulting
DepartmentData Engineering, Software Development
Employment TypeFull Time, Work from office

About the Company

Deloitte logo

Deloitte

Financial Services

Manager | Data Engineer | Chennai | Regulatory & Financial Risk at Deloitte | SkillMX | SkillMX