Senior Consultant | AWS Data Engineering | Mumbai | Engineering | Data Modernization & Migration

Deloitte

3–8 yrs Mumbai Full Time Hybrid (office + remote)
Deloitte logo
Posted : today
Actively hiring

Job description

Join our dynamic team as a Senior AWS Data Engineer, focused on designing, developing, and maintaining robust data pipelines and scalable data lake solutions within the AWS ecosystem. This role demands hands-on expertise in AWS data services, SQL, Spark, and modern data lake architectures. Prior experience in the Banking and Financial Services (BFSI) sector is a significant advantage. You will collaborate with cross-functional teams to build high-performance data solutions that drive enterprise analytics and meet critical reporting needs.

This position offers a hybrid work model, providing flexibility and a balanced approach to work and life. We are committed to fostering a collaborative environment where innovation and technical excellence thrive.

Responsibilities

Key responsibilities include architecting and implementing scalable ETL/ELT pipelines on AWS, and constructing enterprise Data Lakes using Amazon S3 and Apache Iceberg. You will develop and optimize Spark applications with PySpark on Amazon EMR, and craft efficient SQL queries using Amazon Athena. Designing and maintaining dimensional data models, data marts, and implementing incremental loading, CDC, and data reconciliation processes are also core functions. Optimizing Spark jobs for performance and cost, alongside monitoring and troubleshooting data pipelines, is essential. You will also implement data quality frameworks, collaborate with business users, participate in testing and deployment, create technical documentation, and adhere strictly to data governance, security, and compliance standards.

Qualifications

We are seeking candidates with 3-8 years of experience in Data Engineering, demonstrating strong proficiency in AWS Data Services and hands-on PySpark development on EMR. Excellent SQL development and query optimization skills, along with experience managing large datasets and building production-grade Data Lakes and Data Marts, are crucial. Familiarity with Apache Iceberg tables, data reconciliation, validation techniques, and Agile/Scrum methodologies is highly valued. A Bachelor's degree in Engineering or Technology (B.E/B.Tech) is required for this role.

Essential Skills

AWS S3AWS GlueAWS EMRAmazon AthenaAWS LambdaIAMCloudWatchEventBridgeAWS Step FunctionsGlue Data CatalogApache SparkPySparkApache IcebergHiveParquetSQLPostgreSQLOracleTeradataPythonShell ScriptingETL/ELT DevelopmentData WarehousingData Lake ArchitectureData ModelingStar SchemaSnowflake SchemaSlowly Changing Dimensions (SCD)PartitioningData Quality FrameworksGit

Good to Have

Amazon RedshiftAmazon QuickSightTableauPower BIBankingFinancial ServicesFinacleCore BankingCI/CD pipelinesApache AirflowTerraformCloudFormationData GovernanceMetadata ManagementApache KafkaAmazon KinesisLakehouse architecture

Highlights

  • Actively hiring

More Details

RoleSenior Consultant | AWS Data Engineering | Mumbai | Engineering | Data Modernization & Migration
DepartmentData Engineering, Cloud Engineering, Software Development
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Deloitte logo

Deloitte

IT Consulting

Senior Consultant | AWS Data Engineering | Mumbai | Engineering | Data Modernization & Migration at Deloitte | SkillMX | SkillMX