Lead Senior Associate | Data Engineering | Pune | Engineering as a Service/ Operate (Pune, IN)

Deloitte

8–10 yrs Pune Full Time Work from office
Deloitte logo
Posted : today
Actively hiring

Job description

Seeking a seasoned, hands-on Data Engineering Lead to spearhead the design, development, and deployment of extensive cloud-based data engineering solutions. This role demands deep expertise in data lakes, cloud environments, robust ETL/ELT pipelines, and contemporary data architecture. The successful candidate will also manage technical teams and client interactions, from initial sales discussions through to project completion.

This is an opportunity to shape and deliver innovative data solutions within a dynamic engineering environment.

Responsibilities

Lead the architecture and implementation of scalable cloud data engineering solutions and data lakes. Drive client engagements, including pre-sales discussions, solution design, proposal creation, and proof-of-concept development. Design secure and scalable data storage architectures on AWS, Azure, or GCP. Develop and optimize ETL/ELT pipelines using technologies like Apache Spark, Databricks, AWS Glue, or Azure Data Factory. Build efficient data transformation workflows with serverless functions. Establish comprehensive data governance, security, and quality frameworks. Foster collaboration with data scientists, BI teams, and business stakeholders for reliable analytics. Mentor and guide a team of data engineers throughout project lifecycles. Optimize cloud infrastructure costs without compromising performance and reliability, ensuring successful project delivery aligned with client and business objectives.

Qualifications

A minimum of 5 years of practical experience in Data Engineering and cloud-based data solutions is essential. Demonstrable expertise in AWS, Azure, or Google Cloud Platform is required. Experience in designing and implementing Data Lakes is a must. Proficiency with Apache Spark, Databricks, AWS Glue, Azure Data Factory, or similar ETL tools is necessary. Experience with serverless computing (AWS Lambda, Azure Functions, Google Cloud Functions) is expected. A strong grasp of data governance, data quality, security, and compliance principles is vital. Familiarity with Docker and Kubernetes is required. Excellent programming skills in SQL, Python, Scala, or Java are needed. Experience with cloud data warehouses such as Amazon Redshift, Google BigQuery, or Azure Synapse is important. Proven leadership capabilities in managing technical teams and delivering projects end-to-end are crucial. Outstanding communication and stakeholder management skills are essential for this role.

Essential Skills

Data EngineeringAWSAzureGoogle Cloud PlatformData LakesApache SparkDatabricksAWS GlueAzure Data FactoryServerless ComputingAWS LambdaAzure FunctionsGoogle Cloud FunctionsData GovernanceData QualitySecurityComplianceDockerKubernetesSQLPythonScalaJavaAmazon RedshiftGoogle BigQueryAzure SynapseTeam LeadershipProject DeliveryStakeholder ManagementClient Engagement

Good to Have

AWS Lake FormationAzure PurviewGoogle Data CatalogCloud CertificationsCI/CD PipelinesDevOps

Highlights

  • Actively hiring

More Details

RoleLead Senior Associate | Data Engineering | Pune | Engineering as a Service/ Operate (Pune, IN)
DepartmentEngineering
Employment TypeFull Time, Work from office

About the Company

Deloitte logo

Deloitte

IT Consulting

Lead Senior Associate | Data Engineering | Pune | Engineering as a Service/ Operate (Pune, IN) at Deloitte | SkillMX | SkillMX