Lead Associate | Data Engineering | Bengaluru | Engineering as a Service/ Operate (Bengaluru, IN)

Deloitte

3 yrs Bengaluru Full Time Work from office
Deloitte logo
Posted : today
Actively hiring

Job description

Seeking a skilled Lead Associate for Data Engineering to join our team in Bengaluru. This role is crucial in developing and maintaining robust data pipelines and platforms that empower analytics, reporting, and AI/ML initiatives. You will tackle moderately complex data engineering challenges independently and collaborate with stakeholders to deliver effective data solutions.

As a key technical resource, you will guide team members, share best practices, and drive continuous improvements in our data platforms and engineering processes.

Responsibilities

Design, build, and manage scalable data ingestion, transformation, and integration pipelines. Develop and optimize ETL/ELT workflows for diverse data sources. Translate business requirements into robust technical data solutions. Address complex data challenges and engineering problems. Develop and maintain data models, quality frameworks, and validation processes. Collaborate with data scientists, analysts, and product teams to deliver trusted data assets. Monitor and optimize pipeline performance, reliability, and cost efficiency. Support cloud-based data platforms and data warehouse/lakehouse environments. Implement data governance, security, and compliance standards. Create comprehensive technical documentation and operational procedures. Participate in code reviews and champion engineering best practices. Troubleshoot production issues and implement sustainable solutions. Contribute to automation, CI/CD, and continuous improvement initiatives.

Qualifications

A Bachelor's degree in Computer Science, Data Engineering, Information Systems, or a related field is required. We are looking for candidates with 3+ years of experience in data engineering, software engineering, or big data development. Demonstrated experience in building ETL/ELT pipelines and handling large-scale datasets is essential. Familiarity with data warehouses, data lakes, and modern data architectures is necessary. Proficiency in SQL and Python for data processing and engineering tasks is expected. Knowledge of cloud platforms like Azure, AWS, or Google Cloud is required. Understanding of data modeling, data quality, and data governance principles is important. Strong analytical and problem-solving abilities are a must. Excellent communication and stakeholder collaboration skills are essential. Ability to work independently and manage multiple priorities effectively is key.

Essential Skills

SQLPythonETLData WarehousingData LakesData ModelingData QualityData GovernanceCloud PlatformsAzureAWSGoogle Cloud

Good to Have

DatabricksSparkPySparkSnowflakeBigQueryAirflowAzure Data FactoryCloud Composer

Highlights

  • Actively hiring

More Details

RoleLead Associate | Data Engineering | Bengaluru | Engineering as a Service/ Operate (Bengaluru, IN)
DepartmentData Engineering
Employment TypeFull Time, Work from office

About the Company

Deloitte logo

Deloitte

IT Consulting

Lead Associate | Data Engineering | Bengaluru | Engineering as a Service/ Operate (Bengaluru, IN) at Deloitte | SkillMX | SkillMX