Lead Associate | Data Engineering | Bengaluru | Engineering as a Service/ Operate (Bengaluru, IN)

Deloitte

2–4 yrs Bengaluru Full Time Work from office
Deloitte logo
Posted : today
Actively hiring

Job description

Join our team as a Data Engineer in Bengaluru, focusing on building and maintaining robust data platforms. This role is crucial for enabling advanced analytics, reporting, and AI/ML initiatives.

You will work on moderately complex data engineering challenges, collaborating with stakeholders to deliver reliable data solutions. As a technical resource, you'll guide team members and contribute to the continuous improvement of our data infrastructure and processes.

Responsibilities

Design, develop, and maintain scalable data pipelines for ingestion, transformation, and integration.

Build and optimize ETL/ELT workflows, processing diverse data types from multiple sources.

Translate business and customer requirements into effective technical data solutions.

Address and resolve complex engineering problems and non-standard data challenges.

Develop and maintain data models, quality frameworks, and validation processes.

Collaborate with data scientists, analysts, and product teams to deliver trusted data assets.

Monitor and optimize pipeline performance, reliability, scalability, and cost-efficiency.

Support cloud-based data platforms and data warehouse/lakehouse environments.

Implement data governance, security, lineage, and compliance standards.

Create comprehensive technical documentation and operational procedures.

Participate in code reviews and uphold best practices for development and deployment.

Troubleshoot production issues, conduct root-cause analysis, and implement lasting solutions.

Contribute to automation, CI/CD, and continuous improvement initiatives.

Qualifications

A Bachelor's degree in Computer Science, Data Engineering, Information Systems, or a related engineering field is required.

We seek candidates with 3+ years of experience in data engineering, software engineering, or big data development.

Proven experience in developing ETL/ELT pipelines and handling large-scale datasets is essential.

Solid proficiency in SQL and Python for data processing and engineering tasks is a must.

Familiarity with cloud data platforms like Azure, AWS, or Google Cloud is necessary.

Understanding of data modeling, data quality, and data governance principles is expected.

Strong analytical and problem-solving skills, along with excellent communication and collaboration abilities, are key.

The ability to work independently and manage multiple priorities is crucial.

Essential Skills

SQLPythonETLELTData EngineeringData PipelinesData ModelingData QualityData GovernanceCloud PlatformsAzureAWSGoogle CloudProblem-SolvingCommunicationStakeholder Collaboration

Good to Have

DatabricksSparkPySparkSnowflakeBigQueryAirflowAzure Data FactoryCloud Composer

Highlights

  • Actively hiring

More Details

RoleLead Associate | Data Engineering | Bengaluru | Engineering as a Service/ Operate (Bengaluru, IN)
Employment TypeFull Time, Work from office

About the Company

Deloitte logo

Deloitte

IT Consulting

Lead Associate | Data Engineering | Bengaluru | Engineering as a Service/ Operate (Bengaluru, IN) at Deloitte | SkillMX | SkillMX