EY - GDS Consulting - AI and DATA - Kafka Engineer - Senior

EY

5–7 yrs Bengaluru Full Time Hybrid (office + remote)
EY logo
Posted : today
Actively hiring

Job description

Join EY's Global Delivery Services (GDS) Consulting team as a Senior Consultant, focusing on AI and Data Engineering. This role offers a unique opportunity to build a career leveraging global scale, support, and an inclusive culture.

We are seeking experienced professionals to design and implement cutting-edge data platforms, build robust enterprise-grade data pipelines, and deliver analytics-ready data products. You will be instrumental in shaping our data architecture and driving innovation.

Bring your expertise to EY and contribute to building a better working world through advanced data solutions and technologies.

Responsibilities

As a Senior Consultant, you will architect and deploy modern Data Lakehouse platforms using Databricks on AWS, defining scalable Raw, Silver, and Gold layer architectures. You will design and develop large-scale ETL/ELT pipelines, build high-performance Spark solutions, and implement real-time data ingestion frameworks using Kafka.

Key duties include designing conceptual, logical, and physical data models, creating dimensional models, and implementing CI/CD pipelines with Azure DevOps and GitHub. You will also provide technical leadership, mentor engineering teams, and collaborate with stakeholders to translate business requirements into scalable solutions.

Qualifications

We are looking for professionals with 5-7 years of experience in Data Engineering and Data Architecture, with expert-level proficiency in Databricks and Apache Spark (PySpark/Spark SQL). Essential skills include experience with Delta Lake, Kafka Streaming, semi-structured data processing (JSON, XML), and AWS Cloud Services.

Candidates must demonstrate strong capabilities in ETL/ELT design, Data Lakehouse Architecture, Data Modeling, and Data Warehousing concepts. Experience with SQL performance optimization, real-time data processing, and data pipeline orchestration is crucial. Familiarity with DevOps tools like GitHub and Azure DevOps, including CI/CD implementation, is required.

A Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field is necessary. Strong problem-solving, analytical, communication, and stakeholder management skills are essential for success in this global delivery environment.

Essential Skills

DatabricksApache SparkPySparkSpark SQLDelta LakeKafka StreamingJSONXMLAWS Cloud ServicesETLELTData Lakehouse ArchitectureData ModelingDimensional ModelingData WarehousingSQLReal-Time Data ProcessingData Pipeline OrchestrationGitHubAzure DevOpsCI/CDDatabricks Asset Bundles (DAB)Agile Methodology

Good to Have

Insurance Domain Data PlatformsBanking Domain Data PlatformsFinancial Services Domain Data PlatformsAI/ML Workloads

Highlights

  • Actively hiring

More Details

RoleEY - GDS Consulting - AI and DATA - Kafka Engineer - Senior
IndustryManagement Consulting, Financial Services
DepartmentData Engineering, Software Development
Employment TypeFull Time, Hybrid (office + remote)

About the Company

EY Global Delivery Services ( EY GDS) logo

EY Global Delivery Services ( EY GDS)

Management Consulting

EY - GDS Consulting - AI and DATA - Kafka Engineer - Senior at EY | SkillMX | SkillMX