EY - GDS Consulting - AI and DATA - Kafka Engineer - Manager

EY

10–12 yrs Bengaluru Full Time Hybrid (office + remote)
EY logo
Posted : today
Actively hiring

Job description

Join EY's GDS Consulting team as a Manager focused on AI and Data. This role involves leading the design and implementation of advanced data engineering and architecture solutions, leveraging Databricks, Kafka, and AWS. You'll be instrumental in building scalable data platforms and enterprise-grade data products that drive analytics and AI initiatives. If you are passionate about shaping the future of data solutions and possess a strong leadership aptitude, this is an exceptional opportunity to contribute to a better working world.

Responsibilities

Key responsibilities include architecting and implementing modern Data Lakehouse platforms using Databricks on AWS, and designing scalable ETL/ELT pipelines. You will build robust Kafka streaming solutions, develop dimensional models (Fact and Dimension tables), and implement CI/CD practices with Azure DevOps and GitHub. Providing technical leadership and mentoring to engineering teams is also a crucial aspect of this role.

Qualifications

We are seeking candidates with 10-12 years of experience in Data Engineering and Data Architecture, demonstrating expert-level proficiency in Databricks, Apache Spark (PySpark/Spark SQL), Delta Lake, and Kafka Streaming. A strong understanding of semi-structured data processing (JSON, XML), AWS Cloud Services, data lakehouse architecture, data modeling, and SQL performance optimization is essential. Familiarity with CI/CD implementation, Azure DevOps, GitHub, and Agile methodologies is required.

Essential Skills

DatabricksApache SparkPySparkSpark SQLDelta LakeKafka StreamingAWSETLELTData LakehouseData ModelingDimensional ModelingData WarehousingSQLReal-Time Data ProcessingData Pipeline OrchestrationGitHubAzure DevOpsCI/CDDatabricks Asset Bundles (DAB)Agile

Good to Have

Databricks Certified Data EngineerDatabricks Certified ProfessionalDatabricks Generative AI EngineerDatabricks LakeflowInsurance DomainBanking DomainFinancial Services DomainAI/ML

Highlights

  • Actively hiring

More Details

RoleEY - GDS Consulting - AI and DATA - Kafka Engineer - Manager
IndustryManagement Consulting, Information Technology & Services, Data Analytics
DepartmentData Engineering, Software Development
Employment TypeFull Time, Hybrid (office + remote)

About the Company

EY Global Delivery Services ( EY GDS) logo

EY Global Delivery Services ( EY GDS)

Management Consulting

EY - GDS Consulting - AI and DATA - Kafka Engineer - Manager at EY | SkillMX | SkillMX