EY - GDS Consulting - AI and DATA - Kafka Engineer - Manager
EY
EY
Join EY's GDS Consulting team as a Manager focused on AI and Data. This role involves leading the design and implementation of advanced data engineering and architecture solutions, leveraging Databricks, Kafka, and AWS. You'll be instrumental in building scalable data platforms and enterprise-grade data products that drive analytics and AI initiatives. If you are passionate about shaping the future of data solutions and possess a strong leadership aptitude, this is an exceptional opportunity to contribute to a better working world.
Key responsibilities include architecting and implementing modern Data Lakehouse platforms using Databricks on AWS, and designing scalable ETL/ELT pipelines. You will build robust Kafka streaming solutions, develop dimensional models (Fact and Dimension tables), and implement CI/CD practices with Azure DevOps and GitHub. Providing technical leadership and mentoring to engineering teams is also a crucial aspect of this role.
We are seeking candidates with 10-12 years of experience in Data Engineering and Data Architecture, demonstrating expert-level proficiency in Databricks, Apache Spark (PySpark/Spark SQL), Delta Lake, and Kafka Streaming. A strong understanding of semi-structured data processing (JSON, XML), AWS Cloud Services, data lakehouse architecture, data modeling, and SQL performance optimization is essential. Familiarity with CI/CD implementation, Azure DevOps, GitHub, and Agile methodologies is required.
EY Global Delivery Services ( EY GDS)
Management Consulting