Join a leading global professional services organization as a Senior Consultant in Tech Consulting, specializing in AI and Data. This role offers a unique opportunity to work with national, sector-agnostic teams, contributing to EY's mission of building a better working world through transformative technology solutions. You'll be part of a dynamic environment that prioritizes innovation, client-centric problem-solving, and your professional growth.

EY Consulting is at the forefront of transforming businesses, leveraging people, technology, and innovation. Within Technology Consulting, we focus on placing humans at the center, utilizing technology at speed, and enabling innovation at scale. This position is ideal for ambitious professionals seeking to make a significant impact in a collaborative and forward-thinking organization.

As a Senior Consultant, you will be instrumental in designing, developing, and maintaining scalable Python-based microservices for data ingestion and processing. Your responsibilities include building and optimizing microservices for end-to-end ETL pipelines, developing distributed data processing workflows with Apache Spark and PySpark, and creating, scheduling, and monitoring workflows using Apache Airflow.

You will also design and deploy data pipelines on cloud platforms like AWS EMR, implement real-time data ingestion and streaming pipelines, and ensure the quality, reliability, performance, and scalability of data systems. Adhering to best practices for code quality, testing, CI/CD, and production monitoring is crucial. You will troubleshoot production issues, perform root-cause analysis, and collaborate within Agile/Scrum environments.

To excel in this role, you should possess 6-8 years of experience in Data Engineering or backend data platform roles. A strong proficiency in Python, with a proven track record of building production-grade microservices, is essential. You must have hands-on expertise with Apache Spark and PySpark, along with experience working with cloud-based big data services such as AWS EMR (knowledge of the AWS ecosystem is mandatory).

Demonstrated experience with Apache Airflow for workflow orchestration and a deep understanding of ETL pipeline design and data modeling are required. Hands-on experience with Kafka for inter-domain communication and real-time streaming data pipelines, coupled with strong experience in PostgreSQL or similar RDBMS, is expected. Experience working in Agile/Scrum environments is also a key requirement. Candidates should hold a Bachelor of Technology in Computer Science or a Master of Computer Applications.