EY - GDS Consulting - AI And DATA - Data Engineer-Senior
EY
EY
Embark on a rewarding career journey with EY, a global leader dedicated to building a better working world. Join our GDS Consulting AI and Data team as a Senior Data Engineer. You will leverage cutting-edge technologies within an Agile framework to design, construct, and refine scalable data solutions. This role is instrumental in driving business insights and fostering innovation across the entire data lifecycle, from ingestion to deployment.
As a Senior Data Engineer, you will architect and maintain robust CI/CD pipelines, ensuring seamless product development and deployment of data solutions. You'll be responsible for intricate data mapping and integration across diverse systems to support critical analytics and business intelligence functions. Your expertise will be vital in building and optimizing advanced Data & AI solutions, including data pipelines and modeling, with a focus on performance tuning. You will develop high-quality, production-ready code in Python, PySpark, and SQL, emphasizing maintainability and scalability. Implementing enterprise-scale production deployments using DevOps best practices and Git is a key aspect of this role. Collaboration within Agile teams, contributing to sprint planning and continuous improvement, is essential.
We seek extensive experience in creating scalable data ingestion frameworks and pipelines. Proven expertise in AWS cloud services such as S3, EC2, Glue, Lambda, and Secrets Manager is required, alongside hands-on experience with Databricks for unified analytics. Proficiency in DBT for data transformation and modeling is expected, as is skill in orchestrating workflows with Apache Airflow. Strong programming abilities in Python, PySpark, Spark, and Scala are crucial. Experience with software version control and CI/CD tools like Git is necessary. A minimum of 3 years in large-scale data warehousing environments and at least 3 years with data warehouse architectures, ETL/ELT processes, and analytics tools are mandatory. Excellent analytical skills and deep SQL knowledge are paramount.
EY Global Delivery Services ( EY GDS)
Management Consulting