EY - GDS Consulting - AI And DATA - Data Engineer-Senior

EY

5–8 yrs Chennai Full Time Hybrid (office + remote)
EY logo
Posted : today
Actively hiring

Job description

Embark on a rewarding career journey with EY, a global leader dedicated to building a better working world. Join our GDS Consulting AI and Data team as a Senior Data Engineer. You will leverage cutting-edge technologies within an Agile framework to design, construct, and refine scalable data solutions. This role is instrumental in driving business insights and fostering innovation across the entire data lifecycle, from ingestion to deployment.

Responsibilities

As a Senior Data Engineer, you will architect and maintain robust CI/CD pipelines, ensuring seamless product development and deployment of data solutions. You'll be responsible for intricate data mapping and integration across diverse systems to support critical analytics and business intelligence functions. Your expertise will be vital in building and optimizing advanced Data & AI solutions, including data pipelines and modeling, with a focus on performance tuning. You will develop high-quality, production-ready code in Python, PySpark, and SQL, emphasizing maintainability and scalability. Implementing enterprise-scale production deployments using DevOps best practices and Git is a key aspect of this role. Collaboration within Agile teams, contributing to sprint planning and continuous improvement, is essential.

Qualifications

We seek extensive experience in creating scalable data ingestion frameworks and pipelines. Proven expertise in AWS cloud services such as S3, EC2, Glue, Lambda, and Secrets Manager is required, alongside hands-on experience with Databricks for unified analytics. Proficiency in DBT for data transformation and modeling is expected, as is skill in orchestrating workflows with Apache Airflow. Strong programming abilities in Python, PySpark, Spark, and Scala are crucial. Experience with software version control and CI/CD tools like Git is necessary. A minimum of 3 years in large-scale data warehousing environments and at least 3 years with data warehouse architectures, ETL/ELT processes, and analytics tools are mandatory. Excellent analytical skills and deep SQL knowledge are paramount.

Essential Skills

PythonPySparkSQLAWSDatabricksDBTApache AirflowSparkScalaGitCI/CDData WarehousingETLELTDevOps

Good to Have

JenkinsApache SubversionAWS CertificationsDatabricks CertificationsJava

Highlights

  • Actively hiring

More Details

RoleEY - GDS Consulting - AI And DATA - Data Engineer-Senior
IndustryManagement Consulting, Financial Services
DepartmentData Science
Employment TypeFull Time, Hybrid (office + remote)

About the Company

EY Global Delivery Services ( EY GDS) logo

EY Global Delivery Services ( EY GDS)

Management Consulting

EY - GDS Consulting - AI And DATA - Data Engineer-Senior at EY | SkillMX | SkillMX