EY - GDS Consulting - AI And DATA -AWS Data Engineer - Manager

EY

8–11 yrs Coimbatore Full Time Hybrid (office + remote)
EY logo
Posted : 2 weeks ago

Job description

Join EY's GDS Consulting team as an AI Data Engineer Manager and contribute to building cutting-edge AWS-native Data & AI platforms. This role offers the opportunity to shape the future of data and analytics within financial services and beyond, leveraging deep industry experience and strong technical capabilities. You'll be instrumental in creating compelling business cases for analytical practices at the heart of client decision-making, fostering growth and safeguarding businesses.

Responsibilities

Design and implement robust AWS data pipelines using services like S3, Glue, PySpark, Athena, Redshift, EMR, and MWAA. Develop reusable ingestion frameworks for various data patterns, including batch, streaming, and event-driven. Build curated data layers with scalable lakehouse architectures, optimizing Spark/Glue/EMR workloads for performance and cost. Create AWS platform accelerators for onboarding, monitoring, and deployment. Integrate data platforms with enterprise APIs, source applications, and downstream consumers. Enable AI/ML capabilities by integrating with Amazon SageMaker and supporting MLOps workflows. Implement comprehensive data security controls and Data SRE practices, including observability, incident response, and production reliability.

Qualifications

Candidates should possess 8-11 years of experience in data engineering, platform operations, or AI platform enablement, with a strong track record in cloud data platforms, APIs, Git, CI/CD, and SRE practices. Expertise in AWS services such as Glue, S3, Redshift, EMR, and SageMaker is essential. Proficiency in Python, PySpark, SQL, and DevOps tools like Terraform and Jenkins is required. Familiarity with data governance tools like Lake Formation and Immuta, along with strong Data SRE and FinOps skills, is highly beneficial.

Essential Skills

AWS GlueAmazon S3AthenaRedshiftEMRMWAA/AirflowStep FunctionsLambdaEventBridgeCloudWatchAmazon SageMakerSageMaker PipelinesFeature StoreModel RegistryModel MonitorBedrockRAGAgentic AIPythonPySparkSQLAPIsGitCI/CDShell scriptingUnit testingIntegration testingData pipeline testingTerraformOpenTofuCloudFormationGitHub ActionsAzure DevOpsJenkinsDockerKubernetes/EKSPolicy-as-codeIAMKMSLake FormationGlue Data CatalogMacieImmutaPurviewCloudTrailData QualityObservabilityData SREFinOps

Good to Have

Bedrock optional

More Details

RoleEY - GDS Consulting - AI And DATA -AWS Data Engineer - Manager
IndustryManagement Consulting, Financial Services
DepartmentData Engineering, AI / Machine Learning
Employment TypeFull Time, Hybrid (office + remote)

About the Company

EY Global Delivery Services ( EY GDS) logo

EY Global Delivery Services ( EY GDS)

Management Consulting

EY - GDS Consulting - AI And DATA -AWS Data Engineer - Manager at EY | SkillMX | SkillMX