DE - Cloud - Senior Data Platform Engineer - GDSN02

EY

4–8 yrs Chennai Full Time Hybrid (office + remote)
EY logo
Posted : today
Actively hiring

Job description

Join EY's Cloud Engineering team as a Senior Data Platform Engineer and contribute to global IT project delivery. You'll be instrumental in building a career that's as unique as you are, leveraging EY's global scale, supportive culture, and advanced technology to achieve your full potential. Your unique perspective is vital in helping EY excel.

This role offers the opportunity to make a significant impact, driving innovation and excellence in data platform solutions. Become part of a dynamic team that shapes the future of technology for clients worldwide.

Responsibilities

Architect and manage scalable, secure, and cost-effective Databricks/Snowflake infrastructure on Azure and AWS. Establish robust data governance frameworks, including access controls, lineage, and compliance. Design and implement DataOps and MLOps pipelines for automated data workflows. Automate infrastructure provisioning using IaC tools like Terraform, ARM, or Bicep. Integrate Databricks/Snowflake with enterprise CI/CD pipelines for lifecycle management. Implement comprehensive monitoring, logging, and alerting for Databricks workloads. Optimize Databricks cluster performance and cost efficiency. Ensure adherence to security best practices, including encryption and compliance. Collaborate with data engineering, analytics, and ML teams to streamline workflows. Drive adoption of DevSecOps practices within data pipelines. Lead incident response and root cause analysis for platform issues. Document architecture, processes, and best practices for knowledge sharing.

Qualifications

A Bachelor's degree in BE/B.Tech/MCA coupled with 4-8 years of extensive industry experience is required.

Essential skills include strong knowledge of cloud computing environments (Azure, AWS), with hands-on experience in Databricks administration on these platforms. Proficiency in DevOps practices, including setting up CI/CD pipelines using Azure DevOps, GitHub Actions, or GitLab CI, is crucial.

You must possess a deep understanding of DataOps and MLOps principles, covering orchestration, monitoring, and governance. Hands-on experience with containerization technologies such as Docker and Kubernetes (AKS/EKS/GKE) is necessary. Proficiency in scripting languages like PowerShell, Python, Groovy, and Shell Scripting, along with cloud-native CLIs, is essential.

Expertise in Infrastructure as Code (IaC) tools like Terraform or ARM/Bicep, and configuration management tools such as Ansible, Chef, or Puppet, is mandatory. A strong ability to create Golden Paths for end-to-end developer workflows is also a key requirement.

Essential Skills

DatabricksSnowflakeAzureAWSTerraformARM TemplatesBicepPythonBashPowerShellAzure DevOpsGitHub ActionsJenkinsGitDataOpsMLOpsDockerKubernetesAnsibleChefPuppetAgileScrum

Good to Have

Unity CatalogPurviewAWS Lake FormationDatadogPrometheusGrafanaAzure MonitorGDPRHIPAAMicrosoft Certified: DevOps Engineer Expert (AZ-400)Microsoft Certified: Designing Microsoft Azure Infrastructure Solutions (AZ-305)Microsoft Certified: Azure Solutions Architect ExpertAWS Certified DevOps Engineer – ProfessionalAWS Certified Solutions Architect – AssociateHashiCorp Certified: Terraform AssociateCertified Kubernetes Administrator (CKA)GitHub CopilotTerraform CloudAnsible TowerSonarQubeVeracodeFortifyArgo CDFlux CDChatGPTOpenAI

Highlights

  • Actively hiring

More Details

RoleDE - Cloud - Senior Data Platform Engineer - GDSN02
DepartmentEngineering, Technology
Employment TypeFull Time, Hybrid (office + remote)

About the Company

EY Global Delivery Services ( EY GDS) logo

EY Global Delivery Services ( EY GDS)

IT Consulting

DE - Cloud - Senior Data Platform Engineer - GDSN02 at EY | SkillMX | SkillMX