DE - Cloud - Senior Data Platform Engineer - GDSN02
EY
EY
Join EY as a Senior Data Platform Engineer and contribute to a global technology leadership role within our Cloud Engineering team. You will play a crucial part in delivering innovative IT projects for clients worldwide, shaping the future of data platforms in multi-cloud environments.
This is an opportunity to leverage your expertise in cloud technologies and data engineering to drive impactful solutions. You'll be instrumental in architecting and managing robust data infrastructure, ensuring scalability, security, and cost-efficiency.
Become part of a dynamic team that's dedicated to building a better working world through technology. EY offers a unique environment for professional growth, where your contributions are valued and your career can flourish.
Architect and manage Databricks/Snowflake infrastructure on Azure and AWS for scalable, secure, and cost-effective deployments. Establish and enforce data governance frameworks, including access controls and compliance. Design and implement DataOps and MLOps pipelines for automated data workflows. Automate infrastructure provisioning using Infrastructure as Code (IaC) tools like Terraform or Bicep. Integrate platforms with CI/CD pipelines for comprehensive lifecycle management. Implement robust monitoring, logging, and alerting for all data workloads.
Optimize Databricks cluster performance and cost, ensuring efficient resource utilization. Uphold security best practices, including network isolation and encryption. Collaborate with cross-functional teams to ensure seamless integration and workflow automation. Drive the adoption of DevSecOps practices, embedding security into data pipelines. Lead incident response and root cause analysis to maintain high availability. Document architectural decisions, processes, and best practices for knowledge sharing.
A Bachelor's or Master's degree in a relevant field, coupled with 4-8 years of substantial industry experience. Proven expertise in cloud computing, specifically Azure and AWS, and hands-on experience with Databricks administration on these platforms. Proficiency in setting up CI/CD pipelines using Azure DevOps, GitHub Actions, or GitLab CI. Strong understanding of DataOps and MLOps principles, including orchestration, monitoring, and governance. Experience with containerization technologies like Docker and Kubernetes is essential.
Proficiency in scripting languages such as PowerShell, Python, Groovy, and Shell Scripting, alongside cloud-native CLIs. Must possess strong skills in IaC tools like Terraform or ARM, and configuration management tools such as Ansible, Chef, or Puppet. Expertise in creating Golden Paths for end-to-end developer workflows is highly desirable. Excellent communication, stakeholder management, and problem-solving skills are critical for this role.
EY Global Delivery Services ( EY GDS)
Information Technology & Services