Databricks & Snowflake Infrastructure Engineer
NTT DATA
NTT DATA
Join our team as a Databricks & Snowflake Infrastructure Engineer and take ownership of designing, building, and maintaining robust cloud platforms on AWS. This role is crucial for automating the deployment and management of Databricks and Snowflake environments, ensuring scalability, security, and operational excellence.
You will be instrumental in implementing Infrastructure as Code (IaC) using Terraform, deploying complex configurations for Databricks workspaces and Snowflake accounts, and establishing strong data governance controls. Your expertise will shape the foundation for our data analytics and AI/ML initiatives.
Automate the deployment of Databricks and Snowflake platforms on AWS using Terraform and IaC principles.
Configure and validate key aspects of Databricks, including Unity Catalog, cluster policies, and networking. For Snowflake, you'll manage account setup, virtual warehouses, RBAC, and resource monitors.
Implement secure AWS infrastructure, focusing on VPCs, PrivateLink, IAM, KMS, and Secrets Manager to support platform deployments.
Build and manage CI/CD pipelines to streamline environment provisioning, testing, and promotion across different stages.
Conduct thorough platform validation, operational readiness testing, and troubleshoot infrastructure and security-related issues.
Collaborate with Cloud Architects and Data Platform teams to define deployment standards and governance controls.
Develop reusable accelerators, Terraform modules, and operational runbooks for enterprise-scale rollouts.
A minimum of 7 years of experience in Cloud, DevOps, or Infrastructure Engineering is required.
Proven experience with Terraform (5+ years) for developing IaC solutions is essential.
Extensive hands-on experience with AWS services such as VPCs, IAM, KMS, and Secrets Manager (5+ years).
Significant experience deploying and administering Databricks on AWS (3+ years) and Snowflake (3+ years).
Proficiency in building CI/CD pipelines using tools like GitHub Actions or Azure DevOps (3+ years).
Experience implementing secure cloud architectures, including encryption and network isolation (3+ years).
Familiarity with automation scripting in Python, Bash, or PowerShell (2+ years).
Experience with platform readiness validation, DevSecOps practices, and Agile methodologies is expected.
Excellent client-facing communication and leadership skills are vital for architecture reviews and deployment planning.
NTT DATA
IT Consulting