Databricks & Snowflake Infrastructure Engineer

NTT DATA

7+ yrs Hyderabad Full Time Hybrid (office + remote)
NTT DATA logo
Posted : today
Actively hiring

Job description

Spearhead the design, development, and maintenance of robust Databricks and Snowflake platforms on AWS. This role focuses on automating infrastructure deployment using Infrastructure as Code (IaC) and ensuring seamless integration with cloud security best practices.

Key responsibilities include building and managing Terraform templates, configuring complex Databricks environments with Unity Catalog, and deploying Snowflake accounts with granular access controls. You will also be instrumental in establishing secure AWS infrastructure and building automated CI/CD pipelines for efficient environment management.

Collaboration is crucial, working closely with Cloud Architects and Security Engineers to define deployment standards and governance controls. Troubleshooting complex infrastructure and security issues will also be a significant part of this dynamic role.

Responsibilities

Automate the deployment and configuration of Databricks and Snowflake platforms on AWS using Terraform and IaC frameworks.

Deploy and manage Databricks workspaces, including Unity Catalog, cluster policies, and service principals, leveraging Terraform and platform APIs.

Configure and validate Snowflake accounts, virtual warehouses, databases, and role-based access control (RBAC).

Implement and maintain secure AWS infrastructure, including VPCs, PrivateLink, security groups, IAM, KMS, and Secrets Manager.

Develop and manage CI/CD pipelines for automated provisioning, configuration, and promotion across environments.

Conduct platform validation, operational readiness testing, and troubleshooting for infrastructure, connectivity, and security issues.

Collaborate with cross-functional teams to establish deployment standards, reference architectures, and platform governance.

Qualifications

A minimum of 7 years in Cloud, DevOps, or Infrastructure Engineering is required, with at least 5 years dedicated to developing IaC solutions using Terraform.

Extensive experience with AWS services such as VPCs, IAM, KMS, Secrets Manager, and cloud security is essential. You'll also need at least 3 years of hands-on experience deploying and administering Databricks on AWS and Snowflake.

Proficiency in building CI/CD pipelines using tools like GitHub Actions or Azure DevOps is necessary. Experience with scripting languages like Python or Bash is also a key requirement.

Demonstrated experience in implementing secure cloud architectures, DevSecOps practices, and working within Agile environments is expected. Strong client-facing communication skills are vital for leading technical discussions and workshops.

Essential Skills

TerraformAWSDatabricksSnowflakePythonBashCI/CDInfrastructure as Code (IaC)VPCIAMKMSSecrets ManagerCloudTrailNetworkingCloud SecurityUnity CatalogGitHub ActionsAzure DevOpsJenkinsGitLabDevSecOpsAgile

Good to Have

PowerShellData EngineeringAnalyticsAI/MLAWS CertifiedTerraform CertifiedDatabricks CertifiedSnowflake Certified

Highlights

  • Actively hiring

More Details

RoleDatabricks & Snowflake Infrastructure Engineer
DepartmentEngineering, Information Technology
Employment TypeFull Time, Hybrid (office + remote)

About the Company

NTT DATA logo

NTT DATA

IT Consulting

Databricks & Snowflake Infrastructure Engineer at NTT DATA | SkillMX | SkillMX