Azure Administration

Infosys

7–9 yrs Bengaluru Full Time Hybrid (office + remote)
Infosys logo
Posted : today
Actively hiring

Job description

Join our Data & Analytics Unit as a Senior Consultant, specializing in Azure Databricks administration. This role is pivotal in managing, optimizing, and ensuring the high availability, security, and performance of enterprise-scale Azure Databricks platforms. You will be instrumental in supporting critical data engineering, analytics, and AI/ML workloads.

We seek a candidate with extensive hands-on experience in Azure Databricks, coupled with a deep understanding of Azure infrastructure, security best practices, and governance. Collaboration with cloud, data, and business teams is essential to deliver a robust and scalable data platform.

Infosys is a global leader in digital transformation, empowering clients across over 50 countries. We leverage AI-powered cores and agile digital capabilities to drive unprecedented performance and customer satisfaction, fostering continuous improvement through digital skills development.

Responsibilities

Key responsibilities include administering Azure Databricks workspaces, configuring clusters, and managing environment setups and upgrades. You will ensure the operational stability of Databricks services, integrating them with other Azure data services like ADLS Gen2 and Azure SQL.

Responsibilities extend to managing network configurations, including VNet injection and private endpoints, while collaborating with Azure networking teams. User access control through Azure Active Directory and implementing data governance via Unity Catalog are crucial. Secure authentication, secrets management using Azure Key Vault, and ensuring compliance with enterprise security and audit requirements are also key.

Cost optimization strategies, including cluster right-sizing and autoscaling, will be a focus, alongside performance tuning and providing usage reports. You will deploy and manage infrastructure using Terraform or ARM templates, support CI/CD pipelines for Databricks artifacts, and automate operational tasks. Monitoring, alerting, troubleshooting, and root cause analysis are essential components of this role, demanding Level 2/3 support within a 24x7 model.

Qualifications

Mandatory technical skills include 7+ years of experience in data platform or cloud administration, with a strong focus on Azure Databricks. Proficiency in Azure services such as ADLS Gen2, Azure Networking, Azure Monitor, and Azure AD is required.

A solid understanding of Apache Spark architecture and performance tuning is essential. Experience managing secure, enterprise-scale Azure Databricks environments and scripting proficiency in Python, PowerShell, or Bash are necessary. Hands-on experience with Infrastructure as Code tools like Terraform or ARM templates is also a requirement.

Preferred qualifications include experience with Unity Catalog, data lineage, governance frameworks, Delta Lake, and CI/CD pipelines. Familiarity with FinOps practices in Azure and relevant Azure certifications are advantageous. Strong analytical, troubleshooting, and communication skills are vital, along with the ability to work independently in a fast-paced, 24x7 support setting.

Essential Skills

Azure DatabricksAzure AdministrationADLS Gen2Azure NetworkingAzure MonitorAzure ADApache SparkPythonPowerShellBash ScriptingTerraformARM Templates

Good to Have

Unity CatalogDelta LakeAzure DevOpsGitHub ActionsFinOps

Highlights

  • Actively hiring

More Details

RoleAzure Administration
DepartmentData & Analytics
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Infosys logo

Infosys

IT Consulting