Databricks Administration

Infosys

7–9 yrs Bengaluru Full Time Hybrid (office + remote)
Infosys logo
Posted : today
Actively hiring

Job description

Join Infosys as a Senior Consultant in our Data & Analytics Unit, focusing on Databricks Administration. This role is crucial for managing and enhancing enterprise data and analytics platforms. You will be instrumental in driving platform governance, security, automation, and cost management to support large-scale analytics and AI/ML initiatives.

This position offers the opportunity to shape the future of data infrastructure within a global leader in digital services. You will collaborate with cross-functional teams and contribute to the operational maturity and innovation of our data platforms.

Responsibilities

Key responsibilities include owning Databricks account administration across multiple workspaces and SDLC phases, defining and enforcing platform standards for clusters, jobs, and configurations. You will lead the Unity Catalog governance strategy, design monitoring and alerting systems, and manage high-severity incidents. Additionally, you'll drive cost optimization, develop automation strategies using Infrastructure-as-Code, and standardize CI/CD and DevOps practices. Mentoring junior administrators and acting as a senior technical escalation point are also vital aspects of this role.

Qualifications

We are looking for candidates with 7-9 years of experience in Databricks Administration or Big Data Platforms. Strong hands-on expertise with Databricks (Workspace, Clusters, Jobs, Notebooks) and Apache Spark (PySpark/Scala) is essential. A deep understanding of cloud platforms, particularly Azure, along with experience in data storage systems like ADLS, S3, or Blob Storage is required. Familiarity with data engineering concepts, ETL/ELT pipelines, and proficiency in SQL and scripting languages like Python and Shell are also necessary. Experience in performance tuning and cost optimization is a significant advantage.

Essential Skills

DatabricksSparkPySparkSQLPythonCloud PlatformsAWSAzureGCPUnity CatalogDelta Live TablesServerless SQLTerraformCI/CDDevOpsDatabricks Asset BundlesData StorageADLSS3Blob StorageETLELTIAMShell Scripting

Highlights

  • Actively hiring

More Details

RoleDatabricks Administration
IndustryInformation Technology & Services, Data Analytics, Cloud Computing
DepartmentData Engineering, Cloud Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Infosys logo

Infosys

Information Technology & Services

Databricks Administration at Infosys | SkillMX | SkillMX