Databricks Administration
Infosys
Infosys
Join Infosys as a Senior Consultant in our Data & Analytics Unit, focusing on Databricks Administration. This role is crucial for managing and enhancing enterprise data and analytics platforms. You will be instrumental in driving platform governance, security, automation, and cost management to support large-scale analytics and AI/ML initiatives.
This position offers the opportunity to shape the future of data infrastructure within a global leader in digital services. You will collaborate with cross-functional teams and contribute to the operational maturity and innovation of our data platforms.
Key responsibilities include owning Databricks account administration across multiple workspaces and SDLC phases, defining and enforcing platform standards for clusters, jobs, and configurations. You will lead the Unity Catalog governance strategy, design monitoring and alerting systems, and manage high-severity incidents. Additionally, you'll drive cost optimization, develop automation strategies using Infrastructure-as-Code, and standardize CI/CD and DevOps practices. Mentoring junior administrators and acting as a senior technical escalation point are also vital aspects of this role.
We are looking for candidates with 7-9 years of experience in Databricks Administration or Big Data Platforms. Strong hands-on expertise with Databricks (Workspace, Clusters, Jobs, Notebooks) and Apache Spark (PySpark/Scala) is essential. A deep understanding of cloud platforms, particularly Azure, along with experience in data storage systems like ADLS, S3, or Blob Storage is required. Familiarity with data engineering concepts, ETL/ELT pipelines, and proficiency in SQL and scripting languages like Python and Shell are also necessary. Experience in performance tuning and cost optimization is a significant advantage.
Infosys
Information Technology & Services