Databricks Administration
Infosys
Infosys
Join Infosys as a Lead Consultant in our Data & Analytics Unit, focusing on Databricks Administration. This role is pivotal in managing enterprise data and analytics platforms, ensuring robust governance, security, automation, and cost-efficiency for large-scale AI/ML workloads.
This position offers a dynamic environment to define standards and drive the operational maturity of our Databricks ecosystem. You will be instrumental in shaping the future of data platforms within a global organization.
We are committed to fostering an inclusive workplace and provide equal employment opportunities. Come be a part of a company that empowers businesses with agile digital solutions.
As a Databricks Administrator, you will own the administration of Databricks accounts and multi-workspace environments across the SDLC. Key responsibilities include defining and enforcing platform standards, leading Unity Catalog governance, and designing comprehensive monitoring and alerting systems.
You will also manage high-severity incidents, establish security and compliance controls, and drive cost optimization strategies. This includes defining and leading Infrastructure-as-Code and automation initiatives, standardizing CI/CD pipelines, and partnering with cross-functional teams on architectural decisions.
Additional duties involve owning platform documentation, mentoring junior administrators, and providing Tier 2/3 support. You will also administer clusters, jobs, SQL warehouses, and ensure security and governance through RBAC and least-privilege access.
Ideal candidates will possess 9-11 years of experience in Databricks Administration or Big Data Platforms, with a strong emphasis on Databricks Lakehouse architecture, Unity Catalog, and Delta Live Tables. Proficiency in Python, PySpark, and Spark SQL is essential.
We require deep understanding of major cloud platforms like AWS, Azure, or GCP, along with experience in data storage systems (ADLS, S3, Blob Storage). Familiarity with data engineering concepts, ETL/ELT pipelines, and security best practices is also necessary.
A Bachelor of Engineering degree is required. Experience with Apache Spark, performance tuning, and cost optimization for clusters and workloads will be highly valued. Proficiency in SQL and scripting languages is also a key requirement for this role.
Infosys
IT Consulting