Azure databricks Platform Admin
Infosys
Infosys
Join our Data & Analytics Unit as a Senior Consultant and play a pivotal role in architecting and optimizing cutting-edge big data solutions on Azure Databricks. This is an exciting opportunity to leverage your expertise in cloud data platforms and drive innovation within a leading organization.
Architect and optimize big data pipelines using Apache Spark, Delta Lake, and Databricks-native tools. Design scalable data ingestion and transformation workflows, including batch and streaming (e.g., Kafka, Spark Structured Streaming). Develop integration guidelines for Databricks security and data access control. Implement robust data security and governance using Unity Catalog and access controls. Support the migration of legacy systems to Databricks on cloud platforms (Azure, AWS, GCP). Manage cloud platform operations, focusing on FinOps, cost optimization, and multi-cloud governance.
Provide technical advisory services to data engineering and analytics teams, guiding best practices and performance tuning. Collaborate with architects and business stakeholders to align Databricks solutions with enterprise goals. Lead proof-of-concept initiatives to showcase Databricks capabilities. Mentor junior engineers and foster knowledge sharing. Contribute to platform adoption strategies through training, documentation, and evangelism. Stay abreast of Databricks innovations and recommend architectural enhancements.
Infosys
IT Consulting