T&T | EAID | Engineering | Azure Integration | Senior Consultant | Bangalore (Bengaluru, IN)

Deloitte

5–12 yrs Bengaluru Full Time Hybrid (office + remote)
Deloitte logo
Posted : today
Actively hiring

Job description

Join Deloitte's Technology & Transformation practice, a leader in leveraging data to drive strategic advantage. We empower organizations to unlock the value within vast datasets, converting information into actionable insights for informed decision-making. Our practice spans business intelligence, data management, performance management, and advanced analytics, including big data, cloud, cognitive, and machine learning.

India is a significant player in the global economy, and Deloitte offers a platform to collaborate with cutting-edge leaders and organizations shaping the future. Bring your whole self to work and harness our drive to propel with purpose, creating a perfect environment for collaboration, innovation, growth, and impactful contributions.

Responsibilities

- Develop and maintain scalable data engineering solutions using Databricks, PySpark, and SQL for enterprise data platforms. - Design, implement, and optimize secure, scalable, reliable, and performance-driven data architectures. - Build and manage data pipelines for structured, semi-structured, and unstructured data from multiple sources. - Develop and support batch and near real-time data processing using Databricks and Spark. - Implement and manage Databricks capabilities including Delta Lake, DLT, Workflows, Serverless Compute, Unity Catalog, Genie, Mosaic AI, and the Data Intelligence Platform. - Design and develop data solutions following Lakehouse, Medallion, Data Warehouse, and Data Mart standards. - Optimize Spark jobs, SQL queries, clusters, and pipelines for performance, scalability, reliability, and cost efficiency. - Manage and monitor Databricks clusters, resource utilization, and workload performance. - Collaborate with stakeholders to understand business requirements and translate them into technical solutions. - Define and implement enterprise data governance, security, access controls, lineage, and compliance within Databricks. - Leverage cloud-native services on Azure, AWS, or GCP for integrated, scalable data solutions. - Develop and deploy code using GitHub, CI/CD pipelines, and Agile methodologies. - Work with large-scale datasets while implementing robust security, data quality, and performance optimization. - Perform system integration and end-to-end testing. - Analyze, troubleshoot, and resolve defects and production incidents promptly.

Qualifications

- Bachelor’s or master’s degree in any field; B.E/B.Tech preferred. - 5+ years of relevant experience in designing, implementing, and maintaining data solutions on Databricks. - Experience with Azure, AWS, or GCP cloud platforms. - Proficiency in ETL/ELT processes, data warehousing, and data modelling concepts. - Strong command of Python and SQL. - Hands-on experience with Delta Lake. - Understanding of DevOps principles and practices. - Excellent problem-solving, troubleshooting, communication, and teamwork skills. - Experience with Databricks, PySpark, SQL, Delta Lake, Delta Live Tables (DLT), Unity Catalog/Data Governance, Databricks Workflows, and Serverless Compute. - Familiarity with Genie, Mosaic AI, and the Databricks Data Intelligence Platform capabilities. - Solid understanding of Data Architecture, Data Modelling, Lakehouse Architecture, Data Warehousing, and the Medallion Framework. - Experience with GitHub, CI/CD pipelines, Agile delivery, and DevOps practices. - Strong analytical, troubleshooting, and performance optimization skills. - Excellent stakeholder management and business requirement gathering capabilities. - Ability to take ownership of performance and cost optimization initiatives.

Essential Skills

DatabricksPySparkSQLAzureAWSGCPDelta LakeDelta Live Tables (DLT)Unity CatalogData GovernanceDatabricks WorkflowsServerless ComputeGenieMosaic AIDatabricks Data Intelligence PlatformData ArchitectureData ModellingLakehouse ArchitectureData WarehousingMedallion FrameworkGitHubCI/CD pipelinesAgileDevOpsPython

Highlights

  • Actively hiring

More Details

RoleT&T | EAID | Engineering | Azure Integration | Senior Consultant | Bangalore (Bengaluru, IN)
IndustryTechnology
DepartmentEngineering, Information Technology
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Deloitte logo

Deloitte

Technology

T&T | EAID | Engineering | Azure Integration | Senior Consultant | Bangalore (Bengaluru, IN) at Deloitte | SkillMX | SkillMX