T&T | EAD | HCE | Senior Consultant | AI Infrastructure On Prem | Pan India (Bengaluru, IN)

Deloitte

5–9 yrs Bengaluru Full Time Hybrid (office + remote)
Deloitte logo
Posted : today
Actively hiring

Job description

Join Deloitte's Technology & Transformation practice and help businesses leverage their data through advanced AI infrastructure. This role focuses on designing, building, and managing cutting-edge NVIDIA GPU-based AI infrastructure within enterprise data centers, private clouds, and hybrid environments. You will be instrumental in unlocking the value hidden within vast data sets, enabling fact-driven decision-making and a significant insight-driven advantage for clients.

The team specializes in business intelligence, data management, performance management, and next-generation technologies like big data, cloud, cognitive computing, and machine learning.

Responsibilities

Key responsibilities include leading the deployment of GPU clusters, compute, high-speed networking, and storage infrastructure. You will implement Kubernetes/OpenShift and/or Slurm for efficient GPU orchestration and resource management. Integrating NVIDIA AI technologies such as CUDA, NCCL, NIM, NeMo, and Triton is crucial. This role also involves driving infrastructure automation, optimizing performance, capacity planning, ensuring security, and managing platform operations. Collaboration with compute, network, storage, cloud, and MLOps teams is essential for delivering scalable AI solutions.

Qualifications

Ideal candidates will possess 5–9 years of experience in AI infrastructure, cloud, HPC, SRE, or platform engineering, with hands-on expertise in NVIDIA GPU infrastructure, AI data centers, and GPU cluster deployment. A Bachelor's or Master's degree in Computer Science, IT, Engineering, or a related field is preferred. Relevant certifications in NVIDIA, Kubernetes, Red Hat, or Linux are advantageous. The position is based in Bengaluru, India, with a hybrid work model.

Essential Skills

NVIDIA GPU InfrastructureDGX/HGXAI Data CentersGPU Cluster DesignCompute InfrastructureStorage InfrastructureHigh-Speed NetworkingInfiniBandSpectrum-X EthernetRoCEKubernetesOpenShiftSlurmGPU SchedulingNVIDIA CUDANCCLNIMNeMoTritonDCGMLinuxContainersGPU DriversFirmware ManagementAI WorkloadsHPC WorkloadsDistributed TrainingInferenceData Center Power ManagementData Center CoolingRack DesignPlatform Operations

Good to Have

NVIDIA CertificationsKubernetes CertificationsRed Hat CertificationsLinux Certifications

Highlights

  • Actively hiring

More Details

RoleT&T | EAD | HCE | Senior Consultant | AI Infrastructure On Prem | Pan India (Bengaluru, IN)
IndustryTechnology
DepartmentInformation Technology, Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Deloitte logo

Deloitte

Technology