Senior AI Architect - Private AI

NTT DATA

10–13 yrs Bengaluru, Chennai, New Delhi, Pune, Hyderabad Full Time Hybrid (office + remote)
NTT DATA logo
Posted : yesterday
Actively hiring

Job description

Join a leading global innovator in business and technology services, renowned for technical excellence and impactful innovations. We foster a diverse and inclusive workplace where growth, belonging, and thriving are paramount. As a Senior AI Architect specializing in Private AI, you will play a pivotal role in designing and implementing enterprise-scale AI and GenAI platforms within private cloud, on-premises, and hybrid settings. This position involves architecture, presales, and delivery, focusing on secure, scalable, and sovereign AI solutions leveraging open-source technologies, self-hosted LLMs, and agentic AI systems. You will serve as a key advisor, guiding AI transformation programs while upholding stringent data privacy, governance, and regulatory compliance standards.

Responsibilities

Design, build, configure, deploy, and troubleshoot enterprise-grade Private AI/GenAI platforms using open-source and self-hosted technologies. Develop high-level and low-level designs, platform blueprints, deployment patterns, and reference architectures for various AI environments. Implement robust LLM, RAG, and agentic AI solutions, including ingestion pipelines, vector databases, tool integrations, and orchestration components. Build and operationalize AI platforms using Kubernetes, containerization, and modern platform engineering. Implement MLOps/LLMOps frameworks for model training, deployment, monitoring, and governance. Deploy, configure, and optimize self-hosted foundation models and enterprise AI workloads, focusing on GPU utilization, quantization, batching, autoscaling, and latency tuning. Develop accelerators and reusable frameworks for Private AI adoption. Lead RFPs, proposals, and estimations for AI engagements. Advise clients on AI strategy, platform modernization, infrastructure readiness, and AI operating models. Collaborate with cross-functional teams, including infrastructure, cloud, security, and data engineering, to establish enterprise AI foundations. Drive POCs, MVPs, and enterprise AI adoption initiatives.

Qualifications

A minimum of 10 to 13 years of IT experience is required, with over 5 years dedicated to AI/ML architecture. Proven experience in delivering enterprise AI/GenAI solutions across private cloud, on-premises, or hybrid environments is essential. Strong expertise in self-hosted LLMs, open-source AI ecosystems, and enterprise AI platforms is a must. Deep knowledge of LLMs, RAG, vector databases, prompt engineering, and agentic frameworks is expected, along with experience in frameworks like LangChain, LlamaIndex, Haystack, or Semantic Kernel. Familiarity with open-source models such as Llama, Mistral, DeepSeek, Qwen, or Falcon is beneficial. Expertise in the MLOps/LLMOps lifecycle and governance, including model evaluation, hallucination testing, tracing, monitoring, and production support, is crucial. Proficiency in Kubernetes, Docker, OpenShift, platform engineering, and distributed systems is required. Experience with AI infrastructure, including GPUs, model serving frameworks, inference optimization, and vector databases, is necessary. Knowledge of data platforms, data pipelines, and enterprise integration architectures is important. Experience with technologies like MLflow, Kubeflow, KServe, Ray, vLLM, or Ollama is preferred. Understanding of quantization, batching, GPU utilization, latency optimization, autoscaling, and high-availability inference design is essential. Familiarity with GPU sizing, NVIDIA stack, CUDA, MIG, distributed inference/training, storage throughput, networking, capacity planning, workload scheduling, and infrastructure readiness assessment is required. Strong knowledge of security, privacy, and sovereign AI controls, including data isolation, zero-trust architecture, IAM/RBAC, encryption, secrets management, audit logging, secure model hosting, tenant isolation, data residency, and regulatory compliance, is critical. Experience in RFPs, proposals, and estimations, coupled with strong stakeholder management and communication skills, is vital.

Essential Skills

AI/ML ArchitectureEnterprise AI ArchitectureGenAI PlatformsPrivate CloudOn-premises AIHybrid AI EnvironmentsOpen-source TechnologiesSelf-hosted LLMsAgentic AI SystemsData PrivacyGovernanceRegulatory ComplianceKubernetesContainerizationPlatform EngineeringMLOpsLLMOpsGPU UtilizationQuantizationBatchingAutoscalingLatency TuningRAGVector DatabasesPrompt EngineeringLangChainLlamaIndexHaystackSemantic KernelLlamaMistralDeepSeekQwenFalconMLflowKubeflowKServeRayvLLMOllamaNVIDIA StackCUDAMIGDistributed InferenceDistributed TrainingStorage ThroughputNetworkingCapacity PlanningWorkload SchedulingZero-Trust ArchitectureIAM/RBACEncryptionSecrets ManagementAudit LoggingSecure Model HostingTenant IsolationData ResidencyRFPsProposalsEstimationsStakeholder ManagementCommunication Skills

Good to Have

NVIDIA AI EnterpriseRed Hat OpenShift AIVMware Private AIAir-gapped AISovereign AI EnvironmentsResponsible AIBFSIHealthcareGovernment

Highlights

  • Actively hiring

More Details

RoleSenior AI Architect - Private AI
DepartmentPre-Sales
Employment TypeFull Time, Hybrid (office + remote)

About the Company

NTT DATA logo

NTT DATA

IT Consulting

Senior AI Architect - Private AI at NTT DATA | SkillMX | SkillMX