AI / LLM Engineer

Infosys

10–18 yrs Pune Full Time Hybrid (office + remote)
Infosys logo
Posted : today
Actively hiring

Job description

Shape enterprise-wide AI capabilities by developing AI-enabled features for summaries, narratives, recommendations, retrieval, and governed human review.

Collaborate closely with architects, product teams, data engineers, backend engineers, security, QA, and domain specialists to transform AI concepts into robust, production-ready software.

This role is crucial in bridging the gap between advanced AI research and practical application within a large-scale platform.

Responsibilities

Design and implement LLM-driven workflows for tasks like summarization, narrative generation, classification, extraction, contextual reasoning, and reviewer assistance.

Develop retrieval-augmented generation (RAG) pipelines, encompassing document ingestion, chunking, embedding creation, vector indexing, and response grounding.

Build reusable prompt templates, manage prompt versions, develop context builders, define response schemas, and create AI orchestration services.

Integrate with leading enterprise AI services such as Azure OpenAI, Google Gemini, or Anthropic.

Implement comprehensive AI run logging, capture prompt and model metadata, ensure evidence citation, and establish human-in-the-loop controls for AI outputs.

Develop AI evaluation routines to assess answer quality, retrieval accuracy, hallucination rates, and ensure consistency and groundedness.

Work with backend and DevOps teams to containerize AI services, deploy them securely, monitor usage, manage costs, and resolve production issues.

Uphold responsible AI practices, including prompt injection checks, data leakage prevention, policy enforcement, and AI output validation.

Qualifications

Requires a minimum of 10-18 years of experience in software engineering, AI/ML engineering, applied ML, or data science engineering.

Possess strong hands-on Python programming skills and practical experience in developing LLM-based applications.

Demonstrated experience with RAG, vector databases, embeddings, prompt engineering, evaluation frameworks, and AI service integration is essential.

Familiarity with frameworks like LangChain, LangGraph, LlamaIndex, Semantic Kernel, AutoGen, or CrewAI is highly desirable.

Working knowledge of REST APIs, microservices, SQL, structured data, Git workflows, testing, and general software engineering best practices is required.

Understanding of document extraction, semantic search, NLP, retrieval quality, hallucination risks, prompt safety, and AI evaluation methods is expected.

Ability to create production-grade AI components, not just proof-of-concept demos, is critical.

A Master of Engineering or Bachelor of Engineering degree is required.

Essential Skills

PythonLLMRAGVector DatabasesEmbeddingsPrompt EngineeringAI Service IntegrationREST APIsMicroservicesSQLGitNLPAgent EngineeringAI/ML Solution Architecture

Good to Have

Azure OpenAIAzure AI FoundryAzure AI SearchAzure Document IntelligenceGoogle AI Studio/GeminiAWS BedrockVertex AIRAGASDeepEvalPromptfooLangSmithAI GovernanceAI Audit LogsExplainabilityGroundedness Checks

Highlights

  • Actively hiring

More Details

RoleAI / LLM Engineer
DepartmentAI / Machine Learning
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Infosys logo

Infosys

IT Consulting

AI / LLM Engineer at Infosys | SkillMX | SkillMX