BCG Platinion | Principal AI Tech Architect - AI Platforms
BCG
BCG
BCG Platinion seeks Principal AI Tech Architects to lead the design and evolution of next-generation intelligent agentic systems. This role combines high-level system design with hands-on AI engineering, perfect for individuals who can envision complex AI-enabled ecosystems and prototype solutions. You will collaborate across AI, data, product, and engineering teams to define scalable architectures for AI-driven applications, seamlessly integrating large language models (LLMs), data pipelines, and enterprise systems.
This is an opportunity to join a rapidly growing practice at BCG, driving significant digital transformation for clients. You will be instrumental in developing innovative solutions and pushing the boundaries of what's possible in AI and digital journeys.
Architect AI and LLM-based solutions for scalability and low latency, including agentic AI for business workflow automation using techniques like RAG, memory, and task planning. Establish architectural blueprints, design principles, and governance for model versioning, data lineage, and responsible AI. Design polyglot model runtimes and hybrid pipelines, optimizing for cost, latency, and risk.
Develop prototypes and proofs-of-concept to validate model architectures and AI flows. Evaluate emerging AI frameworks and tools, and build solutions with agentic orchestration engines. Support IT process restructuring for new system adoption and oversee system performance, observability, and governance in production environments. Optimize AI development processes by defining standards for model versioning, testing, and monitoring (LLMOps).
Communicate complex AI concepts through compelling narratives and impactful presentations to both technical and non-technical audiences. Build collaboration, mentor teams, and share knowledge to drive collective success. Facilitate technical and strategic working sessions, providing direction and mentorship to engineering teams on best practices. Manage junior team members, organizing their work, providing feedback, and ensuring quality assurance. Foster a positive team environment and serve as a role model for BCG's culture and values.
A Bachelor's degree in a relevant field such as Information Technology, Business Administration, Computer Science, Information Systems, or System Controls & Engineering is required; a Master's degree is a plus. You should have 10+ years of technology consulting or software engineering experience, with over 5 years in an architecture discipline. A strong foundation in software architecture and distributed systems design is essential, alongside proven experience designing or scaling AI/ML or LLM-based applications.
Proficiency in programming languages like Python, JavaScript, or TypeScript, and familiarity with modern AI frameworks such as LangChain, LangGraph, or LlamaIndex are necessary. A solid understanding of Agentic AI capabilities, RAG, vector databases, and cloud architectures on platforms like AWS, Azure, or Google Cloud is expected. Experience with containerization technologies like Docker and Kubernetes, and AI coding tools is also beneficial.
BCG
Management Consulting