Join Boston Consulting Group's pioneering team as an AI/ML Engineer Manager, contributing to transformative Gen AI initiatives. BCG, a leader in business strategy, empowers organizations through a blend of digital and human capabilities, fostering innovation and competitive advantage. This role is integral to developing a Generative AI assistant designed to revolutionize BCG's operational landscape. You will be part of a dynamic LLM Squad, collaborating with experts to advance cutting-edge AI products and drive significant business impact.

As a key member of the LLM Squad, you will champion the design, development, and optimization of Generative AI products. Your expertise will be crucial in enhancing Squad performance and contributing to the overall success of our AI aspirations. This position offers a unique opportunity to work across the full spectrum of LLM-based applications, from core LLM engineering and data science to backend development and API integration, ensuring robust and stable custom-built solutions.

Key responsibilities include the continuous development of your technical acumen, staying abreast of the latest industry trends and innovations in AI/ML and LLMs. You will also actively share your knowledge and expertise within your team and across the organization, aligning with technical roadmaps and best practices. A core part of this role involves contributing to your Squad's mission by driving tasks forward based on product owner priorities and collaborating cross-functionally to achieve impactful results.

Furthermore, you will identify and articulate technical resource needs, suggesting solutions to bridge any gaps, whether through personal contribution, training, or advocating for new talent. Embracing and supporting the organization's evolving working models, including Agile practices, is essential. You will foster a positive and collaborative team culture, embodying the values of innovation and shared success.

We are seeking candidates with a BA degree in Computer Science, Statistics, or a related field, with a strong focus on Artificial Intelligence, Machine Learning, or Natural Language Processing. A minimum of 2 years of experience in developing and experimenting with Large Language Models (LLMs) is required, alongside 3+ years of experience in developing AI/ML technologies for large-scale, business-critical applications.

Mandatory skills include proficiency in Python and associated Data Science libraries, strong knowledge of AI, machine learning, and natural language processing principles. Experience with leveraging, training, and fine-tuning Foundation Models, including multimodal inputs and outputs, is essential. Proficiency with key LLM model APIs (e.g., OpenAI, Anthropic) and LLM Frameworks like LangChain and LlamaIndex is crucial. Familiarity with multi-agent frameworks/systems and their application in complex problem-solving scenarios is also required. Experience with libraries like unstructured.io for handling diverse document formats and extracting structured information, along with expertise in using LlamaIndex for building and querying knowledge bases, is expected. Knowledge of effective text chunking techniques and proficiency in generating and working with text embeddings (e.g., BERT, GPT) are important. Experience in constructing and querying knowledge graphs using technologies like Neo4j or RDF triplestores, and a solid understanding of RAG concepts and fundamentals (vector databases, semantic search) are key requirements. Nice-to-have skills include experience with cloud infrastructure for AI/ML, LLM guardrails, monitoring, and observability, as well as LLM security.