Global IT LLM Engineer – Senior Manager

Who We Are

Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business strategy when it was founded in 1963. Today, we help clients with total transformation-inspiring complex change, enabling organizations to grow, building competitive advantage, and driving bottom-line impact.

To succeed, organizations must blend digital and human capabilities. Our diverse, global teams bring deep industry and functional expertise and a range of perspectives to spark change. BCG delivers solutions through leading-edge management consulting along with technology and design, corporate and digital ventures—and business purpose. We work in a uniquely collaborative model across the firm and throughout all levels of the client organization, generating results that allow our clients to thrive.

What You'll Do

BCG Legal has been on a Generative AI journey to transform internal operations powered through cutting edge Generative AI technologies are core to this journey. Thus, we are looking for Generative AI engineers who are passionate about designing, developing, deploying and optimizing Gen AI products at scale.

This role will be hosted in Legal digital products team to support building key prioritized Generative AI solutions for achieving Legal operations AI/Gen AI vision.

Key Responsibilities-

You will work as a squad member with strong hands on Gen AI expertise and will guide the product owners, digital leaders in conceptualizing new Gen AI products or embedding Gen AI as part of existing products in most optimum manner. You will be an individual contributor (IC) to develop the Gen AI products along with broader squad members as well as guiding other Gen AI/LLM engineers or data scientists developing Gen AI applications.

Along with core Generative AI expertise, you will bring expertise in full backend development in technologies like python, typescript including REST, GraphQL etc. APIs development, core functional logic, performance, and stability of custom-built products.

Among Your Responsibilities, You Will

Conceptualize Generative AI custom products at BCG internally & operate as a technical thought partner for digital leaders and product owners.

Combine data science & engineering expertise in building Generative AI products

Develop Gen AI products as individual contributors (IC) to develop scalable high performance enterprise products along with broader squad

Share expertise and recommendations on alternate approaches & tools to improve product

Collaborate closely with data engineers, data scientists, software engineers, QA, product owners and analysts develop seamless end to end integrated products

Build strong relationships with business stakeholders, ensuring alignment on project goals and successful integration of products into business processes

Oversee & mentor other LLM/AI engineers, data scientists in the project on Gen AI expertise

Share Gen AI knowledge & expertise across with broader digital teams squads, chapters, CoEs

Regularly ramp up on latest LLMs, technologies, frameworks & platforms in the Gen AI space.

What You'll Bring

• Overall 9+ years of experience in engineering, machine learning & LLMs
• 6+ years of hands-on experience in building & deploying AI/ML/Gen AI solutions in large business critical applications
• 2+ years of experience in developing Gen AI products using variety of LLMs & frameworks
• Advanced proficiency in Python for data science, engineering & LLMs
• Highly curious technically to evaluate & test new technologies in Gen AI space
• Proven ability to work with large structured & unstructured datasets and deploy AI/ML/Gen AI solutions through automated pipelines
• Experience with leveraging, training and fine-tuning Foundation Models including multimodal inputs and outputs
• Strong experience working with key LLM models APIs (e.g. OpenAI, Anthropic) and LLM Frameworks (e.g. LangChain, LlamaIndex)
• Proficiency in generating and working with embeddings across variety of data formats. Understanding of embedding spaces and their applications in semantic search and information retrieval.
• Knowledge of effective text chunking techniques for optimal processing and indexing of large documents or datasets.
• Expertise with RAG concepts and fundamentals (vectorDBs, semanticsearch, re-rankers etc.), Expertise in implementing RAG systems that combine knowledge bases
• Experience with multi-agent frameworks/systems and an understanding of multi-agent systems and their applications in complex problem-solving scenarios
• Experience in working with variety of data bases (SQL, no SQL) , APIs & microservices development
• Experience with LLMOps tools (e.g. Langsmith) to implement guardrails, track accuracy, hallucinations, bias and other metrics in Gen AI products
• Experience in constructing and querying knowledge graphs including graph-based reasoning.
• Experience in front end development technologies (e.g. REACT) would be good to have
• Excellent communication skills, with the ability to explain complex technical concepts to various audiences
• Proven ability to operate with a transparent mindset, communicating openly with stakeholders at various levels of the organization
  
  

Who You'll Work With

As a pivotal member of the team, you will interact extensively with a diverse range of stakeholders from across the functions both geographically and functionally.

Boston Consulting Group is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, age, religion, sex, sexual orientation, gender identity / expression, national origin, disability, protected veteran status, or any other characteristic protected under national, provincial, or local law, where applicable, and those with criminal histories will be considered in a manner consistent with applicable state and local laws.

BCG is an E - Verify Employer. Click here for more information on E-Verify.