MBB Consultant - AI Consulting Simulation and Evaluation

Remote Full-time
Toloka AI supports frontier model post-training by building domain‑specific reinforcement learning environments, tasks, and evaluation frameworks designed by real practitioners.

Mindrift, powered by Toloka — a leading enterprise AI and machine learning data partner since 2014 — connects top domain experts with cutting‑edge AI initiatives. Backed by Toloka’s deep expertise in scalable data generation, crowd technology, and applied ML systems, Mindrift enables experts to shape how next‑generation generative models learn, reason, and perform.

We are now launching a Management Consulting domain focused on translating real‑world consulting engagements into structured learning environments for advanced AI systems. To do this credibly, we are building a team of former McKinsey, BCG, and Bain consultants who can convert authentic project experience into end‑to‑end examples — from problem structuring and work planning to analysis, synthesis, and client‑ready recommendations.

You will join a team of ex‑McKinsey and Bain consultants shaping how AI learns high‑level business reasoning.

Important: This role is exclusively for consultants with MBB experience (McKinsey, BCG, or Bain). If you do not have direct experience at one of these firms, please do not apply. This requirement is non‑negotiable and helps us ensure the domain is built by practitioners with firsthand MBB training and standards.

Who We're Looking For

Consultants with 3+ years of experience at McKinsey & Company, Boston Consulting Group, or Bain & Company.

You should have hands‑on project experience:
• Structuring ambiguous client problems
• Building models and synthesized findings
• Producing client‑ready deliverables
• Forming recommendations under uncertainty

No deep technical background required, we’ll onboard you on the lightweight tools involved.

What You’ll Do
• Build realistic consulting project environments: create detailed project scenarios (industry context, financials, constraints, incomplete information)
• Design structured consulting tasks for AI Agents: break projects into tasks that mirror real consulting work such as market sizing, due diligence, cost reduction, growth strategy, or operational diagnosis
• Define evaluation criteria and quality standards: develop a grading approach, evaluation criteria and golden solutions for each task that will be used to train and calibrate an LLM‑based grading system that evaluates AI outputs at scale

This is a remote individual‑contributor project‑based role focused on analytical design and evaluation.

Skills & Requirements
• 3+ years at McKinsey, BCG, or Bain
• Strong structured problem‑solving skills
• Ability to translate vague problems into clear analytical steps
• High attention to logical consistency
• Independent working style
• Clear written English (B2+)

Apply Now

Apply Now
Apply Now

Similar Opportunities

Experienced Registered Behavior Technician for In-Home ABA Therapy - Atlanta, GA

Remote Full-time

Immediate Hiring: Experienced Registered Behavioral Technician (RBT) for Clinic-Based ABA Therapy Services

Remote Full-time

Experienced Registered Behavioral Technician (RBT) - ABA Therapy for Children with Autism Spectrum Disorder

Remote Full-time

Experienced Registered Nurse - Telehealth: Providing Remote Care Coordination and Patient Support

Remote Full-time

Experienced Substitute Teacher for Riverside County Schools - Join Scoot Education's Innovative Team

Remote Full-time

Experienced Substitute Teacher for San Bernardino County - Flexible Schedules & Competitive Pay

Remote Full-time

Experienced School Year Instructional Coach for High-Dosage Tutoring Programs in Edgewater Park, NJ

Remote Full-time

Experienced School Year Tutor for K-8 Students in Math and Literacy - Mickleton, NJ

Remote Full-time

Experienced Secondary Social Studies Teacher for Kansas - Flexible Hybrid Remote Arrangement

Remote Full-time

USPS Office Helper

Remote Full-time

Senior Manager, US Operations Lead - Walmart Field Sales

Remote Full-time

Registered Nurse (RN) - Telehealth - $35-55 per hour - Now Hiring

Remote Full-time

Remote Customer Service Chat Support for a Major Walmart Vendor ($32/hour) in The Bronx, NY in Remote Job Team

Remote Full-time

Join Today: Assisted Living Coordinator

Remote Full-time

Experienced Senior Manager, Customer Experience Strategy, Insights, and Programs – Driving Business Growth through Data-Driven Decision Making at blithequark

Remote Full-time

Sr Product Manager, Learning Management

Remote Full-time

Home Office Hero – Amazon Remote Fulfillment Assistance Specialist – USA Remote Jobs

Remote Full-time

**Experienced Data Entry Payroll Clerk – Heavy Industrial Construction and Maintenance Services**

Remote Full-time

Accounts Payable Specialist job at Perry Homes in Houston, TX

Remote Full-time

Rotech Healthcare – Patient Care Customer Service Evenings & Weekends REMOTE – Murray, KY

Remote Full-time
← Back to Home