Strategy Consultant - AI Training & Evaluation (MBB & Top-Tier Firms)

Remote Full-time
Toloka AI supports frontier model post-training by building domain-specific reinforcement learning environments, tasks, and evaluation frameworks designed by real practitioners.

Mindrift, powered by Toloka — a leading enterprise AI and machine learning data partner since 2014 — connects top domain experts with cutting-edge AI initiatives. Backed by Toloka's deep expertise in scalable data generation, crowd technology, and applied ML systems, Mindrift enables experts to shape how next-generation generative models learn, reason, and perform.

We are launching a Management Consulting domain focused on translating real-world consulting engagements into structured learning environments for advanced AI systems. To do this credibly, we are assembling a team of strategy consultants from top-tier firms who can convert authentic project experience into end-to-end examples — from problem structuring and work planning to analysis, synthesis, and client-ready recommendations.

You will join a growing team of consultants from leading strategy firms shaping how AI learns high-level business reasoning.

Important: This role is exclusively for consultants with direct experience at a top-tier strategy consulting firm. If you do not have hands-on project experience at one of the firms listed below, please do not apply. This requirement ensures the domain is built by practitioners trained to the highest standards of structured problem-solving and client delivery.

Eligible firms: McKinsey & Company, Boston Consulting Group (BCG), Bain & Company, Oliver Wyman, Roland Berger, Monitor Deloitte (Deloitte S&C), EY-Parthenon, Kearney, and Strategy& (PwC).

Who We're Looking For

Consultants with 3+ years of experience at one of the firms listed above, with hands-on project experience in:
• Structuring ambiguous client problems into workable analytical plans
• Building financial models, market analyses, or synthesized findings from messy inputs
• Producing client-ready deliverables under time pressure
• Forming and defending recommendations under uncertainty

No deep technical background is required — we will onboard you on the lightweight tools involved.

What You'll Do
• Build realistic consulting project environments — create detailed project scenarios grounded in real engagement dynamics: industry context, financials, constraints, conflicting inputs, and incomplete information
• Design structured consulting tasks for AI agents — break projects into discrete tasks that mirror real consulting work: market sizing, commercial due diligence, cost optimization, growth strategy, operational diagnosis, benchmarking, and more
• Define evaluation criteria and quality standards — develop grading frameworks, evaluation rubrics, and golden-answer solutions for each task, used to train and calibrate an LLM-based grading system that evaluates AI outputs at scale

This is a remote, project-based, individual-contributor role focused on analytical design and evaluation.

Skills & Requirements
• 3+ years at McKinsey, BCG, Bain, Oliver Wyman, Roland Berger, Monitor Deloitte, EY-Parthenon, Kearney, or Strategy&
• Strong structured problem-solving and hypothesis-driven thinking
• Ability to translate vague problems into clear analytical steps and deliverables
• High attention to logical consistency and output quality
• Independent, self-directed working style
• Clear written English (B2+)

Apply Now

Apply Now
Apply Now

Similar Opportunities

Experienced Registered Behavior Technician for In-Home ABA Therapy - Atlanta, GA

Remote Full-time

Immediate Hiring: Experienced Registered Behavioral Technician (RBT) for Clinic-Based ABA Therapy Services

Remote Full-time

Experienced Registered Behavioral Technician (RBT) - ABA Therapy for Children with Autism Spectrum Disorder

Remote Full-time

Experienced Registered Nurse - Telehealth: Providing Remote Care Coordination and Patient Support

Remote Full-time

Experienced Substitute Teacher for Riverside County Schools - Join Scoot Education's Innovative Team

Remote Full-time

Experienced Substitute Teacher for San Bernardino County - Flexible Schedules & Competitive Pay

Remote Full-time

Experienced School Year Instructional Coach for High-Dosage Tutoring Programs in Edgewater Park, NJ

Remote Full-time

Experienced School Year Tutor for K-8 Students in Math and Literacy - Mickleton, NJ

Remote Full-time

Experienced Secondary Social Studies Teacher for Kansas - Flexible Hybrid Remote Arrangement

Remote Full-time

USPS Office Helper

Remote Full-time

Pharmacy Manager | Flexible Hours | Inclusive Community Pharmacy

Remote Full-time

**Part‑Time Remote Chat Support Specialist – Deliver Exceptional Banking Service & Customer Success from Home**

Remote Full-time

Experienced Bilingual Customer Support Specialist - Remote Opportunity Across the US for a Leading Childcare Software Provider

Remote Full-time

Long Term Disability Claims Specialist II

Remote Full-time

(REMOTE) Delta Airlines Work From Home Jobs

Remote Full-time

Part Time Live Chat Customer Support Representative - Remote Opportunity with Walmart

Remote Full-time

SEO Content Editor/Writer

Remote Full-time

Remote Part‑Time / Full‑Time Data Entry Operator – Legal Documentation & Quality‑Control Specialist for arenaflex

Remote Full-time

Enterprise Account Executive – Remote B2B Meal Solutions Sales Leader for DoorDash for Business (North America)

Remote Full-time

Staff Accountant/HR Assistant/Bookkeeper

Remote Full-time
← Back to Home