Strategy Consultant – AI Training & Evaluation (MBB & Top-Tier Firms)

Strategy Consultant – AI Training & Evaluation (MBB & Top-Tier Firms)

Mindrift, powered by Toloka, is seeking experienced strategy consultants to join a new domain focused on translating real-world consulting engagements into structured learning environments for advanced AI systems. This is a unique opportunity to leverage your consulting expertise to shape how next-generation generative models learn, reason, and perform.

As a Strategy Consultant, you will play a crucial role in building realistic consulting project environments and designing structured tasks for AI agents. You will define evaluation criteria and quality standards to train and calibrate an AI grading system. This is a remote, project-based, individual contributor role.

About Mindrift & Toloka: Mindrift, backed by Toloka's deep expertise in scalable data generation and applied ML systems, connects top domain experts with cutting-edge AI initiatives. Toloka AI supports frontier model post-training by building domain-specific reinforcement learning environments, tasks, and evaluation frameworks.

Key Responsibilities

• Build realistic consulting project environments, creating detailed scenarios grounded in real engagement dynamics, including industry context, financials, constraints, and incomplete information.
• Design structured consulting tasks for AI agents, breaking down projects into discrete tasks that mirror real consulting work (e.g., market sizing, commercial due diligence, cost optimization, growth strategy).
• Define evaluation criteria and quality standards, developing grading frameworks and golden-answer solutions to train an LLM-based grading system.

Requirements

This role is exclusively for consultants with direct experience at a top-tier strategy consulting firm.

• Minimum of 3 years of experience at one of the following firms: McKinsey & Company, Boston Consulting Group (BCG), Bain & Company, Oliver Wyman, Roland Berger, Monitor Deloitte, EY-Parthenon, Kearney, or Strategy&.
• Hands-on project experience in:
  • Structuring ambiguous client problems into workable analytical plans.
  • Building financial models, market analyses, or synthesizing findings from complex data.
  • Producing client-ready deliverables under time pressure.
  • Forming and defending recommendations under uncertainty.
• Strong structured problem-solving and hypothesis-driven thinking skills.
• Ability to translate vague problems into clear analytical steps and deliverables.
• High attention to logical consistency and output quality.
• Independent, self-directed working style.
• Clear written English (B2+).
• No deep technical background is required; onboarding on relevant tools will be provided.

What We Offer

• Compensation: Up to $60 per hour equivalent, depending on your level and pace of contribution.
• Work Model: Fully remote.
• Contract Type: Contract-based project work.
• Impact: Contribute to shaping the future of AI by building high-quality training data for advanced AI systems.
• Flexibility: Work on a project basis, allowing for a flexible schedule.