explainx.ai0k
TrendingNewsPathwaysSkills
Pricing
explainx.ai

Upskill in AI — 16 free pathways, live workshops & bootcamps, and 50+ courses from practitioners. Plus the skills, tools, and MCP servers to practice on.

follow us

follow on google

Add explainx.ai as a preferred source

corporate training

support@explainx.ai

get started

Find your pathTake Free Evaluation

learn

mind: share how you thinkpathways — start freeworkshopsbootcampscoursescertificationsmock testsexplainx universitycorporate traininglearn skills & mcp

discover

skillsmcp serversexplainx mcptoolsmdx readeragentsllmsdesignsdictionaryagi trackerfelony benchranks

company

aboutvisionmissionteaminstructorsteach on explainxpartnershipscommunityhackathonscareers

content

daily AI newsstate of AI — live resultsblogreleasespromptsgeneratorsresource libraryfor LLMsexplainx.ai kids

solutions

all solutionsdeveloper upskillingmarketing upskillingproduct manager upskillingleadership upskilling

newsletter · weekly

Get AI news, tools, and insights in your inbox.

supportcontactprivacytermsdata rightshow we create contentsubmission guidelines

© 2026 AISOLO Technologies Pvt Ltd

  1. Home
  2. /
  3. Dictionary
  4. /
  5. Adaptive Exploration Bias
Safety & Alignmentaka exploration-exploitation biasaka emergent stratification bias

Adaptive Exploration Bias

Adaptive exploration bias is when an AI agent invents a systematic bias toward or against a group or option purely from under-exploring during sequential decision-making, even when no real difference between the options exists.

Ask Melo about this← all terms

The term comes from the ICML 2026 spotlight paper "Large Language Models Develop Novel Social Biases Through Adaptive Exploration" (Wu, Liu, Bai, Griffiths; Princeton/Stanford), which had LLMs play a repeated hiring-decision game across four fictional demographic groups with identical success rates. Models still stratified applicants by group, overgeneralizing from early random outcomes and then exploiting that impression instead of continuing to sample — a failure mode borrowed from human decision-making research (the "hot stove effect"). Unlike training-data bias, this bias has no origin in the model's training corpus; it is generated live by insufficient exploration during a sequential task, and the paper found it gets worse, not better, with newer and larger models. Classical bandit algorithms like UCB and Thompson Sampling, which explore more systematically, show far less of it on the same task.

Related terms

Bias MitigationReward HackingSampling BiasAI EthicsCapability ControlExistential Risk from AI