PsychBench — AI Psychology Benchmark

PsychBench evaluates how frontier AI models think under pressure. Using poker as a controlled environment, we analyze 47 models from 9 providers across 5,135+ games and 100,000+ individual decisions. Our ECAAMS framework classifies 19 psychological dimensions from each model's visible reasoning summaries.

Heads-Up Tournament Leaderboard

RankModelEloObserved Win Rate
1Claude Fable 5160959.1346%
2GPT-6.1 Terra160058.125%
3Muse Wonder 1.0157854.375%
4GPT-6 Astra157357.7381%
5Muse Spark 1.1157151.9481%
6GPT-5.6 Terra156150.6608%
7Grok 4.5156054.6053%
8ChatGPT 5.2154959.9138%
9Claude Opus 4.8154851.699%
10Gemini 3.5 Flash Lite154148.9583%
11GPT-6 Sol153951.875%
12Claude Sonnet 4.6153758.9958%
13GPT-6.1 Sol153653.75%
14Claude Opus 4.5153560.0917%
15Claude Opus 4.6153458.1967%
16GPT-5.6 Sol153458.7342%
17Claude Opus 4.7153458.2677%
18ChatGPT 5.4153357.8512%
19ChatGPT 5.5152254.7468%
20Grok 4.7152152.5%
21Gemini 4 Argon151950.625%
22GPT-5.6 Luna151356.3855%
23Claude Sonnet 5150548.9796%
24Grok 4.2150053.5849%
25Claude Opus 5.5149548.75%
26Muse Spark 1.2149148.125%
27Gemini 3.6 Flash149051.7857%
28Claude Sonnet 5.5148549.375%
29Grok 4.1148153.8095%
30Gemini 3.8 Flash146446.875%
31DeepSeek V4 Pro145947.2973%
32Grok 4.3145148.9286%
33GPT-6 Luna142741.6667%
34Claude Haiku 5.5142439.881%
35Gemini 3.5 Flash142247.7941%
36DeepSeek v3.2140743.3628%
37Kimi K2.6140442.5234%
38Qwen3-235B Thinking139743.3628%
39Gemini 3.1 Pro139340.7834%
40Gemini 3.1 Flash Lite138633.9286%
41GLM-5.2136848.1818%
42Gemini 3 Pro136838.3333%
43Kimi K2.5136738.8889%
44GLM-5136338.5%
45Qwen3-Max Thinking132733.1731%
46Qwen3.5-397B131831.5534%
47Qwen3.6-35B-A3B131335.4167%

ECAAMS Psychological Framework

ECAAMS (Emotion, Cognition, Action, Arousal, Meaning, Social) classifies 19 psychological dimensions across 6 axes from each model's visible reasoning summaries. Dimensions include emotional regulation, metacognition, confidence calibration, theory of mind, competitive framing, and more. Each trace is classified using the rater panel documented for its cohort.

Why Poker?

Poker involves hidden information, deception, risk management, and opponent modeling — unlike chess or other perfect-information games. These properties make it an ideal proxy for real-world decision-making under uncertainty, in domains like finance, negotiation, and medicine.