Method

Total

4 players

5 players

6 players

Random baseline

0.2086

0.2509

0.2025

0.1657

Frequency baseline

0.2090

0.2931

0.2332

0.2076

Naive CLIP

0.2767

0.3239

0.2661

0.2236

Human, from [3]

0.4782

0.542

0.472

0.410

Keyword model [3]

0.4042

0.443

0.407

0.360

Full model [3]

0.4793

0.523

0.488

0.427

Hint history (max)

0.4590

0.4970

0.4504

0.4207

Hint history (min)

0.2117

0.2497

0.2013

0.1740

Hint history (avg)

0.3180

0.3571

0.3063

0.2604

Hint history (top 5)

0.4995

0.5343

0.4972

0.4619

Hint history (max range)

0.4223

0.4614

0.4304

0.3754