Method | Total | 4 players | 5 players | 6 players |
Random baseline | 0.2086 | 0.2509 | 0.2025 | 0.1657 |
Frequency baseline | 0.2090 | 0.2931 | 0.2332 | 0.2076 |
Naive CLIP | 0.2767 | 0.3239 | 0.2661 | 0.2236 |
Human, from [3] | 0.4782 | 0.542 | 0.472 | 0.410 |
Keyword model [3] | 0.4042 | 0.443 | 0.407 | 0.360 |
Full model [3] | 0.4793 | 0.523 | 0.488 | 0.427 |
Hint history (max) | 0.4590 | 0.4970 | 0.4504 | 0.4207 |
Hint history (min) | 0.2117 | 0.2497 | 0.2013 | 0.1740 |
Hint history (avg) | 0.3180 | 0.3571 | 0.3063 | 0.2604 |
Hint history (top 5) | 0.4995 | 0.5343 | 0.4972 | 0.4619 |
Hint history (max range) | 0.4223 | 0.4614 | 0.4304 | 0.3754 |