| Experiment one | Experiment two | ||||||||
| Probability | Reward | Probability | Reward | Arm | Probability | Reward | Probability | Reward | Arm |
| 0.426 | 1 | 0.574 | −1 | 1 | 0.426 | 1 | 0.574 | −1 | 1 |
| 1.0 | 1 | 0.0 | −1 | 2 | 0.5066 | 1 | 0.4934 | −1 | 2 |
| 0.5809 | 1 | 0.4191 | −1 | 3 | 0.5809 | 1 | 0.4191 | −1 | 3 |
| 0.5066 | 1 | 0.4934 | −1 | 4 | 1.0 | 1 | 0.0 | −1 | 4 |