| N | Algorithm | ||
|
| Multiple Q-Learning | MVQRL | MQQRL |
| 1 | 1.5 | 8.3 | 8.1 |
| 2 | 1.8 | 8.0 | 12.2 |
| 3 | 1.7 | 7.9 | 14.7 |
| 4 | 1.7 | 8.0 | 18.0 |
| 5 | 1.7 | 7.8 | 20.4 |
| 6 | 1.7 | 7.7 | 22.8 |
| 7 | 1.7 | 7.7 | 24.9 |
| 8 | 1.6 | 7.6 | 27.7 |
| 9 | 1.6 | 7.7 | 30.4 |
| 10 | 1.6 | 7.8 | 34.3 |