| N | Algorithm | ||
|
| Multiple Q-Learning | MVQRL | MQQRL |
| 1 | 137.5 | 102.2 | 97.7 |
| 2 | 368.7 | 108.5 | 167.2 |
| 3 | 397.9 | 112.2 | 208.0 |
| 4 | 449.8 | 114.9 | 259.7 |
| 5 | 475.8 | 114.0 | 301.7 |
| 6 | 534.0 | 114.7 | 346.2 |
| 7 | 576.6 | 116.8 | 376.1 |
| 8 | 584.9 | 116.2 | 422.4 |
| 9 | 630.8 | 119.3 | 466.2 |
| 10 | 673.0 | 123.8 | 536.5 |