Momentum = 0 | Momentum = 0.1 | ||
Learning rates | Training loss | Learning rates | Training loss |
0.002 | 2.30428 | 0.002 | 2.30422 |
0.01 | 2.30212 | 0.01 | 2.30183 |
0.05 | 2.29297 | 0.05 | 2.29170 |
0.2 | 2.22897 | 0.2 | 2.21025 |
1.0 | 1.59884 | 1.0 | 1.52411 |
5.0 | 2.30132 | 5.0 | 2.30185 |
20.0 | 2.30259 | 20.0 | 2.30259 |