Momentum = 0

Momentum = 0.1

Learning rates

Training loss

Learning rates

Training loss

0.002

2.30428

0.002

2.30422

0.01

2.30212

0.01

2.30183

0.05

2.29297

0.05

2.29170

0.2

2.22897

0.2

2.21025

1.0

1.59884

1.0

1.52411

5.0

2.30132

5.0

2.30185

20.0

2.30259

20.0

2.30259