Momentum = 0.5

Momentum = 0.9

Learning rates

Training loss

Learning rates

Training loss

0.002

2.30372

0.002

2.30014

0.01

2.29971

0.01

2.28402

0.05

2.28010

0.05

2.00861

0.2

1.99455

0.2

1.08343

1.0

1.13944

1.0

2..01872

5.0

2.30255

5.0

2.30259

20.0

2.30259

20.0

2.30259