| OPTIMIZERS | LR = 10−3 | LR = 10−4 | LR = 10−5 |
| AdaGrad_60_40 | 87.12% | 57.21% | 50.75% |
| Adam_60 | 95.13% | 94.04% | 89.88% |
| Adamax_60 | 95.21% | 92.25% | 86.29% |
| Nadam_60 | 95.58% | 94.25% | 89.04% |
| RMSprop_60 | 94.88% | 93.25% | 89.38% |
| AdaGrad_70 | 88.50% | 59.68% | 51.82% |
| Adam_70 | 94.00% | 93.93% | 90.36% |
| Adamax_70 | 94.93% | 91.93% | 86.25% |
| Nadam_70 | 95.39% | 93.54% | 89.29% |
| RMSprop_70 | 94.36% | 94.29% | 90.50% |
| AdaGrad_80 | 88.03% | 63.63% | 57.13% |
| Adam_80 | 94.97% | 93.81% | 89.78% |
| Adamax_80 | 94.22% | 92.56% | 87.81% |
| Nadam_80 | 95.44% | 94.69% | 90.19% |
| RMSprop_80 | 94.91% | 94.28% | 89.00% |