| OPTIMIZERS | LR = 10−3 | LR = 10−4 | LR = 10−5 |
| AdaGrad_60 | 88.21% | 63.88% | 48.96% |
| Adam_60 | 94.79% | 93.50% | 91.12% |
| Adamax_60 | 89.38% | 93.50% | 86.71% |
| Nadam_60 | 94.79% | 93.50% | 90.75% |
| RMSprop_60 | 94.63% | 93.54% | 90.25% |
| AdaGrad_70 | 88.50% | 62.50% | 50.25% |
| Adam_70 | 94.86% | 94.18% | 90.79% |
| Adamax_70 | 94.08% | 92.89% | 88.64% |
| Nadam_70 | 95.61% | 95.11% | 90.39% |
| RMSprop_70 | 95.18% | 94.00% | 91.68% |
| AdaGrad_80 | 88.25% | 65.75% | 49.59% |
| Adam_80 | 95.11% | 94.34% | 91.31% |
| Adamax_80 | 94.16% | 93.09% | 89.22% |
| Nadam_80 | 94.34% | 94.81% | 91.53% |
| RMSprop_80 | 94.84% | 93.78% | 90.25% |