| OPTIMIZERS | LR = 10−3 | LR = 10−4 | LR = 10−5 |
| AdaGrad_60 | 86.83% | 66.71% | 53.83% |
| Adam_60 | 94.83% | 94.96% | 89.33% |
| Adamax_60 | 94.75% | 94.00% | 85.62% |
| Nadam_60 | 94.67% | 93.88% | 89.33% |
| RMSprop_60 | 94.33% | 94.08% | 89.33% |
| AdaGrad_70 | 85.39% | 59.25% | 51.14% |
| Adam_70 | 95.43% | 94.07% | 90.43% |
| Adamax_70 | 95.32% | 92.86% | 87.25% |
| Nadam_70 | 94.32% | 95.04% | 90.21% |
| RMSprop_70 | 94.93% | 94.79% | 90.29% |
| AdaGrad_80 | 87.63% | 65.31% | 56.03% |
| Adam_80 | 94.88% | 94.47% | 91.44% |
| Adamax_80 | 94.41% | 92.72% | 87.53% |
| Nadam_80 | 95.19% | 94.84% | 91.16% |
| RMSprop_80 | 95.34% | 94.34% | 91.28% |