OPTIMIZERS | LR = 10−3 | LR = 10−4 | LR = 10−5 |
AdaGrad_60 | 86.83% | 66.71% | 53.83% |
Adam_60 | 94.83% | 94.96% | 89.33% |
Adamax_60 | 94.75% | 94.00% | 85.62% |
Nadam_60 | 94.67% | 93.88% | 89.33% |
RMSprop_60 | 94.33% | 94.08% | 89.33% |
AdaGrad_70 | 85.39% | 59.25% | 51.14% |
Adam_70 | 95.43% | 94.07% | 90.43% |
Adamax_70 | 95.32% | 92.86% | 87.25% |
Nadam_70 | 94.32% | 95.04% | 90.21% |
RMSprop_70 | 94.93% | 94.79% | 90.29% |
AdaGrad_80 | 87.63% | 65.31% | 56.03% |
Adam_80 | 94.88% | 94.47% | 91.44% |
Adamax_80 | 94.41% | 92.72% | 87.53% |
Nadam_80 | 95.19% | 94.84% | 91.16% |
RMSprop_80 | 95.34% | 94.34% | 91.28% |