Dataset | Digit5 | Incremental-CIFAR | Incremental-Animal | |||
Metric | ACC (↑) | FGT (↓) | ACC (↑) | FGT (↓) | ACC (↑) | FGT (↓) |
Protocol | in-order | |||||
Oracle | 95.92 ± 0.06 | 0.75 ± 0.04 | 84.83 ± 1.45 | 0.78 ± 0.58 | 90.94 ± 0.47 | 0.69 ± 0.25 |
Finetune | 90.93 ± 0.39 | 6.84 ± 0.46 | 67.97 ± 1.75 2 | 24.63 ± 1.70 | 70.71 ± 0.87 | 26.57 ± 1.32 |
EWC | 91.82 ± 0.30 | 3.52 ± 0.23 | 68.87 ± 1.49 | 21.86 ± 1.42 | 74.11 ± 0.85 | 18.97 ± 1.00 |
MAS | 91.50 ± 0.39 | 5.46 ± 0.39 | 69.46 ± 1.32 | 17.85 ± 1.16 | 75.78 ± 1.50 | 11.48 ± 1.53 |
SI | 91.81 ± 0.38 | 4.56 ± 0.46 | 68.84 ± 1.67 | 20.28 ± 1.81 | 74.38 ± 0.76 | 17.05 ± 1.67 |
P2P-KD | 92.99 ± 0.46 | 3.88 ± 0.66 | 77.48 ± 1.75 | 10.83 ± 1.52 | 81.99 ± 0.63 | 6.89 ± 0.66 |
Protocol | reverse-order | |||||
Oracle | 96.19 ± 0.05 | 0.60 ± 0.07 | 84.25 ± 0.55 | 0.29 ± 0.17 | 89.73 ± 0.39 | 0.36 ± 0.16 |
Finetune | 88.21 ± 0.38 | 11.45 ± 0.65 | 69.59 ± 0.64 | 20.93 ± 0.91 | 66.37 ± 2.01 | 28.11 ± 1.19 |
EWC | 90.38 ± 0.36 | 7.51 ± 0.33 | 70.02 ± 0.89 | 19.23 ± 1.22 | 67.32 ± 1.51 | 25.05 ± 1.10 |
MAS | 90.00 ± 0.34 | 7.48 ± 0.38 | 70.39 ± 0.70 | 15.41 ± 0.98 | 67.84 ± 1.38 | 19.24 ± 1.12 |
SI | 89.91 ± 0.21 | 89.71 ± 0.56 | 70.32 ± 1.10 | 16.19 ± 1.64 | 67.62 ± 1.68 | 23.39 ± 1.44 |
P2P-KD | 89.71 ± 0.56 | 8.27 ± 0.72 | 78.40 ± 0.43 | 8.39 ± 0.77 | 77.86 ± 1.10 | 13.05 ± 1.73 |