Dataset

Digit5

Incremental-CIFAR

Incremental-Animal

Metric

ACC (↑)

FGT (↓)

ACC (↑)

FGT (↓)

ACC (↑)

FGT (↓)

Protocol

in-order

Oracle

95.92 ± 0.06

0.75 ± 0.04

84.83 ± 1.45

0.78 ± 0.58

90.94 ± 0.47

0.69 ± 0.25

Finetune

90.93 ± 0.39

6.84 ± 0.46

67.97 ± 1.75 2

24.63 ± 1.70

70.71 ± 0.87

26.57 ± 1.32

EWC

91.82 ± 0.30

3.52 ± 0.23

68.87 ± 1.49

21.86 ± 1.42

74.11 ± 0.85

18.97 ± 1.00

MAS

91.50 ± 0.39

5.46 ± 0.39

69.46 ± 1.32

17.85 ± 1.16

75.78 ± 1.50

11.48 ± 1.53

SI

91.81 ± 0.38

4.56 ± 0.46

68.84 ± 1.67

20.28 ± 1.81

74.38 ± 0.76

17.05 ± 1.67

P2P-KD

92.99 ± 0.46

3.88 ± 0.66

77.48 ± 1.75

10.83 ± 1.52

81.99 ± 0.63

6.89 ± 0.66

Protocol

reverse-order

Oracle

96.19 ± 0.05

0.60 ± 0.07

84.25 ± 0.55

0.29 ± 0.17

89.73 ± 0.39

0.36 ± 0.16

Finetune

88.21 ± 0.38

11.45 ± 0.65

69.59 ± 0.64

20.93 ± 0.91

66.37 ± 2.01

28.11 ± 1.19

EWC

90.38 ± 0.36

7.51 ± 0.33

70.02 ± 0.89

19.23 ± 1.22

67.32 ± 1.51

25.05 ± 1.10

MAS

90.00 ± 0.34

7.48 ± 0.38

70.39 ± 0.70

15.41 ± 0.98

67.84 ± 1.38

19.24 ± 1.12

SI

89.91 ± 0.21

89.71 ± 0.56

70.32 ± 1.10

16.19 ± 1.64

67.62 ± 1.68

23.39 ± 1.44

P2P-KD

89.71 ± 0.56

8.27 ± 0.72

78.40 ± 0.43

8.39 ± 0.77

77.86 ± 1.10

13.05 ± 1.73