Dataset

Digit5

Incremental-CIFAR

Incremental-Animal

Metric

ACC (↑)

FGT (↓)

ACC (↑)

FGT (↓)

ACC (↑)

FGT (↓)

Protocol

in-order

P2P-CE

91.81 ± 0.43

5.69 ± 0.54

69.53 ± 1.77

26.96 ± 1.23

71.77 ± 0.71

30.41 ± 0.47

OS-KD

91.87 ± 0.53

5.79 ± 0.74

76.61 ± 1.49

10.60 ± 1.23

80.97 ± 0.15

11.35 ± 1.06

P2P-KD

92.99 ± 0.46

3.88 ± 0.66

77.48 ± 1.75

10.83 ± 1.52

81.99 ± 0.63

6.89 ± 0.66

Protocol

reverse-order

P2P-CE

88.73 ± 0.23

10.87 ± 0.35

71.13 ± 1.08

23.13 ± 1.23

69.76 ± 1.70

29.33 ± 0.69

OS-KD

90.36 ± 0.25

7.58 ± 0.34

77.08 ± 0.65

9.99 ± 0.80

74.37 ± 1.39

18.80 ± 1.17

P2P-KD

89.71 ± 0.56

8.27 ± 0.72

78.40 ± 0.43

8.39 ± 0.77

77.86 ± 1.10

13.05 ± 1.73