Model | Hyper- Partisan | 20 News | EURLEX | Inverted EURLEX | Book Summary | Paired Summary |
BERT | 92.00 | 84.79 | 73.09 | 70.53 | 58.18 | 52.24 |
BERT + TextRank | 91.15 | 84.99 | 72.87 | 71.30 | 58.94 | 55.99 |
BERT + Random | 89.23 | 84.65 | 73.22 | 71.47 | 59.36 | 56.58 |
Longformer | 95.69 | 83.39 | 54.53 | 56.47 | 56.53 | 57.76 |
ToBERT | 89.54 | 85.52 | 67.57 | 67.31 | 58.16 | 57.08 |
CogLTX | 94.77 | 84.63 | 70.13 | 70.80 | 58.27 | 55.91 |
Mamba | 96.71 | 93.16 | 74.82 | 74.56 | 64.70 | 69.23 |