Marking scheme

ICC consistency*

(95% Confidence Interval)

ICC agreement**

(95% Confidence Interval)

Analytical structural MMR

0.71 (0.59 - 0.81)

0.57 (0.25 - 0.77)

Patient-Main concept links

(P-MC)

0.74 (0.62 - 0.83)

0.71 (0.57 - 0.81)

Concept-Concept links, plus examples, symptoms (C-C-ESS)

0.87 (0.80 - 0.92)

0.85 (0.75, 0.91)

Pictures

0.89 (0.83 - 0.93)

0.88 (0.82 - 0.93)

Relationship links

0.44 (0.28 - 0.60)

0.38 (0.19-0.56)

Cross-links

0.39 (0.22 - 0.56)

0.25 (0.04 - 0.47)

Colours

0.74 (0.63 - 0.83)

0.74 (0.62 - 0.83)

Holistic, qualitative MMR

0.33 (0.16 - 0.51)

0.32 (0.15 - 0.49)