| Dataset | XSum | |||||||||
| Threshold Values | Threshold = 0.0001 | Threshold = 0.11 | Threshold = −0.08 | |||||||
| Metrics | Accuracy | Precision | Recall | Accuracy | Precision | Recall | Accuracy | Precision | Recall | |
| Attacks | Models |
| ||||||||
| Self-calibrated Probabilistic Variation MIA | Mistral 7B | 89.50 | 82.75 | 99.80 | 50.00 | 50.00 | 100.00 | 69.00 | 100.00 | 38.00 |
| LLaMA 7B | 80.30 | 71.74 | 97.80 | 50.00 | 50.00 | 100.00 | 72.80 | 100.00 | 45.60 | |
| LLaMA 13B | 94.20 | 89.61 | 100.00 | 50.20 | 50.10 | 100.00 | 90.60 | 100.00 | 81.20 | |
| Mixtral 8x7B | 79.00 | 71.08 | 97.80 | 50.00 | 50.00 | 100.00 | 56.00 | 100.00 | 12.00 | |