Polymorphic Malware

Pairwise Alignment/AVS

Product

Top Five State-of-the-art AVS Products and Our Top Signatures (S)

Detection Ratio (with Accuracy) and Statistical Measures

W32.Kitti

Virus

AntiVirus Ranked No. 1

Bitdefender Antivirus

Detection Ratio (Accuracy)

324/1106 (29.29%)

Sensitivity/Recall

29.29%

Specificity

0.00%

Precision

100.00%

F1 Score

45.31%

AntiVirus Ranked No. 2

Kaspersky Anti-Virus

Detection Ratio (Accuracy)

1106/1106 (100.00%)

Sensitivity/Recall

100.00%

Specificity

0.00%

Precision

100.00%

F1 Score

100.00%

AntiVirus Ranked No. 3

McAfee AntiVirus

Detection Ratio (Accuracy)

293/1106 (26.49%)

Sensitivity/Recall

26.49%

Specificity

0.00%

Precision

100.00%

F1 Score

41.88%

AntiVirus Ranked No. 4

Norton Security

Detection Ratio (Accuracy)

450/1106 (40.69%)

Sensitivity/Recall

40.69%

Specificity

0.00%

Precision

100.00%

F1 Score

57.84%

AntiVirus Ranked No. 5

F-Secure Anti-Virus

Detection Ratio (Accuracy)

333/1106 (30.11%)

Sensitivity/Recall

30.11%

Specificity

0.00%

Precision

100.00%

F1 Score

46.28%

Original W32.Kitti virus and

Variant 1

S1-S6

Detection Ratio (Accuracy)

1106/1106 (100.00%)

Sensitivity/Recall

100.00%

Specificity

0.00%

Precision

100.00%

F1 Score

100.00%

Variant 1 and Variant 2

S7-S10

Detection Ratio (Accuracy)

1106/1106 (100.00%)

Sensitivity/Recall

100.00%

Specificity

0.00%

Precision

100.00%

F1 Score

100.00%