Anti-Virus Software Trojan Testing

Courtesy of the alt.comp.virus newsgroup participants.
(These "anti-malware" pages are the result of a continuing cooperative effort.)

Anti-Virus Main Menu
Main Menu
Users considering Trojan specific scanners in addition to their anti-virus scanner product will do well to consider the following Trojan detection test results. You will probably notice that a number of anti-virus products fare better, and some fare very much better overall, than the Trojan specific products tested.

Quality independent test results require much work, not only in planning, preparation and conduction, but also in the area of presentation of the results. Those seeking information on current scanning engine capabilities must take this into account. At the time of this writing, the subject tests below are almost one year old. It is hoped that the type of tests presented here will continue to be performed periodically and that newer summary tables can be presented here in a more timely fashion in the future.

Credits for the preparation of the summary tables go to Thomas Tietz, webmaster for http://www.trojaner-info.de, and thanks go to him for permission to reproduce the charts here. Thanks also to Andreas Marx of Magdeburg, Germany for his permissions and helpful suggestions.



University of Magdeburg and GEGA IT-Solutions GbR
July 2001 - Short Test Anti-Trojan and Anti-Virus-Software detection results


The detection results below were condensed from a "Short Test".
The full test results including false alarms are available in English here: SHORT TEST TROJANER-INFO

The main web site is: http://www.av-test.org

Chart #1. 1,367 Trojans considered to be infrequently seen.
Web site source:
http://trojaner-info.de/test_07_2001_kaumtrojan.shtml
*
Program
# Detected
Percent
1.
 AVK 10.0.1.0 (V)
1366
99.93 %
2.
 Kaspersky Anti-Virus 3.5.133.0 (V)
1364
99.78 %
3.
 McAfee VirusScan 5.12 (V)
1339
97.95 %
4.
 Panda AntiVirus 6.0 Platinum (6.22.00) (V)
1241
90.78 %
5.
 RAV AntiVirus 8.2.1.12 (V)
1164
85.15 %
6.
 F-Secure 5.21 (V)
1059
77.47 %
7.
 F-Prot 3.09a (V)
955
69.86 %
8.
 Command 4.61 (V)
954
69.79 %
8.
 FP-Win 3.09 (V)
954
69.79 %
9.
 Norman Virus Control 5.00.24 (V)
931
68.11 %
10.
 InoculateIT 6.0 Advanced Edition 6.0.85 (V)
866
63.35 %
11.
 PC-cillin 7.51 (V)
785
57.43 %
12.
 Sophos Anti-Virus 3.45 (V)
662
48.43 %
13.
 DrWeb 4.24b (V)
651
47.62 %
14.
 AntiVir PE 6.07.00.51 (V)
648
47.40 %
15.
 AntiVir Pro 6.07.00.00 (V)
632
46.23 %
16.
 AVX 5.9.3 (V)
579
42.36 %
17.
 Norton AntiVirus 2001 (7.00.51F) (V)
441
32.26 %
18.
 NOD32 Anti-Virus 1.86 (V)
351
25.68 %
19.
 PC Door Guard (T)
192
14.05 %
20.
 The Cleaner 3.2 build 3213 (T)
186
13.61 %
21.
 Tauscan 1.5 build 0920 (T)
175
12.80 %
22.
 AVG 6.0.255 (V)
118
8.63 %
23.
 ANTS 2.0 Release 1 (T)
93
6.80 %
24.
 Avast 3.0.341.0 (V)
84
6.14 %
25.
 eSafe Desktop 3.0 (V)
79
5.78 %
26.
 Ikarus Virus Utilities 5.01 (V)
72
5.27 %
27.
 Anti-Trojan 5.5 build 335 (T)
64
4.68 %
28.
 TrojanHunter 1.0 build 298 (T)
15
1.10 %
29.
 Quickheal X-Gen 6.0 (V)
15
1.10 %


Chart #2. 1,252 Backdoors considered to be infrequently seen.
Web site source:
http://www.trojaner-info.de/test_07_2001_kaumback.shtml
*
Program
# Detected
Percent
1.
 AVK 10.0.1.0 (V)
1252
100.00 %
1.
 Kaspersky Anti-Virus 3.5.133.0 (V)
1252
100.00 %
2.
 McAfee VirusScan 5.12 (V)
1241
99.12 %
3.
 F-Secure 5.21 (V)
1190
95.05 %
4.
 RAV AntiVirus 8.2.1.12 (V)
1182
94.41 %
5.
 Norman Virus Control 5.00.24 (V)
1118
89.30 %
6.
 Panda AntiVirus 6.0 Platinum (6.22.00) (V)
1101
87.94 %
7.
 F-Prot 3.09a (V)
1011
80.75 %
7.
 FP-Win 3.09-pre (V)
1011
80.75 %
8.
 Command 4.61 (V)
1010
80.67 %
9.
 DrWeb 4.24b (V)
963
76.92 %
10.
 PC-cillin 7.51 (V)
879
70.21 %
11.
 InoculateIT 6.0 Advanced Edition 6.0.85 (V)
842
67.25 %
12.
 AVG 6.0.255 (V)
826
65.97 %
13.
 The Cleaner 3.2 build 3213 (T)
815
65.10 %
14.
 NOD32 Anti-Virus 1.86 (V)
781
62.38 %
15.
 Tauscan 1.5 build 0920 (T)
779
62.22 %
16.
 PC Door Guard (T)
687
54.87 %
17.
 AntiVir PE 6.07.00.51 (V)
646
51.60 %
18.
 Norton AntiVirus 2001 (7.00.51F) (V)
640
51.12 %
19.
 AntiVir Pro 6.07.00.00 (V)
593
47.36 %
20.
 Sophos Anti-Virus 3.45 (V)
466
37.22 %
21.
 Anti-Trojan 5.5 build 335 (T)
438
34.98 %
22.
 AVX 5.9.3 (V)
391
31.23 %
23.
 ANTS 2.0 Release 1 (T)
275
21.96 %
24.
 TrojanHunter 1.0 build 298 (T)
129
10.30 %
25.
 Ikarus Virus Utilities 5.01 (V)
115
9.19 %
26.
 eSafe Desktop 3.0 (V)
71
5.67 %
27.
 Avast 3.0.341.0 (V)
62
4.95 %
28.
 Quickheal X-Gen 6.0 (V)
50
3.99 %

Chart #3. 71 Trojans considered to be frequently seen.
Web site source:
http://www.trojaner-info.de/test_07_2001_weittrojan.shtml
*
Program
# Detected
Percent
1.
 AVK 10.0.1.0 (V)
71
100.00 %
1.
 Kaspersky Anti-Virus 3.5.133.0 (V)
71
100.00 %
1.
 McAfee VirusScan 5.12 (V)
71
100.00 %
2.
 RAV AntiVirus 8.2.1.12 (V)
70
98.59 %
3.
 ANTS 2.0 Release 1 (T)
69
97.18 %
3.
 The Cleaner 3.2 build 3213 (T)
69
97.18 %
3.
 Norman Virus Control 5.00.24 (V)
69
97.18 %
3.
 PC-cillin 7.51 (V)
69
97.18 %
4.
 AVX 5.9.3 (V)
67
94.37 %
4.
 F-Secure 5.21 (V)
67
94.37 %
5.
 AntiVir PE 6.07.00.51 (V)
66
92.96 %
5.
 AntiVir Pro 6.07.00.00 (V)
66
92.96 %
5.
 Command 4.61 (V)
66
92.96 %
5.
 F-Prot 3.09a (V)
66
92.96 %
5.
 FP-Win 3.09 (V)
66
92.96 %
5.
 Sophos Anti-Virus 3.45 (V)
66
92.96 %
6.
 InoculateIT 6.0 Advanced Edition 6.0.85 (V)
65
91.55 %
6.
 NOD32 Anti-Virus 1.86 (V)
65
91.55 %
7.
 AVG 6.0.255 (V)
64
90.14 %
7.
 Panda AntiVirus 6.0 Platinum (6.22.00) (V)
64
90.14 %
8.
 Tauscan 1.5 build 0920 (T)
57
80.28 %
9.
 Anti-Trojan 5.5 build 335 (T)
55
77.46 %
9.
 DrWeb 4.24b (V)
55
77.46 %
10.
 Norton AntiVirus 2001 (7.00.51F) (V)
51
71.83 %
11.
 PC Door Guard (T)
41
57.75 %
12.
 Avast 3.0.341.0 (V)
27
28.03 %
13.
 Ikarus Virus Utilities 5.01 (V)
19
26.76 %
14.
 eSafe Desktop 3.0 (V)
9
12.68 %
15.
 Quickheal X-Gen 6.0 (V)
8
11.27 %
16.
 TrojanHunter 1.0 build 298 (T)
3
4.23 %


Chart #4. 307 Backdoors considered to be frequently seen.
Web site source:
http://www.trojaner-info.de/test_07_2001_weitback.shtml
*
Program
# Detected
Percent
1.
 AVK 10.0.1.0 (V)
307
100.00 %
1.
 Kaspersky Anti-Virus 3.5.133.0 (V)
307
100.00 %
1.
 McAfee VirusScan 5.12 (V)
307
100.00 %
2.
 Norman Virus Control 5.00.24 (V)
306
99.67 %
2.
 RAV AntiVirus 8.2.1.12 (V)
306
99.67 %
3.
 ANTS 2.0 Release 1 (T)
305
99.35 %
4.
 F-Secure 5.21 (V)
305
99.35 %
5.
 Command 4.61 (V)
303
98.70 %
5.
 F-Prot 3.09a (V)
303
98.70 %
5.
 FP-Win 3.09 (V)
303
98.70 %
5.
 Panda AntiVirus 6.0 Platinum (6.22.00) (V)
303
98.70 %
6.
 PC-cillin 7.51 (V)
301
98.05 %
6.
 Sophos Anti-Virus 3.45 (V)
301
98.05 %
7.
 AntiVir Pro 6.07.00.00 (V)
298
97.07 %
8.
 AntiVir PE 6.07.00.51 (V)
297
96.74 %
8.
 DrWeb 4.24b (V)
297
96.74 %
9.
 The Cleaner 3.2 build 3213 (T)
295
96.09 %
10.
 Tauscan 1.5 build 0920 (T)
288
93.81 %
10.
 InoculateIT 6.0 Advanced Edition 6.0.85 (V)
288
93.81 %
10.
 NOD32 Anti-Virus 1.86 (V)
288
93.81 %
11.
 AVG 6.0.255 (V)
287
93.49 %
12.
 Anti-Trojan 5.5 build 335 (T)
279
90.88 %
13.
 Norton AntiVirus 2001 (7.00.51F) (V)
277
90.23 %
14.
 PC Door Guard (T)
221
71.99 %
15.
 AVX 5.9.3 (V)
208
67.75 %
16.
 TrojanHunter 1.0 build 298 (T)
79
25.73 %
17.
 Ikarus Virus Utilities 5.01 (V)
67
21.82 %
18.
 Avast 3.0.341.0 (V)
44
14.33 %
19.
 Quickheal X-Gen 6.0 (V)
19
6.19 %
20.
 eSafe Desktop 3.0 (V)
12
3.91 %


False positive data. Results of testing with 5,730 files.
Data extracted from the same "Short Test" results as above.
Program
# of false positves
% of total files
ANTS
0
0 %
BO Clean
0
0 %
Agnitum Tauscan
0
0 %
The Cleaner
1
0.02 %
Trojan Hunter
1
0.02 %
McAfee
2
0.03 %
AVG
3
0.05 %
RAV
3
0.05 %
Panda
4
0.07 %
Avast32
4
0.07 %
AVK GData
5
0.09 %
KAV
5
0.09 %
Sophos
7
0.12 %
F-Prot
7
0.12 %
Norton
7
0.12 %
PC DoorGuard
8
0.14 %
Anti Vir
8
0.14 %
Pc-cillin
8
0.14 %
Command
10
0.17 %
F-Secure
11
0.19 %
Norman
12
0.21 %
Inoculate IT
13
0.23 %
AVX Sofwin
14
0.24 %
Aladdin ESafe
19
0.33 %
NOD32
35
0.61 %
DrWeb
47
0.82 %
Ikarus
64
1.12 %
Quick Heal
121
2.11 %



© Claymania Creations 2002 - 2008. All rights reserved.
Test result data reproduced with permission.

Updated: July 8, 2002