Explanation

Notes

The statistics that are listed here are the Day0 test. I.E. what are the results on the day that we acquire any binary and is tested. We also have included all the re-test results over the same calendar day. Each vendor should improve as they start detecting the older and more common malicious binaries.

Each of the vendor's update process is executed prior to each run to ensure that the latest virus signatures are loaded for our tests.

The tables on each page represent the results of the Anti-Virus tests against the malware that we collect each day. Each AV vendor has different capabilities and success in detecting malware that is collected. No single vendor detects 100%, nor can they ever. To expect complete protection will always be science-fiction.

That being said, you can see the different statistics of the different vendors in our charts. It can be confusing since each vendor uses a different name for each infection type and family. All tests are done with the same set of binaries for each vendor. We continue to test each of the binaries until each vendor is able to detect each piece of malware in our repository. Where ever possible we have attempted to contact the vendor for assistance with the command line options that we use. Otherwise we try different options to produce the highest detection rate available from the options.

Time Periods

In all cases the time periods listed for the charts are summarizations for that specific time period. So for the Re-Tests, the time period does not represent the interval for testing. ie, the weekly charts are for the last seven days of processing. The seven day Re-Test chart does not represent that the binaries were re-tested once in that period. It does represent a summarization of the processing and testing of the binaries in that time period.

AV Results for Comparisons

It is difficult to not compare one vendor to the next due to how we have the data structured on the pages. It would be impossible not to try and derive conclusions from those results. While that is the case, our goal is not to create a real comparison site for everyone to try and compete to see which AV vendor is better than the next. There are a multitude of those already, each of which have their own sets of malware to test and rules that they follow for complete their testing. That is not our purpose. We do not have a specific set of malware to test. We instead gather in new malware daily and test it against the different vendors.

The versions of AV engines that we have are as new as the vendor can provide us and updated at least hourly if not more frequently. But they are gateway or fileserver products for the most part. We do have plans for using full consumer AV applications as well, but that will take time and much more in donations to allow us to build the back end for that. We will get to it, just not today.

AV Vendor List

The following Vendor tables show which of the AV vendors we are currently using as well as the engine and signature level of each application. In most cases we are using the command-line-interface versions, gateway versions, or file server versions. These are not the normal home user versions and in some cases are special versions for anti-virus test systems. The data within the tables is being pulled from the live systems and updated twice a day. The actual engines and signatures are attempted to be updated prior to each malware run whether it is from the day0 test or for a retry. So the applications should be as updated as possible before testing occurs.

The current list of AV tools that we use are as follows:

Linux Vendor List

Vendor Engine Signatures Command Options
Authentium 4.6.5 201407282208 aiscan --nomem --nombr --noboot --all --pua
Avast 1.0.10 14072802 scan -b
AVG 13.0.3114 3955/7940 avgscan --heur --arc --macrow --pwdw --repok --pup
Avira 8.3.22.14 7.11.164.86 avscan --batch -noboot -nombr -s -rs --scan-in-archive --alltypes --allfiles --without-PCK -nomem --heur-level=3 --alert-action=none
BitDefender 7.2 7.56108 bdc -arc -noclean
Clam 0.97.6 19236 clamscan --no-summary --detect-pua -r
DrWeb 6.0.0.02020 7.0.9.4080 drweb -ar -cn -ha -ok -path=$1
Eset 3.0.21 10167 (20140728) esets_scan --files --arch --subdir --mail --sfx --rtp --adware --heur --adv-heur
FProt 4.6.5.141 201407290034 fpscan --scanlevel=4 --heurlevel=4 --archive=99 --adware --report
FSecure 2.50 build 11035 Monday, 28 July 2014_02 fsav --allfiles=yes --scanexecutables=yes --archive=yes --mime=yes --riskware=yes --virus-action1=report --riskware-action1=report --suspected-action1=report --auto=yes --list=yes
Ikarus 1.06.01 29.07.2014 t3scan
Kaspersky 8.0.0.35 Monday, 4 February 2013 kes4lwks-control --scan-file
McAfee 5400.1158 5000 created Jul 28 2014 uvscan --recursive --noboot --allole --mime --program --unzip --secure --!guru --!server
Norman 7.4.4 2014-27-07 22:26 mtscan
Panda 9.04.03 28/07/2014 pavcl -auto -nob -cmp -nos -noscr -rpt:$out -aex -heu:1
QuickHeal 11.00 28 July, 2014 qhscan -DNAScan -ARCHIVE -WARE -LIST -PACKED -REPORT=$tmp
Sophos 4.94.0 4.95 savscan -all -archive
TrendMicro 9.200-1012 Monday, 28 July 2014 vscantmrh -S -NC -NM -NB
Vexira 5.5.2.13 15.0.385.1 vascan --all-files --heuristics=high --sfx --action=skip -G
VirusBlokAda 3.12.26.3 Monday, 28 July 2014 vba32.sh -m=3 -af+ -pm+ -rw+ -ha=2 -vm+ -ar+ -sfx+ -ml+
VirusBuster 5.5.2.13 15.0.860.0 vbscan --all-files --heuristics=high --sfx --action=skip -G

Windows Vendor List

Vendor Engine Signatures Command Options
AhnLab Friday, 11 October 2013.00 Friday, 11 October 2013.00 v3tmedic.exe /scantype:all /cure:off /log
Authentium 4.6.2 201407290034 aiscan.exe --nomem --nombr --noboot --all --pua
Avast command-line scanner 140728-2 ashcmd /_ /s /d /p /a /c /i /t=a /x=P /e=100 /r=report
AVG 10.0.3955 271/7440 avgscanx.exe /HEUR /ARC /MACROW /PWDW /REPOK /PUP
Avira 8.3.22.14 7.11.164.82 scancl --nombr /s /z /a --nomem --heurlevel=3
BitDefender 7.1 7.56108 bdc.exe -arc -noclean
Clam 0.97.3 19236 clamscan --no-summary --detect-pua -r
Comodo 5.1 18997 cavscons /h2 /c
DrWeb 7.00.100.09170/7.00.9.04080 Monday, 28 July 2014 16:15 dwscancl /ar /ha /ok /sls- /sps-
Emsisoft 8.1.0.31 Tuesday, 29 July 2014 a2cmd.exe /h /r /a /service
Eset 4.2.71.2 9674 (20140414) ecls --files --arch --subdir --mail --sfx --rtp --adware --heur --adv-heur
Fortinet 5.1.153 22.561, vscanner.exe -V -gALL
FProt 4.6.2.117 201407290034 bin64\\MS\\fpscan64.exe -i \\antivir.def --scanlevel=4 --heurlevel=4 --archive=99 --adware --report
FSecure 11.00.19100 Monday, 28 July 2014 scan --archive --adv-heur
GData AVA 24.3385,GD 25.3663 28.07.2014,28.07.2014 avkcmd.exe /scan(e0):
Ikarus 1.06.01 29.07.2014 t3scan
K7 12.8.0.104 9.181.12872 k7cscn32.exe
K7GW 12.8.0.39 9.176.11226 k7cscn32.exe
Kaspersky 6.0.4.1424 13022014 0450 avp.exe SCAN /i0 /fa
McAfee 15.6 5500.1093 6975 Sunday, 3 February 2013 scan.exe /RECURSIVE /NOBOOT /ALLOLE /MIME /PROGRAM /UNZIP /SECURE
Microsoft 1.10802 Mon Jul 28 11:53:07 2014 mpscanp.exe /report /rptall
Norman 5.99.02 Monday, 28 July 2014 06:26 nvcc /BS- /C /CL:0 /N /L:0 /O /SB:1 /U
PCTools 7.0.5.0 20130904.003 SDAVFileScan.exe -v
QuickHeal 14.00 28 July, 2014 qhscan /DNAScan /ARCHIVE /WARE /LIST /PACKED
Sophos 3.27.0 4.73G sav32cli.exe -ndi -ns -nb -all -rec -nremove -eec -sc -f -tnef -mime -oe -pua -suspicious -archive -nmbr -nmem
Sunbelt 3.9.2557.2 31704 vscan /r /v
Symantec 20131.1.5.61 2014/4/20 Build: 8 symscan.exe /defs
TrendMicro 9.700-1001 Monday, 28 July 2014 vscantm.exe /S /NM /NB /NC
Vexira 5.5.2.13 15.0.385.1 vascan --all-files --heuristics=high --sfx --action=skip -G
VirusBlokAda 3.12.26.3 Wednesday, 2 July 2014 vba32w /mr=0 /as=0 /bt- /m=3 /af+ /pm+ /rw+ /ha=2 /vm+ /ar+ /sfx+ /ml+
VirusBuster 5.5.2.13 15.0.745.0 vbscan.exe --all-files --heuristics=high --sfx --action=skip -G

Updates

These reports are updated once a day.

Getting New Scanners Added

If you are an AV vendor and would like to have your scanner added to our list, please email admin<at>shadowserver.org for that request. We will need a CLI version of the scanner for Linux or Windows (or both if you have them). We will need to know how to update the subscriptions and data files. We would also like to have the suggested running options for your scanner.

AV Processing Statistics

This chart is the total number of files processed by the AV test system.

Zero AV Detection Statistics

These statistics are the result of AV testing over a 48-hour period and how many files were still not detected by any single vendor. There is a severe change in the results after 2011-07 which is when we added in the Windows AV scanners to our test suite. While on most days the results are not zero, the values are so low as to not be seen in the current chart.

<< | Statistics | >>