Explanation

Notes

The statistics that are listed here are the Day0 test. I.E. what are the results on the day that we acquire any binary and is tested. We also have included all the re-test results over the same calendar day. Each vendor should improve as they start detecting the older and more common malicious binaries.

Each of the vendor's update process is executed prior to each run to ensure that the latest virus signatures are loaded for our tests.

The tables on each page represent the results of the Anti-Virus tests against the malware that we collect each day. Each AV vendor has different capabilities and success in detecting malware that is collected. No single vendor detects 100%, nor can they ever. To expect complete protection will always be science-fiction.

That being said, you can see the different statistics of the different vendors in our charts. It can be confusing since each vendor uses a different name for each infection type and family. All tests are done with the same set of binaries for each vendor. We continue to test each of the binaries until each vendor is able to detect each piece of malware in our repository. Where ever possible we have attempted to contact the vendor for assistance with the command line options that we use. Otherwise we try different options to produce the highest detection rate available from the options.

Time Periods

In all cases the time periods listed for the charts are summarizations for that specific time period. So for the Re-Tests, the time period does not represent the interval for testing. ie, the weekly charts are for the last seven days of processing. The seven day Re-Test chart does not represent that the binaries were re-tested once in that period. It does represent a summarization of the processing and testing of the binaries in that time period.

AV Results for Comparisons

It is difficult to not compare one vendor to the next due to how we have the data structured on the pages. It would be impossible not to try and derive conclusions from those results. While that is the case, our goal is not to create a real comparison site for everyone to try and compete to see which AV vendor is better than the next. There are a multitude of those already, each of which have their own sets of malware to test and rules that they follow for complete their testing. That is not our purpose. We do not have a specific set of malware to test. We instead gather in new malware daily and test it against the different vendors.

The versions of AV engines that we have are as new as the vendor can provide us and updated at least hourly if not more frequently. But they are gateway or fileserver products for the most part. We do have plans for using full consumer AV applications as well, but that will take time and much more in donations to allow us to build the back end for that. We will get to it, just not today.

AV Vendor List

The following Vendor tables show which of the AV vendors we are currently using as well as the engine and signature level of each application. In most cases we are using the command-line-interface versions, gateway versions, or file server versions. These are not the normal home user versions and in some cases are special versions for anti-virus test systems. The data within the tables is being pulled from the live systems and updated twice a day. The actual engines and signatures are attempted to be updated prior to each malware run whether it is from the day0 test or for a retry. So the applications should be as updated as possible before testing occurs.

The current list of AV tools that we use are as follows:

Linux Vendor List

Vendor Engine Signatures Command Options
Authentium 4.6.5 201408221455 aiscan --nomem --nombr --noboot --all --pua
Avast 1.0.10 14082200 scan -b
AVG 13.0.3114 3955/8081 avgscan --heur --arc --macrow --pwdw --repok --pup
Avira 8.3.24.18 7.11.168.226 avscan --batch -noboot -nombr -s -rs --scan-in-archive --alltypes --allfiles --without-PCK -nomem --heur-level=3 --alert-action=none
BitDefender 7.2 Fri Aug 22 21:45:40 2014 bdc -arc -noclean
Clam 0.97.6 19301 clamscan --no-summary --detect-pua -r
DrWeb 6.0.0.02020 7.0.9.4080 drweb -ar -cn -ha -ok -path=$1
Eset 3.0.21 10299 (20140822) esets_scan --adv-heur --adware --sfx --unsafe --unwanted
FProt 4.6.5.141 201408221232 fpscan --scanlevel=4 --heurlevel=4 --archive=99 --adware --report
FSecure 2.50 build 11035 Thursday, 21 August 2014_01 fsav --allfiles=yes --scanexecutables=yes --archive=yes --mime=yes --riskware=yes --virus-action1=report --riskware-action1=report --suspected-action1=report --auto=yes --list=yes
Ikarus 1.06.01 22.08.2014 t3scan
Kaspersky 8.0.0.35 Monday, 4 February 2013 kes4lwks-control --scan-file
McAfee 5400.1158 5000 created Aug 22 2014 uvscan --recursive --noboot --allole --mime --program --unzip --secure --!guru --!server
Norman 7.4.4 2014-22-08 01:41 mtscan
Panda 9.04.03 21/08/2014 pavcl -auto -nob -cmp -nos -noscr -rpt:$out -aex -heu:1
QuickHeal 11.00 22 August, 2014 qhscan -DNAScan -ARCHIVE -WARE -LIST -PACKED -REPORT=$tmp
Sophos 4.94.0 4.95 savscan -all -archive
TrendMicro 9.200-1012 Friday, 22 August 2014 vscantmrh -S -NC -NM -NB
Vexira 5.5.2.13 15.0.384.2 vascan --all-files --heuristics=high --sfx --action=skip -G
VirusBlokAda 3.12.26.3 Friday, 22 August 2014 vba32.sh -m=3 -af+ -pm+ -rw+ -ha=2 -vm+ -ar+ -sfx+ -ml+
VirusBuster 5.5.2.13 15.0.884.0 vbscan --all-files --heuristics=high --sfx --action=skip -G

Windows Vendor List

Vendor Engine Signatures Command Options
AhnLab Friday, 11 October 2013.00 Friday, 11 October 2013.00 v3tmedic.exe /scantype:all /cure:off /log
Authentium 4.6.2 201408221855 aiscan.exe --nomem --nombr --noboot --all --pua
Avast command-line scanner 140822-1 ashcmd /_ /s /d /p /a /c /i /t=a /x=P /e=100 /r=report
AVG 10.0.3955 271/7577 avgscanx.exe /HEUR /ARC /MACROW /PWDW /REPOK /PUP
Avira 8.3.24.18 7.11.168.226 scancl --nombr /s /z /a --nomem --heurlevel=3
BitDefender 7.1 Fri Aug 22 22:48:13 2014 bdc.exe -arc -noclean
Clam 0.97.3 19300 clamscan --no-summary --detect-pua -r
Comodo 5.1 19279 cavscons /h2 /c
DrWeb 7.00.100.09170/7.00.9.04080 Friday, 22 August 2014 07:45 dwscancl /ar /ha /ok /sls- /sps-
Emsisoft 9.0.0.4353 Saturday, 23 August 2014 a2cmd.exe /h /r /a /service
Eset 4.2.71.2 10299 (20140822) ecls /adv-heur /adware /sfx /unsafe /unwanted
Fortinet 5.1.153 22.685, vscanner.exe -V -gALL
FProt 4.6.2.117 201408221855 bin64\\MS\\fpscan64.exe -i \\antivir.def --scanlevel=4 --heurlevel=4 --archive=99 --adware --report
FSecure 11.00.19100 Friday, 22 August 2014 scan --archive --adv-heur
GData AVA 24.3720,GD 25.3782 22.08.2014,22.08.2014 avkcmd.exe /scan(e0):
Ikarus 1.07.05 22.08.2014 t3scan
K7 12.8.0.110 9.183.13139 k7cscn32.exe
K7GW 12.8.0.39 9.176.11226 k7cscn32.exe
Kaspersky 6.0.4.1424 10022014 0123 avp.exe SCAN /i0 /fa
Lionic 2.12 Monday, 4 August 2014 14:28:12 lcav.exe -v
McAfee 5400.1158 7538 created Aug 22 2014 scan.exe /RECURSIVE /NOBOOT /ALLOLE /MIME /PROGRAM /UNZIP /SECURE
Microsoft 1.10904 Fri Aug 22 00:57:18 2014 mpscanp.exe /report /rptall
Norman 5.99.02 Friday, 22 August 2014 09:41 nvcc /BS- /C /CL:0 /N /L:0 /O /SB:1 /U
PCTools 7.0.5.0 20130904.003 SDAVFileScan.exe -v
QuickHeal 14.00 22 August, 2014 qhscan /DNAScan /ARCHIVE /WARE /LIST /PACKED
Sophos 3.27.0 4.73G sav32cli.exe -ndi -ns -nb -all -rec -nremove -eec -sc -f -tnef -mime -oe -pua -suspicious -archive -nmbr -nmem
Sunbelt 3.9.2557.2 32446 vscan /r /v
Symantec Norton360 6.4.0.9 LiveUpdate symscan.exe /defs
TrendMicro 9.700-1001 Friday, 22 August 2014 vscantm.exe /S /NM /NB /NC
Vexira 5.5.2.13 15.0.385.1 vascan --all-files --heuristics=high --sfx --action=skip -G
VirusBlokAda 3.12.26.3 Friday, 22 August 2014 vba32w /mr=0 /as=0 /bt- /m=3 /af+ /pm+ /rw+ /ha=2 /vm+ /ar+ /sfx+ /ml+
VirusBuster 5.5.2.13 15.0.745.0 vbscan.exe --all-files --heuristics=high --sfx --action=skip -G

Updates

These reports are updated once a day.

Getting New Scanners Added

If you are an AV vendor and would like to have your scanner added to our list, please email admin<at>shadowserver.org for that request. We will need a CLI version of the scanner for Linux or Windows (or both if you have them). We will need to know how to update the subscriptions and data files. We would also like to have the suggested running options for your scanner.

AV Processing Statistics

This chart is the total number of files processed by the AV test system.

Zero AV Detection Statistics

These statistics are the result of AV testing over a 48-hour period and how many files were still not detected by any single vendor. There is a severe change in the results after 2011-07 which is when we added in the Windows AV scanners to our test suite. While on most days the results are not zero, the values are so low as to not be seen in the current chart.

<< | Statistics | >>