The statistics that are listed here are the Day0 test. I.E. what are the results on the day that we acquire any binary and is tested. We also have included all the re-test results over the same calendar day. Each vendor should improve as they start detecting the older and more common malicious binaries.
Each of the vendor's update process is executed prior to each run to ensure that the latest virus signatures are loaded for our tests.
The tables on each page represent the results of the Anti-Virus tests against the malware that we collect each day. Each AV vendor has different capabilities and success in detecting malware that is collected. No single vendor detects 100%, nor can they ever. To expect complete protection will always be science-fiction.
That being said, you can see the different statistics of the different vendors in our charts. It can be confusing since each vendor uses a different name for each infection type and family. All tests are done with the same set of binaries for each vendor. We continue to test each of the binaries until each vendor is able to detect each piece of malware in our repository. Where ever possible we have attempted to contact the vendor for assistance with the command line options that we use. Otherwise we try different options to produce the highest detection rate available from the options.
In all cases the time periods listed for the charts are summarizations for that specific time period. So for the Re-Tests, the time period does not represent the interval for testing. ie, the weekly charts are for the last seven days of processing. The seven day Re-Test chart does not represent that the binaries were re-tested once in that period. It does represent a summarization of the processing and testing of the binaries in that time period.
It is difficult to not compare one vendor to the next due to how we have the data structured on the pages. It would be impossible not to try and derive conclusions from those results. While that is the case, our goal is not to create a real comparison site for everyone to try and compete to see which AV vendor is better than the next. There are a multitude of those already, each of which have their own sets of malware to test and rules that they follow for complete their testing. That is not our purpose. We do not have a specific set of malware to test. We instead gather in new malware daily and test it against the different vendors.
The versions of AV engines that we have are as new as the vendor can provide us and updated at least hourly if not more frequently. But they are gateway or fileserver products for the most part. We do have plans for using full consumer AV applications as well, but that will take time and much more in donations to allow us to build the back end for that. We will get to it, just not today.
The following Vendor tables show which of the AV vendors we are currently using as well as the engine and signature level of each application. In most cases we are using the command-line-interface versions, gateway versions, or file server versions. These are not the normal home user versions and in some cases are special versions for anti-virus test systems. The data within the tables is being pulled from the live systems and updated twice a day. The actual engines and signatures are attempted to be updated prior to each malware run whether it is from the day0 test or for a retry. So the applications should be as updated as possible before testing occurs.
The current list of AV tools that we use are as follows:
Linux Vendor List
|Authentium||4.6.5||201407250619||aiscan --nomem --nombr --noboot --all --pua|
|AVG||13.0.3114||3955/7917||avgscan --heur --arc --macrow --pwdw --repok --pup|
|Avira||22.214.171.124||126.96.36.199||avscan --batch -noboot -nombr -s -rs --scan-in-archive --alltypes --allfiles --without-PCK -nomem --heur-level=3 --alert-action=none|
|BitDefender||7.2||7.56043||bdc -arc -noclean|
|Clam||0.97.6||19221||clamscan --no-summary --detect-pua -r|
|DrWeb||6.0.0.02020||188.8.131.5280||drweb -ar -cn -ha -ok -path=$1|
|Eset||3.0.21||10150 (20140725)||esets_scan --files --arch --subdir --mail --sfx --rtp --adware --heur --adv-heur|
|FProt||184.108.40.206||201407250619||fpscan --scanlevel=4 --heurlevel=4 --archive=99 --adware --report|
|FSecure||2.50 build 11035||Thursday, 24 July 2014_01||fsav --allfiles=yes --scanexecutables=yes --archive=yes --mime=yes --riskware=yes --virus-action1=report --riskware-action1=report --suspected-action1=report --auto=yes --list=yes|
|Kaspersky||220.127.116.11||Monday, 4 February 2013||kes4lwks-control --scan-file|
|McAfee||5400.1158||5000 created Jul 25 2014||uvscan --recursive --noboot --allole --mime --program --unzip --secure --!guru --!server|
|Panda||9.04.03||23/07/2014||pavcl -auto -nob -cmp -nos -noscr -rpt:$out -aex -heu:1|
|QuickHeal||11.00||24 July, 2014||qhscan -DNAScan -ARCHIVE -WARE -LIST -PACKED -REPORT=$tmp|
|Sophos||4.94.0||4.95||savscan -all -archive|
|TrendMicro||9.200-1012||Friday, 25 July 2014||vscantmrh -S -NC -NM -NB|
|Vexira||18.104.22.168||15.0.365.0||vascan --all-files --heuristics=high --sfx --action=skip -G|
|VirusBlokAda||22.214.171.124||Thursday, 24 July 2014||vba32.sh -m=3 -af+ -pm+ -rw+ -ha=2 -vm+ -ar+ -sfx+ -ml+|
|VirusBuster||126.96.36.199||15.0.857.0||vbscan --all-files --heuristics=high --sfx --action=skip -G|
Windows Vendor List
|AhnLab||Friday, 11 October 2013.00||Friday, 11 October 2013.00||v3tmedic.exe /scantype:all /cure:off /log|
|Authentium||4.6.2||201407251147||aiscan.exe --nomem --nombr --noboot --all --pua|
|Avast||command-line scanner||140725-0||ashcmd /_ /s /d /p /a /c /i /t=a /x=P /e=100 /r=report|
|AVG||10.0.3955||271/7410||avgscanx.exe /HEUR /ARC /MACROW /PWDW /REPOK /PUP|
|Avira||188.8.131.52||184.108.40.206||scancl --nombr /s /z /a --nomem --heurlevel=3|
|BitDefender||7.1||7.56044||bdc.exe -arc -noclean|
|Clam||0.97.3||19221||clamscan --no-summary --detect-pua -r|
|Comodo||5.1||18961||cavscons /h2 /c|
|DrWeb||7.00.100.09170/7.00.9.04080||Thursday, 24 July 2014 19:03||dwscancl /ar /ha /ok /sls- /sps-|
|Emsisoft||220.127.116.11||Friday, 25 July 2014||a2cmd.exe /h /r /a /service|
|Eset||18.104.22.168||9674 (20140414)||ecls --files --arch --subdir --mail --sfx --rtp --adware --heur --adv-heur|
|Fortinet||5.1.153||22.531,||vscanner.exe -V -gALL|
|FProt||22.214.171.124||201407250836||bin64\\MS\\fpscan64.exe -i \\antivir.def --scanlevel=4 --heurlevel=4 --archive=99 --adware --report|
|FSecure||11.00.19100||Thursday, 24 July 2014||scan --archive --adv-heur|
|GData||AVA 24.3323,GD 25.3642||24.07.2014,24.07.2014||avkcmd.exe /scan(e0):|
|Kaspersky||126.96.36.1994||13022014 0450||avp.exe SCAN /i0 /fa|
|McAfee||15.6 5500.1093||6975 Sunday, 3 February 2013||scan.exe /RECURSIVE /NOBOOT /ALLOLE /MIME /PROGRAM /UNZIP /SECURE|
|Microsoft||1.10802||Thu Jul 24 08:44:06 2014||mpscanp.exe /report /rptall|
|Norman||5.99.02||Thursday, 24 July 2014 10:20||nvcc /BS- /C /CL:0 /N /L:0 /O /SB:1 /U|
|QuickHeal||14.00||24 July, 2014||qhscan /DNAScan /ARCHIVE /WARE /LIST /PACKED|
|Sophos||3.27.0||4.73G||sav32cli.exe -ndi -ns -nb -all -rec -nremove -eec -sc -f -tnef -mime -oe -pua -suspicious -archive -nmbr -nmem|
|Sunbelt||3.9.2557.2||31576||vscan /r /v|
|Symantec||20188.8.131.52||2014/4/20 Build: 8||symscan.exe /defs|
|TrendMicro||9.700-1001||Friday, 25 July 2014||vscantm.exe /S /NM /NB /NC|
|Vexira||184.108.40.206||15.0.385.1||vascan --all-files --heuristics=high --sfx --action=skip -G|
|VirusBlokAda||220.127.116.11||Thursday, 24 July 2014||vba32w /mr=0 /as=0 /bt- /m=3 /af+ /pm+ /rw+ /ha=2 /vm+ /ar+ /sfx+ /ml+|
|VirusBuster||18.104.22.168||15.0.743.0||vbscan.exe --all-files --heuristics=high --sfx --action=skip -G|
These reports are updated once a day.
If you are an AV vendor and would like to have your scanner added to our list, please email admin<at>shadowserver.org for that request. We will need a CLI version of the scanner for Linux or Windows (or both if you have them). We will need to know how to update the subscriptions and data files. We would also like to have the suggested running options for your scanner.
This chart is the total number of files processed by the AV test system.
These statistics are the result of AV testing over a 48-hour period and how many files were still not detected by any single vendor. There is a severe change in the results after 2011-07 which is when we added in the Windows AV scanners to our test suite. While on most days the results are not zero, the values are so low as to not be seen in the current chart.
<< | Statistics | >>