About Me

Igor Muttik

Igor Muttik
Senior Architect

Read More

Feeds & Podcasts

Blogs

Meet the Bloggers

Archive

Tags

#SecChat $1 million guarantee 12 Scams of Christmas access to live fraud resolution agents Acquisition Alex Thurber Android antivirus Apple botnet Channel Partners cloud security Compliance Consumer counter identity theft credit card fraud and protection credit fraud alerts credit monitoring credit monitoring and resolution critical infrastructure Cyber Security Mom cyberbullying Cybercrime cybermom data breach data center data center security Data Protection Dave DeWalt DLP Email & Web Security embedded encryption Endpoint Protection enterprise facebook fake anti-virus software Family Safety Friday Security Highlights global threat intelligence google government Hacktivism how to talk to kids how to talk to teens identity fraud identity fraud scams identity protection identity protection $1 million guarantee identity protection fraud identity protection surveillance identity surveillance identity theft identity theft expert identity theft fraud identity theft protection identity theft protection product Identity thieves and cybercriminals intel iphone kids online behavior lost wallet protection malware McAfee McAfee Channel McAfee Family Protection McAfee Identity Protection McAfee Initiative to Fight Cybercrime McAfee Labs McAfee security products Mid-Market Mobile mobile malware mobile security monitor credit and personal information Network Security online personal data protection online safety Operation Aurora PCI personal identity theft fraud personal information loss personal information protection phishing privacy proactive identity protection proactive identity surveillance Public Sector restore credit and personal identity Risk and Compliance scam scams scareware security smartphones social media social networking social networks spam Stuxnet twitter vulnerability Web 2.0 work with victim restore identity

Shall we all write viruses to find the best antivirus?

Wednesday, August 16, 2006 at 5:38am by Igor Muttik
Igor Muttik

A Website called ConsumerReports.org today published an article (strangely it was dated “September 2006) about a test they conducted involving 5,500 samples of artificially created virus samples.

There are several things here that do not seem right:

  1. It is claimed that created viruses were “the kind you’d most likely encounter in real life” which is, of course, something the testers cannot know.
  2. Creating new viruses for the purpose of testing and education is generally not considered a good idea – viruses can leak and cause real trouble (you can read an open letter on the AVIEN site about that).
  3. There is a more scientific way of measuring real proactive detection of AV products on future malware – it is called “proactive testing” or “retrospective testing”. The idea is to measure, say, 3-month old AV product against real field viruses that appeared within these last 3 months. The discussion of the methodology of such tests can be found here and some real test results with common AV products are on the AV-comparatives.org site.
  4. Objection #1, that ConsumerReports.org cannot know what viruses we are going to face in future could be moot as their testing team apparently invented a time machine and shifted themselves forward to September ;-) .
Bookmark and Share

Submit your own comments / message for this post

Your email is never published nor shared. Required fields are marked *

 

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

Comments (2)

  • Foobar April 26, 2008 9:42PM

    So perhaps the methodology wasn’t as professional as you would like. So what. The simple fact is that Consumer Reports created a variety of viruses and anti-virus protection software such as McAfee didn’t do a very good job in protecting against those viruses.

    Listen, as you well know there are thousands of new viruses for Windows created every month. How is Consumer Reports creating viruses for the purpose of testing different then the real-world reality of hackers creating viruses every day?

    Good article: http://securityabsurdity.com/failure.php

  • Fumba January 20, 2008 6:22AM

    Dear Sir,
    isn’t the tragic truth rather that you are upset because your “security software” was widely unable to detect simple modifications of existing malware, although it obviously should?

    You are trying to rule out something that your software did not detect because your software did not detect it. This is the same approach that the many “secure by obscurity” security systems take. It also strongly reminds me of the propaganda and ideology that were common in the USSR and East Germany, and which is still encountered in China today (“we have no gays”, “there are no HIV infections in our country”, “there is nothing to criticise”).
    Denying an obvious condition does not make it disappear, and reacting to criticism by declaring criticism invalid or illegal is simply evidence of incapacity.

    You make your living by selling a solution that presumably makes your customers’ computers safe for a lot of money. What does it tell us if a few people who aren’t even professional virus writers can easily bypass your security, and instead of assessing the problem, you leash out propaganda?