download

MSE Fail’s AV-Test Certification; Microsoft Challenges the Testing Methodology

Microsoft’s antivirus product, Microsoft Security Essentials has once again failed AV-Test’s criteria for Certification. MSE was able to garner a score of 10 out of a possible 18, while a score of at least 11 was needed to obtain the certification.

The area where MSE failed was on detecting zero day attacks. MSE detected only around 78% of the attacks, whereas the industry standard is 91%. The test included 24 other security solutions out of which two other products also failed to obtain the certification. While Bit Defender Internet Security, Kaspersky Internet Security and Norton Internet Security got the highest ratings, AhnLab and PC Tools Internet Security failed.

Obviously, Microsoft was not happy with the test results and challenged AV-Test’s results in a blog post,

Our review showed that 0.0033 percent of our Microsoft Security Essentials and Microsoft Forefront Endpoint Protection customers were impacted by malware samples not detected during the test. In addition, 94 percent of the malware samples not detected during the test didn’t impact our customers.

AV-Test reports on samples hit/missed by category. We report (and prioritize our work) based on customer impact.

AV-Test’s test results indicate that our products detected 72 percent of all “0-day malware” using a sample size of 100 pieces of malware. We know from telemetry from hundreds of millions of systems around the world that 99.997 percent of our customers hit with any 0-day did not encounter the malware samples tested in this test.

AV-Test’s test results indicate that our products missed 9 percent of “recent malware” using a sample size of 216,000 pieces of malware. We know from telemetry that 94 percent of these missed malware samples were never encountered by any of our customers.

You can read the full response here.

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong>