2020年 第三者機関テストでの高い評価
62回：テスト/レビューに参加

80%

60%

3位以内に入賞した割合

100%

45回（73%)：1位受賞（受賞率）

50回（81%)：3位以内に入賞（入賞率)

Kaspersky
1位受賞 45回
テスト/レビュー参加
62回
3位入賞率 81%

Symantec
Avira

Trend Micro

G DATAESET

NortonLifeLock40%

Sophos

20%

0%

AVG

Microsoft
F-Secure

McAfeeBitdefender

Avast

テスト/レビューへの参加回数
25

35

Copyright © 2021 Kaspersky Lab. All rights reserved.

45

55

65

注）
・2020年に実施された法人、個人、モバイル向け製品の第三者機関テスト結果をKasperskyが独自に集計したものです。
・第三者機関にはAV-Comparatives, AV-Test, SE Labs, ICSA
Labs, NSS Labs, MRG Effitas, Virus Bulletinが含まれます。
・各テストは既知および未知の脅威ならびに高度な攻撃に対する防御性能を対象にしています。
・“Most Tested”は、2013～2020年から2019～2020年の任意の期間で確認しています。
・円の大きさは1位受賞の回数を表しています。
1

2020年 第三者機関テスト ‐TOP3メトリック 集計詳細
TOP3メトリックは、1年間に実施された第三者機関によるテスト結果を
Kasperskyが独自に集計したものです。
主な指標である「TOP3スコア」は、集計期間中にベンダーとその製品が参加した第三者機関によるテストで、1位、2位、または3位を受賞した回数を示す「上位3位への入賞率」です。「上位3位への入賞率」は、ベンダーの「上位3位への入賞数」を当該ベンダーのテストへの「参加回数」で割ってパーセント値に変換する方法で算出します。
「TOP3スコア」（上位3位への入賞率）は、参加ベンダーそれぞれについて計算し比較します。

テスト
参加回数

上位3位
入賞数

上位3位
入賞率

1位
受賞数

Kaspersky

62

50

81%

45

ESET

63

47

75%

40

Broadcom (Symantec)*

32

23

72%

20

34

22

65%

19

40

24

60%

21

69

36

52%

31

56

28

50%

27

41

20

49%

20

Microsoft

45

21

47%

13

Sophos

37

17

46%

13

F-Secure

42

18

43%

16

Avast

57

21

37%

17

AVG

41

14

34%

12

McAfee

52

17

33%

13

1. テストによっては参加ベンダーに賞を授与する場合や、検知率と誤検知数のリストのみを提示する場合などがある
NortonLifeLock
ため、最終テスト結果は異なることがあります。
ベンダーの「上位3位への入賞数」は、賞を受賞した場合またはテストで上位3位以内に入った場合に加算されます。
Avira
複数のベンダーが検知率またはサマリー結果で同じ結果を、あるいは同じ評価の賞を受賞している場合があります。
この場合、ベンダーは同じテストで同率順位の扱いとなります。
Bitdefender
検知率またはサマリー結果の場合、結果が同率順位より低いベンダーの順位は、「上位のベンダーの数+ 1」としTrend Microて計算されます。たとえば、「1、1、3、4」、「1、2、2、4」、または「1、1、1、1、1、6」では、下線のベン
ダーのみ上位3位への入賞数が加算されます。 「1、1、2、3」の順位付けは不可です。
G DATA
2. ベンダーの「参加回数」は、そのベンダーの製品の1つがテスト/レビュー/総合評価に参加するごとに加算されます。
一部のテストでは、同じベンダーから複数の製品が同一テストに参加できる場合があります。その場合、すべての製品でベンダーの参加回数が加算されるため、参加回数がテストの合計数より多くなることがあります。
2020年のスコアは2021年2月3日時点のデータを集計したもので、それ以降のテストやレビューは含んでいません。
テストの合計数の35%以上に参加したベンダーのみをグラフ化しています。
TOP3スコアには、次のセキュリティベンダーの結果が含まれています：Avast, AVG, Avira, Bitdefender, BlackBerry(Cylance), Broadcom (Symantec), BullGuard, CrowdStrike, ESET, F-Secure, G DATA, Kaspersky, McAfee, Microsoft,
NortonLifeLock, Palo Alto, Panda, Sentinel One, Sophos, Trend Micro, Quick Heal, VMWare (Carbon Black)

Copyright © 2021 Kaspersky Lab. All rights reserved.

* Broadcom (Symantec) は全テストの34％しか参加していませんが、チャートに表示しています。

2

2020年 TOP3メトリック詳細（1）
これらのテストは高度な脅威を含むさまざまな種類のマルウェアに対して実施されたものです。
防御率と誤検知の頻度も重視しています。TOP3メトリックの算出に利用しています。
Specialized threats
Ransomware• AV-Comparatives. Business Security Test
• AV-Comparatives. Malware Protection Test
• AV-Comparatives. Real-World Protection Test
• AV-TEST. Bi-Monthly Certification: Consumer and Business• MRG Effitas. 360 Degree Assessment & Certification• NSS Labs. Advanced Endpoint Protection Test
• SE Labs. Home Anti-Malware Protection Test
• SE Labs. Small Business Endpoint Protection Test
• SE Labs. Enterprise Endpoint Protection Test

Dedicated Tests
Financial malware• MRG Effitas. Online Banking/Browser Security Certification（Q1)• MRG Effitas. 360 Degree Assessment & Certification (sinceQ2)

Android Tests• AV-Comparatives. Mobile Security Review• AV-TEST. Android Mobile Security Products Test
• MRG Effitas: Android 360 Assessment Programme

APT• AV-Comparatives. Endpoint Prevention & Response (EPR) Test
• AV-Comparatives. Enhanced Real-World Test: Consumer
and Business• ICSA. Advanced Threat Detection Certification

Mac Tests• AV-Comparatives. Mac Security Test & Review• AV-TEST. Mac Detection & Performance Test: Consumer
and Business
Email protection• SE Labs. Email Security Services Protection

Phishing
Fileless• AV-Comparatives. Anti-Phishing Test
• AV-Comparatives. Endpoint Prevention & Response (EPR) Test
• Virus Bulletin. VBWeb Comparative Review• AV-Comparatives. Enhanced Real-World Test:
Consumer and Business
Parental control• NSS Labs. Advanced Endpoint Protection Test
• AV-Comparatives. Parental Control Certification
Exploits• AV-Comparatives. Enhanced Real-World Test
• MRG Effitas. 360 Degree Assessment & Certification• NSS Labs. Advanced Endpoint Protection Test
• SE Labs. Home Anti-Malware Protection Test
• SE Labs. Small Business Endpoint Protection Test
• SE Labs. Enterprise Endpoint Protection Test
• Virus Bulletin. VBWeb Comparative Review

Real-World Tests• AV-Comparatives. Real-World Protection Test
• AV-Comparatives. Enhanced Real-World Test: Consumer
and Business• AV-TEST Bi-Monthly Certification Consumer and Business• SE Labs. Home Anti-Malware Protection Test
• SE Labs. Small Business Endpoint Protection Test
• SE Labs. Enterprise Endpoint Protection Test

Tests on a static collection• Virus Bulletin. VB100 Certification

False positives (FP)• All the tests mentioned above include FP measurements

Copyright © 2021 Kaspersky Lab. All rights reserved.

3

2020年 TOP3メトリック詳細（2）このページ以降のテストは、2020年に実施されTOP3メトリックの算出に利用したものです。
AV-Comparatives• Product of the YearAt the end of the year, this annual award is given to thevendor who attained the highest awards in an entire year’s
testing cycle, involving the following tests: Malware
Protection Test (MPT) + Real-World Protection Test
(RWPT) + Enhanced Real-World Test + Performance
Test. According to AV-Comparatives’ rules, in cases where
two or more vendors receive the same maximum score, theaward goes to the vendor who has never received it before,or was the last of the participants to receive it previously.
The seal is counted as a first place in the TOP3 metric.
Vendors who were nominated, but did not receive the‘Product of the Year’ award, are given the ‘Outstanding
Product’ rank, which counts as a second place in the TOP3
metrics.
Vendors who achieved at least 90 points across the entire
test cycle are awarded the ‘Top Rated’ rank, which counts
as a third place in the TOP3 metric. Vendors that fail toscore any points in, at least, one of the tests are excluded.
At the end of the year, medals ('Gold’, ‘Silver’, ‘Bronze’) arealso given for the best results in specific tests: MPT,
RWPT, Performance, Enhanced Real-World Test. As thesetest results have already contributed to overall TOP3
metrics, the medals themselves do not count towards it
since 2015.

• Malware Protection Test
This test is a successor of the File Detection Test andincludes execution of the tested files. It is conducted twicea year and, correspondingly, is counted two times in themetrics. The test consists of two parts: Detection Rate andFalse Positives.
Products receive the following awards: “Advanced+”,“Advanced”, “Standard” or “Tested”. Only products with“Advanced+” gain an increment of TOP3 counters for theirvendor.
• Real-World Protection Test
The test lasts for five months and is finalized in two halfyear reports using mainly current, visible, and relevant
malicious websites/malware. Correspondingly, this test iscounted two times in the metrics. Because all productcomponents contribute a significant role in overall
protection, results achieved in this category are a good
indicator of anti-malware product efficiency
in real-world scenarios.
Products receive the following awards: “Advanced+”,“Advanced”, “Standard” or “Tested”. Only products with“Advanced+” gain an increment of TOP3 counters for theirvendor.

• Enhanced Real-World Test: Consumer and BusinessThis is the Advanced Threat Protection test that checks
the products’ defenses against targeted attacks that aim tosabotage corporate networks or steal confidential data.
This test is conducted and counted in the metrics once ayear. Consumer and Business related products areassessed separately.
Products receive the following awards: “Advanced+”,“Advanced”, “Standard” or “Tested”. Only products with“Advanced+” gain an increment of TOP3 counters for theirvendor.
• Anti-Phishing Test
This test is performed and counted in the metrics once a
year and simulates a common situation: users rely on theanti-phishing protection provided by their security products
while browsing the web. The test consists of two parts:
Detection Rate and False Positives.
If all products achieved zero False Positives, the products
achieving the highest three places based on Protection
Rate, gain an increment of TOP3 counters for their vendor.
If any of participating products achieved any False
Positives, only certified products gain an increment of
TOP3 counters for their vendor.

Only awards can contribute towards TOP3 counters in
AV-Comparatives tests.

Copyright © 2021 Kaspersky Lab. All rights reserved.

4

2020年 TOP3メトリック詳細（3）AV-Comparatives• Endpoint Prevention & Response (EPR) Test
This test is performed and counted once a year andincludes a study of security solution performance metrics inrelation to targeted attacks (time to prevention; time toresponse), with correlating all stages to the tactics andtechniques of the MITRE ATT&CK matrix, and the total costof ownership (TCO) calculated for each product.
Products that demonstrate the three highest
Prevention/Response Capabilities gain an increment of
TOP3 counters for their vendor.
• Parental Control Certification
The test is performed and counted in the metrics once a
year and evaluates protection efficiency of security products
to prevent children from visiting unwanted web sites.
Products that blocked 98% of pornographic websites withno more than a few False Positives on child-friendly
websites, and have no severe unresolved bugs (or design
flaws) discovered during the review, are certified by the testlab, and gain an increment of TOP3 counters for theirvendor.
• Mobile Security Review
This review is done and counted in the metrics once a year
and includes a malware protection test along with an
overview of additional features (theft protection, battery
consumption, etc.).
If all products achieved zero False Positives, the products
achieving the highest three places based on Protection
Rate, gain an increment of TOP3 counters for their vendor.

Copyright © 2021 Kaspersky Lab. All rights reserved.

AV-TestIf any of participating products achieved any False
Positives, only certified products gain an increment of
TOP3 counters for their vendor.
• Mac Security Test & Review• Best Protection Award: Consumer and BusinessThis annual award is given once a year for perfect resultsin the Protection category over the course of an entire year,
during which bi-monthly certification takes place.
Consumer and Business related products are assessed
separately.

This review is done and counted in the metrics once a year
and evaluates various Mac protection products against a
Only products that receive this award gain a TOP3 counterproduct feature list and measures protection levels inincrement for their vendor.
categories such as Detection Rate on separate Mac- &Windows-related malware sets and a False Positive level.
• Best Usability Award: Consumer and BusinessIf all products achieved zero False Positives, the productsThis annual award is given once a year for perfect results
achieving the highest three places based on Protectionin the Usability category over the course of an entire year,
Rate, gain an increment of TOP3 counters for their vendor.
during which bi-monthly certification takes place.
If any of participating products achieved any False
Consumer and Business related products are assessed
Positives, only certified products gain an increment of
separately.
TOP3 counters for their vendor.
• Business Security Report

Only products that receive this award gain a TOP3 counterincrement for their vendor.

This report is conducted and published twice a year.
Correspondingly, it is counted two times in the metrics.
The report includes a review of various business security
products and also evaluates the protection efficiency in
categories such as Protection Rate on different malware
sets, websites, and exploits and a False Positive level.

• Best Android Security: Consumer and Business

Products achieving, at least, 90 percent Protection Ratewith no False Positives on common business software in
the Malware Protection Test and, at least, 90 percent
Protection Rate with less than 100 False Positives on any
clean software/websites in the overall Real-World
Protection Test, with no major performance issues, arecertified by the test lab, and gain an increment of TOP3
counters for their vendor.

Only products that receive this award gain a TOP3 counterincrement for their vendor.

This annual award is given once a year for perfect resultsin the Android security testing over the course of a wholeyear. Consumer and Business related products areassessed separately.

5

2020年 TOP3メトリック詳細（4）AV-Test• Best Mac Security: Consumer and BusinessThis annual award is given once a year for perfect results in
the Mac security testing over the course of a whole year.
Consumer and Business related products are assessed
separately.

MRG Effitas• Mac Detection & Performance Test: Consumer andBusiness
This test evaluates various security protection products for
Mac OS X and is conducted twice a year. Correspondingly,
this test is counted two times in the metrics. Consumer
and Business related products are assessed separately. All
participating products receive points in Protection,
Performance and Usability categories. The sum of thepoints gained in each category makes up the overall score;products in the top three have their TOP3 counters
incremented.

Only products that receive this award gain a TOP3 counterincrement for their vendor.
• Bi-Monthly Certification: Consumer and BusinessThis year-long certification series consists of Consumer
and Business segments, each divided into six separate,
two-month-long tests, which results are published every
even months, i.e. this test is counted 6 times in themetrics. Consumer and Business related products areassessed separately. All participating products areevaluated and receive points in Protection, Performanceand Usability categories. The sum of the points gained ineach category makes up the overall score; products in the
top three have their TOP3 counters incremented.
• Android Mobile Security Products Test : Consumer andBusiness
This year-long certification series is divided into six
separate, month-long tests, which results are publishedevery odd months, i.e. this test is counted 6 times in themetrics. All participating products are evaluated andreceive points in Protection, Performance and Usability
categories. The sum of the points gained in each category
makes up the overall score; products in the top three havetheir TOP3 counters incremented.

Copyright © 2021 Kaspersky Lab. All rights reserved.

ICSA Labs•

Advanced Threat Defense Certification
This assessment is performed every quarter, i.e. four [1]times a year, and aims to evaluate the efficiency of security
solutions to detect new and little-known threats while
minimizing false positives.
Each product that passes the certification gains anincrement of TOP3 counter for their vendor.

• Online Banking/Browser Security Certification
This test is conducted and published four times a year andassesses the efficiency of products against financial
malware by implementing different test methodologies andscenarios: ‘In The Wild’ real financial malware sets, botnet
environments, and simulations of different sensitive datainterception techniques. Only products that successfully
pass the first two steps receive certification and gain aTOP3 counter increment for their vendor.
• 360 Assessment & Certification
This test is conducted and published four times a year andevaluates both the ability to block initial infection and time
taken to detect and remediate malware on a compromised
system.
This test replaces the older “Time to Detect & Remediate
Assessment” test. Only certified products gain an
increment of TOP3 counters for their vendor.
• Android 360 Assessment Programme
The conducted every quarter test is published four times ayear and evaluates both the ability to block initial infection
while copying it to the device, so called the Early Stage
Detection, and while running it, the Installation Stage. The
test also includes a false positive subtest.
Products placing in the highest three positions based on
the combined of two stages Detection Rate gain an
increment of TOP3 counters for their vendor.

[1] Results for the fourth quarter were not taken into account in the TOP3
metrics as they had not been published by the database freeze deadline.

62020年 TOP3メトリック詳細（5）NSS Labs• Advanced Endpoint Protection Test v.4
This test is done once a year and evaluates Advanced
Endpoint Protection solutions (AEP) on security effectivenessand total cost of ownership.
Based on Detection Rate, products that achieve the top threeplaces gain an increment of TOP3 counters for their vendor.

• Email Security Services Protection Test
This test is performed and counted in the metrics one time ayear and assesses how effectively the email hosted
protection services for the Office365 platform are at detecting
and/or protecting against threats in real time, including
phishing, BEC (business e-mail compromise), social
engineering and real world spam. The test includes a
detection subtest and a false positive one.

• Home Anti-Malware Protection Test

Three products with the highest Total Accuracy Rating scores(calculated as a combination of points of the two subsets)gain an increment of TOP3 counters for their vendor.

• Small Business Anti-Virus Protection Test

• Annual Awards “BEST”• Enterprise Endpoint Protection Test

These annual awards are counted in the metrics once a yearand given for perfect results in different categories over thecourse of an entire year: Consumer Anti-Malware, Email
Security Service, Endpoint Detection Response, Enterprise
Endpoint, Free Anti-Malware, Innovator, New Endpoint,
Product Development, Small Business Endpoint. Each award
is assessed separately.

SE Labs (formerly known as Dennis Technology Labs)

These quarterly-long tests are published and counted in themetrics four times a year. These tests aim to compare theeffectiveness of anti-malware products provided by wellknown security companies. Enterprise, Home, and Small
Business products are evaluated separately. The products are
exposed to live Internet threats during the test period. This
exposure is carried out in a very realistic way, closelyreflecting the customer experience.
The results reflect how products perform under real-life,
customer-use-case scenarios, i.e. what happens when a user
visits an infected website. The tests include a detection
subtest and a false positive one.

Virus Bulletin• VB100 Comparative Review and Certification
These tests are held every two months on operating
systems Win7 and Win10 in parallel to evaluate different
types of products; the reports are published six times a
year.
Each product that passes the certification gains anincrement of TOP3 counter for their vendor.
• VBWeb Comparative Review
This test is performed every quarter, i.e. four times a year,
and measures the ability of participating gateway levelproducts to prevent malicious traffic such as malicious
executables and drive-by downloads from infecting anorganization's network.
Each product that passes the certification gains anincrement of TOP3 counter for their vendor.

Only products that receive one of these awards gain a TOP3
counter increment for their vendor.

Three products with the highest Total Accuracy Rating scores(calculated as a combination of points of the two subsets)gain an increment of TOP3 counters for their vendor.

Copyright © 2021 Kaspersky Lab. All rights reserved.

7

2020年 TOP3メトリック対象ベンダー• 1E• CMC Cyber Security• G Data• NorthGuard,• Sequretec• VIPRE• Acronis• Comodo• Google• SK Telecom• VMware (CarbonBlack)• AdSpider• CORE• GoSecure• NortonLifeLock• SonicWall• Webroot• AhnLab• CrowdStrike• Hammock• Sophos• Wontok• Antiy Labs

• Cybereason• Heimdal• SparkCognition• Zemana• ArcaBit• Cynet• iBoss• Tabidus• Zoner• Avast• CyRadar• Ikarus• AVG• CYREN• Innovana• Avira• Deep Instinct• Intego• Bitdefender• Defenx• Juniper• BlackBerry (Cylance)• Elastic• K7 Computing• EmsiSoft• Kaspersky• eScan• Lavasoft• ESET• LINE• ESTsecurity• Malwarebytes• Exosphere• McAfee• Faronics• Microsoft• FireEye• Microworld• Fortinet• Mimecast• F-Secure• NANO• BlackFort• Broadcom (Symantec)• BullGuard• Carbon Black• Check Point• Cheetah Mobile• Cisco• ClamXav• Clario

Copyright © 2021 Kaspersky Lab. All rights reserved.

• NSHC• Palo Alto
• Panda• PC Pitstop• PCProtect• Perception-Point• Pocket Bits
• Private Internet Access Inc.
• Qi-ANXIN• Quick Heal
• Rising• SafeDNS• Sangfor• Scanguard• SecureAge• Securion• SentinelOne• Seqrite• TAPI Security Labs
• TeamViewer• Tencent(合計 106社)• TGSoft• Total Defense• TotalAV• Trend Micro• TrustPort• Tuxguard• Tweaking Technologies• Vendor A• Vendor B• Vendor C• Vendor D

8