2019年 第三者機関テストでの高い評価
86回：テスト/レビューに参加
64回：1位受賞

70回(81%)：3位以内に入賞(入賞率)3位以内にランクインした割合

100%

80%

60%

40%

Kaspersky

Symantec

1位受賞 – 64回
テスト/レビュー参加 – 86回
3位入賞率 – 81%

ESET

SophosAvira

AVG
Bitdefender

F-Secure

Trend Micro

Avast
G DATA
Microsoft20%

注）・ 2019年に実施された法人、個人、モバイル向け製品の第三者機関テスト結果をKasperskyが独自に集計したものです。
・ 第三者機関にはAV-Comparatives、AV-Test、SE Labs、ICSA Labs、
NSS Labs、MRG Effitas、Virus Bulletin、PCSLが含まれます。
・ 各テストは既知および未知の脅威ならびに高度な攻撃に対する防御性能を対象にしています。
・ 円の大きさは1位受賞の回数を表しています。

McAfee

テスト/レビューへの参加回数
0%
20

40

60

80

100
1

Copyright © 2020 Kaspersky Lab. All rights reserved.

2019年 第三者機関テスト ‐TOP3メトリックス 集計詳細
TOP3メトリックスは、1年間に実施された第三者機関によるテスト結果を
Kasperskyが独自に集計したものです。
テスト
参加回数

上位3位
入賞数

上位3位
入賞率

1位
受賞数

Kaspersky

86

70

81%

64

「TOP3スコア」（上位3位への入賞率）は、参加ベンダーそれぞれについて計算し比較します。

Symantec

68

52

76%

45

1. テストによっては参加ベンダーに賞を授与する場合や、検知率と誤検知数のリストのみを提示する場合などがあるため、最終テスト結果は異なることがあります。
ベンダーの「上位3位への入賞数」は、賞を受賞した場合、またはテストで上位3位以内に入った場合のどちらかについてのみ加算されます。受賞と上位3位以内の入賞の両方で加算されることはありません。
複数のベンダーが検知率またはサマリー結果で同じ結果を、あるいは同じ評価の賞を受賞している場合があります。この場合、ベンダーは同じテストで同率順位の扱いとなります。
検知率またはサマリー結果の場合、結果が同率順位より低いベンダーの順位は、「上位のベンダーの数+ 1」として計算されます。たとえば、「1、1、3、4」、「1、2、2、4」、または「1、1、1、1、1、6」では、下線のベンダーのみ上位3位への入賞数が加算されます。 「1、1、2、3」の順位付けは不可です。

ESET

60

36

60%

32

Sophos

37

21

57%

16

Bitdefender

70

36

51%

33

Avira

43

20

47%

19

AVG

40

18

45%

17

2. ベンダーの「参加回数」は、そのベンダーの製品の1つがテスト/レビュー/総合評価に参加するごとに加算されます。
一部のテストでは、同じベンダーから複数の製品が同一テストに参加できる場合があります。その場合、すべての製品
でベンダーの参加回数が加算されるため、参加回数がテストの合計数より多くなることがあります。

Avast

57

25

44%

22

Trend Micro

68

26

38%

24

F-Secure

37

14

38%

11

G Data

35

12

34%

11

Microsoft

45

13

29%

8

McAfee

67

18

27%

15

主な指標である「TOP3スコア」は、集計期間中にベンダーとその製品が参加した第三者機関によるテストで、1位、2位、または3位を受賞した回数を示す「上位3位への入賞率」です。「上位3位への入賞率」は、ベンダーの「上位3位への入賞数」を当該ベンダーのテストへの「参加回数」で割ってパーセント値に変換する方法で算出します。

2019年のスコアは2020年2月1日時点のデータを集計したもので、それ以降のテストやレビューは含んでいません。
テストの合計数の35%以上に参加したベンダーのみをグラフ化しています。
TOP3スコアには、次のセキュリティベンダーの結果が含まれています：Avast、AVG、Avira、Bitdefender、BullGuard、
CrowdStrike、Cylance、ESET、F-Secure、G DATA、Intel Security（McAfee）、Kaspersky、Microsoft、Palo Alto、
Panda、Sentinel One、Sophos、Symantec、Trend Micro、Quick Heal。

2

Copyright © 2020 Kaspersky Lab. All rights reserved.

2019年 TOP3メトリックス詳細（1）
これらのテストは高度な脅威を含むさまざまな種類のマルウェアに対して実施されたものです。防御率と誤検知の頻度も重視しています。TOP3メトリックスの算出に利用しています。
Specialized threats

Dedicated Tests

Ransomware
Financial malware• MRG Effitas. 360 Degree Assessment & Certification• MRG Effitas. Online Banking/Browser Security Certification• SE Labs. Enterprise Endpoint Protection Test
• MRG Effitas. 360 Degree Assessment & Certification• SE Labs. Home Anti-Malware Protection Test
APT
• SE Labs. Small Business Endpoint Protection Test
• ICSA Labs. Advanced Threat Defense Certification Testing• AV-TEST. Bi-Monthly Certification: Consumer and Business• SE Labs. Breach Response Test
• AV-Comparatives. Real-World Protection Test
• AV-Comparatives. Enhanced Real-World Test: Consumer• AV-Comparatives. Malware Protection Test
and Business• AV-Comparatives. Business Security Report
Phishing
Fileless• AV-Comparatives. Anti-Phishing Test
• AV-Comparatives. Enhanced Real-World Test:• Virus Bulletin. VBWeb Comparative Review
Consumer and BusinessAndroid Tests• AV-Comparatives. Mobile Security Review• AV-Comparatives. Android Test
• AV-TEST. Android Mobile Security Products Test
• MRG Effitas: Android 360 Assessment Programme• PCSL. Mobile Security Product Test for Android• SE Labs. Breach Response Test
• AV-TEST. Fileless Threat Protection Test
Exploits• SE Labs. Enterprise Endpoint Protection Test
• SE Labs. Home Anti-Malware Protection Test
• SE Labs. Small Business Endpoint Protection Test
• MRG Effitas. 360 Degree Assessment & Certification• NSS Labs. Advanced Endpoint Protection Test
• AV-Comparatives. Enhanced Real-World Test
• SE Labs. Breach Response Test
• Virus Bulletin. VBWeb Comparative Review

Mac Tests• AV-Comparatives. Mac Security Test & Review• AV-TEST. Mac Detection & Performance Test: Consumer
and Business
Remediation Tests• AV-TEST. Remediation Product Test

Real-World Tests• AV-Comparatives. Real-World Protection Test
• AV-Comparative. Enhanced Real-World Test
• AV-TEST Bi-Monthly Certification Consumer and Business• SE Labs. Enterprise Endpoint Protection Test
• SE Labs. Home Anti-Malware Protection Test
• SE Labs. Small Business Endpoint Protection Test

False positives (FP)• All the tests mentioned above include FP measurements

3

Copyright © 2020 Kaspersky Lab. All rights reserved.

2019年 TOP3メトリックス詳細（2）このページ以降のテストは、2019年に実施されTOP3メトリックスの算出に利用したものです。
AV-Comparatives• Product of the YearAt the end of the year, this annual award is given to thevendor who attained the highest awards in an entire year’s
testing cycle, involving the following tests: Malware
Protection Test (MPT) + Real-World Protection Test
(RWPT) + Enhanced Real-World Test + Performance
Test. According to AV-Comparatives’ rules, in cases where
two or more vendors receive the same maximum score, theaward goes to the vendor who has never received it before,or was the last of the participants to receive it previously.
The seal is counted as a first place in the TOP3 metric.
Vendors who were nominated, but did not receive the‘Product of the Year’ award, are given the ‘Outstanding
Product’ rank, which counts as a second place in the TOP3
metrics.
Vendors who achieved at least 90 points across the entire
test cycle are awarded the ‘Top Rated’ rank, which counts
as a third place in the TOP3 metric. Vendors that fail toscore any points in, at least, one of the tests are excluded.
At the end of the year, medals ('Gold’, ‘Silver’, ‘Bronze’) arealso given for the best results in specific tests: MPT,
RWPT, Performance, Enhanced Real-World Test. As thesetest results have already contributed to overall TOP3
metrics, the medals themselves do not count towards it
since 2015.
Only awards can contribute towards TOP3 counters in
AV-Comparatives tests.

• Malware Protection Test
This test is a successor of the File Detection Test andincludes execution of the tested files. It is conducted
twice a year and, correspondingly, is counted two times in
the metrics. The test consists of two parts: Detection Rateand False Positives.
Products receive the following awards: “Advanced+”,“Advanced”, “Standard” or “Tested”. Only products with“Advanced+” gain an increment of TOP3 counters for theirvendor.
• Real-World Protection Test
The test lasts for five months and is finalized in two halfyear reports using mainly current, visible, and relevant
malicious websites/malware. Correspondingly, this test iscounted two times in the metrics. Because all productcomponents contribute a significant role in overall
protection, results achieved in this category are a good
indicator of anti-malware product efficiency
in real-world scenarios.
Products receive the following awards: “Advanced+”,“Advanced”, “Standard” or “Tested”. Only products with“Advanced+” gain an increment of TOP3 counters for theirvendor.

• Enhanced Real-World Test:
Consumer and BusinessThis is the Advanced Threat Protection test that checks
the products’ defenses against targeted attacks that aim
to sabotage corporate networks or steal confidential
data. This test is conducted and counted in the metrics
once a year. Consumer and Business related products
are assessed separately.
Products receive the following awards: “Advanced+”,“Advanced”, “Standard” or “Tested”. Only products with“Advanced+” gain an increment of TOP3 counters fortheir vendor.
• Anti-Phishing Test
This test is performed and counted in the metrics once a
year and simulates a common situation: users rely on theanti-phishing protection provided by their security
products while browsing the web. The test consists of
two parts: Detection Rate and False Positives.
If all products achieved zero False Positives, theproducts achieving the highest three places based on
Protection Rate, gain an increment of TOP3 counters fortheir vendor.

If any of participating products achieved any False
Positives, only certified products gain an increment of
TOP3 counters for their vendor.

4

Copyright © 2020 Kaspersky Lab. All rights reserved.

2019年 TOP3メトリックス詳細（3）AV-Comparatives• Android Test
This test is performed and counted in the metrics once a
year and evaluates the protection capabilities of mobile
security applications for Android.
Products achieving the highest three places, based on
Protection Rate, gain an increment of TOP3 counters fortheir vendor.
• Mobile Security Review
This review is done and counted in the metrics once a
year and includes a malware protection test along withan overview of additional features (theft protection,battery consumption, etc.).
If all products achieved zero False Positives, theproducts achieving the highest three places based on
Protection Rate, gain an increment of TOP3 counters fortheir vendor.
If any of participating products achieved any False
Positives, only certified products gain an increment of
TOP3 counters for their vendor.
•

Mac Security Test & Review

AV-TestIf all products achieved zero False Positives, the products
achieving the highest three places based on Protection
Rate, gain an increment of TOP3 counters for their vendor.
If any of participating products achieved any False
Positives, only certified products gain an increment of
TOP3 counters for their vendor.
• Business Security Report
This report is conducted and published twice a year.
Correspondingly, it is counted two times in the metrics.
The report includes a review of various business security
products and also evaluates the protection efficiency in
categories such as Protection Rate on different malware
sets, websites, and exploits and a False Positive level.
Products achieving, at least, 90 percent Protection Ratewith no False Positives on common business software in
the Malware Protection Test and, at least, 90 percent
Protection Rate with less than 100 False Positives on any
clean software/websites in the overall Real-World
Protection Test, with no major performance issues, arecertified by the test lab, and gain an increment of TOP3
counters for their vendor.

• Best Protection Award: Consumer
and BusinessThis annual award is given once a year for perfect resultsin the Protection category over the course of an entire
year, during which bi-monthly certification takes place.
Consumer and Business related products are assessed
separately.
Only products that receive this award gain a TOP3 counterincrement for their vendor.
• Best Usability Award: Consumer
and BusinessThis annual award is given once a year for perfect resultsin the Usability category over the course of an entire year,
during which bi-monthly certification takes place.
Consumer and Business related products are assessed
separately.
Only products that receive this award gain a TOP3 counterincrement for their vendor.

This review is done and counted in the metrics once a
year and evaluates various Mac protection products
against a product feature list and measures protectionlevels in categories such as Detection Rate on separate
Mac- & Windows-related malware sets and a False
Positive level.

5

Copyright © 2020 Kaspersky Lab. All rights reserved.

2019年 TOP3メトリックス詳細（4）SE Labs

AV-Test• Best Android Security
This annual award is given once a year for perfectresults in the Android security testing over the course of
a whole year.
Only products that receive this award gain a TOP3
counter increment for their vendor.
• Bi-Monthly Certification: Consumer
and BusinessThis year-long certification series consists of Consumer
and Business segments, each divided into six separate,
two-month-long tests, which results are published every
even months, i.e. this test is counted 6 times in themetrics. Consumer and Business related products areassessed separately. All participating products areevaluated and receive points in Protection, Performanceand Usability categories. The sum of the points gainedin each category makes up the overall score; products inthe top three have their TOP3 counters incremented.
• Android Mobile Security Products Test
This year-long certification series is divided into six
separate, month-long tests, which results are publishedevery odd months, i.e. this test is counted 6 times in themetrics. All participating products are evaluated andreceive points in Protection, Performance and Usability
categories. The sum of the points gained in eachcategory makes up the overall score; products in the top
three have their TOP3 counters incremented.

• Mac Detection & Performance Test:
Consumer and BusinessThis test evaluates various security protection products
for Mac OS X and is conducted twice a year.
Correspondingly, this test is counted two times in themetrics. Consumer and Business related products areassessed separately. All participating products receive
points in Protection, Performance and Usability
categories. The sum of the points gained in each category
makes up the overall score; products in the top three havetheir TOP3 counters incremented.
• Repair Test: Integrated and DedicatedThis test is published and counted in the metrics once a
year, and evaluates various security protection packages
for clean-up performance and system recovery. Integrated
and dedicated Consumer products are assessed
separately.
Three products with the highest remediation points gain
an increment of TOP3 counters for their vendor.
• Fileless Threat Protection Test
This vendor-comissioned test aims to reveal ability of the
products to detect fileless threats and protect andremediate all malicious actions by fileless threats.
Three products with the highest Protection Rate gain an
increment of TOP3 counters for their vendor.

• Enterprise Endpoint Protection Test
• Home Anti-Malware Protection Test
• Small Business Anti-Virus Protection Test

These quarterly-long tests are published and counted in
the metrics four times a year. These tests aim tocompare the effectiveness of anti-malware products
provided by well-known security companies. Enterprise,Home, and Small Business products are evaluatedseparately. The products are exposed to live Internet
threats during the test period. This exposure is carriedout in a very realistic way, closely reflecting the customer
experience.
The results reflect how products perform under real-life,
customer-use-case scenarios, i.e. what happens when auser visits an infected website. The tests include a
detection subtest and a false positive one.
Three products with the highest Total Accuracy Ratingscores (calculated as a combination of points of the two
subsets) gain an increment of TOP3 counters for theirvendor.
• Breach Response Test
This vendor-comissioned test evaluates effectiveness ofa tested product against a range of hacking attacks
designed to compromise systems and penetrate target
networks in the same way as criminals and otherattackers breach systems and networks. The tests
include a detection subtest and a false positive one.
Three products with the highest Total Accuracy scores(calculated as a combination of points of the two
subsets) gain an increment of TOP3 counters for theirvendor.
6

Copyright © 2020 Kaspersky Lab. All rights reserved.

2019年 TOP3メトリックス詳細（5）MRG Effitas

Virus Bulletin

NSS Labs• Online Banking/Browser Security Certification• VB100 Comparative Review and Certification• Advanced Endpoint Protection Test

This test is conducted and published four times a year andassesses the efficiency of products against financial
malware by implementing different test methodologies andscenarios: ‘In The Wild’ real financial malware sets, botnet
environments, and simulations of different sensitive datainterception techniques. Only products that successfully
pass the first two steps receive certification and gain aTOP3 counter increment for their vendor.
• 360 Assessment & Certification
This test is conducted and published four times a year andevaluates both the ability to block initial infection and time
taken to detect and remediate malware on a compromised
system.
This test replaces the older “Time to Detect & Remediate
Assessment” test. Only certified products gain an
increment of TOP3 counters for their vendor.
• Android 360 Assessment Programme
The conducted every quarter test is published four times ayear and evaluates both the ability to block initial infection
while copying it to the device, so called the Early Stage
Detection, and while running it, the Installation Stage. The
test also includes a false positive subtest.
Products placing in the highest three positions based on
the combined of two stages Detection Rate gain an
increment of TOP3 counters for their vendor.

These tests are held every two months on operating
systems Win7 and Win10 in parallel to evaluate different
types of products; the reports are published six times a
year.
Each product that passes the certification gains anincrement of TOP3 counter for their vendor.

This test is done once a year and evaluates Advanced
Endpoint Protection solutions (AEP) on security
effectiveness and total cost of ownership.
Based on Detection Rate, products that achieve the top
three places gain an increment of TOP3 counters for theirvendor.

• VBWeb Comparative Review
This test is performed every quarter, i.e. four times a year,
and measures the ability of participating gateway levelproducts to prevent malicious traffic such as malicious
executables and drive-by downloads from infecting anorganization's network.
Each product that passes the certification gains anincrement of TOP3 counter for their vendor.

PCSL (PC Security Labs)• Mobile Security Product Test for Android 1
This test evaluates Detection Rate and False Positives ofmobile products every quarter and are published fourtimes a year.
Products achieving the highest three Final scores, basedon Detection Rate and False Positives, gain an incrementof TOP3 counters for their vendor.

ICSA Labs• Advanced Threat Defense Certification TestingThis assessment is performed every quarter, i.e. fourtimes a year, and aims to evaluate the efficiency of
security solutions to detect new and little-known threats
while minimizing false positives.

1:Results for the third and fourth quarters were nottaken into account in the TOP3 metrics as they had notbeen published by the database freeze deadline.

Each product that passes the certification gains anincrement of TOP3 counter for their vendor.

7

Copyright © 2020 Kaspersky Lab. All rights reserved.

2019年 TOP3メトリックス対象ベンダー• 1E• Cheetah Mobile• FireEye• Lavasoft• PSafe• TGSoft• AdSpider• Chili Security• Fortinet• Qihoo 360• Total Defense• AegisLab• Cisco• Fotoable• Lookout Mobile
Security• Quick Heal

• TotalAV• F-Secure• Malwarebytes• REVE• Trend Micro• G Data• MalwareFox• Rising• TrustGo• GizmoLife• Max Dev Labs

• Samsung• Trustlook• Google• McAfee• Scanguard• TrustPort• Hammock• Media Master• Securetek IT Solutions• Trustwave• Hawk App• Microsoft• Securion• Vendor A• Heimdal• Microworld• SentinelOne• Vendor B• Hi Security Lab• MY-DATA• Seqrite• Vendor C• AhnLab• Airo• Alibaba• Antivirus• Apps Studio• Antiy Labs
• Apex Apps
• APUS Group• ArcaBit• Avast• AVG• Avira• Baidu• Bitdefender• Brainiacs Apps
• Bsafe Labs
• BullGuard• CAP Lab• Carbon Black• Check Point• ClamXav• Clean Boost+• Comodo•

Counter Tack

• CrowdStrike• Cyber Intell Solutions• Cylance• Cynet• CYREN• Defenx• Dr.Web• DU Apps Studio• EmsiSoft• Endgame• Ensilo• eScan• ESET• ESTsoft• Exosphere• Faronics• Hyper Speed• MYMobileSecurity• SK Telecom• Vendor D• iBoss• NANO• Smooth Apps Studio• VIPRE• Ikarus• Nox• Sophos• Watchdog• INetCop• NQ mobile• SparkCognition• We Make It Appen• Innovana• NSHC• STOPzilla• Webroot• Intego• ONE App Limited• Super Cleaner Studio• Wontok• IntelliAV• Panda• Super Security Studio• Zemana• Iobit Mobile• PC Pitstop• Supermobilesafe• Zoner• Security• Juniper• PCProtect• Phone Clean Apps

• Symantec• TAPI Security Labs

• K7 Computing• Power Tools Team

• TeamViewer• Kaspersky• Privacy Lab• Tencent8

Copyright © 2020 Kaspersky Lab. All rights reserved.