2021年 第三者機関テストでの高い評価

3位以内に入賞した割合

75回：テスト/レビューに参加

57回（76%)：1位受賞（受賞率）
AVG

Avast

Broadcom(Symantec)

60%

Total AV40%

Sophos
Avira

20%
0%

1

1位受賞 57回
テスト/レビュー参加
75回
3位入賞率 84%

Microsoft

NortonLifeLock80%

63回（84%)：3位以内に入賞（入賞率)

Kaspersky

100%

G DATA

McAfeeESET

Bitdefender

Trend Micro
Malwarebytes

25

35

45

55

Copyright © 2022 Kaspersky Lab. All rights reserved.

65

75

85

テスト/レビューへの参加回数

注）• 2021年に実施された法人、個人、モバイル向け製品の第三者機関
テスト結果をKasperskyが独自に集計したものです。
• 第三者機関にはAppEsteem, AV-Comparatives, AV-TEST,ICSA Labs, MRG Effitas, SE Labs, Testing Ground Labs,
Virus Bulletinが含まれます。
• 各テストは既知および未知の脅威ならびに高度な攻撃に対する防御性能を対象にしています。
• “Most Tested”は、2013～2021年の期間で確認しています。
• 円の大きさは1位受賞の回数を表しています。

2021年 第三者機関テスト ‐TOP3メトリック 集計詳細
TOP3メトリックは、1年間に実施された第三者機関によるテスト結果をKasperskyが独自に集計したものです

テスト
参加回数

上位3位
入賞数

上位3位
入賞率

1位
受賞数

Kaspersky

75

63

84%

57

AVG

52

39

75%

37

Broadcom (Symantec)*

28

21

75%

16

Avast

73

53

73%

48

Microsoft

54

38

70%

32

NortonLifeLock

50

34

68%

33

Bitdefender

80

48

60%

43

Total AV

43

26

60%

26

Avira

54

32

59%

31

McAfee

59

34

58%

33

Sophos

53

31

58%

25

G DATA

56

30

54%

30

2021年のスコアは2022年2月1日時点のデータを集計しました。それ以降のテストやレビューは含んでいません。

Trend Micro

65

33

51%

32

TOP3スコアには、次のセキュリティベンダーの結果が含まれています：Avast, AVG, Avira, Bitdefender,
Blackberry (Cylance), Broadcom (Symantec), BullGuard, CrowdStrike, ESET, F-Secure, G DATA, McAfee,
Kaspersky, Microsoft, NortonLifeLock, Palo Alto, Panda, Sentinel One, Sophos, Trend Micro, Quick Heal andVMware (Carbon Black)すべての参加ベンダーのリストは、このドキュメントの最後に記載しています。

ESET

69

32

46%

29

Malwarebytes

46

9

20%

8

主な指標である「TOP3スコア」は、集計期間中にベンダーとその製品が参加した第三者機関によるテストで、1位、2位、または3位を受賞した回数を示す「上位3位への入賞率」です。「上位3位への入賞率」は、ベンダーの「上位3位への入賞数」を当該ベンダーのテストへの「参加回数」で割ってパーセント値に変換する方法で算出します。
「TOP3スコア」（上位3位への入賞率）は、参加ベンダーそれぞれについて計算し比較します。
1. テストによっては参加ベンダーに賞を授与する場合や、検知率と誤検知数のリストのみを提示する場合などがあるため、最終テスト結果は異なることがあります。
ベンダーの「上位3位への入賞数」は、賞を受賞した場合またはテストで上位3位以内に入った場合に加算されます。受賞と上位3位以内の入賞の両方で件数が加算されることはありません。複数のベンダーが検知率
またはサマリー結果で同じ結果を、あるいは同じ評価の賞を獲得している場合があります。この場合、ベンダーは同じテストで同率順位の扱いとなります。検知率またはサマリー結果の場合、結果が同率順位より低いベンダーの順位は、「上位のベンダーの数+ 1」として計算されます。たとえば、「1、1、3、4」、「1、2、2、4」、または「1、1、1、1、1、6」では、下線のベンダーのみ上位3位への入賞数が加算されます。
「1、1、2、3」の順位付けは不可です。これらの順位では、太字のベンダーのみ、上位3位への入賞数が加算されます。
2. ベンダーの「参加回数」は、そのベンダーの製品の1つがテスト/レビュー/総合評価に参加するごとに加算されます。一部のテストでは、同じベンダーから複数の製品が同一テストに参加できる場合があります。その場合、すべての製品でベンダーの参加回数が加算されるため、参加回数がテストの合計数より多くなることがあります。
テストの合計数の35%以上に参加したベンダーのみをグラフ化しています。

2

Copyright © 2022 Kaspersky Lab. All rights reserved.

* Broadcom (Symantec) は全テストの23%の参加ですが、チャートに表示しています。

2021年 TOP3メトリック詳細（1）
ここでは、高度な脅威と誤検知を含む、さまざまな種類のマルウェアに対して実施されたテストをピックアップして紹介しています
Specific threats
Ransomware• AV-Comparatives. Advanced Threat Protection Test:
Consumer and Business• AV-Comparatives. Business Security Test

• AV-Comparatives. Malware Protection Test

• AV-Comparatives. Real-World Protection Test

• AV-TEST. Advanced Threat Protection: Ransomware
Protection Test
• AV-TEST. Bi-Monthly Certification: Consumer andBusiness• AV-TEST. Red Team Test: EDR and EPP, Consumer andBusiness• SE Labs. Enterprise Advanced Security (EDR) Test
• SE Labs. Enterprise Endpoint Protection Test

• SE Labs. Home Anti-Malware Protection Test

• SE Labs. Small Business Endpoint Protection Test

• MRG Effitas. 360 Degree Assessment & Certification

Fileless• AV-Comparatives. Endpoint Prevention & Response (EPR)
Test• AV-Comparatives. Advanced Threat Protection Test:
Consumer and Business

Exploits• AV-Comparatives. Advanced Threat Protection Test:
Consumer and Business3• MRG Effitas. 360 Degree Assessment & Certification• SE Labs. Enterprise Advanced Security (EDR) Test
• SE Labs. Enterprise Endpoint Protection Test
• SE Labs. Home Anti-Malware Protection Test

• SE Labs. Small Business Endpoint Protection Test

APT

• AV-Comparatives. Advanced Threat Protection Test:
Consumer and Business• AV-Comparatives. Endpoint Prevention & Response (EPR)
Test• ICSA. Advanced Threat Detection Certification• SE Labs. Enterprise Advanced Security (EDR) Test

Phishing• AV-Comparatives. Anti-Phishing Test

Stalkerware• AV-Comparatives. Stalkerware Test
• AV-TEST. Stalkerware Test

Dedicated tests• AV-Comparatives. Android VPN Test

• AV-TEST. Personal Identifiable Information Protection:
Sensitive Data Discovery test
• AV-TEST. Parental Control Certification• AV-TEST. VPN Test

Copyright © 2022 Kaspersky Lab. All rights reserved.

Android tests• AV-Comparatives. Android VPN Test
• AV-Comparatives. Mobile Security Review• AV-Comparatives. Stalkerware Test
• AV-TEST. Android Mobile Security Products Test:
Consumer and Business• AV-TEST. Stalkerware Test
• MRG Effitas. Android 360 Assessment Programme• Testing Ground Labs. Android Malware Detection Test

Mac tests• AV-Comparatives. Mac Security Test & Review• AV-TEST. Mac Detection & Performance Test: Consumer
and Business

Real-world tests• AV-Comparatives. Advanced Threat Protection Test:
Consumer and Business• AV-Comparatives. Business Security Test

• AV-Comparatives. Real-World Protection Test
• AV-TEST Bi-Monthly Certification Consumer and Business• SE Labs. Enterprise Endpoint Protection Test

• SE Labs. Home Anti-Malware Protection Test

• SE Labs. Small Business Endpoint Protection Test

False positives (FP)• All the tests mentioned above include FP measurements

2021年 TOP3メトリック詳細（2）このページ以降のテストは、2021年に実施されTOP3メトリックの算出に利用したものです
AppEsteem• Deceptor Fighter Certification
These tests are held every month, and measure the ability ofparticipating products to block Deceptors apps and allow
Certified apps.
Only products that block 95% / allow no more than two of the
Deceptor apps, and allow 95% / block no more than two of theCertified apps, pass the certification and gain an increment of
TOP3 counter for their vendor.

AV-Comparatives• Product of the YearAt the end of the year, this annual award is given to theConsumer related product which attained the highest awards inan entire year’s testing cycle, involving the following tests: 2
Malware Protection Tests (MPT) + 2 Real-World Protection
Tests (RWPT) + Enhanced Real-World Test + 2 Performance
Tests. According to AV-Comparatives’ rules, in cases where two
or more products receive the same maximum score, the award
goes to the product which gained the highest individual scoresand did not receive it the previous year. The seal is counted as afirst place in the TOP3 metric4

Products which were nominated, but did not receive the ‘Productof the Year’ award, are given the ‘Outstanding Product’ rank fortheir vendors, which counts as a second place in the TOP3
metrics.
Products which achieved at least 90 points across the entire test
cycle are awarded the ‘Top Rated’ rank for their vendors, whichcounts as a third place in the TOP3 metric. Products that fail toscore any points in, at least, one of the tests are excluded.
At the end of the year, medals ('Gold’, ‘Silver’, ‘Bronze’) are also
given for the best results in specific tests: MPT, RWPT,
Performance, Enhanced Real-World Test. As these test results
have already contributed to overall TOP3 metrics, the medals
themselves do not count towards it since 2015.
Only awards can contribute towards TOP3 counters in
AV-Comparatives tests.

• Malware Protection Test
This test is a successor of the File Detection Test and includes
execution of the tested files. It is conducted twice a year and,correspondingly, is counted two times in the metrics. The test
consists of two parts: Detection Rate and False Positives.
Products receive the following awards: “Advanced+”, “Advanced”,“Standard” or “Tested”. Only products with “Advanced+” gain an
increment of TOP3 counters for their vendor.

Copyright © 2022 Kaspersky Lab. All rights reserved.

• Real-World Protection Test
The test lasts for four months and is finalized in a half-year reportusing mainly current, visible, and relevant malicious
websites/malware. The test is conducted twice a year and,correspondingly, counted two times in the metrics. Because all
product components contribute a significant role in overall
protection, results achieved in this category are a good indicatorof anti-malware product efficiency in real-world scenarios.
Products receive the following awards: “Advanced+”, “Advanced”,“Standard” or “Tested”. Only products with “Advanced+” gain an
increment of TOP3 counters for their vendor.

• Anti-Phishing Test
This test is performed and counted in the metrics once a year andsimulates a common situation: users rely on the anti-phishingprotection provided by their security products while browsing theweb. The test consists of two parts: Detection Rate and False
Positives.
If all products achieved zero False Positives, the products
achieving the highest three places based on Protection Rate, gain
an increment of TOP3 counters for their vendor.
If any of participating products achieved any False Positives, only
certified products gain an increment of TOP3 counters for theirvendor.

2021年 TOP3メトリック詳細（3）AV-Comparatives• Advanced Threat Protection Test: Consumer
and BusinessThis test uses hacking and penetration techniques that allow
attackers to target specific external computer systems, andevaluates how well security products protect against suchattacks. This test checks protection against targeted advanced
threats, such as exploits and fileless attacks.
Despite the fact that all products from consumer Main-TestSeries are expected to be tested by default, the vendors were
given the opportunity to opt out of this test before it started,which is why not all vendors are included in this test. This test is
conducted and counted in the metrics once a year. Consumer andBusiness related products are assessed separately.
Consumer products receive the following awards: “Advanced+”,“Advanced”, “Standard” or “Tested”. Only products with“Advanced+” gain an increment of TOP3 counters for theirvendor.
Business products which block at least 8 of the 15 attacks used in
the test, without blocking non-malicious operations, are certified
by the test lab and gain an increment of TOP3 counters for theirvendor.

• Endpoint Prevention & Response (EPR) Test
This test is performed and counted once a year and includes a
study of security solution performance metrics in relation totargeted attacks (time to prevention; time to response),
correlating all stages to the tactics and techniques of the MITRE
ATT&CK matrix, and the total cost of ownership (TCO) calculated
for each product.

• Business Security Report
This report is published twice a year. Correspondingly, it iscounted twice in the metrics. The report includes a review ofvarious business security products and evaluates the protection
efficiency in categories such as Protection Rate on different
malware sets, websites, and exploits, and a False Positive level.
Products achieving at least a 90 percent Protection Rate with noFalse Positives on common business software in the Malware
Protection Test and at least 90 percent Protection Rate with lessthan 100 False Positives on any clean software/websites in theoverall Real-World Protection Test, with no major performanceissues, are certified by the test lab, and gain an increment of
TOP3 counters for their vendor.

• Stalkerware Test
This test is performed and counted in the metrics once a year. It
evaluates capabilities of Android-based endpoint security
solutions and a network analysis tool TinyCheck, which runs on
Linux-based devices such as Raspberry Pi mini-computers, todetect the Stalkerware class of threats and correctly cooperatewith stalkerware victims in case Stalkerware is detected on amobile device. Due to it being methodological impossible tocompare TinyCheck with Android-based security solutions, theseproducts are assessed separately.
Products placing in the highest three positions based on the
Detection Rate gain an increment of TOP3 counters for theirvendor.

Products that demonstrate the three highest
Prevention/Response Capabilities gain an increment of TOP3
counters for their vendor.

5

Copyright © 2022 Kaspersky Lab. All rights reserved.

• Mobile Security Review
This review is done and counted in the metrics once a year andincludes a malware protection test along with an overview ofadditional features (theft protection, battery consumption, etc.).
If all products achieved zero False Positives, the products
achieving the highest three places based on Protection Rate gain
an increment of TOP3 counters for their vendor.
If any of participating products achieved any False Positives, only
certified products gain an increment of TOP3 counters for theirvendor.

• Mac Security Test & Review
This review is done and counted in the metrics once a year andevaluates various Mac protection products against a productfeature list and measures protection levels in categories such as
Detection Rate on separate Mac- & Windows-related malware
sets and a False Positive level.
If all products achieve zero False Positives, the products
achieving the highest three places based on Protection Rate, gain
an increment of TOP3 counters for their vendor.
If any of participating products achieve any False Positives, only
certified products gain an increment of TOP3 counters for theirvendor.

2021年 TOP3メトリック詳細（4）AV-Comparatives• Android VPN Test
This test is done and counted in the metrics once a year. It is
performed in collaboration with PC Magazine and assesses
several customer-selected Android-based VPN applications interms of security, privacy, download speed, upload speed, andlatency.
Only certified products gain an increment of TOP3 counters fortheir vendor.

AV-TEST• Best Protection Award: Consumer
and BusinessThis annual award is given once a year for perfect results in theProtection category over the course of an entire year, during
which bi-monthly certification takes place. Consumer andBusiness related products are assessed separately.
Only products that receive this award gain a TOP3 counterincrement for their vendor.

• Best Usability Award: Consumer
and BusinessThis annual award is given once a year for perfect results in theUsability category over the course of an entire year, during which
bi-monthly certification takes place. Consumer and Business
related products are assessed separately.

• Best Android Security: Consumer
and BusinessThis annual award is given once a year for perfect results in the
Android security testing over the course of a whole year.
Consumer and Business related products are assessed
separately.
Only products that receive this award gain a TOP3 counterincrement for their vendor.

• Best Mac Security: Consumer and BusinessThis annual award is given once a year for perfect results in the
Mac security testing over the course of a whole year. Consumer
and Business related products are assessed separately.
Only products that receive this award gain a TOP3 counterincrement for their vendor.

• Bi-Monthly Certification:
Consumer and BusinessThis year-long certification series consists of Consumer andBusiness segments, each divided into six separate, two-monthlong tests, which results are published every even months, i.e.
this test is counted 6 times in the metrics. Consumer andBusiness related products are assessed separately. All
participating products are evaluated and receive points inProtection, Performance and Usability categories. The sum of thepoints gained in each category makes up the overall score;products in the top three have their TOP3 counters incremented.

Only products that receive this award gain a TOP3 counterincrement for their vendor.

6

Copyright © 2022 Kaspersky Lab. All rights reserved.

• Android Mobile Security Products Test:
Consumer and BusinessThis year-long certification series evaluates various security
protection products for Android and consists of Consumer andBusiness segments, each divided into six separate tests. Theirresults are published every odd month, i.e. this test is counted 6
times in the metrics. Consumer and Business related products
are assessed separately. All participating products are evaluatedand receive points in Protection, Performance and Usability
categories. The sum of the points gained in each category makes
up the overall score; products in the top three have their TOP3
counters incremented.

• Mac Detection & Performance Test:
Consumer and BusinessThis test evaluates various security protection products for Mac
OS X and consists of Consumer and Business segments, theresults of which are published and counted in the metrics fourtimes a year. Consumer and Business related products areassessed separately. All participating products receive points inProtection, Performance and Usability categories. The sum of thepoints gained in each category makes up the overall score;products in the top three have their TOP3 counters incremented.

2021年 TOP3メトリック詳細（5）AV-TEST• Personal Identifiable Information Protection:
Sensitive Data Discovery Test
This vendor-commissioned test is done and counted in themetrics once a year. It assesses two solutions and aims to reveal
their capabilities to detect German Personal Identifiable
Information (PII) in documents floating in an Office 365 accountwithout generating False Positives.
Each product that passes the certification gains an increment of
TOP3 counter for their vendor.

• VPN Test
The test is performed and counted in the metrics once a year. It
assesses and compares VPN solutions by separate topics ofusability, security, privacy, speed, and transparency.
Each product that passes the certification gains an increment of
TOP3 counter for their vendor.

• Parental Control Certification
This vendor-commissioned test is performed and counted in themetrics once a year and evaluates protection efficiency of security
products on Windows, Android and iOS platforms to protect
children from visiting unwanted web sites.
Only certified products gain an increment of TOP3 counters fortheir vendor.
The URL to be provided one of these days

• Advanced Threat Protection: Ransomware
Protection Test
This vendor-commissioned test is done and counted in themetrics once a year. It assesses security solutions for theirprotection efficiency against ransomware attacks, implemented inthree different scenarios and incorporating different popular
ransomware families.
Products placing in the highest three positions based on the Total
Protection Rate gain an increment of TOP3 counters for theirvendor.

• Red Team Test: EDR and EPP, Consumer
and BusinessThis test is done and counted in the metrics twice a year. It
assesses detection capabilities of EDR solutions and threat
prevention capabilities of EPP solutions against APT attacks
deploying ransomware without generating False Positives on
normal operations. The executed attack chains are split into
separate stages attributed to different TTPs from MITRE
ATT&CK. EDR and EPP related products, Consumer andBusiness ones are assessed separately.
Only certified products gain an increment of TOP3 counters fortheir vendor.

• Stalkerware Test
This test is performed and counted in the metrics one time a year
and evaluates capabilities of Android-based security solutions todetect stalkerware class of threats and correctly cooperate withstalkerware victims in case stalkerware is detected on a mobile
device.
Products placing in the highest three positions based on the
Detection Rate gain an increment of TOP3 counters for theirvendor.

7

Copyright © 2022 Kaspersky Lab. All rights reserved.

ICSA Labs• Advanced Threat Defense Certification
This assessment is performed every quarter, i.e. four times a
year, and aims to evaluate the efficiency of security solutions todetect new and little-known threats while minimizing false
positives.
Each product that passes the certification gains an increment of
TOP3 counter for their vendor.

MRG Effitas• 360 Assessment & Certification 1
This test is conducted and published four times a year andevaluates both the ability to block initial infection and time taken
to detect and remediate malware on a compromised system. This
test replaces the older “Time to Detect & Remediate
Assessment” test. Only certified products gain an increment of
TOP3 counters for their vendor.

• Android 360 Assessment Programme 1
This test is conducted and published four times a year andevaluates both the ability to block initial infection while copying itto the device, so called the Early Stage Detection, and whilerunning it, the Installation Stage. The test also includes a false
positive subtest.
Products placing in the highest three positions based on the
combined of two stages Detection Rate gain an increment of
TOP3 counters for their vendor.

1 Results for the fourth quarter were not taken into account in the TOP3
metrics as they had not been published by the database freeze deadline.

2021年 TOP3メトリック詳細（6）SE Labs (formerly known as Dennis
Technology Labs)• Enterprise Endpoint Protection Test
• Small Business Endpoint Protection Test
• Home Anti-Malware Protection Test
These quarterly-long tests are published and counted in themetrics four times a year. These tests aim to compare theeffectiveness of anti-malware products provided by well-known
security companies. Enterprise, Home, and Small Businessproducts are evaluated separately. The products are exposed tolive Internet threats during the test period. This exposure is
carried out in a very realistic way, closely reflecting the customer
experience. The results reflect how products perform under reallife, customer-use-case scenarios, i.e. what happens when a user
visits an infected website. The tests include a detection subtest
and a false positive one.
Three products with the highest Total Accuracy Rating scores(calculated as a combination of points of the two subsets) gain an
increment of TOP3 counters for their vendor.

• Enterprise Advanced Security (EDR) Test
This test is published and counted in the metrics one time thisyear. It is also known as Breach Response Test (Detection,
Protection) and evaluates effectiveness of a tested productagainst a range of hacking attacks designed to compromise
systems and penetrate target networks in the same way ascriminals and other attackers breach systems and networks. The
tests include a detection subtest and a false positive one.
Detection and Protection parts are evaluated separately.

• Annual Awards “BEST”
These annual awards are counted in the metrics once a year andgiven for perfect results in different categories over the course ofan entire year: Consumer Anti-Malware, Email Security Service,Endpoint Detection Response, Enterprise Endpoint, Free AntiMalware, Innovator, Network Detection and Response, New
Endpoint, Next Generation Firewall, Product Development, Small
Business Endpoint. Each award is assessed separately.
Only products that receive one of these awards gain a TOP3
counter increment for their vendor.

Testing Ground Labs
• Android Malware Detection Test: Consumer
and BusinessThis test evaluates how effectively mobile products can protect
users’ Android-based devices from threats. It includes a detection
subtest and a false positives one. Consumer and Business related
products are assessed separately and are published three times(Consumer) and one time (Business) this year.
Three products with the highest Total Scores (calculated as a
combination of the two subsets) gain an increment of TOP3
counters for their vendor.

Three products with the highest Total Accuracy scores(calculated as a combination of points of the two subsets) gain an
increment of TOP3 counters for their vendor.

8

Copyright © 2022 Kaspersky Lab. All rights reserved.

VirusBulletin• VB100 Certification
These tests are held every month starting from August, 2021 on
the Win10 operating system to evaluate different types of
products (before that, these tests were held every second month);
the reports are published eight times this year.
Each product that passes the certification gains an increment of
TOP3 counter for their vendor.

2021年 TOP3メトリック対象ベンダー• 1E• Comodo• Exosphere• McAfee• RevBits• Trend Micro• Acronis• CORE• Microsoft• Rising• Tuxguard• AdSpider• Coronet• ExpressVPN
International• Microworld• Sangfor• Ahnlab• CrowdStrike• NordVPN• Scanguard• Tweaking
Technologies• Antiy Labs

• Cybereason• NorthGuard• SecureAge• ArcaBit• CyberGhost S.A.

• NortonLifelock• SecuriON• Avast• BlackBerry (Cylance)• Palo Alto• SentinelOne• AVG• Cynet• Panda• Seqrite• Avira• CyRadar• Pango• Sequretec• Barracuda• Data443• PC Pitstop• Shield Antivirus• Bitdefender• Defenx• PCProtect• SonicWall• Broadcom (Symantec)• Dr.Web• Elastic• Intego• Sophos• BullGuard• Private Internet
Access Inc.

• Check Point• EmsiSoft• Juniper• Privax Limited• CHOMAR• Enigma Software
Group

• K7

• Proton Technologies• Kaspersky• Qi-ANXIN• eScan• Lavasoft• Qihoo 360• ESET• LINE• Quick Heal

• ESTsecurity• Malwarebytes• RCS LT• Cisco• ClamXav• Clario• CMC Cyber Security

9• Faronics• FireEye• Fortinet• F-Secure• G DATA• Google• GoSecure• Hammock• Ikarus

Copyright © 2022 Kaspersky Lab. All rights reserved.

• Tabidus• TAPI Security Labs

• Vendor A• Vendor B• Viettel Security• VIPRE• VMware (Carbon
Black)• WatchGuard• Webroot• Zemana• Zoner• TeamViewer• Tencent• TGSoft• Total Defense• Total AV(合計 104社)