Android Malware Detection Test
Consumer Product2024

AprCelebrating Technology Innovation

Android Malware Detection Test 2024 April

Table of Contents

P1P2

P3Background

Test Process &Test Software

Tested Result

P4P4P5

Test Summary &Monthly Award

Compliance

Rights Statement

P5
Disclaimer

Report version 1.0, published on 2024.05.31, initial version© 2020-2024 Testing Ground Labs

Android Malware Detection Test 2024 April

Chap.1 Background
Android is a mobile operating system developed by Google. It is based on a modified
version of the Linux kernel and other open-source software, and is designed primarilyfor touchscreen mobile devices such as smartphones and tablets. In addition, Google
has further developed Android TV for televisions, Android Auto for cars, and Wear OSfor wrist watches, each with a specialized user interface. Variants of Android are also
used on game consoles, digital cameras, PCs and other electronics. Android's
smartphone share will hover with around 85% throughout the forecast. Volumes areexpected to grow at a five-year compound annual growth rate (CAGR) of 1.7% withshipments approaching 1.36 billion in 2022. Android maintained its position as theleading mobile operating system worldwide in January 2022, controlling the mobile
OS market with a close to 70 percent share. Google’s Android and Apple’s iOS jointly
possess over 99 percent of the global market share. Overall this is a positive sign that
consumers are seeing the benefits of moving to a slightly more premium device thanthey likely previously owned.
Aside from the clear advantages to build mobile devices on Android, the platform
also introduces numerous security risks to the platform users. Among them thefollowing malicious activities:
1.

Send messages to "premium service" SMS numbers that cost extra money.

2. Send your personal information to unknown parties.
3. Turn your phone into a part of a botnet so others can execute commands
remotely for nefarious purposes, such as spam, DDOS attack, and more.
4. Non-authorized persons may monitor your phone calls and text messages.
5. Open you to blackmail, if something embarrassing can be found and sent
elsewhere.
6. Trick you into entering financial information, such as account number, birthdate, and more.
7. Even stuff on your PC if you connect your PC to your smartphone.
Clearly, to protect user’s system and the data from the listed threats and theothers, Android-based security applications exist and their efficiency is to beevaluated regularly against the permanently evolving threats.
This test is designed to independently assess the efficiency of consumer security
solutions for Android OS on detecting currently spread malicious mobile apps.

P1© 2020-2024 Testing Ground Labs

Android Malware Detection Test 2024 April

Chap.2 Test Process & Test Software
Detailed process is as follows:1.

Several Android based mobile devices are prepared and backup images are
created then. Platform: Android 12 on XiaoMi 8.

2. 1061 malware samples and 492 different clean android applications installers
are collected, and delivered in a mixed set to the internal storage of mobiledevices. The malware is collected from multiple sources (including China
region-based ones), clean apps are taken from Google AppStore and other
legitimate app stores.
3. Install selected security applications on the physical mobile devices in default
configuration.
4. Update the security applications and their antivirus bases.
5. Run full scan of the collection by the security application. Malware detection
and false positive rates are recorded.
6. Install each missed malicious sample and then run it, detection (if happened)is recorded.
7. Installation process against clean apps is not executed.
8. Test date: April, 2024.

P2

VendorSoftwareVersionAhnLab

AhnLab V3 Mobile Security

3.0.0.8(Build 4145)

Avast

Avast Mobile Security

24.7.0-1004160-c4c71548a

Avira

Avira Antivirus Security for Android

7.23.0 build No. 240206004

Dr.WebDr.Web Mobile Security Suite

12.9.3(2)

ESET

ESET Mobile Security

v. 9.0.32.0-15Kaspersky

Kaspersky Plus for Android

11.111.4.11505

McAfeeMcAfee Mobile Security

8.2.0.480

NortonLifeLock

Norton 360 (Norton Mobile Security)

5.84.3.240409924

Total Defense

Total Defense Mobile Security

3.5.0.4© 2020-2024 Testing Ground Labs

Android Malware Detection Test 2024 April

Chap.3 Tested Result (The test results are shown on the following tab)Vendor

Total
Samples

MissedSamples

Detected
Samples

Detection
Rate

False Positive
CountsTotal Score

Avast

1061

01061

100.00%0100.00

ESET106101061

100.00%0100.00

Kaspersky

106101061

100.00%0100.00

NortonLifeLock

1061

01061

100.00%0100.00

Avira

1061

11060

99.91%

099.91

McAfee

1061

11060

99.91%

099.91

Total Defense

1061

71054

99.34%

099.34

AhnLab1061

15104698.59%

098.59Dr.Web1061

21104098.02%

098.02••P3

For each security solution, a Final Score is calculated once the full test isperformed:
Final Score = (Detection %) *100 - 0.2*FP
Basing on the Final Score, the correspondent rating is grated to eachparticipating security solution, in accordance with the tab below:
final scoremonthly award98.00 - 100.00

5-star rating

95.00 - 97.99

4-star rating

90.00 - 94.99

3-star rating© 2020-2024 Testing Ground Labs

Android Malware Detection Test 2024 April

Chap.4 Test Summary & Monthly Award•Monthly Award:

2024 April

Android Malware Detection Test from Testing Ground Labs

Avast
ESET
Kaspersky
NortonLifeLock
Avira
McAfeeTotal Defense
AhnLab

5 Star Monthly Award 2024 April

Dr.Web

Chap.5 ComplianceThis test was made in accordance with the requirements of the AMTSO Testing
Protocol Standard v.1.3 https://www.amtso.org/standards/. At the moment AMTSO isfinalizing the compliance check. Once it is confirmed, the report will be updatedwith this information.
Details about the test compliance are available on page:https://www.amtso.org/tests/testing-ground-labs-android-malware-detection-testapril-2024-consumer/

P4© 2020-2024 Testing Ground Labs

Android Malware Detection Test 2024 April

Chap.6 Rights Statement
Unless otherwise stated, Testing Ground Labs (hereinafter referred to as “TG Labs”),
owns the copyright of this report. Without prior written consent of TG Labs, no otherunit or individual shall have the right to alter the contents of this report and use it forcommercial purposes by any means (including but not limited to transmission,dissemination, reproduction, excerpt, etc.).
Unless otherwise stated, TG Labs shall be the rightful owner of the trademarks andservice marks used in the report. Any action of infringing upon the legal rights of TG
Labs is prohibited. TG Labs shall have the right to pursue the legal liability of theinfringer in accordance with the law.
Chap.7 Disclaimer
Note that before using the report issued by Testing Ground Labs (hereinafterreferred to as “TG Labs”), please carefully read and fully understand the terms andconditions of this disclaimer (hereinafter referred to as “Disclaimer”), including theclauses of exclusion or restriction of the liabilities of TG Labs and the limitations of
the rights of users. If you have any objection to the terms and conditions of thisDisclaimer, you have the right not to use this report, the act of using this report will
be regarded as acceptance and the recognition of the terms and conditions of thisDisclaimer, so by using this report, you agree to the following terms and conditions:1.

The report is provided by TG Labs, all the contents contained herein are forreference purposes only, and will not be regarded as the suggestion, invitation,
or warranty for readers to choose, purchase or use the products mentioned
herein. TG Labs will not guarantee the absolute accuracy and completenessof the contents of the report; you should not rely solely on this report, orsubstitute the viewpoints of the report for your independent judgment. If you
have any queries, please consult the relevant departments of the State, andthen choose, purchase or use products by your independent judgment.
2. The contents contained herein is the judgment made by TG Labs to theproduct characteristics as of the date the report was published. In the future,TG Labs will have the right to issue new reports which contain different
contents or draw different conclusions, but TG Labs has no obligation orresponsibility to update the original report or inform readers of the update ofit. In this case, TG Labs will bear no responsibility for readers’ loss for using theoriginal report.

P5© 2020-2024 Testing Ground Labs

Android Malware Detection Test 2024 April

3. The report may contain links to other websites, which are provided solely forthe readers’ convenience. The contents of the linked websites are not any partof this report. Readers shall assume the risks and losses or bear the costs whenvisiting such websites. TG Labs will not guarantee the authenticity,completeness, accuracy, and legitimacy of the contents of such websites(including but not limited to advertising, products or other information). TG
Labs does not accept any liability (direct or indirect) for readers’ damages orlosses arising from their clicking on or viewing such websites to obtain some
information, products, or service.
4. TG Labs may have or will have a business relationship with the companies
which produce the products mentioned in this report, but have no obligation
to notify readers about it, it doesn’t matter if there has already been, or there
will be such business relationship in the future.
5. The act of readers’ receiving this report is not regarded as the establishmentof the business relationship between readers and TG Labs, so there is nocustomer relationship existing. TG Labs does not accept any legal liability as
the readers’ customer.
6. The products which are used to be tested as samples by TG Labs are bought
through the official channels and legal means, so the report is proper for
products bought through the same, not for products bought through unofficial
channels and/or illegal means. Therefore, it’s the users buying such productsthat will be responsible for any risk or loss arising there from. TG Labs will nothave or accept any liability whatsoever for any such risk or loss.
7. Some trademarks, photos or patterns owned by units or individuals willprobably be used in this report, if you think your legal right and interests areinfringed, please contact TG Labs promptly, TG Labs will handle the matter as
quickly as possible.
TG Labs reserves the rights to interpret, modify, and update the Disclaimer.
Attorney: Zhejiang CongDian Law Firm

TESTING GROUND LABS
1st Floor, Mezzanine

P669 Warwick Avenue
London W9 2PP

https://www.testingground.io© 2020-2024 Testing Ground Labs