yashsingh1/xdaforums huggingface dataset:
[Android Apps and Games] zgfg:
Why don't you disable all other hosts sources and try them one by one.

If I recall correctly, you had no problem having 600K blocked domains - hence your problem is likely not in the number of 60K hosts listed in a particular source but in the content (which hosts it tries to block) in that source

In that case you would have couple of options:

- give up of that particulat hosts source

- find out what it blocks that disturbes your apps and add those hosts (your apps need) to your Allowed list

- whitelist particular apps (yes, that is possible in VPN mode), those whitelisted apps will completely bypass AdAway or DNS66

Btw, with 600K or 700K of blocked domains you are certainly in the 95/5 or even 98/2 or so position: 98% of the hosts that you keep in your Blocked list are all together no more used (being ever attempted to be reached by your apps) than in 2% of cases (and most of them absolutely never)

Finally, if your phone is not rooted and you cannot use hosts mode (or you don't want to try it), you can disable/uninstall AdAway (or DNS66) app and enable instead (applicable to Android 9 or higher) Private DNS from your native phone Settings, pointing it to dns.adguard.com or dns-family.adguard.com (if you also want to block porn)

In that case your phone (AdAway, DNS66 or Blokada app) will not maintan your blocked list but the adguard DNS server will do it all for you, hence you could not have issues with the size of the list or so.

Also, in that case you cannot maintain your Allowed list.

At least, you can give it a try - since recently I'm using it in parallel with AdAway but in the hosts/root mode and I'm happy with (Private DNS cannot be turned on in parallel with AdAway in VPN mode, or with Blokada or DNS66)
[Android Apps and Games] wudini:
Very detailed answer, thank you, i appreciate that.

I already know all the other options, i used adaway for years @ root and also blokada, i also have a lifetime license for adguard. ;)

I thought i give adaway a try, did not go so well.

As i said i tested DNS66 and it works well.

I found out today that whenever i add a list, i have to kill adaway to get i working as it should.

Example:

Install adaway

wifi works

turn off wifi and switched to mobile connection -> works

add

any

list and update

wifi works

turn off wifi, no connection on mobile connection

When i kill the adaway process and then start it, it works, how long ? I don't know.

I think there is a problem with the update process of the lists.
[Android Apps and Games] gallegonovato:
Good afternoon:

I am contacting you as I want to install the Codeberg source https://codeberg.org/baobab/hosts/raw/branch/master/hosts

Adaway initially installs it. But it always disappears from the counter of the number of hosts when you click on check for updates. But in the counter of fonts that need to be updated it says zero. Or it says others but not that one. Actually that one never comes up for update but if you go to the host lists. Under https://codeberg.org/baobab/hosts/raw/branch/master/hosts it appears in English it needs updating for a few minutes. Or in Spanish "Actualizada para pocos minutos". Or in Spanish needs update in a few minutes.

And all other fonts work fine.

Thanks for your time and help
[Android Apps and Games] zgfg:
You probaby mean hosts, not fonts and Hosts sources list (not hosts list, that would be hosts file what is different)

When I open in browser your hosts source I see that it lacks the timestamp when the file was last time updated - maybe that's the reason for AdAway not properly showing if/when it needs to be updated
[Android Apps and Games] DiamondJohn:
Are you sure you want to use this hostfile? I had a quick look, and near the top it had sites like: www.google.com
[Android Apps and Games] gallegonovato:
good evening: Thank you very much for your help and time but what scares me is that adaway. There are days that he recognizes it well and days that he does not. It must be because of what he tells me

but I use https://gitlab.com/Jorgu81/hosts/-/raw/e8f754d47f463cb77e7e2870b76d5ec06f48e819/HostsGoogle or https://gitlab.com/Jorgu81/hosts/raw/master/Mozilla and they work without problems. It is only with the codeberg links that Adaway does not recognize it well and gives me those glitches.

A hug
[Android Apps and Games] gallegonovato:
good evening: if I would like to use the host on the mobile. and I'm still thinking about passing it to the pc. since in the mobile I do not use anything from Google. I have lineageos 17.1 without any gaps. And nothing from Google. I do not use anything that is not free, that is, no Google service. I use metager for example as a search engine. Or searx. Then I use fennec from fdroid or iceraven with a user.js set. And the things that could have lineageos with Google, such as the time and others modified and changed and I do not miss anything. And while the mobile lasts I will continue like this, then I will try to migrate to Grapheneans without catching the mobile to Google. that is to say second-hand or do the same thing that I have now in a oneplus. A hug
[Android Apps and Games] Utini:
It seems like Adaway doesn't periodically check for updates because I never get the "reboot dialog" and whenever I open AdAway there are outdated sources.

I already have the app as "not battery optimized". Anything else I need to do?
[Android Apps and Games] PerfectSlayer:
Hi all,

I took a few weeks break from the project to enjoy some time with my family.

I have two versions ready to release and a lot of bugs to read and support to provide.

So let's start with XDA! ^^'

Feedback:

You are not alone. I add an "monitor connection" option in the VPN settings to check if the connection dropped and automatically restart the VPN. Please check this option and try if it is better.

When importing a source, I insert it to the database. As the primary key is the URL (or the file path) and conflicts are ignored, a renamed source will be ignored during the import. Do you think it must be changed?

That's a lot! Good thing is the database should be performant enough when growing but it's still big.

I use the Room Android framework to manage the database. I don't know if the framework cleans up from time to time. Could you try to call vacuum and see what size it takes? Do you manipulate the database by yourself or is it just the app that populates it?

Are you running the 5.3+ version? I should have fixed this issue « Fix crash with source file when SAF permission is removed »

Okay, it's still early here and everyone is still sleeping. Time to burn some CPU to build a new version!

A moment later...

Here it is! I also updated the backend to serve the 5.3.0 version on f-droid using the built-in updater =)

Changelog:

Add VPN monitor option to prevent disconnection

Update source update status indicator

Update Android gradle plugin

Update Sentry DSN to support older TLS versions

Update mongoose web server

Update dependencies

Fix welcome screen telemetry preference

Fix VPN authorization check at startup

Thanks:

Special thanks to BearTM, elvissteinjr, ipdev99, patkarmandar, RobBeyer for their bug reports.

Download:

AdAway 5.4.0
[Android Apps and Games] Utini:
Thanks @PerfectSlayer but getting the error "App not installed" :S
[Android Apps and Games] zgfg:
You can't install XDA version over the F-Droid or vice versa. You can only update XDA over XDA (or F-Droid over F-Droid), because of different packages names.

E.g., uninstall F-Droid and download/install from XDA.

There was previously an issue with updating from F-Droid, IDK was it fixed or not (I don't use F-Droid) - to make it simpler, use only the XDA version.

Updated my XDA 5.3 to 5.4 with no problem.
[Android Apps and Games] Utini:
I am using the root based adblocker so I do not have this VPN settings available?

Also is it recommended to use the webserver option or not? What is the difference for me as endpoint user?
[Android Apps and Games] zgfg:
The idea with Webserver is to avoid an empty space reserved to show the blocked adds but some apps like XDA or Amazon do not work with the Web server option enabled (although, Amazon can be whitelisted instead) - please search and read hrough the thread, it was discussed more than once and AFAIK more apps were mentioned as affected by the Webserver option
[Android Apps and Games] gallegonovato:
Good afternoon @PerfectSlayer

Adaway that will happen to download only from github, its official website and from xda?

I comment because I use the version that uploads to Fdroid. And I don't know if you are planning to stop uploading your great app to fdroid.

Because then the new versions I would not be able to install them . And then I install it (before uninstalling the other version), from one of the other places.

Best regards
[Android Apps and Games] shah22:
I don't know about amazon but xda app is working fine here on my end with webserver option enabled ..

Also if I mis-understood what you tried to say, accept my apology
[Android Apps and Games] DiamondJohn:
NO, you do need to change it. There are less than 60 (only 3 by default, but I now have 54 NB some are only a few lines/hosts long). Its good to now how it works, and I can now work to that, and would not expect anything else from someone else's app. Especially when it works.

So, now I am actually around 718K! and the dB is almost 178MB. I copied the dB to another location, and did some admin stuff on it:

Vacuuming /data/media/0/app.db

Before:
-rw-rw-r-- 1 media_rw media_rw 177725440 2021-02-28 13:59 /data/media/0/app.db
===================================================
===================================================
After:
-rw-rw-r-- 1 media_rw media_rw 177725440 2021-02-28 13:59 /data/media/0/app.db

So vacuuming made no difference. Neither did a re-index or an optimize.

I'll zip it up and send you a link via PM, just in case you wish to see my dB; or ignore it of course.

Another weird thing is that I had the permissions bug / crash again. I simply resolved it by re-selecting the file again using the UI. But it had been working by itself, as is, as it was for a few days now.

dogbin - appegocoll

03-01 00:49:15.237 10271 5334 5348 W System : A resource failed to call end. 03-01 00:49:15.238

del.dog
[Android Apps and Games] m0han:
thanks for your work. how about changing thread title to reflect the new release?
[Android Apps and Games] tomdot:
Thanks for 5.4.0. Despite enabling Monitor Connection, I still have problem transitioning from Mobile --> Wifi (always require disabling and re-enabling)

Wifi --> Mobile is always fine
[Android Apps and Games] fubo73:
Note: threat title still reports 5.3.0. :)
[Android Apps and Games] PerfectSlayer:
Thanks, I download it. I will have a quick look when I find time to see what is taking the most space and if it's normal or not (can't promise I will do quick though ^^')

Hum, that's weird... The app requests to keep the right to open the file you selected.

Did you remove SAF permission from the app? Do you move or replace the file the app reads?

I am trying to narrow down the source of the permission denied error.

Done! Thanks 👍
[Android Apps and Games] MaXAiRO:
What could be some possible reasons that the AdAway local web server stopped working? I think it happened either when I updated to 5.4.0 or when I upgraded to Magisk 22 from 21.4. "Local web server not active"

-OnePlus 5 on OxygenOS 10.0.1 (Android 10)

-Magisk 22

-Systemless hosts module enabled

-No VPN

-It's set to 127.0.0.1 and ::1 as always

-The AdAway certificate is installed

-Tried with both WiFi and data.

-Did several reboots

It had been working fine since the early releases of version 5 and I noticed that it stopped working yesterday because the AdAway logo doesn't appear in sites instead of the broken sad faces.

I searched the last 10 pages and used the search function too but couldn't find anything similar except for the usual questions about Amazon.
[Android Apps and Games] DiamondJohn:
An extra FYI. I have an app that estimates the table to file size contribution, and I ran it on my large adaway database.

View attachment 5238269

I also ran it on my other phone, which has the default host sources:

View attachment 5238271

Interesting that the percentage totals were within the same ballpark between both. But it obviously comes down to the two big two tables which are very much related and I guess would differ more if one had a lot more duplication between host sources.
[Android Apps and Games] cognitivedissonance:
Anyone know what I need to whitelist to enable "Messages for web" using Google's Messages app? It blocks it until I stop Adaway. I tried running the DNS logger and it's pretty clearly not logging the actual requests b/c I whitelist what comes up and it still is failing until I again stop Adaway.

Side note: the built-in DNS logger doesn't really seem to show all the traffic. Does anyone have any suggestions about an app that does? It's frustrating not being able to figure out what to whitelist.
[Android Apps and Games] celestialspring:
I sometimes find it helpful to switch on / off airplane mode after performing such actions.

Force closing the app and restarting adaway is also helpful.
[Android Apps and Games] celestialspring:
Strange behaviour with tTorrent app

The automatic VPN connection is killed as soon as I start the ttorrent app and the VPN connection does not come back until I kill the ttorrent app.

Anyone faced similar issues with tTorrent or other apps?
[Android Apps and Games] zgfg:
Did you configure AdAway to whitelist iTorrent for VPN - Android allows only one VPN connection at a time
[Android Apps and Games] celestialspring:
Thank you.

The torrent app is not whitelisted because it displays ads. I was not aware that the torrent app needs it own vpn?

While we are on the topic, flud torrent app also has the same behaviour.

Never had this issue with other vpn based ad blockers.
[Android Apps and Games] yuruyuri:
Same on my device.

It may be reproducible bug on v5.4.0

Web Server Not Running · Issue #2588 · AdAway/AdAway

Describe the bug Test web server shows Not running. To Reproduce Steps to reproduce the behavior: A fresh installation of AdAway. Self-signed certificate installed. Test web server shows Not runnin...

github.com
[Android Apps and Games] MaXAiRO:
Still the same. Web server not running. Also, today I even downgraded from Magisk 22 to 21.4 to check if it's 22's fault but no. Probably 5.4.0's fault as you said.
[Android Apps and Games] PerfectSlayer:
Hi all,

Thanks for the feedback.

I can confirm there is an issue with TLS connection of the web server. It started from AdAway 5.4.0 version with the upgrade of mongoose from 7.0 to 7.1. There is a regression in mongoose that will be fixed in the next mongoose version.

Once released, I will update it to restore the TLS feature of the web server. In the meanwhile, you can read the full details and track the progress here: https://github.com/AdAway/AdAway/issues/2588
[Android Apps and Games] adeptustech:
I can do any testing you may need. I have a Samsung Galaxy A51F. PM me if you need me.
[Android Apps and Games] that1:
Dear all,

Just installed Pixel Experience 10+ (Android 10) on Poco F1 and rooted it by flashing latest Magisk 22. Installed latest Adaway 5.4.0 from F-Droid. Adaway is not able to get root access. No pop-up asking for root permission.

Tried to search this thread for a solution but couldn't find.

I know it is rooted as I have installed AFwall and is working.

Please suggest a solution.

Thanks inn advance.
[Android Apps and Games] zgfg:
First, you must enable Systemless hosts in Magisk.

Check in Magisk app (previously it was Magisk Manager), Superuser tab if AdAway is listed but not granted root - you can grant root there.

If neccessary, wipe Data for AdAway from Settings/Apps and run/configure again.

IMO, I never use f-Droid but install directly from XDA here and let it update when an update is available - don't get what advantage brings the f-Droid version
[Android Apps and Games] that1:
Thanks for your very quick response.

I enabled the systemsless option in magisk.

Installed adaway 5.3.0 from this thread and it simply worked without any issue.

F-Droid version was 5.4.0, that may have some issue.

Thank you for your help.
[Android Apps and Games] zgfg:
Sorry for little bit off-topic and/or if this was previously discussed

I just observed that if I use dns-family.adguard.com for Private DNS server, that Restricted mode in YouTube is enforced (mode is enabled but its setting is greyed-out) - screenshot 1.

As a result, all comments in YouTube are disabled - screenshot 2

If I use just dns.adguard.com (or if I don't use Private DNS server), then Restricted mode option is not greyed-out and I can manually enable/disable.

When Restricted mode is disabled, all comments in YT are visible

(If you want to experiment, make sure to reboot after changing the Private DNS settings)

I'm just curious, if anybody knows, what is the site/domain that must be blocked (e.g. in AdAway) to enforce Restricted mode in YT?
[Android Apps and Games] 64ashg:
It is actually a setting from the network administrator by turning on safe search and associated flags on all devices on the network (here the dns server), a sub set of that functionality which you can turn on from ui for the specific account, hence subset, is only enforcable as far as i know.

I am not a sysadmin or netadmin, they might know some workaround to this.
[Android Apps and Games] zgfg:
As I wrote, in my case it is not set by my mobile operator network or by my ISP, since it gets enforced when I put dns-family.adguard.com for the Private DNS server, and it gets removed when I disable Private DNS (or change to another Private DNS server).

Therefore, it gets blocked just like the porn sites are blocked by the same Private DNS server - hence it must be related to blocking a particular site by DNS (I'm not using AdGuard app, just their DNS server), and the same result should be possible to obtain by blocking the required site(s) through AdAway

Btw, you can test yourself, simply enable Private DNS server, define as above, reboot and check in YT (I tested both with regular YT and Vanced, same results).

Then change Private DNS server to dns.adguard.com, reboot and test again

Btw, I've also googled myself (before asking yesterday here) and found thar explanation about 'network admins', but it doesn't hold since I can simply enable/disable just by using a particular DNS resolver or not
[Android Apps and Games] 64ashg:
And by changing your dns resolver you are essentially changing the" network " outside of the isp. I have already done this in my router and my parents phones via private dns, so anyone who connects to my wifi and whichever network my parents use, they have safeSearch and filters..
[Android Apps and Games] zgfg:
Yes, but at the end, dince it is controlled just by DNS resolver, it means that Restricted mode is enforced if certain URL cannot be resolved

That means the same as blacklisting that the same URL through AdAway.

Hence coming back to my original question:

If anybody (else) maybe knows, blocking which particular site (via dns or firewall), would trigger YT into the Restricted mode?

So sorry, I don't think we need (and I will no more) philosophical debate can we name it as controlled by 'network' or not, my question was simple/exact🤓

If nobody knows that answer, never mind
[Android Apps and Games] celestialspring:
Libretorrent does not Fc the vpn connection for some reason. All good!!!

ps: no ads and almost all basic functionality.(y)(y)(y)
[Android Apps and Games] Hociiii:
I have a rooted P30 Pro VOG-L29 and it's not working for me. I can't get rid of facebook and youtube ads. Can somebody please help me?
[Android Apps and Games] zgfg:
It was mentioned here and elswhere that AdAway cannot help you for YT - please use Search to search through the thread (top/right, Web page not XDA app).

Use Vanced YT (root or no root version) - another thread on XDA
[Android Apps and Games] jawz101:
Hello all. I maintain the AdAway blocklist and just wanted to chime in on big blocklists.

If you have a database over 2MB or so, you're not getting any benefit from a big blocklist.

I watch blocklist effectiveness as a matter of daily habit, compare lists, look for old entries, inactive domains, DNS lookup popularity, etc. At any point in time, no more than maybe 10,000 or 20,000 entries are relevant. Even a list of a few hundred entries would block 99% of ads and trackers you encounter!

Huge blocklists are so big because they started out 15 years ago. Domains are born and die every day! Some entries probably never existed in the first place. Others were for spyware in 10 year old, defunct Windows programs. Things your phone will never encounter.

The AdAway list itself is maybe 9500 entries and could probably be smaller and no one would notice. Especially because I'll watch an app with all blocking turned off to see what traffic happens. It may be that one domain triggers connections to 5 other domains and if I just block the first in the chain the other entries are irrelevant.

If you're really interested in lists, here's exactly how I started looking at what I'm blocking.

With AdAway, remove all of your lists. Then turn on the DNS logger and play a game.

Go back to the logger and see what domains to connected to and blacklist the funny ones. Test the game again and see if anything broke.

After a handful of games you'll get maybe 50 or so entries you're blocking and like 99% of the ads and trackers you experience are gone. It's really that tiny. And if you use an ad blocking web browser you'll see even less traffic in AdAway as your browser will block web ads itself.

So you're 1 million mega blocklists are likely 80% dead domains, 19% Windows and other software related, and maybe 1% of the mega list is doing all of the work.

Try the no list trick and see what you think.
[Android Apps and Games] gallegonovato:
Good evening @PerfectSlayer @zgfg @jawz101

Thanks for the new version of Adaway.

But I have to insist that Adaway does not load and does not recognize any hosts coming from https://codeberg.org/.

I tried with several from that page and none goes like the rest or from other websites like gitlab.

For example from gitlab similar to the ones I use from codeberg and they go great there:

https://gitlab.com/Jorgu81/hosts/raw/master/FC

https://gitlab.com/Jorgu81/hosts/raw/master/Mozilla

But codeberg Adaway does not recognize any of them.

I also opened a problem on https://github.com/AdAway/AdAway/issues/2570

Please I ask you to check this problem to be able to use them.

Best regards and thanks for your time and help.