yashsingh1/xdaforums huggingface dataset:
[Android Apps and Games] DiamondJohn:
Thanks for your write up. I am one of those with a HUGE block list. Historically I have 2 apps (at least) that always have been able to display ads through a smaller list. Since getting to a larger host list, these two apps do not show ads (I also found that I would need to refresh my lists right before using many other apps). I understand that there is probably only a handful of hosts that achieve that goal, but the common lists just did not catch them or the changes/new ones. What was even more annoying was that one of the apps (which I use often) has the habit of displaying the ad on the exit confirmation of the app. This exit confirmation first displays the "Exit/cancel" dialog drawn only big enough for the buttons, but as my finger moved towards the screen, an ad would appear which enlarged the dialog and moved the exit button down and I ended up accidentally clicking on the ad. I tried logging the hist andblocking, but that only worked for a short time, and it made it even worse at catching me out unexpectedly It annoyed the absolute heck out of me. Since going big with my lists, I never see this behavior (although I still flinch a little on exit), or any ads in other aps that use to break through shorter lists without a recent manual refresh. Now, since I do not actually need to do any further daily maintenance, it is a set and forget, and I have not noticed any performance issue I can attribute directly to a large list. The only usability issue I can note is that on news aggregation sites often use tracking URL's to redirect to the actual story. These are no often blocked by my list as "tracking", which to me, is OK. Their tracking, no matter how innocuous, is not for my benefit.
[Android Apps and Games] jawz101:
@DiamondJohn I would be interested to know the blocks that caught it if you ever find out so I can add them to the list.

Or if you have the app names I can test them on my phone.

Feel free to tag me, pm me or put issues on GitHub.

Issues · AdAway/adaway.github.io

Contribute to AdAway/adaway.github.io development by creating an account on GitHub.

github.com

I look at the default AdAway list as our list for mobile app junk. I try to keep it pruned to just what you would see on mobile traffic. That is, not Windows bloatware ads, a

Ads in emails, nor web ads. There is some crossover but it's nice to have a list devoted to mobile. I think there are only 2 or 3 that are.

Fwiw, if I use Firefox with uBlock Origin, I can use the AdAway list and 20 other big lists outside of uBlock (via AdAway, AdGuard, piHole, NextDNS, or whatever) and the AdAway list and uBlock catch everything. The 20 big lists don't do anything extra for me :P
[Android Apps and Games] DiamondJohn:
PM Sent,
[Android Apps and Games] zgfg:
Something is fishy with Codeberg, I tested two scenarios - all updated also to your Issue opened on Github:

Does not load or recognise decoberg source · Issue #2570 · AdAway/AdAway

Describe the bug Good afternoon: I am contacting you as I want to install the Codeberg source https://codeberg.org/baobab/hosts/raw/branch/master/hosts Adaway initially installs it. But it always d...

github.com

1) Only a single hosts source:

Label: "Codeberg - Testing"

URL:

https://codeberg.org/baobab/hosts/raw/branch/master/hosts

(screenshot)

On Apply, it applies successfully and AdAway on the main screen correctly shows 1 Up-to-date source

But when I hit icon next to Up-to-date sources, it immediately displays error: Failed to download, complaining as if there is no Internet connection(?!)

(screenshot)

And after that, it shows 0 for Up-to-date sources (and 0 for Outdated sources)

However, when I hit the icon next to Outdated sources, it happily parses Codeberg and after that it shows again 1 Up-to-date source

Tested dozen of times, 100% reproducible, screenrecording:

File on MEGA

mega.nz

Btw, I checked and no other app had any Internet connection problem in parallel.

Tested even by playing online audio in the background, it had no disconnections

2) Scenario with two hosts sources, Codeberg and Adaway default hosts source

In this case it does not display an error Failed to download, but on hitting that icon next to Up-to-date sources, it drops from 2 sources to 1.

Again, on hitting the icon next to Outdated sources, it parses Codeberg and then again it shows two Up-to-date sources

Screenrecording:

File on MEGA

mega.nz

Btw, Codeberg is not a huge list, it blocks about 56K of sites - but be careful while testing, it blocks all kind of Google sites and who knows what more

In fact, I'm suspicious that on hitting that icon next to Up-to-date, that AdAway maybe tries to access an analytics (?) site or something, which is blocked by Codeberg, and therefore it fails.

But on Apply or on hitting the icon next to Outdated sources, AdAway does not try to access that special site, hence it does not fail

I checked AdAway DNS log, but (as usual?!) it was empty

Logcat is attached, I found there an error (appearing only when I hit the icon next to Up-to-date):

03-11 07:12:21.992 W/NextViewModel(16372): org.adaway.model.error.HostErrorException: An host error DOWNLOAD_FAILED occurred
03-11 07:12:21.992 W/NextViewModel(16372): at org.adaway.model.source.SourceModel.checkForUpdate(SourceModel.java:179)
03-11 07:12:21.992 W/NextViewModel(16372): at org.adaway.ui.home.HomeViewModel.lambda$update$1(HomeViewModel.java:147)
03-11 07:12:21.992 W/NextViewModel(16372): at org.adaway.ui.home.HomeViewModel.lambda$update$1$HomeViewModel(Unknown Source:0)
[Android Apps and Games] gallegonovato:
Good morning

First of all thank you very much for your answer and help.

The rare thing is that it happens for example with any of the ones here:

https://codeberg.org/pekman/psb/src/branch/master/etica or if you click on permanlink and then google hosts link comes out this link https://codeberg.org/pekman/psb/raw/commit/00e31cbedf648d825bd82ea1552f2be0abc92da6/etica/google.txt and if you click on the google hosts in raw comes out https://codeberg.org/pekman/psb/raw/branch/master/etica/google.txt

I have not yet tested for example with https://codeberg.org/Pengin/GameIndustry-hosts-Template that some have what would be called from where the hosts and such.

But for example if you look with these hosts:

https://gitlab.com/Jorgu81/hosts/raw/master/FC

https://raw.githubusercontent.com/Maji78/Antigoogle/master/Hosts

https://gitlab.com/Jorgu81/hosts/raw/master/Mozilla

This error doesn't happen as with codeberg hosts. Even blocking things from google. I think it's either a failure to get the link to the hosts in codeberg or that for some reason that site is not valid for adaway. Because the three that I put you before being in gitlab that let's say so is better known. It does not give those failures even blocking things from google and others.

I do not know if you could take that hosts to a gitlab or github and so check and get out of doubt if the failure is there.

But I have no idea how to do it. And first I have to ask the developer if he would allow it.

The only thing I can think of is to ask the host developer if he would have another link to test or give us permission to do what I said above.

Also if I can try downloading the hosts directly from codeberg to the mobile. And then uploading it as a file in Adaway.

Thanks a lot for your time and help.

Pd: Good afternoon:

I forgot to comment that adaway. With 31 different non codeberg and two codeberg sources. It does what you comment.

You hit update (check for updates of the repos in adaway), it deducts those two from codeberg . And so many of the others appear to update. You click on download and it downloads the updates and the codeberg ones. What it doesn't do with the others from github that I told you. Those are not discounted. And they remain well.

Best regards
[Android Apps and Games] gallegonovato:
Good afternoon:

I forgot to comment that with this other codeberg host https://codeberg.org/pekman/psb/src/branch/master/rastreadores/rastreador-global.txt the same thing happens. And if we put the link that puts in the same hosts ( https://libregit.org/pekman/psb/raw/branch/master/rastreadores/rastreador-global.txt ) . It seems to me that it will do the same with libregit.org.

I also noticed that even having the other sources. Many times Adaway updates well the others. Putting under each list updated for x time. But other times it updates some and in others it says installed for x time. Or updated for a few minutes (in Spanish in my case). And the solution I found. Is to close adaway. Clean the Adaway cache. Reinstall Magisk and Magisk Manager (giving inside magisk to install). Then reboot the phone. And update the Adaway sources again.

With these two new addresses to upload project or things. It seems that Adaway is not getting along well.

A hug
[Android Apps and Games] zgfg:
Apparently it's not about the content of the hosts source (blocking some sites preventing AdAway to operate)

It's either about the format (?) or about communication with the server hosting the source file

I've downloaded your first Codeberg hosts source file and played with...

Long story, short - at the end I left only a single line (blocking a single benign site):

0.0.0.0 www.ebookland.pl

I put it to my GitHub folder as two files:

https://github.com/zgfg/Etc/raw/main/SingleLine.txt

https://github.com/zgfg/Etc/raw/main/CommentedLine.txt

In this second file even that single line is commented, hence it blocks no sites at all

Now, if you

- disable all other hosts sources you have configured in AdAway

- add any of the above hosts sources to AdAway, or both of them

When you press Apply, it will Apply with no error reporting and it will show that first source blocks 1 site, second blocks nothing

On the main window Adaway will show that all together 1 site is blocked (if using first source or both my sources)

It will show that 2 sources are Up-to-date (if using both sources), and 0 for Outdated sources (all correct)

On pressing the icon next to Outdated sources, it will fetch and parse again my sources, successfully, with no error reporting

But if you press the icon next to Up-to-date sources, it willl display that useless error:

Failed to download hosts source

Unable to establish a connection to the Internet

And after that it will show as 0 Up-to-date sources, and 0 Outdated sources - where 0 +0 does not equal 2 for the total number of my enabled sources in the list?!

And, you can play with, repeatedly pressing one or the another icon.

On one it always successfully updates my sources, on the other it always reports that pointless error about No Internet connection

Hence something is first of all different how it fetches & parses when the first icon is pressed vs how when the second icon is pressed

And then it must be a bug, if Apply fetches and parses with no error, as well as when the icon next to Ourdated sources is used - why AdAway reports Download failed - No Internet connection, when pressing the icon next to Up-to-date sources?!

For the same hosts sources files / same URLs

Btw, you can even whitelist that single site www.ebookland.pl I left for blocking through the SingleLine.txt source, it doesn't matter - still the same inconsistent behavior and inappropriate error pop-up on pressing the icon next to Up-to-date sources

PS: The same error can be found in Logcat as for the original Codeberg source (logcat attached):

error.HostErrorException: An host error DOWNLOAD_FAILED occurred
[Android Apps and Games] gallegonovato:
Good afternoon

First of all thank you very much for your help and time.

What is strange to me is that I don't get the error that there is no connection. On the contrary Adaway downgrades or removes those fonts as you say. And the rest it marks them to update and updates fine. That is if I have 31 fonts (2 from codeberg the rest not). For example it removes those two codeberg sources and marks for example 4 to update and updates them fine.

I only ever have to do what I said above with magisk and so on.

But if you use any codeberg hosts. You don't have to be the first to do the same thing. Be it for example a list of Microsoft stuff.

But I never get that warning that I don't have internet. And I have notifications enabled.

I use lineageos with nothing from Google. Everything is downloaded from github or fdroid.

The same thing happens with this one from Microsoft https://codeberg.org/pekman/psb/raw/branch/master/etica/microsoft.txt

This one from Google https://codeberg.org/pekman/psb/raw/branch/master/etica/google.txt

Or any of https://codeberg.org/pekman/psb

It's like with codeberg or libregit.org I don't create or don't want Adaway stuff.

I tried with mobile network or wiffi.

What is left to try if I have time. It is to download the hosts and load it from the same mobile to Adaway. As a file.

A hug
[Android Apps and Games] zgfg:
You will not have that popup saying about No Internet connection as long as you have at least one other 'proper' source in the list.

Test exactly as I explained (!) and then by enabling one other source like AdAway, and check when popup appears or not

Anyway, I've analyzed and explained as much as I could. You can continue (you have also your Github account hence you can create and put the hosts sources there to test with)...

At the end, the AdAway dev will hopefully debug and fix

I will not play with this anymore since I'm not interested in Codeberg at all - there are enough very good hosts sources (lean, mean or huge) available around, many of them have been mentioned or discussed already in this thread, and AdAway flawlessly works with them.

Those hosts sources can cover ads, analytics, porn, etc (depending which one or version you choose).

Also, for my purpuses is wrong to block all possible Google addresses, on my Android pone I actively use GApps, GMapps, Google Mail and so on.

IMO, hosts sources that completely block Google are for PC - somebody who does not want to use GApps on the phone should at the first place install a custom ROM cleaned from all Google stuff (for the AdAway hosts mode the phone must be rooted anyway)

Of course, as analyzed above, observed problem is not in blocking the Google sites but apparently the Codeberg and similar hosts sources are used and tested on PC - by copying their content directly to the hosts (hosts.txt on Windows) file, and for some reason - format or their hosting server, they cause the strange described error when used with AdAway

Good luck with Codeberg 🤓

Edit:

But it's strange that source file with the one line (blocked site), or even when that line is commented, hosted from Github, causes the same error
[Android Apps and Games] gallegonovato:
Good afternoon:

First of all thank you for your help and time.

On my phone I use as you say a room without anything google. And modified more things inside them not to use or lead to google.

As long as the phone lasts I will continue like this, and then I will use grapheneos. Apple will not use because it is equal to Google. even knowing that grapheneos uses google terminals. But I will get a second hand one :)

And I move in systems and other services for privacy (mail, etc...).

Although even github if I remember correctly was bought by Microsoft. And windows 10 has telemetry and so on in spades.

But I'm sorry that it seemed bad to you. Or anything I have commented or said. It was not my intention at all. And please if in any way I offended you or seemed wrong, please receive and accept my sincere apologies and I ask for your forgiveness.

I will keep fighting and have if the developers could polish that bug.

But receive my sincere thanks for all your time and help.

Best regards
[Android Apps and Games] zgfg:
It's not bad - I'm just not in that stuff

But it's strange that hosts source files put to the Codeberg repository (at the end it appears it's not in the content or format - format is correct) cause that error.

Codeberg is just an Open Source repository, https links are ok (files can be opened in the browser, applied by Apply and updated by Outdated)...

But as said, I'm just a user of AdAway, I personally use the other hosts sources and they work fine for me, that's why I will no more investigate that error

But you can check something else (I observed but didn't elaborate earlier):

When updating such a host source by the icon next to Up-to-date (and when it gets dropped from the number of Up-to-date list), if you do use some other valid hosts sources (like you do use and hence the error does not pop-up for you), it seems that all sites that were blocked by the Codeberg hosts source (that source that is dropping from the list of Up-to-date sources), so all those blocked sites still remain blocked

Hence for you it's probably just about failing to update and incorrectly showing the number of active sources - but you can still always trigger manual update by using Outdated icon (once a week or even once a month manual update should be fine)
[Android Apps and Games] andy356:
Well, my hosts file has 1.3M entries , and the size of app.db is 249 MB. Just an additional data point, @PerfectSlayer.
[Android Apps and Games] threeeye:
Hi guys,

I don't know if this was mentioned before, but AdAway blocks the login to Wells Fargo app...

Any fix/workaround for that?

Thanks
[Android Apps and Games] zgfg:
Maybe just turning off Web server (AdAway Preferences) would be enough

Otherwise, there is DNS log facility to investigate which sites to whitelist (but I never got it properly logging)

If using VPN (non-root), you can whitelist particular app
[Android Apps and Games] zgfg:
More or less linear, 140K entries, 28MB db
[Android Apps and Games] Nergal di Cuthah:
Mine works with webserver off or on, what lists do you use (i'm using the default + msvp)
[Android Apps and Games] threeeye:
Turning off Web server did the trick... thanks

I don't know, I just installed it and updated the list...

So I guess I'm using the default...
[Android Apps and Games] zgfg:
Guide for downloading a public hosts source from Internet, uploading to your Github 'project', taking its URL and using for your own hosts source in AdAway - submitted in

For your hosts sources from Github, use a redirected githubusercontent.com URL, not the github.com raw address · Issue #2605 · AdAway/AdAway

First, let me explain how to add your own hosts source to your Github 'project' and to use it for blocking the sites by AdAway. The corresponding issue in AdAway on updating that source file will b...

github.com

It includes about the AdAway's bug when updating from the raw github.com address and the workaround with taking and using the redirected githubusercontent.com URL
[Android Apps and Games] DiamondJohn:
I went down that path originally, but then I realised it was a lot easier to maintain them as file's on my device, and edit them on my desktop. Just my personal experience.
[Android Apps and Games] the_poseidon:
i am using AdAway for a long time, its great app that with right configurations of block list, whitelist and host, its making perfect job

but due to long ping time n loading of pages on last days i stsrted to use DNS

i am using Dns with my wifi router settings also with private DNS on mobile data, but if wifi or mobile data cuts for a little time, phone do not get internet or load pages even its connected back to wifi or mobile data

adaway already paused, tried many solutions but couldnt figure out whats the problem, so any idea to solve this problem?

May a magisk module or something else?

my device mi 8 lite android 10 with root btw
[Android Apps and Games] Nergal di Cuthah:
Are you using a lot of lists or maybe a big list. That's the only thing I can think of that results in long ping (remember the device needs to scan the entire list each time a new domain is encountered)
[Android Apps and Games] PerfectSlayer:
Hi all,

I hope your are all going well.

I get a new version for you that addresses a long running issue: being able to allow hosts from your sources! 😊

For this occasion, I reworked the source UI in order to select the type of list you use:

Block list (ie hosts file, so an IP than a hostname per line)

Allow list (a hostname per line)

Here is the result:

View attachment 5252635

I got some other bugs fixed too, like TLS issue with web server thanks to the new mongoose version and a no internet connection issue on source update check when the application can't check any last modified date.

On top of that, I merged more than a hundred PR of translations. So thanks to all the translators!

I also had a sixth GitHub sponsor yesterday 🥰 and I enjoy to read all your nice words in the donation comments. Thanks a ton for your support! 🤗❤

Changelog:

Add allow list support

Improve source edition UI

Improve source update check

Improve animations

Update mongoose web server

Update dependencies

Fix web server TLS issue

Thanks:

Special thanks to gallegonovato, jawz101 and zgfg for their bug reports.

Download:

AdAway 5.5.0
[Android Apps and Games] zgfg:
Tested with the local Allowed file, working fine - thanks
[Android Apps and Games] rehanumfernando:
In app ads aren't being blocked.

Is there specific setting that I should change for this to happen?
[Android Apps and Games] zgfg:
In which app?

Are you using root or VPN version

It can also depend on hosts source files you are using in AdAway

Please did you follow previous communication or search and take a look into - specifically if for the 'app' you mean YouTube, Chrome
[Android Apps and Games] rehanumfernando:
Am using root based adblocker

Ads on the browser are being blocked.

In apps (eg Facebook, Twitter, etc) are still appearing.
[Android Apps and Games] specialdo:
Hi all! I have always used the blokada app for blocking ads but now I have formatted my phone and rooted it and I want to use adaway to consume less battery and also I can use a personal vpn. I installed version 5.4.0 from f-droid and activated the root version. But when I open google chrome to browse, I can't because I'm asked to install a certificate. what should I do?
[Android Apps and Games] zgfg:
Please read previous discussions 🥸

In short, disable its internal Web server