yashsingh1/xdaforums huggingface dataset:
[Android Apps and Games] ManDone.vRs:
Thank you Wolfie ?
[Android Apps and Games] Ps24u:
Arg, seems like I spoke too fast, negative time came back :rolleyes:
[Android Apps and Games] Wolfcity:
I'm using the VPN based 5.0.2 version of Adaway and if I try to log DNS requests to block ads in some apps the log is always empty.

I deactivate Adaway before and also private DNS like mentioned in the wiki. As the wiki is mainly about the 4.x builds for rooted devices I'm not sure if I'm missing something.

As a reason for empty logs the wiki mentions:

"The TCPDump process could be getting killed by SELinux enforcing policy."

As I'm running stock MIUI that should be the case. Is that the reason and is there a way to get DNS logs on a yet unrooted device though?
[Android Apps and Games] gaww:
Adaway keeps on blocking CNN app. Turning adaway off and on helps for a short while.
[Android Apps and Games] vandyman:
CNN. Is that the Clinton News Network app? [emoji57]
[Android Apps and Games] Josh McGrath:
adaway blocks lies too so of course cnn won't work haha

In all seriousness, you need to whitelist www.cnn.com if you really want to be lied to that badly ?

---------- Post added at 08:03 PM ---------- Previous post was at 08:01 PM ----------

Also you need to log dns request and see which you will need to whitelist. A very few select sites won't load before the ads but I highly doubt CNN would do that
[Android Apps and Games] Doomkopf:
I don't know, seems fine to me. I'd be happy about it
[Android Apps and Games] gaww:
Earlier posts listed some other whitelist items, but didn't get them to work.
[Android Apps and Games] Josh McGrath:
Have you tried logging dns requests? You can sometimes whitelist those request links one by one until you find out which one it is.

But first you should try clearing storage on the cnn app and see if that helps
[Android Apps and Games] catxda:
Hello

How can add the exception for CNN breaking news app ?

Now if I enable Adaway , CNN app is not starting.

Thanks
[Android Apps and Games] ipdev:
Hi all.

Anyone who was a fan of the MVPS hosts.

They now have a TLS or SSL. (https)

AdAway GitHab - Link

[MENTION=3019752]gaww[/MENTION] [MENTION=6126530]catxda[/MENTION]

I'm not sure what all needs to be white listed for CNN.

This will depend on the hosts sources you use and how aggressive the list is.

Quick test with CNN PlayStore - Link

geolocation.onetrust.com

Causing the no start issue?

! Unknown Error Try Again.

Add to your whitelist (Allowed) and see if it helps.

Just keep an eye on your whitelist (Allowed) after download/updating hosts source(s).

Cheers all. :cowboy:
[Android Apps and Games] andy356:
This is good news. As a reminder, Steven Black hosts is now a default for AdAway, and it happens to include MVPS. :good:
[Android Apps and Games] zgfg:
Please always start by reading OP posts.

Post #1, link to Wiki:

Common Issues and Resolutions,

AdAway has made my device/app crash:

https://github.com/AdAway/AdAway/wiki/Solutions
[Android Apps and Games] knpk13:
I tried this but I don't think it's working. And the DNS logging screen is blank on v5 so I'm not sure what other domain to try in the whitelist. Shouldn't this eventually be fixed in the actual ad blocking lists upstream?
[Android Apps and Games] gaww:
Didn't help
[Android Apps and Games] Wolfcity:
I'm with you that the DNS request screen shows nothing (I mentioned that before https://xdaforums.com/showthread.php?t=2190753&p=82504667)

For me whiteistening s.youtube.com was enough to get the YT history working but I'm not able to log any DNS requests and subsequently I can't blacklist something to make uploading pictures to Google photos work of block ads in my weather app (wetter online)
[Android Apps and Games] knpk13:
I read your other post. I'm using the root method on v5.0.2 on OOS, so it's not just you. Seems like uploading pics to Google photos works for me without doing anything. The whitelist also keeps disappearing every time the sources are updated, but seems like that's a known issue with the beta versions. v4 used a different list by default from Steven Black's list right? Haven't read up on why the list was changed yet. I'm going to try reverting to that version because I'm pretty sure I had no problem with YouTube on that one.

Edit: oh v4.3.4 also got switched to Steven Black's list and earlier posts say that the old default list is dead. And looks like the dns logging bug is affecting it too as it's blank. Guess I'll try disabling the list or playing around with other ones to see if that works.
[Android Apps and Games] gaww:
Something funny - went to 5.0.2 beta and CNN working again - for now.
[Android Apps and Games] ipdev:
Hi all.

It's been a very active thread lately. :)

[MENTION=7570546]andy356[/MENTION]

It was also picked up by [MENTION=6150654]AdroitAdorKhan[/MENTION] so it is included in Energized.

EnergizedProtection GitHub - Link

Energized MVP Mirror GitHub - Link

Just a personal preference but, I prefer more minimal and add (black list) as needed.

Like gApps, the least installed the better.

To each their own.

It will change from person, region and habits.

I know what works for me will not work for everyone. :)

[MENTION=7786725]zgfg[/MENTION]

The DNS logging on 5.x is a little off.

(VPN/ROOT method) so the wiki is a little off at the moment.

Some user debugging to figure out what works but, it's a BETA build so bugs are (actually low..) to be expected.

[MENTION=7134312]knpk13[/MENTION]

For YouTube history, s.youtube.com and s*.youtube.com were the common ones to add.

For me history has been working in YouTube without adding anything to a white list.

For the last few versions of YouTube.

As for the Allowed list being wiped after updating/downloading hosts sources.

It appears that it is fix (famous last words.) and will be in the next build.

Work-a-round for now.

Turn of the auto-update (Preferences-> Updates-> uncheck Sync on update)

Make a backup (Preferences-> Backup / restore block rules) before you download/update the hosts sources. Download/update hosts sources and then restore the backup.

The restore is by default add only not replace so, you shouldn't lose anything.

I attached a AdAway backup file with the URL(s) for YouTube added to Allow (white) list.

The current YouTube for me is v15.18.36 from PlayStore.

Also has the last three (active) default hosts sources that AdAway used before things changed. (Before StevenBlack was added.)

If you want to use it with AdAway, remove the .txt

adawy-YT.json (.txt was added to attach to xda)

DNS Logging seems to working for me using the root method.

Do not remember if this is new in the 5.x builds but,

Go back to DNS requests and swipe down on the screen to refresh.

(Get a DNS log dump ??)

[MENTION=5237901]Wolfcity[/MENTION]

This seems to be working for me.

Pixel 3aXL abc ROM (Android 10 May 2020 Security) Magisk canary (debug) AdAway 5.0.2 (VPN method) selinux enforcing (kernel and user-build not magisk hide.) AdAway has root access.

Instead of disabling (pausing) AdAway, remove the hosts sources.

(Host sources-> uncheck all Apply)

Main screen-> Refresh and download. (Should show 0 Blocked unless you have a personal Blocked (black) list.)

Then start the DNS logging, open an app and run though a menu or two.

Go back to DNS requests and swipe down to refresh.

(Get a DNS log dump ??)

Cheers all. :cowboy:
[Android Apps and Games] DiamondJohn:
The other thing that could of changed, is the actual hosts in your selected host sources. Do not forget, its the resultant hosts that block things, not directly AdAway, and I am guessing you used both versions separated with time, which means one or more hosts lists could of changed.
[Android Apps and Games] zgfg:
Sorry but it is all together confusing/contradicting - per your attachment you whitelist many more for YouTube:

suggestqueries.google.com

www.googleadservices.com

www.googleapis.com

youtubei.googleapis.com

pagead2.googlesyndication.com

lh6.googleusercontent.com

r1---sn-vgqsrne6.googlevideo.com

r2---sn-vgqsknez.googlevideo.com

r3---sn-vgqskn7l.googlevideo.com

redirector.googlevideo.com

www.youtube.com

i.ytimg.com

googleads.g.doubleclick.net

Hence which ones are really necessary
[Android Apps and Games] KapilNagpal01:
I have application kite. Trading app, not able to open any details on it. It shows connection error.

If I disable adaway it works. I used dns log but no dns came except time.android.com

I whitelisted it and also kite.zerodha.com but still not opening. Any help is appreciated, in big problem as have to use application daily at all times.

I am on 4.3.4, using adaway for years but no issues. It has started due to new host or adaway update. Please help what to whitelist if someone can help
[Android Apps and Games] gaww:
I have 2 devices with different versions, but both updated. CNN works on one but not the other.
[Android Apps and Games] JudgeDread11:
Might have something to do with this:

"Add broadcast receiver to control ad-blocking from third party applications"

From:

https://github.com/AdAway/AdAway/blob/master/CHANGELOG.md

I think it might be blocking certain broadcast receivers which can be detected by apps. I have a game which complains about some receivers missing, but after that it runs fine.

Other apps might not run when certain receivers are missing.

This is all just a guess. I'm not even 100% sure if I interpreted the meaning of that line in the changelog correct.
[Android Apps and Games] gaww:
Turns out that 5.0.2 was not effectively blocking adds, even though it looked like it was successfully installed and activated.
[Android Apps and Games] rogers11:
Today v4.3.4 arrived at F-droid. Thank you very much.
[Android Apps and Games] DiamondJohn:
If you wish to understand it better, grab the host file off both devices and compare. They should be the same, if they are using the exact same host sources and were updated at the same time.

If they are using the same host sources, and the resultant host files are different, then that may be something the dev may be interested in, unless it was a known issue that has been fixed between versions.
[Android Apps and Games] PerfectSlayer:
Hi all,

It's been two weeks since the last update and it's time for another round of new features and bug fixes!

The big new feature is the web server improvement. It was a long time feature request and it now serves HTTPS pages. That means I can fix the broken resource sad grey icon that appears instead of ads.

For now, it only supports adsense (Google) ads but I plan to support more ad networks later. (I'll talk to jaws101 to pick the most used.)

For this, I need use a fake self-signed certificate for the server that will match the ad network domain. You need to install it from ad blocker preference screen in order to make you browser accept the web server https responses.

Another nice feature is the sad icon is replaced by a light AdAway icon. It's way better than the sad grey icon but if you prefer having an empty blank space, there is an option for that. (the icon as the blank space will take the space the ad has, no more no less)

There is some other new features, like the "Follow dark theme system settings" to match the system theme.

About bug fixes, I fixed user host list item being remove on source update (sorry!) and I improved (once again) the negative time issue by adding some workaround for time not synced servers.

There is some minor bug fixes about backup, like import error toast wrong label or the duplication of imported hosts.

Feedback:

Unlike the root blocking method, you need to have the vpn adblocking enable when logging request. It might need a label to warn users.

Thanks! But it wasn't me ^^' I planned to do it today for the release but I'm glad it is back in order.

Changelog:

Add TLS support for web server

Add web server status in preferences

Add option to install self signed certificate

Add option to display app icon instead of blank page

Add full timezone support for source date

Add workaround for negative source update time when server time is not accurate

Add follow system dark theme mode

Fix user host list lost on source update

Fix import failed toast

Fix web server not start on install

Fix duplicate host entry on backup import

Update mongoose server

Update translations

Thanks:

Special thanks to saltylemondrops, zgfg, ipdev99 and mickrussom for their bug reports.

Download:

AdAway 5.0.3
[Android Apps and Games] bluey45:
Thank you for the hard work and updates [MENTION=2822685]PerfectSlayer[/MENTION]!
[Android Apps and Games] lepicane1:
Could be completely blind, but in version 4 I could see the custom sites I added to be blocked (e.g. for my banking app). I can see all of these in the *.json export from version 5, but not in the version 5 app itself.

EDIT: Found it. In the blocked tab, there is an icon in the top right corner, which toggles your custom blocked list with the system downloaded blocked list(s).
[Android Apps and Games] mohdschizo:
Thankyou [MENTION=2822685]PerfectSlayer[/MENTION]
[Android Apps and Games] ardonhs:
What list I must use for games (coin master) and for xda app?
[Android Apps and Games] JudgeDread11:
I am using root mode and therefore can not log requests.

Would it be possible to switch in app to VPN mode so I can log requests.

And then switch back to root mode when I have the information I need?

The VPN mode in settings is greyed out and not clickable now.

Edit:

While trying things out, I cleared data for the app and the ran it in VPN mode. Did some DNS logging.

Then cleared data again and ran the app in root mode again. It of curiosity I tried the DNS logging and now it worked. Even after a reboot. And without the VPN notification or anything.
[Android Apps and Games] RainGater:
5.0.3 version is, in one word, A-W-E-S-O-M-E!

Thank you so much [MENTION=2822685]PerfectSlayer[/MENTION] for a wonderful and a modern looking app which lists several nice features when you launch the app. Did I already say that I love the layout? Absolutely do. :)

Kudos for a job well done!

EDIT: If anyone is using slickdeals app, use the attached whitelist file - when you click on the deals, it will take you to the appropriate sites.
[Android Apps and Games] Zilla0617:
How do you add the whitelist file to adaway?
[Android Apps and Games] RainGater:
Preferences - Backup/restore block rules - Restore - Pick the file that you saved in your /sdcard.

That simple. ;)
[Android Apps and Games] gaww:
Funny - CNN now working with 5.0.3.
[Android Apps and Games] FunnyCOFE:
Are you know any solution for nonroot?
[Android Apps and Games] dvhttn:
Really??

https://xdaforums.com/showpost.php?p=82281687&postcount=14534
[Android Apps and Games] FunnyCOFE:
Sorry I didnt see that. I didnt try download because havent root on device. Now I will just try.
[Android Apps and Games] Zilla0617:
I noticed some ads get thru on the slickdeals app, particularly the ads in the comments page
[Android Apps and Games] ipdev:
I haven't been able to successfully reproduce breaking history in YouTube consistently.

Blocking s.youtube.com seems to be the most consistent but, not always.

Without being able to replicate the problem consistently, I'm not sure if it's one or multiple hosts that need to be allowed (white list).

Blocking youtubei.googleapis.com will break YouTube's internet connection.

So that would have to be whitelisted if it's being blocked by the hosts sources being used.

Currently testing on Poco F1

(Lineage 17 nightly, OpenGapps stock, magisk canary, AdAway 5.0.3 root method.)

If you want to give it a go, the hosts source I'm using for testing - Link

I attached the matching whitelist (everything enabled) to offset the above hosts source.

Keep in mind, the above hosts source may/will break/limit things including the device internet connection. Also most google apps. (Chrome, drive, ...)

Oddly enough PlayStore still works if internet connection is limited. ;)

With just youtubei.googleapis.com allowed, YouTube starts and runs.

It pulls history but, doesn't seem to write to it.

Unblocking (Allow/white list) s.youtube.com seems to be the most consistent but, not always, for YouTube history to work properly.

Again this all depends on the blocking (hosts sources) you use.

As I mentioned before, I use minimalist approach to avoid this situation.

Personally, I would rather block (blacklist) a domain or two instead of figuring out which ones to allow (whitelist).

To each their own.

It will change from person, region and habits.

I know what works for me will not work for everyone. :)

[MENTION=7134312]knpk13[/MENTION] may be fighting a different issue, it could be a magisk module, something broken in the rom, an app or update, permission(s), etc ...

I could go could go on for quite awhile about Chasing symptoms before figuring out the problem just remember, sometimes something else might be causing the problem.

Debugging really sucks. ;)

I'm giving up for now and going back to my normal setup.

For YouTube, at a minimum, youtubei.googleapis.com needs to be, s.youtube.com probably should be, allowed (white list).

Hope that answered your question.

Cheers all. :cowboy:

PS.

Before I leave this over-the-top block (black list) testing, a few screenshots.

AdAway 5.0.3 is working great, even at System level. :D
[Android Apps and Games] knpk13:
I'm using the default ad blocking lists, and this is working for me consistently now with 5.0.3 , maybe because of the whitelist bug fix. Is 's.youtube.com' even an ad network? Not sure why it's being blocked, is it something we need to report to the maintainer of whichever one of the 3 default hosts files (I'm assuming Steven Black's list as it's the new default, and this problem is recent) is responsible for it?

'youtubei.googleapis.com' (also doesn't sound like an ad network) is not in the default ad blocking lists so I did not have to whitelist it.

Yes the latest version of the stock YouTube app works for me (no history breakage). But since adaway can't block youtube ads (which is why I'm confused to see so many 'youtube' domains in the default block list, maybe it's for the browser version of youtube?), I'm using YouTube vanced which is a mod that's stuck on a slightly older version of youtube for now (15.05.54). And I need the whitelist workaround to fix history for that. I wonder what changed.
[Android Apps and Games] ipdev:
Hi again.

As for youtubei.googleapis.com

In my testing, I broke as much as I could to see what was the minimal needed to run YouTube. I hope it's not blocked by any other list but, just incase I made mentioned of it.

I took another (closer) look at StevenBlack.

Just like I remembered, it incorporates a lot of other hosts file(s) besides it's own.

Does a great job at combining and splitting it up into modular segments to be used separately.

Side note:

If using StevenBlack, it includes:

adaway.org/host.txt

pgl.yoyo.org/adservers/serverlist.php?showintro=0;hostformat=hosts

Counterintuitive to set them as hosts source(s) also.

Line 47719

0.0.0.0 s.youtube.com # Blocking this will interfere with video watching history

This appears to comes from - Link

If I remember correctly, it was a default source years ago? (Maybe it was just one I used back then?)

So you would have to ask about including/removing s.youtube.com at SomeOneWhoCares.org - Link

Not sarcastic, that is actually his registered domain name.

Cheers. :cowboy:
[Android Apps and Games] pycxe-01:
Hi! What's the difference between F-Droid AdAway v4.3.4 & downloaded here? I've noticed that F-Droid version is slightly bigger... Why? ?
[Android Apps and Games] zgfg:
Ok. I'm using my own list of hosts sources and I have 7-8 other domains whitelisted hence I'm not restoring another full backup but want only to add to my whitelist what might be necessary

But anyway, I'm still using Vanced YT Magisk module (although its development was discontinued) and so far I didn't need any specific YT domains whitelisted (ofc, it depends also on hosts sources what they tend to block) but I don't observe any issues with YouTube, nothing missing, so I will continue with...
[Android Apps and Games] Ps24u:
[MENTION=2822685]PerfectSlayer[/MENTION] so where do we stand as 4.3.4 users?

Is the fdroid build supposed to fix the negative time bug ?

Or will you still try to fix the bug with special builds here?

Thanks for your support.
[Android Apps and Games] gaww:
Funny - had 5.0.3 up, and Amazon FC'd. Went back to older one, and fixed.

I have used Adaway for years with zero issues. It's supposed to be a problem with the hosts, but wish a general fix could be found.
[Android Apps and Games] tard24:
Yeah, 5.0.3 seems to be blocking the Amazon Shopping app. If I restart my device and immediately open up the app it works fine, but then when AdAway loads up Amazon looks fine for a split second but then I get the 'dog screen error' no matter where I go on the app.
[Android Apps and Games] mitchdickson:
Amazon working fine for me.

Adaway itself doesn't block anything. Host files do.
[Android Apps and Games] tard24:
Well yeah, sorry, the default host files are blocking the app. What host files are you using, I'll give them a try?
[Android Apps and Games] mitchdickson:
Here are mine:
[Android Apps and Games] mitchdickson:
Sorry, better screenshot attached.
[Android Apps and Games] tard24:
Yeah weird, I have all but one of those, so it shouldn't be affecting Amazon if it isn't affecting it for you.
[Android Apps and Games] mitchdickson:
Maybe it's because I have redirected hosts enabled?
[Android Apps and Games] tard24:
Checked that option and restarted and still the same thing, so wierd. Oh well, guess I'll just have to pause it to use the app. Thanks for the help though.

---------- Post added at 02:21 PM ---------- Previous post was at 02:10 PM ----------

I also just went back to the 4.3.4 version and Amazon is working fine. So it's something with version 5.0.3, as the 4.3.4 version has the same default hosts as the new beta version.
[Android Apps and Games] edwardxi:
interesting

got a new ZTE phone, Blade 10

used AdAway to changed the hosts file successfully (confirmed using Root Explorer)

but after a reboot, the hosts file changed back to the default file... please help, TIA
[Android Apps and Games] dingsaller:
I had the sane amazon problem in Adaway 5.0.3,

DNS logging result

aax-eu.amazon-adsystem.com and

c.amazon-adsystem.com are blocked,

when these 2 whitelisted, amazon app works again
[Android Apps and Games] tard24:
Applied both of those two the whitelist and still getting the same thing on 5.0.3 and don't have to add them to 4.3.4 and Amazon app works fine.
[Android Apps and Games] jlg78:
I whitelisted *. amazon-adsystem.com and now the app works again on 5.0.3.

Maybe it's a European thing?
[Android Apps and Games] whitehollow:
Do you suggest me to add i don't key about cookies in adaway or use the kiwi extension ? Is there any host to hide ad blocker detection to add to adaway ? Thanks
[Android Apps and Games] asanford:
This didn't work for me, but whitelisting *amazon.com got the app working again for me
[Android Apps and Games] DiamondJohn:
Just an FYI, Whenever I try to browse to https://hosts-file.net/ad_servers.txt I get a "Not Found" error message in my browser. Both over standard inet and using TOR
[Android Apps and Games] hyborian:
Yes, I have come to that conclusion. Sometimes Play Store is fine, sometimes not. Like when I want something quickly or want to apply an update, it just stays on "Waiting to download" and I have to go do all the stuff to make it work. On all my devices, it just doesn't want to play nicely with Naptime Doze active, no problem with Greenify's Doze.

Anyway, thanks for the tip, unfortunately, I didn't feel like spending time to find out what to whitelist (I was just using AdAway's defaults), as it was easier to switch to Energized magisk module and use similar hosts to adaway (Sparks pack, the lowest). Voila, no ads, and Google Play Store is perfect. My ad-blocking needs are simple.

Will revisit AdAway one day when needed, it has the UI after all for DNS logging.