yashsingh1/xdaforums huggingface dataset:
[Android Apps and Games] Utini:
I never noticed any placeholders with Adaway. They are probably there but don't disturb me.

Adaway can also replace those blank spots with an Adaway logo.

Adaway can block ads that come from the same server as e.g. "facebook.com".

Simply by blocking only "ads.facebook.com" but not the whole domain?

That is why there are hosts list in Adaway that get updated daily.

E.g. easylist, fanboys list, etc..

Main problem with Adaway: You need to reboot to apply those hosts updates.

Edit: it seems like easylist is pretty advanced with what it blocks on websites?

https://easylist.to/easylist/easylist.txt

You say that domain blocking and https blocking is required to block ads these days.

Yet I don't have any ads on my phone with Adaway?

No other app/extension decrypt my HTTPS traffic and reads/analyzes it.

That creates a huge trust issue with adguard.

Also that makes it more open to MITM attacks.
[Android Apps and Games] thedicemaster:
ads.facebook.com is a separate (sub) domain from facebook.com, which is why domain blocking would still work.

but if ads are served from content.domain.com/ads while actual content comes from content.domain.com/posts domain blocking fails, or also blocks all posts on that domain.

but adguard is better anyway because it does domain blocking, http filtering, and https filtering separately and lets you choose which to use, while adaway doesn't give you a choice and is locked to only domain blocking.

https filtering also is literally impossible to activate without your consent, as it requires installing a certificate.
[Android Apps and Games] Utini:
So you are saying:

Adaway + any DNS Provider = domain blocking

Adguard = domain blocking, http filtering, https filtering

Do you mean with "http filter" = "url blocking"?

I believe Adaway (with e.g. Easylist) will also be able to block "content.domain.com/ads" while still able to show "content.domain.com/post"?

See: https://easylist.to/easylist/easylist.txt

Do you maybe have an example website that I could visit to make a live comparison between my Adaway and Adguard phone?

It is good that adguards certificate doesn't get installed automatically!
[Android Apps and Games] thedicemaster:
http and https filtering work the same: the app intercepts the webpage and deletes the code and exact addresses that load ads.

the difference is that http filtering does this with unprotected pages, while https filtering does this with protected pages.

pure domain based blocking can only filter based on subdomain, domain, and TLD(country code)

an address is built up like protocol://subdomain.domain.topleveldomain/directory/page.filetype

http and https are protocols, the way data is communicated. (http essentially meaning enhanced text files, https meaning enhanced text files with security) domain filtering is blind to this, so it can filter regardless of protocol but also can't let a specific protocol through.

domain filtering works by overriding requests that ask "where is the server with this domain" and replying with a lie if it's an ad domain, this works for any of the 3 domain bits(and subdomains can stack into sub-sub donains, etc.) this is called a DNS request.

directory and page however are requested from the server the website is on(the one returned by the DNS request), the only way for a domain based blocker to block this is to lie about the location of the server so the server never gets the request for the page, but that also redirects every legitimate content request for that server to a fake location(the lie)

i don't know of any specific pages with ads that can be blocked by http(s) filtering but not by domain filtering because i use adguard with its full filtering capabilities, so i don't ever see any ads.

edit: https://gamefaqs.gamespot.com/boards

it's not ads in this case, but that page has a "cookiewall" that cannot be blocked by domain filtering or http filtering but only https filtering.

edit2: twitter main feed has sponsored posts that also can't be blocked by domain and use https.

edit3: facebook does the same.

as mentioned earlier https filtering is pretty good to have now because nearly all websites that use their own servers for ads also use https to protect their pages from tampering.
[Android Apps and Games] Daria Adguard Team:
Don't worry, we do not collect anything. Besides, it's a local process — filtering —that goes within the local VPN tunnel.
[Android Apps and Games] Utini:
In my case, I use the HTTP Proxy. It is the recommended method when rooted?

And it still is a local-only process?
[Android Apps and Games] Daria Adguard Team:
https://kb.adguard.com/en/android/faq#local-http-proxy-mode

It is always about a local process.
[Android Apps and Games] Utini:
Thanks, another question:

Which "stealth" options are enabled when selecting the "high" profile and "ultimate" profile?
[Android Apps and Games] Utini:
Another question:

I have Adguard (Premium) configured and added all the filter lists.

I do not use the DNS Filtering in Adguard but instead added my NextDNS Account in Androids "Private DNS" feature.

I can see a ton of blocks in my logs in NextDNS which has the same lists as Adguard.

Shouldn't I see (nearly) zero blocks in NextDNS because Adguard should block everything?

Basically Adguard should be my first line of blocking and only if Adguard doesn't block it, only then my DNS should get a chance to block anything?

1. App wants to load ads

2. Adguard Local HTTP/HTTPS Filtering tries to block it

3. If ads pass it

4. Adguard Local DNS Filter tries to block it

5. If ads pass it

6. External DNS (E.g. NextDNS with Filterlist) tries to block it

In the logs of my external DNS resolver I can see that the DNS resolver is blocking ads. Which means the ads came through step 2. and 4. ?

Note: I have HTTPS Filtering disabled at the moment (but my DNS Resolver also can't filter HTTPS). I use HTTP Proxy mode (rooted device).
[Android Apps and Games] thedicemaster:
adguard is blocking the elements within the pages, nextdns blocks the entire domain.

adguard still lets non-ad requests to and from those domains through, which is what nextDNS then catches.
[Android Apps and Games] dmarden:
Got the latest update today... 4.0.543. I really really do not like the new UX. Even just something like scrolling the apps list, you can no longer easily see apps that are enabled or disabled for AdGuard... you have to tap and look one by one.

It's also just straight up not working for me... enabling protection then it disables right away.

I even wiped my settings to try fresh... just rolling back for now. :(

Edit: The issue is automatic proxy/root access. Works fine in VPN mode (which I do not want to use). Tried revoking and re-granting, no improvement. Latest Magisk.

I switched to the Beta track for the time being. I forgot I was on the Nightly track. So I will stick with Nightly 38.

Edit2: Also noticed Nightly 39, with the new interface and broken root/auto proxy mode is missing the Quick Setting toggles... just FYI.
[Android Apps and Games] fobtob387:
Yeah as usual with layout updates for applications, it's often worse and less intuitive for the user.
[Android Apps and Games] Lord Sithek:
I like the new interface and it's quite clear to me.
[Android Apps and Games] Buggen82:
I like it too. The firewall page is really good.
[Android Apps and Games] dmarden:
I am not really talking about aesthetics. They're subjective... I agree the new app LOOKS nice. I was saying that specifically the UX (emphasis on the experience part) is diminished in some cases.

To use the same example as before. Nightly 38, you can look at the apps list and see which apps need adjustment. Nightly 39, you cannot. You have to either reset them all and change from there or open each one to confirm/adjust their settings. Visual preference aside, that is just more work.
[Android Apps and Games] TechnoHippie:
I have nightly build 4.0.543 - VPN integration doesn't work. Went thru all the steps to get the VPN nightly build so I could use the integration - but I've never got it. Anyone else able to get it? Does it even exist? My VPN version is 2.2.3 (49) which I assume is not new enough version??
[Android Apps and Games] blksith0:
Have they fixed the issue where all my connections stop working until I toggle it off and on again?

I'm going back to AdAway...
[Android Apps and Games] Nastrahl:
Hello,

It would be good if in the app manager, we could find the network logs for the said app instead playing with filters inside the logs.

Thanks
[Android Apps and Games] Nastrahl:
DNS blocking can't be compared to AdGuard to begging with.

No issue for me though.
[Android Apps and Games] thedicemaster:
seems the unblocking is broken with the new UI update.

twitch.tv streams on the website don't load properly(desktop view), but putting it on the allowlist does nothing to let it through.

there's also an issue that since the UI update adguard keeps turning off in samsung secure folder, the previous version with the old UI just worked.

and with these issues i really miss the notification area toggle.
[Android Apps and Games] vonDubenshire:
On their subreddit the AdGuard team said they're aware of the bugs and it's just a consequence of nightly builds lol 😅 true tho

I went back until I get AdGuard Assistant and the quick tile back
[Android Apps and Games] Daria Adguard Team:
It is required from you to join special AdGuard Google group to take part in Nightly for VPN as well which, in turn, opens a new AdGuard VPN Nightly branch that can be paired with new 4.0 nightly AdGuard: https://adguard-vpn.com/en/beta.html?platform=android&release=nightly

There's no other option for now to get AdGuard VPN Nightly that suitable with 4.0 AdGuard ad blocker
[Android Apps and Games] JohnDoeYT:
what is this ---> https://www.virustotal.com/gui/file...jZGJlOWYzNjdlMzNlZDE2Zjk0OGY6MTY3NjE4NjY5Nw==
[Android Apps and Games] Nastrahl:
What? There's nothing.
[Android Apps and Games] TotallyAnxious:
There doesn't seem to be a QS tile for the nightly build of AdGuard.
[Android Apps and Games] Seosam:
Hi, I'm on the latest nightly (4.0.467) and always used VPN mode. Now I changed to automatic proxy with root. And now I haven't a ipv6 adress anymore.

And some apps need very very long to load.

Is it normal for proxy mode?
[Android Apps and Games] Daria Adguard Team:
Please report any issues with AdGuard 4.0 Nightly version on GitHub: https://github.com/AdguardTeam/Adgu...bel:"Version:+AdGuard+v4.0"+sort:created-desc

In case you won't find anything related to your issue – create a new one and describe it in a very detail.

Thank you!
[Android Apps and Games] dhruvaz:
Hi my issue with adguard is actually coz of my phone. Lemme start by saying its a paid version mods can delete the comment if its against the rule. The thing is it blocks internet...i think its coz of vpn its connected to.... Happens mostly when the phone is idle for say an hour or two. I have to go in app disable protection and enable again and then it starts working ....this happens only on my vivo x90 pro plus. I have battery on high performance, auto start is on and everything..... Doesnt happens only xiaoxin (lenovo) tablet, not on my kids oneplus 7t pro, not on my s.o's galaxy s20 ultra 5g or my pc.... This is vivo specfic problem.
[Android Apps and Games] nacos:
I've been using AdGuard Blocker and AdGuard VPN both, on mine, and my family's rooted & non-rooted Android devices (3 rooted, and 3 non-rooted) as well as on Windows for more than 2 years and I can attest that the opposite of your statement is true.

FYI: I have no affiliation whatsoever with AdGuard. I speak from my own experience and I highly recommended the AdGuard blocker + AdGuard VPN combo over any other alternatives - it just works and personally, I don't know of any other solution that seamlessly integrates a VPN with a blocker. Moreover, unlike all other popular VPNs, AdGuard is Open Source and the company is not affiliated with any one of the 3 corporations that own and control most other popular VPNs.

Note: AdGuard just released the stable AdGuard v.4.0 for Android as well as AdGuard VPN v.2.3 and, in addition to stability and performance improvements, the new version comes with some notable features for rooted Android devices.

Below is an excerpt from the article published a couple of days ago:

"But now, with root access, you can switch AdGuard to the Automatic proxy mode. Just navigate to Settings → Filtering → Network → Routing mode and switch to Automatic proxy. This action takes local VPN out of the picture and instead configures iptables to accomplish the same goals. And there are several benefits to this change.

Firstly, AdGuard is now able to apply DNS filtering to IPv6 requests, something that was not possible before. Secondly, we've ironed out a few issues that hampered AdGuard from accurately associating web requests with their respective apps. This fine-tuning will enhance the performance of Firewall, Filtering log, and so forth. For those of you with rooted devices, this AdGuard update takes your control and customization to a whole new level!"
[Android Apps and Games] nacos:
@Daria Adguard Team

Could you please specify the recommend low-level settings when default routing mode is changed from Local VPN to Automatic Proxy (root)?

This page merely reviews all available options without providing specific choices. Specifically, what are the recommended choices when fallback upstreams are disabled? Which custom IPv4 / IPv6 addresses should be used under Blocking Rules for hosts rules, or should I use REFUSED/NXDOMAIN?

Thanks!
[Android Apps and Games] Daria Adguard Team:
@nacos

Most important, if fallback is set to "none", your requests will not be resolved if the DNS server specified in the DNS protection module fails to respond for some reason.

For blocking rules, the most common and also my personal choice is NXDOMAIN.
[Android Apps and Games] nacos:
Thank you for getting back to me. I did just that, except I chose REFUSE for blocking rules, instead of NXDOMAIN however, I've been struggling to make it stabil. As reported here, AdGuard keeps restarting and in some instances it never starts back up. As soon as I went back to Local VPN, with all other settings kept the same, the problem does go away. Unless there are some other settings (either somewhere in the main app, or under low-level) that negatively impact AdGuard's stability when in Automatic Proxy, this, otherwise tremendous, advantage is pretty much voided. For the time being I went back to Local VPN. Kindly revise this whole configuration with the team and get back to us here, on Xda, as soon as you have some resolutions. My entire configuration was detailed in the GitHub issue report however, I'm more than willing to work with you to help solve this. Thanks and looking forward to your feedback.

Suggestions:

There are two possible configurations that MUST be covered for Automatic Proxy mode: (a) stand-alone AdGuard Blocker AND (b) AdGuard VPN integrated with AdGuard Blocker. Since the VPN integration is used by a relatively small number of users (myself included), I have a feeling that AdGuard's technical team conceptualized the whole implementation under the stand-alone assumption. Thus, the incompatibility might just have been internally created, either by the two working together or,

by a combination of incompatible settings resulted from the switch: Local VPN to Automatic Proxy.
[Android Apps and Games] nacos:
On a second though, I'm not sure how should I interpret your statement. Should fallback be set to "none" or not?

What are the recommended HTTPS filtering rules when using DNS-over-HTTPS? I would think that all HTTPS requests should be redirected through the encrypted DNS however, if you do that, the fallback upstream should be set to "none", correct?

Please refer to the attached screenshot and clarify.
[Android Apps and Games] bit.spirit:
Why is AdGuard whitelisting Appsflyer connections - one of the biggest omni-channel trackers out there?

Can we still trust AdGuard? Screens attached

Whitelisting Appsflyer defeats the whole purpose of the app.

How can I control/edit whitelists?

Any we can supercede these ''Allowlisted'' entries? - bcoz inspite of adding a block entry for Appsflyer, they are still not being blocked.

This new UI is confusing. There used to be setting to disable ADG connect/disconnect issues on network changes...where can I find it? How do I implement this on new ADG?

Thanks in advance.
[Android Apps and Games] nacos:
I may be wrong, but based on your 2nd screenshot which shows the DNS response SERVFAIL, it seems to me that appsflyer.com may have been automatically whitelisted as a result of all DNS servers failing to reply to your requests. I would start diagnosing this by disabling the "SERVFAIL failure response" under Low-level settings, then try visiting the same websites and see whether appflyer.com is still whitelisted. You may have inadvertently misconfigured some DNS related settings.

As for ADG connect/disconnect, that's pretty much the reason I started the conversation here - like you, I need some clarifications and directions from ADG's technical team. When I started playing with ADG v.4.0 I thought it was a half baked product however, switching from local VPN to Automatic Proxy (root only) does change the app's blocking algorithms and behavior completely. Automatic proxy is based on iptables which should drastically improve both, the VPN and firewall capabilities however, at the expense of stability, it seems to me. I explained on a thread above what I believe to be the problem and I also submitted a ticket to ADG. I would also hope for Daria Edgard Team to get more involved and provide the much needed support for advanced users. Moreover, I've asked through various venues (XDA, GitHub and ADG support) for someone in ADG's technical team to provide the complete suggested configuration required to safely switch from Local VPN to Automatic proxy (if ready) but I didn't get anything so far.
[Android Apps and Games] nacos:
I tried visiting Appsflyer.com and the connection was blocked by Peter Lowe's blocking rules. No DNS response, neither blocked, or whitelisted - which is normal.
[Android Apps and Games] bit.spirit:
Thanks Nacos - have implemented as instructed. Seems to be the solution as of now.

Whenever I buy a new phone - I debloat it, then install all apps + ADG ( but no signal/network) and put it in observation mode for a few days to catch and block new ad/analytics/tracking/ping URLs which I find in the logs, before I actually start using the phone. And being in the mobile advertising industry, seeing Appsflyer requests passing thru was like a shock to my system, hence the thread.

Was used to the old UI - this new UI and new nomenclatures is very confusing and cant seem to find old functions - especially the connect/disconnect setting during NW changes. The same seem to be happening in this version too - but no way to mitigate it. Some requests are leaking during this NW change.

ADG version - 4.0 nightly 88

Last - still need a way to edit filters and /or supersede filtering rules.

Need more clarity on this ''AllowListed" filter/setting and how to counter it.

All the same, thanks everybody for the help and support.
[Android Apps and Games] nacos:
Happy to help!

I'm not sure what you mean by NW changes.

You can still block/unblock anything you want and add/remove filters:

- Ad Blocking: Protection > Ad blocking > User Rules.

- DNS: Protection > DNS Protection > DNS Filters > User Rules

Additionally, you can enable/disable any one of the built-in filters.

Yes, completely agree, the new UI is cumbersome and unintuitive but v.4.0 was a major update and something needed to give in order to accommodate all those changes - that was the new UI. Hopefully they'll listen to the many excellent suggestions, over at their AdGuard forum, as well as on GitHub and things will eventually fall back in place.
[Android Apps and Games] bit.spirit:
By NW changes, I meant some old settings in the old UI which are not visible/accessible now.

These settings ensured ADG was not disabled during network connectivity changes i.e. whenever data/wifi was enabled or disabled - screens attached (from old UI)

Would have preferred these settings to be accessible for end users.
[Android Apps and Games] bit.spirit:
Some more queries:

1. As for internet access - which takes precedence, the filters/blocklists or the firewall app rules.

I've blocked the Updater app in firewall but its still able to ping MIUI update servers.

Only after blocking the MIUI update URLs the same was blocked.

2.

In the logs, I see repeated pings to Time servers - some ping/request URLs are as follows:

asia.pool.ntp.org

2.centos.pool.ntp.org

time.nist.gov

2.android.pool.ntp.org

time.android.com

I have already set the device time to manual and edited the local time.

These pings happen throughout the day 24*7.

How can I stop these pings from happening?

They are blocked by AdGuard firewall - want to stop the device making these requests/pings.

Thanks in advance.
[Android Apps and Games] fobtob387:
Just downgraded (or upgraded?) back to version 3.x.

Sorry to all the people who worked on it, but I can't stand the new version whatsoever. It's too convoluted for no legitimate reason, unnecessary redesign IMHO.
[Android Apps and Games] WibblyW:
Anyone else use the automation features? The automation feature no longer seems to work, though it did previously for me. For example, the 'pause' command now seems to do nothing.
[Android Apps and Games] nacos:
The first setting has been removed as it's is now automatically applied (embedded), hence no need for a separate setting.

The other 3 settings are present under low-level settings and accessible to the user in v.4.0 as well.
[Android Apps and Games] bit.spirit:
Thanks Nacos...But I couldn't find these under low level settings

Entire low level screens attached...plz guide

Other issues:

1. Sometimes ADG disabling/enabling during installs/uninstalls.

Same happens randomly when enabling/disabling data/wifi.

2. In lock-screen , ADG shows a timer - what does this signify?

if its active running time - even this is initimating ADG start/stop - from 20 min/30 mins to 1 min without any user action.
[Android Apps and Games] nacos:
You cannot expect the exact same settings since now AdGuard can work both, in Local VPN as well as Proxy mode.

As for the other 2 issues:

1. Which routing mode are you using? Note that I've been experiencing the same issues (only) in Automatic Proxy and submitted a ticket on their GitHub thread. Quite unexpectedly and infuriating I should add, I'm told that AdGuard team is not aware about this problem, when in fact this very behaviour has been reported by many. Please report it yourself too. If you have the official paid AdGuard, I would suggest reporting it directly through the app. Please also report it to @AdGuardSupport_Pavel on Telegram.

2. That's really strange. Have you enabled the watchdog under General > Advanced? Personally, I don't see any counter however, I have disabled AdGuard's all lock screen notifications (see screenshot). The active notifications categories might just give you a hint on that. You can find which category generates the counter by disabling each category, one by one, until the counter goes off.