yashsingh1/xdaforums huggingface dataset:
[Android Apps and Games] DeepScred:
Thank you for this beautiful application. Pro since 2012.

More functionality for an all-in-one would top ?
[Android Apps and Games] hakim462000:
Does sd maid no longer clean play store's download cache? I revert back to v4.1.6 and got like 1gb of free space after cleaning. The latest version doesn't do that for me.
[Android Apps and Games] Dark3n:
[MENTION=7125199]hakim462000[/MENTION] What specific path are we talking about?
[Android Apps and Games] hakim462000:
Umm this one I guess:

http://m.imgur.com/a/03Knq

I'm using Look of Disapproval update as example.

It usually got bigger (filling the internal storage) if I update more apps on play store. Version 4.1.6 and prior usually clean that up, the latest one didn't.
[Android Apps and Games] Dark3n:
The screenshot is from version v4.1.6?

That's not the Google Play download cache, it's the browsers download manager.

Works fine for me on v4.2.5+.

Can you provide a debug log on v4.2.5 where files from that directory are not picked up?

What "Look of Disapproval" ?
[Android Apps and Games] hakim462000:
- Yes, it's 4.1.6

- I don't know but it's the directory that used whenever I install/update an app from GP.

- Look of Disapproval:

https://play.google.com/store/apps/details?id=com.slaughter.look.of.disapproval

Ok I'll try it again using latest one.
[Android Apps and Games] hakim462000:
Using 4.2.5 now. Yup, "Download Manager" is not show up on the list now. Sorry took a bit long.

Debug file:

https://drive.google.com/file/d/0B-ZK8wbuIfBUOEJjbF81VlVzZDQ/view?usp=drivesdk
[Android Apps and Games] Dark3n:
Good log [MENTION=7125199]hakim462000[/MENTION] :good:

Yeah, somehow a permission error, not just for this app, but all apps in private storage.

1466231957487 V/SDM:HybridReaderStreamer: Reading:/data/user/0/com.android.providers.downloads
1466231957488 V/SDM:HybridReaderStreamer: We are running, adding CMD
1466231957488 V/SDM:InteractiveShell: Running next command:eu.thedarken.sdm.tools.shell.a@385cba8f
1466231957488 V/SDM:InteractiveShell: outStream|$BUSYBOX test ! -e \/data\/user\/0\/com\.android\.providers\.downloads || $BUSYBOX find \/data\/user\/0\/com\.android\.providers\.downloads -mindepth 1 -print0 | $BUSYBOX xargs -0 -r $BUSYBOX stat -c "%a:%F:%d:%i:%u:%g:%s:%B:%b:%Z:%N"
1466231957488 V/SDM:HybridReaderStreamer: Waiting for callback
1466231957491 V/SDM:StreamHarvester: Error:find: /data/user/0/com.android.providers.downloads: Permission denied
1466231957491 V/SDM:StreamHarvester: Output:beff6b2f-c8a1-4095-9add-7bb8ab86b165 0
1466231957491 V/SDM:StreamHarvester: Error:beff6b2f-c8a1-4095-9add-7bb8ab86b165
1466231957491 V/SDM:InteractiveShell: Processing marker
1466231957491 V/SDM:InteractiveShell: Marker processed.
1466231957492 V/SDM:InteractiveShell: Processing marker
1466231957492 V/SDM:HybridReaderStreamer: Task done, notifying.

Looks suspiciously similar to this issue:

https://github.com/d4rken/sdmaid-public/issues/413

The error is not exactly the same, because they can still read the parent folders, your log shows it can't even read that.

Do you have CM13 as ROM?

Looks like something went wrong between 4.1.6 and 4.2.3 :(.

Can you pull v4.2.0, e.g. from here:

http://www.apkmirror.com/apk/darken/sd-maid/sd-maid-4-2-0-release/

and let me know if this is the first version where it started?
[Android Apps and Games] hakim462000:
No I'm on stock rom (rooted with supersu 2.65) lollipop 5.0.

OK, using 4.2.0 now. It show up but results came with question marks.

Debug file:

https://drive.google.com/file/d/0B-ZK8wbuIfBUSzI0WDFEUDZYbzA/view?usp=drivesdk
[Android Apps and Games] Dark3n:
The questionsmarks show because you are running without root and SD Maid is guesstimating the results through the system api.

Edit: My mistake, this was a bug that was fixed in v4.2.1. So SD Maid is running with root, but this still doesn't help us :(.

I figured out the cause for ticket #413 and reviewed your log from post #2511.

It doesn't show the symptoms so this is likely a different issue. I doubt if you run v4.2.0 with root that there will be a difference.

At this point I would ask you to create a new ticket on github, you can also add your logs and screenshots to it and then we'll have to do some investigating.
[Android Apps and Games] IronTechmonkey:
Folder named .. (dot dot) in root of internal SD?

After doing 3 things, one of which was testing SD maid, I noticed through USB via Windows Explorer a folder (actually a link) in root of internal SD named .. (dot dot). After deleting the .. folder/link and rebooting I had lost the entire contents of the internal SD card except for items that are created at boot. To be absolutely clear I dont think this issue was caused by SD Maid and I apologize for this bit of OT trolling, but although I can understand why deleting that item cleared the internal SD I am still trying to figure out how it appeared there only a few days ago. Does SD maid ever create such a link to the root of Internal SD named ..?

[EDIT] cleaned up post a bit.
[Android Apps and Games] Dark3n:
".." and "." are not created, they are part of the file system. They exist in any directory on your device.

".." points to the parent of your current directory.

"." points to the current directory itself.

Windows Explorer sees the device sdcard through the MTP file transfer protocol (on newer devices).

What you see is provided by the media storage app, which is why having it rescan storage sometimes helps if you can't see certain files on windows.

Creating a file named ".." or "." is not possible on windows.

I have never heard of ".." or "." being mapped by media storage or being made visible to windows via mtp.

I don't see a relation to SD maid.
[Android Apps and Games] IronTechmonkey:
Yep, that is the weird part. they aren't the conventional .. items that indicate "one directory up tree" (like the old DOS command). In Windows via MTP they are actual items in the file list view bearing folder icons but which report as drives in their properties (with zero size and no contents) and they are not visible on the device in any file manager. Another one appeared in root of external SD. Each time I got rid of them they returned when I restored a particular nandroid backup but I managed to get rid of them seemingly permanently by manually backing up the contents of both internal and external SD then copying back what I needed after deleting everything from the drives. While doing that I found a few odd things like 2 instances of an item named "storage" in root of internal SD. I suspect a combination of mess on the drive, and a different app I was testing were the culprits.

In some staged testing even before I found a way to get rid of them from the possibly bad nandroid restore I did a lot of stuff with SD Maid which did not cause them to return. Thanks for the extra bit of reassurance, and apologies for the OT. I would have more to say on topic if SD maid were not so effective and stable on my device. :)
[Android Apps and Games] PalmCentro:
Thank you!
[Android Apps and Games] Alexey71:
I can not delete system applications on CM13+SU stock. On my two devices. Not optimized for root CM13?
[Android Apps and Games] Dark3n:
[MENTION=4896512]Alexey71[/MENTION] I don't have CM13 on a device I use daily, what has to be optimized for CM13? Also always mention what version of SD Maid you are on, the latest version is beta v4.2.8.
[Android Apps and Games] Alexey71:
https://drive.google.com/open?id=0B35Mew37y2a_NlBZYWVnelhpSzQ
[Android Apps and Games] Dark3n:
Telling me SD Maid v4.2.8 would have been easier than making the video, I can't tell much more from it ;).

Can you record a debug log of the delete action?

I suspect something like this: https://plus.google.com/+Chainfire/posts/dGPQytapwe3
[Android Apps and Games] Dark3n:
[MENTION=4896512]Alexey71[/MENTION] I could confirm the issue. It's related to the toolbox/toybox issue mentione din Chainfires G+ post. Fix coming with v4.2.9 (likely this night).
[Android Apps and Games] Dark3n:
SD Maid v4.2.11(40211) is now the latest production version replacing v4.2.5.

Some notes for v4.2.6 to 4.2.11 from my G+ post:

A change to improve support for unicode characters in filenames (aimed at files with emoticons in their name) unexpectedly also improved handling speed of shell commands, should be quite noticeable when doing mass deletions.

Fixed the AppCleaner not finding all caches on rooted device if parent folders had irregular permissions (https://github.com/d4rken/sdmaid-public/issues/413).

A few different issues causing system app uninstall to fail have been fixed. This includes apps on /vendor and apps on /system on CM13 type ROMs.

If you have a low memory device and SD Maids scheduler could not reliably complete it's operations (orphaned notifications), then this might update might improve things. The "working ..." notification is no longer a normal notification but one that elevates the service priority to "foreground" even if the main UI is closed.

Debugging options have been moved and slightly changed, see wiki for more info.

The usual:

http://sdmaid.darken.eu/download

http://sdmaid.darken.eu/changelog

http://sdmaid.darken.eu/issues﻿
[Android Apps and Games] Oswald Boelcke:
Already for years, I've been running SD Maid. Now on v4.2.11 together with Unlocker v4.0.7. Device's details and configuration at signature block.

SD Maid is simply awesome and fantastic! No issues or problems at all.

Congratulations to [MENTION=608746]Dark3n[/MENTION] for a superb tool and a job well done. Thanks very much!
[Android Apps and Games] Jazz__75:
Hi to All,

Im using SDMaid for a lot of time but having a problem with N6P 6.0.1 & SDMaid v.4. 2.11:

Is extreme slow in the "cleanning system" function:

It start with 2200 operation/second but after it end with 150 operation/second:

Really more slow of nexus 5 (same version of SDMaid and of MM)

I WROTE TO THE DEVELOPER OF SDMAID but not good answer me!

Anyway: do you use SDMaid on your N6P?

Is slow, fast?

You can do me a screenrecorder?
[Android Apps and Games] Dark3n:
v4.2.13 is now the latest stable release and currently in staged rollout.

A couple of fixes for rare crashes and various filter updates (SystemCleaner advertisement filter & AppCleaner hidden caches).

http://sdmaid.darken.eu/download

http://sdmaid.darken.eu/changelog

http://sdmaid.darken.eu/issues﻿
[Android Apps and Games] Andrev01:
[MENTION=608746]Dark3n[/MENTION], hi, thanks for your work on this app. Got one issue here on my Z3 with 6.0.1 Android - SD Maid doesn't optimise contacts and phone apps databases. All other databases get optimised well, and these two - contacts2.db and profile.db say "optimisation impossible" (or something). Why? Thanks.
[Android Apps and Games] Dark3n:
[MENTION=4929611]Andrev01[/MENTION] https://github.com/d4rken/sdmaid-public/issues/436
[Android Apps and Games] Oswald Boelcke:
Same applies to me but additionally musicdb. Screenshots attached.

(Sorry, at the time of the screenshots, system language was set to German. Forgot to switch to English before taking the shots).
[Android Apps and Games] Dark3n:
It's not a problem. You can ignore it, or add an exclusion yourself or make a ticket on Github to also add this as global exclusion.
[Android Apps and Games] RA_dlanor:
Busybox error on Lenovo Ideapad A10 (RK3066 CPU)

I have been using SD Maid Pro on several other rooted Android devices for quite a while, without any problems.

But when I attempt to use it on my Lenovo Ideapad A10 it doesn't work properly.

When I launch the app it does show the initial menu correctly, and when I click on the "Settings" entry this results first in a 'SuperUser' popup where I click the 'Allow' box to give the program root access permission, but after this the 'BUSYBOX error!' message appears. These symptoms seem similar to what I've seen in earlier posts where the problem was lacking support for the CPU by the busybox of SD Maid, but I'm not sure if this is possible for my case.

This lenovo laptop has a Rockchip RK3066 quad-core Cortex-A9 CPU.

I'd appreciate it if someone can tell me whether or not this CPU is supposed to be supported by current SD Maid.

Best regards: RA_dlanor
[Android Apps and Games] Dark3n:
Record a debug log, it will say exactly why it fails to find a usable busybox.

(https://github.com/d4rken/sdmaid-public/wiki/Reporting-a-bug#debugrun-log)

The Cortex A9 is an ARM chip so I doubt it's an architecture issue.

Most likely a permission / root issue.

Does it work if you deny SD Maid root?
[Android Apps and Games] _iron13:
nice work top of the line app cant recommend it enough
[Android Apps and Games] maybeme2:
I recently had a problem which, I think, may have been caused by using SDmaid Pro (purchased unlock version) on my rooted nexus 5 phone running stock Android 5.1.1. I am writing not to complain but to ask if I could be right.

The problem was that suddenly my calendar would repeatedly lose all its data. For privacy reasons I do not sync with Google. I narrowed the cause down to "Calendar Storage" losing its data. If I used tibu to restore its data, the data would be present but then soon disappear again. Even after rebooting. Everything is fine now and SDmaid is uninstalled.

Could this problem be caused by my using SDmaid's Pro database optimization tool which preceded my problem?

Thank you.
[Android Apps and Games] Oswald Boelcke:
Ok, different device, different ROM, most likely total different system setup; however, this issue never occurred to me, and occasionally I also use the database optimisation tool. I don't sync with Google either.

Did you capture a SD Maid log and/or a "catlog"?
[Android Apps and Games] Dark3n:
The VACUUM command itself, that the databases tool runs has never been the issue.

All issues so far came from apps that started and tried to access their database while it was locked by the VACUUM command.

This is why the newer SD Maid versions have an option to skip running apps as well as suspend running apps (if root is available).

[MENTION=6910712]maybeme2[/MENTION] So I could imagine this happening if the app (or its service) was used at just the time the database was locked.

The perfect solution against this would be to preemptively keep an app from launching but I have not got a good solution for that yet.

* Freezing would remove widgets and alarms

* Force-stopping would also remove alarms and there is no way to "un force-stop" an app besides launching it AFAIK, so doing this for many apps wouldn't end well

* Suspending the apps execution (sigstop) is only possible if the app is already running

If anyone has a better idea, go :).
[Android Apps and Games] vlt96:
Is it possible to disable all receivers (that autostart the app), sigstop it, then restoring the receivers afterwards?
[Android Apps and Games] Oswald Boelcke:
Currently running SD Maid Pro v4.2.13. My database settings only provide the first option ("skip running apps") but not the latter. Root is definitely available. Did I miss the settings option for "suspend running apps"?

BTW: My calender DB is only less than 200 kb small i.e. no reason for me to try to optimise.
[Android Apps and Games] Dark3n:
Sigstop is done on a process, so it is only possible if an app is already running.

If the app is running it's a very good solution. Either it already has the database open, then we skip it, or we sigstopped it before we work on the database.

But we can't start all apps to use this, as it would severelly impact device performance to launch every app just to sigstop it.

Disabling all receivers to stop an app from launching might work. It would be very slow slow, receiver counts are anywhere from few to dozens.

I'm also worrying about what happens if SD Maid is killed mid step, how is their original state restored then?
[Android Apps and Games] Dark3n:
The app suspension only comes into effect when you don't skip running apps, as it only works on running apps.

Running VACUUM on a 200kb database is fairly fast, it's unlikely that it launched everytime SD Maid was just working on that db.

How reproducable is this problem?

If you don't want to VACUUm the database anyways, just add an exclusion for the path or even the whole package.
[Android Apps and Games] vlt96:
Hmm, aren't all receivers usually enabled by default? If something happens, a warning that SD Maid was killed in the middle of the job. But they could be re-enabled in their previous state at the next SD Maid launch. IF they launch SD Maid again.

Is this how an Android app developer spends the day? Thinking of all the possible scenarios his app may go through?
[Android Apps and Games] maybeme2:
Thank you for the insights. I was just shooting in the dark at what might have been the cause of the calendar data loss.

I didn't have a log and now that I uninstalled SDmaid I don't want to risk a recurrence... Things are working fine now and I prefer to keep it that way. ;)
[Android Apps and Games] Dark3n:
Some are enabled some are not, if you look through various apps you will see it. Some belong to features and are only enabled if the feature is enabled. Others only serve a single shot task and are deactivated afterwards.

Because apps could launch each other with custom intents (e.g. gplay services) we would need to disable all receiver. To restore the original setting, SD Maid would need to store their state in a file such that it can be recovered after a crash. This one would be tricky to integrate cleanly into SD Maids current architecture.

So it is feasible! But I can already see complaints about a lack of speed... It currently takes around ~1.5s per receiver, an average sized apps has around ~10 receivers, so we are looking at a possible extra 15 seconds per app! We could black list some receivers (if we can recognize them) that are known not to cause us issues, but there is no specific pattern or naming to custom receivers that could help us with that.

I hope so, otherwise I have been doing it wrong for years without anyone telling me!
[Android Apps and Games] vlt96:
Sounds like modifying the current ways brings more headache than good stuff.
[Android Apps and Games] Oswald Boelcke:
It's a pity. We Germans have the inherent tendency to create what we call a "EierlegendeWollMichSau" (probably best translated to a pig also producing milk, wool and eggs).

Too often, we forget that it's very often better to "buy something of the shelf" and never to change a running system. All what I said I experienced during my career. I firmly believe it's much better to stick with the "KISS"-principle all are certainly aware about.
[Android Apps and Games] maybeme2:
If I understand correctly, my suspicion that it was SDmaid database optimization that caused my calendar data loss is a possibility.

Are there similar risks with the other components of SDmaid?

I purchased SDmaid unlocker and am considering reinstalling but avoiding the database optimization tool. Are there other known risks I should be aware of?

Thanks.
[Android Apps and Games] Vagelis1608:
You could add an exclusion for the database that causes the issues and use the app normally.
[Android Apps and Games] Oswald Boelcke:
Personal assessment: No risks at all if you know what you're doing as with every application that has root access. With e.g. the explorer you would be able to harm your system. However, I haven't experienced any trouble with this well programmed app.
[Android Apps and Games] Dark3n:
[MENTION=6910712]maybeme2[/MENTION]

There is always the risk of false positives (being wrong about a suggestion).

This risk can only be minimized, but never be removed. (This could probably be argued for any type of automation).

Even if you manually check the results, you can yourself be wrong about something ;).

The colored circle (and bars) that is used through SD Maid is a rough general indicator for risk.

The CorpseFinders sdcard filter has a redish circle due to how sdcard corpses are detected, which is by whitelisting based on database.

If a directory <-> app relationship is whitelisted SD Maid will consider it for deletion if the responsible app is not installed, but because the sdcard ( in contrast to e.g. /Android/data ) follows no naming scheme what so ever, it sometimes happens that other applications use the same directory and SD Maid doesn't know about it.

Example:

An app 'com.app.pro' uses the folder 'AwesomeFolder' and now the same developer (or someone else) releases a new app which uses the same folder.

There is no other option to this if we want to find corpses in that location.

A good practice is to check the details of each tool after the first scan when using SD Maid for the first time, though there are thousands of people just using SD Maid from the QuickAccess page without any complaints.

I don't think any other tool of this type is risk free unless it just triggers the 'clear default cache' hack in which case you don't even need an app.

In my opinion SD Maid is the best we can do with what we have... (that sounds weird).

There are ideas that could minimize risk further, but it costs us.

Imagine collecting the installed apps from every device and the directory structure.

Using the data we could automatically improve the folder<->app referencing on a large scale.

The more data is available the better it would become.

I doubt most people would want this though, people value their privacy, no matter how good the intentions are.

(I wonder if there is an app that does this already... Probably...?)

Suprisingly (at least to me) many people also value speed over risk.

I talked to users after the v3 to v4 upgrade and despite explaining that v4 is much safer than v3, lots of people said they still prefer v3 because it was faster.
[Android Apps and Games] ruky23:
this is so much better than the old tool i used to use: clean master...which along the way kinda turned adware-ish on me..

im glad for this to take its place.. great job
[Android Apps and Games] MrWasdennnoch:
Please don't quote the OP.

Also, CleanMaster? Ew :eek:

Never install that. It doesn't help at all.
[Android Apps and Games] Oswald Boelcke:
You're absolute right! With both...

"Clean Master"???:eek: I've never understood thus far why people install APKs coming from the PR China, and which have so many permission unless they want their devices to be spied. And there're multiple others around...
[Android Apps and Games] vlt96:
Well, I have a Xiaomi device. I'm forced to use Chinese software (and hardware is mostly made there for all phones, anyway). It's not that bad. Also, before worrying about spying, think about WHO is spying on you and WHY would they spy you and WHAT can they use about you. Seriously, there is no reason to be worried about having all your data on Chinese servers, they have no use of it anyway. They can't store ALL of it, the only things they can take about you are patterns. Generalized patterns. Unless you are a target of the intelligence service, your data is just put as a +1 in the pattern stuff. And if you're targeted by intelligence services, Clean Master is the least of your worries.

Went to a Microsoft Hackathon about data collection in IoT (we were told it was about IoT in general first, but apparently IoT nowadays is about gathering data). The pitch was "We have dozens of billions of devices to gather the data. HOW do we use it?".

On a more related note, I'm using SD maid for 5 years, Clean Master just came there as a worse alternative with a better looking UI. It's one of the apps I always had installed on my phone. ALWAYS. It's the first I install, even though I don't use it as much on 32 GB or 64 GB devices as I did on the 200 MB phone I had back in the day.
[Android Apps and Games] MrMagicPotato:
I am on miui 8 and when I click on settings button and follow the guide it says: "documentari is disabled" then I go ti Titanium backup and un-freeze it, but then when I try again sd maid keeps loading settings Forever....

Now I suppose that its a problemi related to the stock miui file manager (it's different from the "aosp" one)... What should I do to unlock sd maid?

Thanks in advance!