yashsingh1/xdaforums huggingface dataset:
[Android Apps and Games] overground:
These are the two I tested. I'll try a few more, but I suspect the same result.

EDIT: Tried moving a game's files to cache, same error code, with an additional of #1002
[Android Apps and Games] cyansmoker:
OK. Sorry about that, then.

So, I just uploaded a new version and I'll admit: I have some great hopes for this one.

In fact, I suspect that it will either relocate your directories correctly or not at all.

That's because this time most read-related operations happen directly at the OS level, not the shell.

If this works better (rather than not at all) then it means that I can address any remaining issue quickly using this method.

Let me know...

-C.
[Android Apps and Games] overground:
Don't be sorry. This is a development forum. I will give the new version a shot a soon as I'm through testing this new battery calibration method. Thanks for your efforts.

EDIT: Just a quick report before I hit the sack. New version successfully moved Google Earth's lib folder to cache! Earth also functions properly after the move. Great work! I will try some more tomorrow. One small request (I'm sure it won't be the last ;) ). Would it be possible to color code or delineate by some other means, those apps with moved data in the main list? I can explain more if need be, but I think you should catch my drift. Thanks again. Good night. :)
[Android Apps and Games] Biltmore:
NES on HTC aria CM 6.1

I just tried NES on my aria running Cyanogen 6.1. It gives accurate info on the files and and their size but is seems to have the phones internal memory info backwards. It shows the total memory on the phone as 185.1mb with the used as 41.7mb and the free as 141.6 mb. When i sleect a folder to move the program shows the error 'unable to parse * as an integer' and then returns to the folder list screen with every item showing double including the green back arrows.

Here's the debug info if needed.

1:bb

2:/dev/block/mtdblock5 189568 164920 24648 87% /data

3:38658	/data/data

4:null

5:4096/42684/144989
[Android Apps and Games] overground:
Did you grab the latest from HERE? Mine was doing the same thing with the previous version except replace your * with " on mine (see my previous posts). I'm on Miui 12.03, however.
[Android Apps and Games] Biltmore:
I did. The previous version was showing incomplete data so this one is a vast improvment but still has issues.

EDIT: Just downloaded the new version now and tried it. It's working now but the memory info is still backwards.
[Android Apps and Games] overground:
Mine shows correct:

Total: 196.2MB

Used: 121.8MB

Free: 72.5

Database: 29.3MB

Files: 50.1MB

Preferences: 25.4MB

Cache: 15.1MB
[Android Apps and Games] cyansmoker:
BTW,

I suppose you mean color coding at the top, when the app name is displayed, if any of its sub directories was moved?
[Android Apps and Games] cyansmoker:
Are you saying that the application shows something like

Total: 185.1MB Used: 41.7MB Free: 141.6MB

When it should, in fact, be closer to

Total: 185.1MB Used: 141.6MB Free: 41.7MB

?

If so, it means that I should also switch these computations to native file system access rather than just the shell itself. That's very previous information; if you could confirm that would be great.

Cheers,

-Chris.
[Android Apps and Games] Smabbage:
After running for the first time I wanted to clean up the D. Cache and was presented with a requester to download Quickboot which I did. I ran it and gave it su permissions but when I exited Quickboot and reloaded NES and tried to clear the cache again it didn't recognize that Quickboot had been installed and requested that I download it again. Is there something I'm doing wrong or is this a bug in NES?

Update: Google Earth does NOT like it's data moved. I have moved it's data to sd, emmc, and cache and each time after a reboot it force closes. Put the data back and still force closes. Uninstall and reinstall and works fine. Haven't messed with anything else. I've been moving all data but perhaps I just need to move the lib directory. Will keep trying and see if I come across a successful combination.
[Android Apps and Games] cyansmoker:
I believe that I will need to augment the FAQ to detail some of the reasons why moving directories could lead to failure.

For instance, it very rarely is a good idea to move the lib/ directory because it may contain dynamic libraries, which will not run if they lose their executable flag.

Sometimes the files/ directory will also contain native code, which will not like being moved either.

I would say that you get your best bang for the buck when moving cache/ and databases/

Come to think of it, what I should do is sniff for such files and warn you if you try to move directories that contain them.

It is more likely to be a bug in NES, yes. I think I will need to add a version number to the debug screen so that we can figure out which build you are running because I changed the way reboot is detected recently.
[Android Apps and Games] cyansmoker:
...and I just uploaded a new version, which _should_, hopefully, fix your problem if you are seeing "free" and "used" reversed.
[Android Apps and Games] Smabbage:
Thanks for the reply. This program is great in that I can now actually see which programs are eating my data/data partition and remove them if necessary. I look forward to future builds. Thanks for this great app.
[Android Apps and Games] overground:
Exactly. Just something to tell me that all or part of the data has been moved.

All I moved was Earth's lib folder (which is the biggest hog) to cache, have tried it several times and it has worked with no problems.

I think after installing Quickboot, you have to completely exit NES, then open it again for QB to be recognized.
[Android Apps and Games] Smabbage:
Ok. May give it another go later. Right now the new version is giving me a "bad status code 1002" and lists all my data/data folder as NaNKB. :(
[Android Apps and Games] overground:
Confirmed that bug. New version doesn't even give me an apps list. Total and free are the only reported with numbers and free says 194.3MB which can't be right. Reverting for now.

EDIT: You can add my Nexus 1 to the list of tested phones.
[Android Apps and Games] probers1:
I loaded the new version and also got that error. Nexus 1 running enom rom. I went into applications and cleared all data for NES and force closed it. reopened and it read my data and no more error.

Still doing some testing, but I like it so far. If only it could move to an ext partition instead of the sdcard.
[Android Apps and Games] overground:
I used the dalvik clear feature 1x just to test it. It worked (after installing Quickboot and killing / restarting NES), however I don't think it's a feature I'll ever use through the app again. I prefer to clear it through recovery console, but that's just personal preference. It's a nice feature, though, for those who will use it.

EDIT: OK. Uninstall / reinstall of new version fixed the reporting and the apps display, although doing so completely broke my Earth install (didn't show in any apps list). Went through and manually removed the remnants of the old Earth install (including the linked folder in /cache), reinstalled via the Market, then moved the lib folder to /cache again using NES. Earth functions again :). I'm not too sure about the accuracy I'm getting in the reported numbers, however.

NES reports:

Total: 196.2

Used: 66.5

Free: 127.8

Database: 16.5

Files: 17.2

Preferences: 18.5

Cache: 11.7

df -h

# df -h
df -h
Filesystem Size Used Available Use% Mounted on
tmpfs 201.2M 0 201.2M 0% /dev
tmpfs 201.2M 0 201.2M 0% /mnt/asec
/dev/block/mtdblock3 145.0M 130.6M 14.4M 90% /system
/dev/block/mtdblock5 196.3M 145.0M 51.2M 74% /data
/dev/block/mtdblock4 95.0M 17.4M 77.6M 18% /cache
/dev/block/mmcblk0p2 800.8M 380.3M 377.8M 50% /data/sd
/dev/block/vold/179:1
14.0G 9.7G 4.3G 70% /mnt/sdcard
/dev/block/vold/179:1
14.0G 9.7G 4.3G 70% /mnt/secure/asec

EDIT2: Just successfully moved stock browser app-thumbnails and cache to /cache
[Android Apps and Games] cyansmoker:
OK. I suspect that the "nes" binary is now, for some reason, not executable, which will basically render the whole app. useless.

I'm on it.
[Android Apps and Games] overground:
Look @ my edits above first.
[Android Apps and Games] Biltmore:
NES Memory readout reversed

Sorry for the slow response. Yes, the way you describe the memory readout is correct in the first description with the total memory correct but the used and free being backwards.
[Android Apps and Games] Smabbage:
Ok. I too uninstalled and reinstalled and got version 1.1 to work. I now get the app list, however, it's reporting strange numbers. Total:149 Used:83.2 Free:64.3 but Root Explorer is showing Total:149 Used:123.86 Free:25.14.
[Android Apps and Games] overground:
Just quoting to ensure cyansmoker sees this.
[Android Apps and Games] cyansmoker:
OK I just re-uploaded a new version. It should take care of the latest version not running at all. So you know, I found the most formidable bug in my Java code that was killing my native (C) application as soon as it was started. I believe this explains why sometimes is didn't even try to become root at all.

Regarding the numbers: that is very interesting. Let's talk about them:

* Make sure that you are checking the values for /data/data and not /data

* Note that the value returned by the system after moving a file is conservative because it still sees this file as taking up space if it belongs to an application currently using it; this is why I introduced my own formula.

* The formula I am applying is as follows:

free space = total space - ((all apps files size / blocksize + 1) * blocksize / 1024) - (total space / 100)

The first part basically checks every single file's size and rounds it up to the nearest multiple of the block size for this partition;

The second part is arbitrary: I am assuming that /data/data reserves an i-node table that is about 1% of its size; I cannot retrieve this value myself as the partition information table is protected.

I will work on the formula some more, obviously.

-C.
[Android Apps and Games] Smabbage:
The new version works but the math is still a little wonky. I'm looking at my data/data partition with root explorer and it's reporting Total:149, Used:123.90, Free:25.10. Root Explorer has been consistent with the system when it reports low space.

NES is reporting

Total:149

Used:83.2

Free:64.3

Database:27.5

Files:33.7

Preferences:10.7

Cache:9.7

There is 40.7MB unaccounted for. Strange.
[Android Apps and Games] Biltmore:
Latest Version

OK. I installed the latest version and the memory info is now correct. The oddity now is that the program is showing Better Terminal Emulator as 87.7 mb. Also, it shows K9 email as 8.4 mb even though I moved the app using NES. Anyway, progress I'd say and I definitely like the app.
[Android Apps and Games] cyansmoker:
OK, I believe that I have the ultimate test for this discrepancy:

* Root Explorer reports the same as what the system would, because it gets its information from the same place. FYI, I could definitely display this value as well because I, too, get this value.

* The value I report, after adjustment, is what I believe you would have available if your phone was not keeping a hold on temp. files.

* What are these temp. files? They are files that were at one point opened by a process and moved or deleted by another. For instance, if a process logs to a file called 'myprocess.log' and another process deletes this file while in use, the system considers that this logfile's disk space is still unavailable. It is right about that, of course.

What I display is the disk space available after this file's space is collected.

* The test: my guess is that if you were to reboot your phone, you would see that suddenly system free space values and NES's free space values are much more in tune.

I would say that both values are important. I simply need a way to display them both in a way that doesn't use too much real estate.

---

If you are curious while comfortable with the command-line, you can get an idea of how many such "ghost" files exist on your phone at any time using this command:

find /proc/*/fd | xargs ls -l | grep deleted

-Chris.
[Android Apps and Games] overground:
I had the same report for BTEP. It reported the bin folder as being 87MB. I cannot confirm this is a false report ATM, however.

Some of my apps with moved data also show in the list as if no data was moved. Browser does this with cache and app-thumbnails moved. The reality is the data is moved and you can tell by grey duplicate folder icons within that specific app page of NES.
[Android Apps and Games] Smabbage:
I had a similar experience with root explorer giving me the same reading before and after reboot. If it's the temp files that are in question, root explorer and the system shows them as still taking up valuable space after a reboot. Other than that, NES functions as intended.
[Android Apps and Games] TheSSJ:
Works really good on my Milestone with 2.1:

1:sh

2:/data/data: 201856K total, 112820K used, 89036K available (block size 4096)

3:47390	/data/data

4:-rw-rw---- app_1 app_1 14336 2010-10-25 11:47 webview.db

5:4096/50356/149482

nice job :)
[Android Apps and Games] Smabbage:
Love the new icon!! Available space report is consistent with available space reported by Root Explorer. I look forward to moving some of this cached data to SD this evening after work. Until then, just wanted to say, Great Job and Keep Up the Good Work!! :)
[Android Apps and Games] matt992:
hey i would love to beta test i have a nexus one running miui
[Android Apps and Games] overground:
Same specs as me. Grab the .apk and test away.
[Android Apps and Games] cyansmoker:
Thanks for all your feedback, guys.

overgound, it looks like I'm trying to update the screen after the current view went away. Now, why did it go away? There are so many reasons why this can happen on Android that I have to be more defensive in my programming...Oops.

Now, I am going to go away for a few days (yay!) but when I come back there are a few things I will want to do:

1. Yes, do something about version number! I've been leaving it alone because it's not in the marketplace, but it _does_ make it awkward to report what version you are running!

2. Some other suggestions read here need to be implemented;

3. Store all ownership/access rights information for all files, rather than just use a top-level file as template; this should allow you to restore an app perfectly if it stopped working after moving it to the SD Card

4. Be smarter about what is being moved:

4.1. Warn you/maybe block you if a file that will lose important privileges is about to be moved to the SD Card or /emmc (which has its own issues)

4.2. Recursively check subdirectories to check that you are not moving the parent of something that was already moved: could be bad karma.

Maybe make the app's icon bigger (ha!)

-C.
[Android Apps and Games] overground:
Thanks, Chris. To sum up my somewhat confusing post. Everything seems to be working well now. Numbers seem correct, data is moved and linked correctly. The only problem I'm having ATM is moving stock browser's cache folder from cache partition back to internal. In addition to my other requests, a move to ext option would be nice, and probably not hard (for you) to implement. Great work, and thank you again!
[Android Apps and Games] Cheesejam:
Awesome app! It does exactly what I have been looking for: lists how much data each app is using in that dang data/data folder!

However, I tried to move apps onto my SD card. They were successfully moved to my SD card (or at least out of the data/data folder, I can't seem to find them on my SD card). Unfortunately, the apps then no longer worked; they force closed upon starting. I tried to restore them, but that didn't work.

Overall, this app did exactly what I wanted it to do. If it could move these things to the SD card, it would be icing on the cake! :)

(I have an HTC Incredible with Skyraider Vanilla)
[Android Apps and Games] cyansmoker:
So, I'm back, and I've implemented these two.

Actually you will not be able to move a directory that contains an executable (like an executable file or a native library file)

Same if this directory contains one or more links. This takes _partial_ care of 4.2.

-C.
[Android Apps and Games] overground:
Welcome back. Think we need a third forced move for those folders containing executables. All of my apps have worked when moving lib and cache folders to the /cache partition. Maybe just a warning, but please do not disable the option entirely. Or let it be enabled somewhere i.e. settings>advanced. Thanks.

EDIT: Along the lines of my previous request (color code or something those apps with moved data), in the sort options, maybe a sort by moved data? Thanks again.
[Android Apps and Games] cyansmoker:
Ah I may have disabled moving to /cache and it would be a bug. I do not intend to disable /cache or /ext

/sdcard and /emmc are evil, though.

Note: works perfectly on Nook Color! Fun.
[Android Apps and Games] Smabbage:
I think it's awesome that you can run Android on a nook. :)
[Android Apps and Games] overground:
I never have gotten the option to move to ext, just cache and sdcard. Any ideas why? My ext is mounted in /data.
[Android Apps and Games] cyansmoker:
Well, that's why. I look for /ext not /data/ext

Do you know if it's a bind mount? And if it tends to be in /data/ext by default?

Smabbage:

Yes, it's beautiful. I use GO Launcher and I have widgets on my home screen, folders, soft keys, etc. A really enjoyable -- and cheap -- tablet.
[Android Apps and Games] twicejr:
not a number

Getting NaN on all entries.

Gingerbread - oxygen rc5
[Android Apps and Games] cyansmoker:
Ah. That's annoying. What version are you running? (displayed at top of Help screen)
[Android Apps and Games] hgoldner:
The Beta expired?

I'm getting a "beta expired" when I try to open the app (and I only just downloaded it 12/28/10.)

Is this a Y2K11 bug?
[Android Apps and Games] cyansmoker:
Oh, geez. I forgot.

It's not a trial period or anything like that; simply a hardcoded date after which the application stops working.

This is because I do not like, while beta-testing a program, the idea of people walking around with a completely outdated version and no automatic update to tell them that something better is available. So, I put an expiration date.

Please re-download it, I pushed the date back.

-C.
[Android Apps and Games] hgoldner:
Thank you, kind sir. That did the trick.
[Android Apps and Games] overground:
Well it's a little strange. My ROM has an empty sd-ext folder. It's purpose, I'm not sure, probably a place holder or something of not of consequence. Then it has symlinks to app, app-private and dalvik-cache mounted in /data. Think it's using DarkTremor's a2sd scripts found HERE.

df -h
Filesystem Size Used Available Use% Mounted on
tmpfs 203.0M 0 203.0M 0% /dev
tmpfs 203.0M 0 203.0M 0% /mnt/asec
/dev/block/mtdblock3 145.0M 126.3M 18.7M 87% /system
/dev/block/mtdblock5 196.3M 139.0M 57.2M 71% /data
/dev/block/mtdblock4 95.0M 48.3M 46.7M 51% /cache
/dev/block/mmcblk0p2 800.8M 392.6M 365.5M 52% /data/sd
/dev/block/vold/179:1
14.0G 9.6G 4.4G 69% /mnt/sdcard

So looks to be /data/sd

EDIT: This is becoming greatly unusable for me unless a forced move of executable folders is implemented.
[Android Apps and Games] quake3god2004:
What about using symbolic links?

I'm sure the developers have already explored this option, but I feel like I should mention it...

The ln -s command seems to work on the android; I tested it using Terminal Emulator and it worked fine. So couldn't we simply move the /data/data/XXX directory to the SD card and create a symbolic link in the /data/data directory?

IE:

/data/data/abc -> /sdcard/abc

I haven't tried it yet because I was able to free up enough cache in the /data/data directory but thought I'd mention it.
[Android Apps and Games] overground:
That's exactly what this does.
[Android Apps and Games] cyansmoker:
v0.5.3

New: 'Settings' menu entry replaces 'Debug'

New: in settings, add arbitrary destination path to move files to

New: Quick-scroll widget in applications list

Fixed: executables could not be moved to /cache anymore

Fixed: Subdirectories could not be moved anymore
[Android Apps and Games] Smabbage:
Thanks for your hard work. Downloading the update now. :)
[Android Apps and Games] hgoldner:
Download not in sync

I downloaded the latest version and it says 0.52, not 0.53
[Android Apps and Games] Smabbage:
All the new features are there. It was probably a oversight. :)
[Android Apps and Games] overground:
Created directory /data/sd/data (this location will vary depending on ROM)

Moved Google Earth's lib folder there.

Works perfectly! Great work, Chris!

Also works moved to /cache :)

Now just the sort + color code the apps with moved data in the list, and I think it's ready.

Thanks
[Android Apps and Games] hgoldner:
How did you get Google Earth to use the new location? (Google Earth is notorious for filling up the Incredible cache and producing those damnable "low memory space" messages).
[Android Apps and Games] overground:
Just find Google Earth in this app. Long press the lib folder (31+ megs on my phone). Then select move to cache or other available location. Hope this helps.
[Android Apps and Games] cyansmoker:
Thanks for helping, Overground :)

What's next?

Well, I realized, today, that I could actually make things even easier.

If you want to store things on your SD Card, there is a well-know issue: it's a VFAT device which will just not run your games or anything else using native code correctly.

The workaround used by some, is to re-partition your SD Card so that it has both a VFAT and an EXT2 partition.

Here is the alternative I am working on:

The application will offer to create a new partition, on the SD Card. However this partition will be a loopback file, which means that your SD Card will remain intact: not, in fact, re-partitioned, not reformatted; and yet it will be possible to store any application on that new partition-on-a-partition (think of it as a container)

So far I've performed all these steps manually and got the whole thing working perfectly. Note that creating that new partition is going to be quite slow: 16s for a 100MB partition, 183s for a 1GB partition; my guess is that a 10GB partition would take close to 2000s (1/2 hour) to create.

But at least it will be a one-time operation and, of course, you will get to pick the size of your partition.

Cheers,

-C.
[Android Apps and Games] Smabbage:
Sounds cool. So if I understand you correctly, it will opperate like a virtual drive of sorts from a VFAT partitioned SD Card. Neat!
[Android Apps and Games] cyansmoker:
v0.5.4

New: Create NES Partition -- non-destructive EXT2 container on SD Card; great for games

New: Apps with relocated folders are visually differentiated and sorted

Fixed: Some apps were showing with 4KB size only

Smabbage: exactly!
[Android Apps and Games] Anon87:
Hi, first of all thanks for all the hard work.

Just one problem I'm hàving - I keep getting a 'failed to format container' error when i try to create a NES Partition. Then a FC.
[Android Apps and Games] cyansmoker:
Ah. Yes, I should have been clear about this: this new feature absolutely needs testing.

I expect it to fail for some and work for some.

The good news is that it will not destroy anything on your phone; just fall on its face.

Anyway...

Do you have a file explorer that would let you check the content of /data/data/com.voilaweb.mobile.notenoughspace/files/?

You should see several files; two of them executable: nes and mke2fs

-Chris.
[Android Apps and Games] Anon87:
Yes, I see those.

Sent from Soft-Rooted HTC Desire using Tapatalk
[Android Apps and Games] gen_scheisskopf:
Hi

I've tried running NotEnoughSpace 0.5.4 on Samsung Spica (gt-i5700, deodexed Eclair- SamdroidMod 1.3.1).

Problem: FC when creating ext2 container- I've tried 128MB and 256 MB size with different mount points, everytime I got popup sayng "failed to create..." followed by FC.

Logcat attached