yashsingh1/xdaforums huggingface dataset:
[Galaxy S I9000 General] HaTeNL:
Wrong! :P My previous datafix was 29032012v2.

And I'm back to that one. After a few hours I restarted my phone and it wouldn't boot with your script, even recovery didn't work :s (which is weird)

I am now back on the 29032012v2 version, but I might get out of space soon when the cache builds up. :(
[Galaxy S I9000 General] Wendigogo:
Did you use my last datafix (from 20120524) *and* remove by hands previous init.d scripts ? The first I post here was buggy if you've got previous datafix installed (my bad for that) and problems you describe are similars.

Did you use the skip_apps variable in 2903 datafix ?
[Galaxy S I9000 General] RootTheMachine:
If my phone won't boot because /datadata is full, what can I do to allow it to boot? Obviously I can wipe data, but I'm talking in terms of being able to use the current data again. You could probably make some kind of revert .zip for this purpose. I'm hoping you can do this, because my Tibu backups aren't working and I accidentally corrupted an old nandroid in attempt to repair this one.
[Galaxy S I9000 General] upichie:
Awesome! Congrats. :D
[Galaxy S I9000 General] Wendigogo:
Your phone should warn you when free space on /datadata is lower than 10%. If this comes you could first try to clear some apps cache (or move some cache to /data using my script).

If it doesn't work, try uninstalling some apps (before rebooting of course).

To know which ones uses the most space on /datadata use the command :

du -s /datadata/*|sort -n

I think you could remove the cache by hand if the apps don't permit you to do it :

rm -r /datadata/appsdirname/cache/*

Anyway, I'll make a zip file to revert datafix. But that implies you still have access to recovery ...
[Galaxy S I9000 General] RootTheMachine:
Sometimes the phone doesn't give the warning, and the only warning is the massive outbreak of FC's. Last time I fixed it by wiping app caches, but this time, that operation would FC too (I used an app; didn't think about terminal...)

Thanks, a revert would be nice. My recovery is fine, and I would assume it would be for others too.
[Galaxy S I9000 General] basily:
Come to think of it, my phone never gives the warning anymore. It used to, but now i just get the FC's. I wonder why?
[Galaxy S I9000 General] HaTeNL:
Yes:

Nope

FYI: Market says I have 140 apps installed.
[Galaxy S I9000 General] crocodylek:
encryption

Hey, does it still break the encryption of the user data introduced in AOSP anroid ver 4.0?
[Galaxy S I9000 General] yalouf:
I have to try that out !

Envoyé depuis mon GT-I9000 avec Tapatalk
[Galaxy S I9000 General] Zatta:
could you add this line somewhere to the OP, FAQ maybe?? Pretty usefull sometimes, I knew I read it in this thread and looked it up. Thanks

EDIT: Oh, are you still struggling with removing the file in init.d from the updaterscript? If needed I could spent some time figuring it out for you.
[Galaxy S I9000 General] Wendigogo:
Have a look at your /datadata : df /datadata

It may be fulfilled again. Some apps store a lot of cache in /datadata. Use the previous command to check if this is the case.

The datafix will not permit you to install all apps available but more than with stock CM based Roms.

I don't know where encryption is done; but accordingly to comments in /sbin/setupdatadata.sh it seems /datadata partition could not manage encrypted data (probably a yaffs2 limitation) so imho no datafix could manage encryption except by moving all files in /data (the original datafix included in CM roms) ...

That's a good idea ! Will do that shortly.

Don't look at this for the moment so it's still a problem ... :rolleyes:

I'm working on a new version with some improvements : check there's enough space in /datadata before running the datafix (if previous datafix installed), clean empty dirs to avoid warning in scripter/script manager and the revert possibility for "skip_apps" (all in /data or standard datafix parameters).
[Galaxy S I9000 General] RootTheMachine:
So are you making something to revert this also?

Sent from my SGH-I897
[Galaxy S I9000 General] Wendigogo:
What do you expect by revert this ? Moving back all to /datadata or all to /data/data ? If it's the second option, it's quiet easy as everything is still included in my current datafix (it's a part of it).

Anyway, it's also on my todo list but after improvements I listed before. It'll check if there's enough space in /datadata then choose where moving apps data.
[Galaxy S I9000 General] RootTheMachine:
The second one, I couldn't figure it out myself.

EDIT: I just made a script for it from your datafix, let's see if it works.

Again: Nope, can't seem to get it to execute.

Sent from my SGH-I897
[Galaxy S I9000 General] ninja_rancher:
So I read through all the pages and didn't see an answer to this. I have the latest CM9 nightly on my wife's Captivate. I've never applied a data fix script before, but I have manually moved apps to the SD card whenever the low storage warning comes up. It's a losing battle, though, so I'd like to flash this fix. My question is this: after applying the fix, should I start moving apps back to phone? Or should I let them stay on the SD card? Is there a performance difference? Thanks.
[Galaxy S I9000 General] anuj_blaster:
what will happen if i do not add any apps to both the text file.. "move_cache.txt" and "skip_apps.txt"...

/datadata is still moved right?
[Galaxy S I9000 General] Zatta:
Most stuff will be in /datadata, just the libs will stay in /data/data/packagename:

Taptalked u see
[Galaxy S I9000 General] schinden:
So let's make a list of applications that should remain on the data/data?
[Galaxy S I9000 General] anuj_blaster:
Thanks.. problem sloved :)

just got a fc on nova launcher.. but it stopped after a couple of reboots..
[Galaxy S I9000 General] All Day On XDA:
Not working for me on SlimICS 3.8 and Devil kernel 0.94

I deleted the init.d scripts as recommended but the phone still bootloops.

I have the swap partition enabled. Could that be the problem?
[Galaxy S I9000 General] Wendigogo:
Sorry about this delay, I've been busy (and still is) ...

I'm near about releasing a new version with some checkin/cleaning/upgrading skip_apps parts (see my post above). I have to test it a little more before posting it here.

If someone could help me about the zip file : I need to remove previously installed (S)30datafix(_ng_busybox) before adding mine.

Moving apps to SDcard is not the solution. Apps apk are installed in /data which is a 2Go partition (frequently with around 1Go free).

I think the Low storage comes from the /datadata partition and datafixes try to deal with this little 172Mo speedy partition without performances lost.

So you don't have to move back apps to phone but you should stop moving them to SDcard as it's not relevant. ;)

As answered before, in this configuration, the 2405 datafix is the same as the 2903 one.

I see a side effect of these datafixes : they remove the /sbin/setupdatadata.sh script. So Gmail and Play Store cache is back on /datadata.

So adding "com.android.providers.downloads" and "com.google.android.gm" in "move_cache.txt" is a good starting point.

Then you could run du -s /datadata/*/cache|sort -nto see which apps cache are wasted your /datadata space.

I don't think it's a swap related problem. I had some issues with latest Devil kernels : reboot and/or bootloop when flasing some zip (bootanimation). Stock CM9/Semaphore are more robusts imho (but they don't include VC so I come back to Devil :D )
[Galaxy S I9000 General] Zatta:
I think you didn't receive my mail?

Taptalked u see
[Galaxy S I9000 General] All Day On XDA:
afaik, Semaphore doesn't support swap. Seems I'm stuck then.

Has anyone managed to enable both swap and a datafix?
[Galaxy S I9000 General] Wendigogo:
Oops !

Forgot this ...

I saw some zip files with script included but you're welcome if you could help me on this part. Will answer your MP asap. ;)

EDIT : I answered you 1st june ... Don't you have received my MP ? :confused:

I didn't use swap with Devil and had bootloop/reboot. So it may not be a swap/datafix problem.
[Galaxy S I9000 General] yakari35:
Hi Wendigogo, and thanks for your script.

I have a question regarding Titanium Backup: I made my last backup with your previous script installed (2903) but without ticking the 'Follow symlinks' option (because it was scheduled backup and I didn't pay attention).

But my device crashed and went into bootloop, and now, when I try to restore my apps or even just the data, with ot without the follow symlinks option, these apps force close...

Any advice?
[Galaxy S I9000 General] Silentbob999:
Data that are symlinks are missing from the backup (titanium had backup only the shorcut) ... New backup will be ok. Older backup before the script too... But for what you have now I don't think you can do anything... App only but avoid restore data from that backup.

If someone else can confirm my thoughts..

Envoyé depuis mon GT-I9000 avec Tapatalk
[Galaxy S I9000 General] Wendigogo:
You're right : Apps data are missing from backup following datafix execution. You could restore an old backup (apps&data) or just apps from recent TB backup.

No problem with nandroid backup if you've got one.

As I'm too busy to make full test of the next datafix here is a Beta vesion for testing (Thanks to Zatta which helps me to make the flashing zip file).

Please report about it and MAKE A NANDROID BACKUP BEFORE (I double check the script but it could still have bugs).

What's new :

Flashing zip file remove old datafix in /system/etc/init.d and /data/data/.datafix_ng and copy the new datafix_ng_busybox (only "S" version uploaded, just edit the filename in zip file before flashing if you have stock CM kernel)

Check if there enough space before applying the Datafix

Cleaning empty dirs (no more warning when executing the script from scripter or equivalent)

"skip_apps.txt" works like "move_cache.txt" now : the script move selected apps to /data or /datadata (libs stay in /data/data) accordingly to /data/local/datafix/skip_apps.txt content : you could add and remove apps name in this file when yout want.

Some cleaning

Please add "com.android.providers.downloads" and "com.google.android.gm" in "/data/local/datafix/move_cache.txt" to put GMail and Play Store cache in /data/data (it's the default behaviour of CM roms and datafixes change this) : if you wanna install big apps (like themes) it could fail and fulfilled your /datadata (FC etc.)

Next zip file will include these files.
[Galaxy S I9000 General] Zatta:
I think something went wrong. At least now i know what lag means :-)

Investigating it:

Taptalked u see
[Galaxy S I9000 General] Wendigogo:
:eek:

You tried it with scripter or with init.d ?

EDIT : Do you have a previous datafix installed ?

EDIT bis : got it !!!
[Galaxy S I9000 General] Wendigogo:
Here is the corrected version. Previous used an "old" buggy datafix. I make a mistake when copying it into the zip file ... Sorry for this.

Zatta, you should apply this correct datafix directly : the previous bug stop the execution before moving back files to /datadata.
[Galaxy S I9000 General] Zatta:
Thanks, it works as expected now (after a quick test /datadata is filled again with 26 mb free space. Man, what was that phone laggy for a short while!

Taptalked u see
[Galaxy S I9000 General] RootTheMachine:
Works great for me with latest one

Sent from my SGH-I897
[Galaxy S I9000 General] acmilan77051:
should i use this zip file or the one from the OP?
[Galaxy S I9000 General] Zatta:
I would advice the last one.

Taptalked u see
[Galaxy S I9000 General] Wendigogo:
I made some test with this latest one with success. No one report bugs since yesterday so you should try this one.

A fresh nandroid backup is *always* a good starting point. :D
[Galaxy S I9000 General] acmilan77051:
yup i flashed the last one,it doesn't produce any lag,so it is better compared to the old datadata low storage notification fix..but there seems to be one problem,after flashing this,whenever i install or update anything from play store,download delays for about 2-3 minutes showing 'downloading',previously it took not more than 5 seconds to start the download..is it normal with this fix?
[Galaxy S I9000 General] artyfarty:
this is first time that I use this datafix (the last one - DataFix-test). It seems it works fine, no lag or problem (market works as usually).

now I test for a few days.

thanks!
[Galaxy S I9000 General] Silentbob999:
Same thing for me. It works great, and I like the verbose part for cleaning and thanks. Good job!

The first post should be updated with that version of the script ;-)

Envoyé depuis mon GT-I9000 avec Tapatalk
[Galaxy S I9000 General] Bejda:
Ok,I'll leave my reliable 2903 only libs datafix and will test Wendigogo's latest product.

Thanks to you and Zatta.(and all guys who've been involved in full datadata issues workarounds from the beginning btw).
[Galaxy S I9000 General] Jay Evans:
Been running the test zip for several days. No lag and no low mem warning. THANK YOU!

Fascinate on Glitched AOKP build 38.
[Galaxy S I9000 General] HaTeNL:
I applied this latest Datafix, because my /datadata was full again and this time it seems to work great :)

Congratulations :)
[Galaxy S I9000 General] Thiefyo:
q I put the shell script in attachement here. Just grab it on your sdcard, remove the ".txt" extension and you could run it using Scripter or equivalent (root needed). Please post here if something gone wrong when using it.?

i dont get it attachment here where? i dont see it rename what .txt the zip? from zip to txt? i installed the fix from 1st post from 170 mb i got 117 ocupied he cleared only 30 mb i want to use scripter tips helps thx.
[Galaxy S I9000 General] Zatta:
You can't find it because it isn't there anymore.

But, 30 mb is enough, if it fills up again, just reboot and the script will run again. Plus you can add apps to the two files as described in the OP to move all data (or just the cache) to /data.

Taptalked u see
[Galaxy S I9000 General] upichie:
Honestly I think it's a better idea to leave the cache on /datadata and just clear it whenever you need to. I use Cache Cleaner NG from the Market. It even has an option for a scheduled daily run. This way you don't have to worry about sacrificing performance from moving an app's cache to /data. Works for me.
[Galaxy S I9000 General] Zatta:
Personally I use titanium backup to clear the app caches if needed. I just have the two recommended apps on the text file (fownloads and play). But I'm not worried about "just" 30 mb free.

Taptalked u see
[Galaxy S I9000 General] kasper_h:
But what is the use of having cache on datadata if you clean it daily? Cache should help speeding things up, which will not work if it is deleted daily...
[Galaxy S I9000 General] upichie:
I assumed writing to /data being slower than /datadata was the reason for an app's performance being worse, and not because it uses a cache. Isn't that the entire point of this script? If /data was as fast as /datadata, we wouldn't store any apps on /datadata.

I may be entirely wrong here, but I don't think I am. We want the app's cache on /datadata otherwise the app will perform worse. But this takes up a ton of space. Clearing that space solves this. Doing it daily might be a stretch, but I do it whenever I need the space.
[Galaxy S I9000 General] upichie:
I didn't find an option for this in Titanium Backup, only clear data. Care to explain how? It's probably obvious, but I'll ask anyway. ;)
[Galaxy S I9000 General] Silentbob999:
It's a case by case. Imagine your browser that cache tone of pictures. It's better to have them cached in a slower memory that not having them at all and loading them from the Web again.

Envoyé depuis mon GT-I9000 avec Tapatalk
[Galaxy S I9000 General] yalouf:
After trying all datafix, the solution you describe works the best for me.

No performance hit because of the datafix, everything is smooth.

Does somebody knows what is the size of that very fast nand memory on the recent phones like GS2-3, HTC one S or X and xperia S ????
[Galaxy S I9000 General] Zatta:
It is under the batch options (pro version only i believe). I dint know the category name in English, it should be something like "adjust data", "clear all caches for user and system apps".

Taptalked u see
[Galaxy S I9000 General] Wendigogo:
As @Silentbob999 says, it's a case by case.

And cleaning cache daily could be a bad option imho. If you clean your browser cache daily then you have to re-donwload all stuff, increasing your data consumption. And reading cache on /data is still faster than your 3G/LTE connexion.

So for some apps it's a good idea to let their cache living and for some specific ones living in /data doesn't decrease their performances; I think about some Browser don't storing their cache in sdcard, Google Play when donwloading big apps, Google Music storing albumart in cache etc.

With latest dev (will add it in op today) datafix you could try which cache you put on /data and see if performance is affected. If not, let it on cache and if app slow down move it back to /datadata. ;)
[Galaxy S I9000 General] belrik:
How long to wait?

I've flashed the Datafix_test package mentioned above but it's taking ages to boot. I waited an hour a couple of nights ago and then restored from nandroid, is it safe to do the first run while the OS is running instead of at boot in order to get console output on the progress? Or perhaps to turn off boot animation and see the script running?

I remember the previous datafix_2903 package taking only around 5-6 mins. I have around 10mb free in datadata (after applying the old lagfix). I'm looking to free more space so I can install chrome without killing my phone...

thanks
[Galaxy S I9000 General] Wendigogo:
The datafix doesn't take more than 5-6 minutes to run the first time.

You could run it with scripter in Android but some apps could fc when moving their data.

What rom/kernel are you using ?
[Galaxy S I9000 General] ivanchin99:
Twice now i've run datafix_test and came up with wiped data. Luckily I had backup everything before hand, coming from latest CM9 build. Why?
[Galaxy S I9000 General] belrik:
Tried from 20120609 cm9 build with semaphore and the 20120517 build stock. Both spent a while on the initial boot screen (assuming this was doing the bulk of the changes) but then spent 20+ minutes on the cm9 load screen with the little robot dude flying through space. Guessing those apps aren't getting their data then.

I'd love to fix this problem so I'll try running within cm9 and put up with a few fc apps. not sure what the issue is- it sounds like a straightforward copy/symlink affair, perhaps I could even do this manually for a few? :(
[Galaxy S I9000 General] Silentbob999:
some precision needed

Hi,

is there an error in that part of the text ?

I have some difficulty to fully understand it.

There is what my understanding of the script was:

Normal behavior is : All files except Lib/Libs are in /Datadata (fast), lib are in /Data (slow)

Apps in "move_cache.txt" : Normal Behavior + Cache also in /Data (slower but more free space)

Apps in "skip_apps.txt" : All files including Lib/Libs are in /Datadata (fast)

I thought it was like that, but putting my GoLauncherEX in "skip_apps.txt" made it start to be Laggy...

I thought that the normal behavior without the script will be that all the application are in /Datadata (so it is fast) but at some point there are not enough space. For that reason I have difficulty to understand that part : " If apps was previously moved to /datadata by the datafix". At start, the script is just moving lib/libs to /Data to clear a bit of space without sacrifice the speed, right?

What I am getting wrong?
[Galaxy S I9000 General] belrik:
So I ran a test in a terminal. The script starts off ok but quickly fills up the /datadata partition, whereupon it carries on attempting to copy. It then fails ungracefully and the datadata partition and data partitions are unmounted. All in all, not good.

Why would this script be attempting to copy *extra* data to the /datadata partition? That bit makes no sense at all. Some data is already moved from that partition, the partition is low on space, so why is it trying to move data back onto it?? Mad. I'd suggest that perhaps the first invocation be handled with some user validation via either an app or a script that takes user input, or perhaps some much more sophisticated validation.

The script looks like it should, on first run, copy all data from /datadata onto /data/data but this logic is somehow flawed- I had 1.5GB free on /data but only 10MB free on /datadata so it looks like writes were made to /datadata.

The script claimed to auto-detect previous lagfixes, perhaps the 2903 lagfix was symlinking parts to /datadata which caused that partition to fill? I certainly had to turn on the "follow symlinks" option in TB to get restores working properly. In conclusion I think that the script isn't correctly detecting previous lagfixes. Any chance this can be incorporated? I will check my datadata structure but I've been busy doing some other builds recently and not really delved into CM much.
[Galaxy S I9000 General] 94SupraTT:
Hopefully this solves my issues.
[Galaxy S I9000 General] thehyecircus:
I am about to Titanium Backup data copy over my Super Monkey Ball Data. What do I do with this script once it freezes in copying the data over and I get a "Low Space" notification?

And how do I prevent them from popping up in the first place?
[Galaxy S I9000 General] ivanchin99:
Just flash the script in the OP via CMW
[Galaxy S I9000 General] lazerbourne:
Correct overall, except the part

Apps in "skip_apps.txt" : All files including Lib/Libs are in /Datadata (fast)

Apps in "skip_apps.txt" : All files remain in /Data (very slow) - Use Storage Analyser on your /data and use this file for apps with are occupying a lot of space but you use them seldom. No part of these apps will go to /datadata then.

---------- Post added at 02:26 PM ---------- Previous post was at 02:02 PM ----------

First of all thanks a ton for this fix Wendigogo. It really saved my Galaxy S from going to the trash. I've been using the fix since the test script was released on Jun 7 and it works beautifully.

Just wanted to let you know that the process to apply the fix for AOKPs via the cwm should be done slightly differently. I was able to deduce this by reading the clearly marked comments in your script. The difference in AOKPs is that nothing resides on /datadata initially. So, if the fix is applied via CWM, the initial step of moving everything to /data is skipped. The datafix files are created but since they are empty, the script tries to move all the apps to /datadata. Here I ran into trouble since the data it was trying to move to /datadata was way beyond the 170 Mb limit. Here's what I did and it worked for me. Maybe it could help someone using the AOKP build (I was using AOKP build 37 with Devil 2_0.94 Kernel)

1. Use Storage Analyser from Google Play to analyse /data.

2. Note the apps using the max. data that you don't use that often i.e. its ok to have them be slow.

3. Use any root file explorer e.g. Solid Explorer to create a folder /datafix in /data/local under root.

4. Create file move_cache.txt

5. Add all the apps in the list created in step 2.

6. Add com.android.providers.downloads and com.google.android.gm

7. Create another file skip_apps.txt and leave it empty.

8. Now apply the fix via the cwm. Everything should work just fine.

How many apps to add in step 2 is a best guess scenario. I added the top 15 with max data but not so frequent usage. Now I have about 40 Mb free on /datadata. The phone zips around pretty fast except for those 15 apps but then I don't use them all that often :)
[Galaxy S I9000 General] acmilan77051:
cannot download from play store

now i cannot download from play store,first i had the low storage notification,i flashed the datafix..it was good after the flash,no lag n no problem...but from today i cannot download from play store,i checked datadata by root explorer,there were just 166KB of space left..then i flashed the datafix again,now i have 9MB of space left but still cannot download from play store...any clue what to do?