yashsingh1/xdaforums huggingface dataset:
[Samsung Galaxy Nexus] gimpyestrada:
I can confirm that the compression does bring the file size down significantly. Looks like it is just a gzip after the tar.

I am not convinced that restoring will work. Effectively what happens is that the file created when using compression is data.tar.gz and when you uncompress it unzips it and then untars it so the problem might still exist. I'm not able to give it a try right now.
[Samsung Galaxy Nexus] Jubakuba:
Mine was 2.5 gigs.

Dropped all the way to 1.8.

Haven't flashed yet...Need my phone after work.

But I will tonight at some point after I get off.
[Samsung Galaxy Nexus] claytonjn:
I made a backup, did a wipe, then restored the backup...rebotted and it was like I never wiped...I'd say it works. At least for me.

Now I just need to get TWRP on my ThinkPad Tablet...

-Posted from my Lenovo ThinkPad Tablet
[Samsung Galaxy Nexus] Jubakuba:
Wow! ****ing worked. I'm stoked.
[Samsung Galaxy Nexus] Dees_Troy:
we do the tar as one single command: "tar -czvf" if I remember correctly. If we did it as 2 separate commands like you were suggesting then the backup never would have worked either.

TWRP also uses pigz to handle the compression. pigz supports multiple cores so on a device like the GNex, it doesn't take that much longer even with compression turned on. pigz happens to be faster than regular gzip on single core devices too, fwiw.

I will admit that the compression isn't a fix, but it does buy you some extra headroom until we arrive at a better solution. Unfortunately, right now I'm attempting to get TWRP to compile in CM9, so I won't be able to work on this issue right away.
[Samsung Galaxy Nexus] gimpyestrada:
Pardon my ignorance, but are you a developer of TWRP?

Agreed, compression isn't a fix. IMO the best thing to do would be to split the file up. This will have the greatest benefit for the most people/devices and cause the least headache.

If you don't mind me asking a question or two I might see if I can implement this myself. I've got a pretty good idea how to do it already.
[Samsung Galaxy Nexus] Dees_Troy:
Yes, I'm currently the primary developer of TWRP.

Here's a guide for compiling TWRP: http://rootzwiki.com/topic/23903-how-to-compile-twrp-from-source/

The device configs for the GNex are a little tricky to get everything working perfectly, but you should be able to get backup and restore working without much fuss. The backup and restore code is in backstore.c Good luck and feel free to stop by #twrp on freenode if you have questions. I probably won't frequent this thread since I have many other things to work on ;)
[Samsung Galaxy Nexus] open1your1eyes0:
Thanks again guys for all your assistance. :) Let's see if we can get more people to test the compression method that have had this issue with CWM before. According to Dees_Troy's explanation, it should work properly if the compressed file can be kept under 2GB.
[Samsung Galaxy Nexus] claytonjn:
I had this problem on my Lenovo ThinkPad tablet too...any chance of getting TWRP on that? There's no way I'm going back to CWM on my GNex...

-Posted from my Verizon Galaxy Nexus
[Samsung Galaxy Nexus] open1your1eyes0:
So I just did a backup with compression enabled and I went down from 2.563GB data to 2.001GB. What do you guys think? Worth risking wipe and restore or am I hitting the borderline really close here (assuming 2.048GB is the limit)?

Anyone with success of restore on TWRP can say how big their data partition and backed up data was?
[Samsung Galaxy Nexus] open1your1eyes0:
Bumping for more input
[Samsung Galaxy Nexus] gimpyestrada:
I've downloaded the source and am trying to figure out how to get everything to build properly.

I don't understand how to build CM7 source for the Galaxy Nexus, so I think the best I am going to be able to do is build for my old OG Droid and if that works submit a patch file to the TWRP group.
[Samsung Galaxy Nexus] open1your1eyes0:
Best of luck gimpyestrada. :)

Anyone else have any luck with TWRP compression method as of yet? I'm a little hesitant to try mine since the compressed is really cutting it close to that 2GB limit (technically over).
[Samsung Galaxy Nexus] dougxd:
I've tried it too. Compressed from 1.3gb to 870mb. Restored just fine. I have a bunch of apps, but not enough to breach the uncompressed 2gb limit.
[Samsung Galaxy Nexus] open1your1eyes0:
Great to hear. Looking for more examples like this but from people who had the issue in the OP with CWM.
[Samsung Galaxy Nexus] :
Had a similar problem. See here: http://xdaforums.com/showthread.php?t=1541379

Interesting that the compression worked... I was unable to do anything. I couldn't flash a stock zip or nandroid or anything for that matter. Always corrupt and always boot loop on the Google logo (Scared the crap out of me)

Someone in that link indicated it could be related to the ext4 boot partition becoming corrupt (I had several force closes prior to experiencing my problem)

It should be able to be fixed by running e2fsck/fsck via adb to fix any corruption errors on the partition. I haven't had the problem again, but I will try to run e2fsck/fsck the next time (hopefully there will be no next time)
[Samsung Galaxy Nexus] open1your1eyes0:
Any updates?
[Samsung Galaxy Nexus] Lost Dog:
One possible way to resolve this would be to use a more modern tar compile. The one in busybox does not have the -M (--multi-volume) option which could create multiple archives of a given length using -L (--tape-length=NUMBER).
[Samsung Galaxy Nexus] open1your1eyes0:
This sounds like a very workable idea. Here's to hoping someone can implement this. :)
[Samsung Galaxy Nexus] Dees_Troy:
I should have test builds available for all variants of the Galaxy Nexus with a backup routine that splits the backup into multiple smaller archives available for testing sometime tomorrow.
[Samsung Galaxy Nexus] open1your1eyes0:
Thank you sir! :D

I am absolutely loving TWRP Recovery right now. Far better than CWM as far as I'm concerned. If you can resolved this issue for us that will be amazing and will definitely stay loyal to your work. Thank you again sir. Looking forward to your update. :)
[Samsung Galaxy Nexus] Dees_Troy:
These are test builds of TWRP that should allow you to back up data that is larger than 2GB without compression (compression still works though). These have not been extensively tested yet. They will break the backup into multiple <= 1.5GB files. The 1.5GB size doesn't take into account compression because we have no idea how compressible the data will be. Feel free to test these out and let me know.

Sprint aka toroplus: http://goo.im/devs/OpenRecovery/toroplus/twrp-toroplus-2.1.8TEST.img

Verizon aka toro: http://goo.im/devs/OpenRecovery/toro/twrp-toro-2.1.8TEST.img

GSM aka maguro: http://goo.im/devs/OpenRecovery/maguro/twrp-maguro-2.1.8TEST.img

I also hacked the UTC build date to 0 so these builds should get rid of some of the annoying sideload error 7 assert failed errors.
[Samsung Galaxy Nexus] Jubakuba:
Flashed 'er.

Sorry...but the pain in the ass setup that I use...and the fact that I have work in 40 minutes...I won't be testing today.

Fingers crossed that AOKP 38 will drop tonight and I'll actually feel productive in attempting :p.

Either way.

I'm one of those >2gig guys. I'll test tomorrow/tonight.
[Samsung Galaxy Nexus] open1your1eyes0:
Thank you again sir! Let's see if we can get some testers working on these. :)

Excellent! Can't wait to see your results. Can you confirm that you had the same issue as the OP when restoring?
[Samsung Galaxy Nexus] Jubakuba:
Definitely.

Tried multiple recoveries...eventually gave up.

Until someone here mentioned the compression of TWRP

(Previously Tried TWRP without compression...didn't even think about it)

And it works for me.

Having a more reliable method would be nice, however.

A few users are bordering that 2 gig line a little too close even after compression.

I'm lucky enough to have some room to spare.

But the concept is awesome: knowing backups may work for ALL users now.
[Samsung Galaxy Nexus] Dees_Troy:
The original builds that I posted yesterday afternoon didn't work. I uploaded new builds using the same file name around 10pm central time. If you are unsure of what time you downloaded, just redownload & reinstall. Thanks.
[Samsung Galaxy Nexus] open1your1eyes0:
Thanks for looking out for that Dees_Troy. Let's hope we can get some more testers going on these. Would be awesome to see some solid results here.

Sidenote: Just curious what was the issue with the original builds?
[Samsung Galaxy Nexus] Dees_Troy:
Long story short, the original builds failed to break the data into multiple archives. I've tested the current build with ~2.25GB of data, no compression, and it seems to be fine but I'm using mostly "garbage data" because I don't have the time to find and install a bunch of apps. I made multiple copies of a CM9 zip in /data to get from ~57MB to ~2250MB. All the files are there on a restore and I'm getting 2 archives like I would expect.

I did most of my testing using a smaller set of data. Told it to break the archive by 10MB chunks on 57MB of data and would get 6 archives, etc. Must faster and easier to test like that (and less wear and tear on the emmc memory chip).
[Samsung Galaxy Nexus] open1your1eyes0:
For the "garbage data" you used to test, are you able to confirm getting that same restore error (as in OP) first with CWM or the official (not the one posted here) TWRP build? Just want to know because if it's not giving you the error then it might not be a workable testing solution.

I might be keen to testing it personally on my phone but I have to find some time where I can afford to take time to restore my apps/data from scratch again in case it fails like before. (Considering making every type of backup just in case, CWM, TWRP official, TWRP test build, "adb backup" method, Titanium Backup, etc...).
[Samsung Galaxy Nexus] gimpyestrada:
I just successfully performed:

Flash new test recovery

Perform new backup without compression

Perform factory reset (wipe)

Restore new backup image (verified that it is split into multiple data files)

Reboot back to my phone

Threw confetti!
[Samsung Galaxy Nexus] open1your1eyes0:
Excellent! :D

Do you know how big the data partition was that it backed up? I'm hoping 2GB+ correct?
[Samsung Galaxy Nexus] gimpyestrada:
Yes. It is still a big one.

Also note that it won't take you nearly as long to perform the backup and restore as it used to in cwm. This is a couple of orders of magnitude faster.
[Samsung Galaxy Nexus] open1your1eyes0:
I have updated the OP with the latest we have on resolving this issue (with major thanks so far to Dees_Troy). Let's keep this testing coming! :)

PS: Always remember to mention if you had the OP issue prior to testing this new TWRP build and confirming if it worked afterwords. Also please mention how big your data partition is.
[Samsung Galaxy Nexus] :
hi,

I'm loving the twrp recovery for my gnex gsm 2.1.2 - maguro, it's working great!

unfortunately the 2.1.8TEST recovery doesn't work for me: it doesn't mount the "sdcard" and I can't find it to enable it (in "advanced" sdcard isn't listed) -> I can't use it :-(

Please support. Thx
[Samsung Galaxy Nexus] Dees_Troy:
Post a log.

http://rootzwiki.com/topic/24120-how-to-get-a-log-from-twrp/
[Samsung Galaxy Nexus] :
log attached (has to be unzipped :-)

thx in advance
[Samsung Galaxy Nexus] :
any news for the 2.1.8 version?
[Samsung Galaxy Nexus] Dees_Troy:
Sorry, was a very busy weekend and wasn't able to get to a computer to fix the problem until today. The maguro 2.1.8TEST build is updated and it should work now. Thanks for posting the log.
[Samsung Galaxy Nexus] :
thanks!!!!

some remarks:

* being in the recovery: twrp version listed as 2.1.7

* access to sdcard is working fine now!

* funny thing: sdcard is still not listed in advance (mount/unmount)

* launching twrp: after full twrp screen there are some grafic glitches, buttons are not immediately visible when twrp screen is disapperaring (like 2.1.2)

hope that helps
[Samsung Galaxy Nexus] gimpyestrada:
I have also seen the glitches. It is like the animation when the twrp logo screen that scrolls up is not quite right.
[Samsung Galaxy Nexus] socah:
I had similar problem after I backuped my turkbey rom and installed dragon ics as primary os, then moved it as secondary os (dual boot option in cwm). After this I wanted to get my turkbey to be restored from backup as first rom. No sucess. Restoring error. Installed new turkbey rom, after this used restore backup again and this worked. Also noticed that from my second rom I`m not able to see my externalsd properly - sdcard where my backup was ... It had some files on it but not real data that was shown on pc.
[Samsung Galaxy Nexus] swogg:
mine does the same thing

no matter how i wipe me phone or what rom i install CWM restore does not work. it says error restoring data during the data restore phase,
[Samsung Galaxy Nexus] open1your1eyes0:
Please check "Update 2" in OP. Please try that TWRP test recovery and let us know your results.
[Samsung Galaxy Nexus] Cowboys630:
Glad I found this thread! I was in the same boat. I was running AOKP B31 and decided to finally upgrade. Nandroid, flashed B37, then couldn't restore my data. I'd been running a pretty clean install after that, since I hadn't bothered restoring my other apps. I went ahead and did so and then flashed the test build of TWRP.

First backup: 1.52 GB (Compressed) (Took about 14-15 mins)

Second backup: 2.05 GB (2,208,262,344.00 bytes) (Not Compressed) (Made immediately after with no changes) (Took about 7-8 mins)

I know that's extremely near what we think is the cutoff, but I went for the gusto. Wiped and then full restored the larger, uncompressed backup and it went flawless! I wish I had a clearly larger backup that wasn't so close to the cutoff, but still very exciting!

So it's more that it's split into multiple, smaller chunks rather than it's just compressing to keep it under 2 GB total, right?

Either way, I look forward to flashing more often if I don't have to worry about not being able to restore data!

Thanks a lot Dees_Troy! You just picked up another user!
[Samsung Galaxy Nexus] Lost Dog:
Any update on this? The build on the TWRP web site is still 2.1.2. I had cleaned out my rom to get it down below 2GB but it's starting to creep back up...

Thanks!
[Samsung Galaxy Nexus] open1your1eyes0:
I'm hoping there is an update soon. I should be getting the Galaxy S III soon so I hope this new split fix is going to be added to the official builds soon.
[Samsung Galaxy Nexus] jhhoffma:
Will the TWRP allow us to restore a nandroid backup made with CWM? I'm in the same boat where I made a nandroid backup and now I can't restore it because of the "restoring /data" errors.

Sucks cause all I wanted to do was try out Jelly Bean real quick and then go back to AOKP b40. Now I've lost everything unless I can get it all back?
[Samsung Galaxy Nexus] claytonjn:
If you have titanium backup you can restore the apps from the nandroid. I don't know if you can use TWRP to restore a CWM backup, but it wouldn't help anyways. Backups where /data is larger than 2gb fail to restore in TWRP too, the difference is in TWRP the backup can be compressed or in 2.1.8 split up. That occurs when the backup is made not restored though so for a backup you already have best bet is to use titanium to restore app data.

-Posted from my Verizon Galaxy Nexus
[Samsung Galaxy Nexus] Lost Dog:
You cannot restore CWM with TWRP.

If you want to get your hands dirty you copy the nandroid to your computer and open it up with something like 7zip. Delete enough things to get it under 2GB and save it. Update the md5 file in the CWM backup directory and restore.

Here is what I ended up doing to restore:

http://xdaforums.com/showpost.php?p=26535138&postcount=8
[Samsung Galaxy Nexus] Lox_Dev:
ClockworkMod Recovery 6 fixes the restore of 2gb+ data images. At leat it worked for me.

https://plus.google.com/103583939320326217147/posts/cPF6gkmpM9m

Regards
[Samsung Galaxy Nexus] open1your1eyes0:
This is excellent news if Koush finally discovered this issue. Let's see if we can get some testers on this. OP has been updated. Thank you much sir. :) :good:
[Samsung Galaxy Nexus] Rabbit911:
I have had the same problem but i think i found the solution to solve it.

At least it worked for me...

I did a factory reset and then flashed the same ROM as the one i tried to restore. Then restore and it worked for me :-)

Hope this helps someone :)
[Samsung Galaxy Nexus] dirbo:
Hi,

thank you so much. I had the same problem on another device and this helped me too...:good:

Very good idea. :D
[Samsung Galaxy Nexus] aswindivakar100:
Remove your memmory card connect it to a computer.then go to the back up data folder and open it.There will be a "nandroid.md5" back up it.then delete that file.and open note pad and save a blank file named "nandroid" as "md5" file.then copy to the back up folder and simply restore.if it says "Error while restoring /data!" again avoid it and reboot the device.i think this will help you.:cool:
[Samsung Galaxy Nexus] dmanmatt10:
Still not working...

Hey guys,

I tired entering the ADB stuff, and the blank file thing and nothing worked.

The first solved that problem but created a "error while restoring /data" message every time so i replaced it with a blank file and now it says md5 mismatch again

I have no idea, and need this backup

Thanks!
[Samsung Galaxy Nexus] Shaun1231:
Hey has anyone had any luck with this so far? I'm experiencing the Error while restoring /data! issue with my cyanogen 11 backup restore.. it's driving me insane! I've tried everything from fresh installs of roms to wiping the sd drive!
[Samsung Galaxy Nexus] jdsank:
I'll try flashing it. hope it works! I'll let you know.
[Samsung Galaxy Nexus] OpXim:
I have the same problem, since recovery data error when trying to restore the system. What I can do ???

---------- Post added 30th March 2015 at 12:12 AM ---------- Previous post was 29th March 2015 at 11:53 PM ----------

how can u say me how can i flash Data ???
[Samsung Galaxy Nexus] NaaZ-10-:
ERROR WHILE RESTORING /DATA! cwm gs4 i9500 5.0.1

I am having a huge problem trying to restore phone with backup on ext sd card. this is what I get...

Restoring data...

Error while restoring /data!

tar: write error: Read-only file system

rList-com.android.setting. AppPicker

rList-com.android.setting.MediaFormatsd

rList-com.android.setting.ConfirmLockPasswor

sans. loc

DroidSans.ttf

DroidSans-Bold.ttf

Error while restoring /data!

I: Can't partition non-vfat: datamedia

I:Can't format unknown volume: /emmc
[Samsung Galaxy Nexus] NaaZ-10-:
Restoring data...

Error while restoring /data!

tar: write error: Read-only file system

rList-com.android.setting. AppPicker

rList-com.android.setting.MediaFormatsd

rList-com.android.setting.ConfirmLockPasswor

sans. loc

Iam Getting this while trying to restore data...

DroidSans.ttf

DroidSans-Bold.ttf

Error while restoring /data!

I: Can't partition non-vfat: datamedia

I:Can't format unknown volume: /emmc
[Samsung Galaxy Nexus] Kdom81:
I have also figured out that if the data partition to restore is in excess of 2Gb, CWM fails to restore /data.
[Samsung Galaxy Nexus] dz2k:
I also have this issue while using cwm restore on v5.x. I got rom manager and updated to cwm v6.x and it restored a >2gb /data file, etc. just fine! thanks.
[HTC Breeze] rame511:
pllllllllllllllles i whant rom arabic for imate sp jas :)
[Nexus S Q&A, Help & Troubleshooting] vitaumtb:
Hey guys, I've been using the stock OTA 4.0.3 on my I9023, but I've been trying to hookit up with evelisto's search key to recent, but there it says only stock rom's deodexed.

I search everything but didn't find an ICS stock OTA deodexed, is there any rom like this out?
[Nexus S Q&A, Help & Troubleshooting] sean1984:
try this http://xdaforums.com/showthread.php?t=1399956
[Verizon Droid Incredible 2] Golgotha theskull:
I was wondering if anybody else has had problems with based on runny I know my data almost never worked and other stuff that has just been a deal breaker for me
[Verizon Droid Incredible 2] knipp21:
Why not ask in the runny thread?
[Verizon Droid Incredible 2] Golgotha theskull:
Because there are so many roms running runny.
[Verizon Droid Incredible 2] jrizk07:
Like what other stuff??

Been running MikRunny for a while now, it's my daily driver. Great ROM and save for little things here and there it's been running great.

My little things are you can't dial out when a number has been formatted as +1-123-456-7890, Every custom sense ROM i've been on though has had this issue.
[Verizon Droid Incredible 2] Golgotha theskull:
Biggest thing for me is data just drops and won't come on unfilled I reboot my phone and it would be one thing if it was on one Rom but all runny roms do it
[Verizon Droid Incredible 2] HypostaticOnion:
Easier way is to toggle airplane mode on and off.
[HTC Rezound] alford6:
i bought the htc rezound from ebay and want to know how to unlock to gsm networks since im not in the usa?
[HTC Rezound] feralicious:
Check this thread out:

http://xdaforums.com/showthread.php?t=1421341
[HTC Rezound] zetsumeikuro:
I see something in your future... It's bright and yellow... has a magnifying glass in it... Oh wait! It's the SEARCH button! Works wonders breh.
[HTC Rezound] rockehill10:
LTE Switch

You might also want to put the app, LTE Switch, on your phone--really easy way to switch between different systems.
[HTC Rezound] alford6:
i will be getting the rezound soon. and would post how it works on a gsm quadband 850 network
[HTC Rezound] feralicious:
You didn't like my answer? I had to actually go find the thread to post that link for you. :p
[HTC Rezound] kancherlapraneeth:
But does just switching the mode should be good?
[HTC Rezound] RoryHe:
hey don't want to be rude but the first reply had a link to like any question you may have on this topic so go there.
[HTC Rezound] EclipseX:
I order one rezound for me too in xda markplace

It already brings the code for unlock for I can put when phone ask for that

The guy who sold order code for free from verizon
[HTC Rezound] nrfitchett4:
verizon says its not a global phone and as such does not have unlock codes for it.

Good luck anyways.
[HTC Rezound] EmerikL:
Hope you didn't pay extra for that. Lol.
[T-Mobile LG G2x] zoppp:
Here is what LG replied when i asked politely for helping out the devs by providing source code and drivers.

" Thank you for contacting LG Electronics. I will gladly assist you.

I apologize for any inconvenience you may have experienced.

At the moment, no official upgrade of software for Android 4.0 nor the source codes or drivers have been made available for this device.

I know most blog sites I myself follow speak of the manufacturer being the party with all the answers, but in actuality, it's related to all three companies involved to be in one accord.

Once all parties involved complete the pertinent reviews and evaluations, they will decide and make known their decision to release such update for your device along with drivers and source codes.

I hope this information is helpful, please do not hesitate to contact us back if you have any other inquiry. I will gladly assist you. Please enjoy the rest of the day and I wish you the best!"

Sent from my G2X
[T-Mobile LG G2x] alteredmass:
LGs crappy devs probably don't have ICS working either
[T-Mobile LG G2x] zoppp:
Thats what im thinking. But then again the manufacturer can only do so much. NVIDIA needs to release the harmony drivers for our tegra 2.

Sent from my G2X
[T-Mobile LG G2x] IRASadPanda:
We're much closer than you think though, over in the O2x thread they just got sound working and are working hard to get everything else working. Once they get it, all we do is port it to the G2x (wouldn't hurt to go help their dev team though)
[AT&T Samsung Galaxy S II SGH-I777] AntwanL:
So I've been using Google Voice for my Voicemail and I like it, but its word transcription is seriously hilarious. What are some of your best ones?

" I just left there and your phone breathable the million cos it's. "

That one was supposed to say something about the world ending if I ever actually answered my phone (buddy of mine).

So let's hear them!