yashsingh1/xdaforums huggingface dataset:
[Magisk] BigBrosMo:
I think it's a great module but its... Well... Confusing. The readme doesn't actually explain what it does. (I know because I've been following it from the beginning) and the instructions for how to use it aren't clear or easy to follow for the average user. In my opinion anyway.

The readme needs to be expanded with a better intro. And if instructions could be written step by step for the layman I think you'd get a better response or wider user base.

Again, just my two cents.
[Magisk] VR25:
v2020.8.26-beta (202008260)

A comma can be used in place of "|" for regex alternation (e.g., "M -b faceb,instag,whatsa").

Added tips on using rsync in auto-backup config to sync backups over an ssh tunnel.

Read package names from list, with regex support (e.g., "M -b /path/to/file", "M -b --" (for /sdcard/Download/migrator/packages.list)).

Remove backups of uninstalled apps from export directory as well.

Don't overwrite the log file if its size is less than 2M.

Performance enhancements

Skip unistalled packages from <list>".

Unlike -rE, -bE now implies D too.

Updated documentation.

Updated bundled terminal (Magisk variant).

https://github.com/VR-25/migrator/releases/tag/v2020.8.26-beta

I'll resubmit Migrator to Magisk repo once it gets out of beta.

By that time, the documentation will be more user-friendly.

With enough interest, an open source frontend app, like AccA for ACC, will pop up.

I can't develop one alone at this point - but I'm willing to work closely with an app dev to make things happen quickly.

Thanks for all the feedback!
[Magisk] knpk13:
Yeah I've been following this thread for a while but haven't gotten around to trying it for this reason.

I'm interested in it because it seems like titanium backup has been abandoned and I've been looking for an alternative. Swift Backup is a no go because it requires a Google account. OandbackupX and Migrate seem to work fine. How is Migrator different/better than them?
[Magisk] VR25:
Better is subjective.

Migrator is way faster, more efficient and provides more flexibility than both.
[Magisk] VR25:
v2020.8.27-beta (202008270)

Export backups to $base_dir/migrator_exported/ to prevent accidental data loss while auto-removing backups of uninstalled packages.

Filter out packages already backed up ("M -bn" or "M -b --new").

Misc safety patches

v2020.8.27-beta.1 (202008271) - Same Link

Fixed restore "data_de only" not working (Android keyboard (AOSP) was affected).

Fixed settings restore issues on Nougat.

Force all apps to reregister for push notifications (Google Cloud Messaging)

-n|--notifications

Suppress unimportant errors when restoring system data (D).
[Magisk] VR25:
v2020.8.28-beta (202008280)

Fixed compressed/encrypted export issues.
[Magisk] initguru:
I think this is good concept (using hard-link) for backup mechanism so I'm going to give it a shot.

Tonight I'm going to change to another rom so I already backed up my whole data by 'M -bE', exported then rsynced to my server.

A path on the server is /home/initguru/migrator.

In this case, Is the procedure below right, after installing a new rom? *** For more specific, I need to format data, not wipe so I cannot utilize hard-link.

1. Install magisk and migrator then reboot

2. rsync back to /sdcard/Download/migrator

3. M -riE

4. launch magisk manager to manage modules

5. reboot

Please let me know if the procedure should be changed.

TIA
[Magisk] VR25:
Hi,

I simplified the instructions.

refer to the updated README.

Thanks

v2020.9.11-beta (202009110)

- "-m" option and M sub-option (as in -beM) to move hard link backups to /data/media/0/, so that they survive factory resets.

When launched without the -m (move) option, Migrator automatically moves hard link backups back to /data/migrator/local/, for convenience.

/data/migrator/ is inconvenient, but more private than /data/media/ and /data/media/0/.

- Auto-generate sample /sdcard/Download/migrator/packages.list.

- Backup/restore LineageOS-specific Android settings as well.

- copy README.md to /sdcard/Download/migrator/.

- Enforce Unix line endings (LF) in /data/migrator.conf before parsing it.

This ensures config files written on Windows Notepad or other CRLF-loving editors still work as expected.

- Exported backups are now imported to local/ as opposed to imported/ in /data/migrator/.

This means the "i" flag, as in -ri is no longer necessary/valid.

- Fixed: "migrator" executable inaccessible or not found.

- Removed long options (e.g., --backup --app) to reduce overhead.

Other performance enhancements were made on top of that.

- System data (D) is no longer hard-linked.

Regular copies are made instead.

Android dislikes otherwise.

- Two flags changed: A --> b (both (app and data)), E --> e (everything).

- Updated documentation.

This includes data migrator tutorial, flag mnemonics (e.g., -rb = restore both (app and data)) and more.

As hard as the text may seem, read the damn thing anyway and give me some feedback on it... please!

Release Notes

- MIUI users who face the "reboot to fastboot" issue should refrain from flashing the zip for now.

- I recommend extracting zip_file/migrator.sh and running it as is - until the cause of that issue is identified and eliminated.

- Usage example: "su -c sh /path/to/migrator.sh -be"

- An alias can be appended to Termux's .bashrc to save time and effort, e.g., alias M="su -c sh /sdcard/Download/migrator.sh".

Download: https://github.com/VR-25/migrator/releases/tag/v2020.9.11-beta
[Magisk] initguru:
Thx, I will try again after reading updated instructions.

btw I found a bug:

- Magisk module contents are not backed up, but only module names.
[Magisk] VR25:
Weird

I don't face this issue.

Try the latest version: https://github.com/VR-25/migrator/releases/tag/v2020.9.13-beta.1 .

v2020.9.13-beta.1 (202009131)

- Enhanced system data backup and restore logic.

- General fixes & optimizations

- Parse "codePath" from /data/system/package.xml.

- Updated data migration tutorial.

Release Notes

- Please test whether system data backup and restore work as expected.

- This version fixes several issues that affected encrypted devices and Android 11 in particular.

- Nothing was done in regards to the "MIUI 12" bootloop issue. The root cause is still unknown.
[Magisk] VR25:
v2020.9.24-beta (202009240)

- Do not remount / rw if it's not tmpfs.

- Fixed backup import issue.

https://github.com/VR-25/migrator/releases/tag/v2020.9.24-beta
[Magisk] justcosmic:
I am going to give this a try once I've worked out how to get it installed.

I'm going to be migrating from an old Galaxy S4 running optimised lineage Nougat to an LG V20 running Lineage 18 unofficial which I will then need to do regular backup/restores for each new build as I plan to do clean flash of each build.

Any guidance for a relative noob to this process would be gratefully recieved.

:)
[Magisk] justcosmic:
Sadly struggling to get Magisk installed on my S4...so I might just try using this for the ROM updates once I get everything onto the new phone
[Magisk] ratelutz:
Hi VR-25,

i need your help. I already tried to get in touch with you an telegram.

My phone is messed up. After a reboot all the user apps are no more starting. the appdrawer icons are present but App names displayed with the package name and force closing if i try to start.

i had this situation last after removing migrator magisk module. reinstalling the module fix it (last time) so i think the problem is migrator related in any way.

could you help to get this sorted?
[Magisk] Estebanium:
I don't get it. What is A for? Even in the FLAG MNEMONICS it is mentioned and moreover as a hint for Termux users.

And what is -v? Which part of migrator -bA -v termux excludes termux?

The "-v ." construct is meant for excluding user apps.
[Magisk] Toolmighty:
I've never heard of this module but my interest is piqued. I love xda and the things your guys do but sometime falling into little gems like this is like beating your head against a wall to hammer a thumbtack. Harder for me than most too as I tend to be pretty introverted. And I don't develop networks well.
[Magisk] PNIGGE:
Hello VR-25,

I have a question: I wanted to automate my migrator backups. I've read in your docu and seen the section with magisk and init.d . Where I have to store the migrator.conf for automating the backups? in the /data? and which permission I have to grant?
[Magisk] cesar_9046:
Works for A11?
[Magisk] jamille:
I've used this utility to backup and restore a few times and aside from it not being able to backup call,sms and wifi\BT it works well for most apps. Albeit for some apps I found it didn't restore all data, just the app. So as precaution I still use titanium backup.

The concept is great though and I would love to see the dev continue working on this tool.

To the person above, yes it does work for Android 11, I tried it on lineageos 18.1

Thank you to VR-25
[Magisk] VR25:
THIS PROJECT IS DEPRECATED. I HAVE AN ALTERNATIVE HERE.
[Magisk] Zaxx32:
I have a newb-ish dumb question that I'd rather make a fool of myself here instead of in ur shiny new dev thread. 😟

I noticed 'twrp' in the keywords and my jaw dropped...but then I seen where u said it's not for backing up/restoring google accts...so is it meant for custom ROMs only? At first sight I thought it was a working recovery for rooted, stock A10/11/12 A/B slot phones...I'm an idiot. :rolleyes:
[Magisk] VR25:
It's not [yet] meant for restoring Google accounts (talking about emails only).

It works in recovery mode as well, meaning, you can backup apps with respective data, Magisk modules, system settings, and more -- even if your system no longer boots.
[Magisk] VR25:
Hmm, this seems to be a permission issue... but why is that happening... ?

It's as of the mv command changed attributes somehow.

- What if you set SELinux mode to permissive (setenforce 0)?

- Could you pick one app data folder in /data/media/adk/.appData, check its permissions, ownership and group & post the info?
[Magisk] J4jks:
-Changed to permissive yet problem persist.

-yeah, different apps have different permissions and ownerships and groups

In default location permission is 755 but in /adk/ few have 700, few 751

BBS has system as owner and group, permission 755 but in adk , telegram is owner and group, permission is 700

No app has system owner and group with 755 permissions
[Magisk] ovizii:
[MENTION=5228676]VR25[/MENTION]

- I got it working by "mistake" - I saw there was an update to this extension (which was installed but not enabled in magisk 16.4) and didn't realize that updating/downloading an extension automatically enables it. Only some time later did I realize that ADK is actually enabled and working. The logs are looking good too. APK backups are happening too.

- Maybe you can amend your usage instructions, one needs to execute su before adk is recognized as a command in the terminal

- Feature suggestion: simply running adk shows ALL apps currently. There is another magisk extension ([TERMINAL] DEBLOATER) out there which also runs on the command line and that one has a different approach which I personally prefer: it spits out a numbered list of apps and instead of using a matching pattern you can then simply type in the number corresponding to the desired app. I think that is a more precise approach then a pattern, which might be too broad or does your extension first show what the pattern would match before executing? (I admit I haven't tested it yet)
[Magisk] Yom:
Conflict between ADK and FBind?

Hey VR25!

Love your work!

I'm just wondering... why does the app data become inaccessible to the apps after installing ADK? Are the data folders not being bound properly? Could that be due to a conflict with FBind?
[Magisk] VR25:
**2018.8.2 (201808020)**

- Auto-move excluded apps data back to /data/media

- Fixed adk issues in recovery mode

- General optimizations (more modular code)

- Improved safety mechanisms to prevent data loss in "fatal error" situations

- Use rsync to copy app data folders attributes instead of using `mkdir -m`

Those experiencing issues, please, start from scratch.

No conflict was observed between adk and fbind.
[Magisk] J4jks:
Thanks a lot

It's not giving problems as before.

I found only .appdata, info and logs only in adk folder but apksbkp not found.

PS: I didn't succeed in restoring apls after twrp factory reset:(
[Magisk] keshok:
After installing this module, Google Play Services keep stopping. Is there a solution to remedy this nagging issue?
[Magisk] smartymcfly:
To the developer, Is the testing you are doing on an a/b device? Like pixel or pixel 2 or any of the others?
[Magisk] kancrutt:
not works on MIX2 running ABC rom (treble-enabled)
[Magisk] Alxoom33:
[MENTION=5228676]VR25[/MENTION] (Do you know your handle referrs to some great French racing skiis, I still have a pair) :)

Thank you for your development of this long needed module. I tried it on my Pixel C tablet back on July 29th. Yes, thanks for the advice, I made a full TWRP backup before trying your module. When I flashed the module and rebooted in TWRP (i think 16.6 or 16.7 at the time) all of my apps and system UI continually started crashing. I then restored my Nandroid from TWRP and deleted the module.

[MENTION=5228676]VR25[/MENTION] I just subscribed to your thread and am considering trying the updated module again. I checked and appears that my data was in fact backed up to data/media/adk/app.data as it survived the wipe when I restored my Nandroid. However, I did not try to restore from that location.

So, if I try with the updated module, will the data be updated from July 29 to today's date? Do you know what caused all of my apps and system ui to start crashing on my initial try? Do you have any recommendations? I really like the concept and am willing to experiment on my Pixel C, as long as I have my Nandroid backups.

Do you know if the module works on a Pixel 2XL? If so, are there any additional steps needed. I am concerned about flashing on my phone, as TWRP Nandroids are not very reliable on that platform. Thank you again!
[Magisk] Tesla:
"And of course, uninstall or disable adk with Magisk Manager for Recovery Mode."

Soo.. if i uninstall and disable adk in Magisk Manager and reboot everything is back to normal? That's all i have to do and i can reboot again with no fuss or data loss?
[Magisk] Alxoom33:
Not too shure about that on chief :) I had to reflash the Factory build with a full wipe and restore data from my Nandroid.
[Magisk] Tesla:
Thanks for answer m8.

Stupid if we have to go through all that trubbel just to get back to normal.

I could agree on a dirty flash to fix it. But all this? Damn :/
[Magisk] J4jks:
Yeah, I also had to restore nandroid backup after removing this module, or else start afresh
[Magisk] Tesla:
Hi o/

So if i understand you correctly here.. i uninstall this thing, reboot, loose data.

But only once?

Next time i reboot all is good?

Btw.. do i loose data the moment i enter TWRP? Or can i do a backup, boot, reboot to TWRP, restore?
[Magisk] J4jks:
Take a backup even before installing this.
[Magisk] r0ni3:
I couldn't recover anything...

mv cant rename .... Directory not empty .

I don't need the data, just to understand
[Magisk] Tesla:
To late :/ That's why i'm asking here.

Do you know the answers to my questions?
[Magisk] Alxoom33:
Restore using the terminal command. See the OP.
[Magisk] ovizii:
For what it is worth, ADK broke for me again today. My phone worked smoothly after the update of ADK on the 2nd of august. Yesterday I installed a new app, today I realized it had lost all the settings I had made yesterday so I used the author's advice and copied this app's data from /data/media/.appData to /data/data force-closed the app, opened it again and my lost data was back indeed. Shortly after I had to reboot and since then my phone is stuck on the android loading screen saying: starting up... please wait.

I know I can boot to TWRP, disable ADK, reboot but I#d like to know what is happening here to my phone?

###edit###

[MENTION=5228676]VR25[/MENTION] it looks liek you're also the author of the mm extension, would you maybe give me a little info how to use mm to disable ADK? I booted into recovery, typed /data/media/mm selected to disable adk and even turned off its auto mount but I'm still stuck on Android "starting up...please wait" screen.

I do have a nandroid backup I'd just like to avoid going that far back and use these tools you have provided, I'm sure I am just using them wrong.

###edit 2###

Turns out the issue (seems) to have originated with an xposed module. Used mm from recovery, disabled all magisk modules, disabled auto mounting of all magisk modules, rebooted. Phone starts.

lost a couple of settings though then tried enabling all "safe" magisk modules + all xposed modules. rebooted.

went to recovery tried adk => not found ; tried /data/media/adk . => permission denied

Any ideas?
[Magisk] Tesla:
Hi o/

An update.

I was about to downgrade my kernel because reasons.

Here is what i did today.

1. I deleted this module in Magisk manager. Then i deleted the zip in my file manager.

2. Rebooted to TWRP.

3. Format Dalvik/Art.

4. Installed new kernel.

5. Installed Magisk.

6. Reboot.

7. Nothing deleted so far.

8. Shut down phone, restarted.

So far everything works as it should.
[Magisk] Elusivo:
Meh, installed the module, disabled it before rebooting cause i din wanna use it right away -> disaster.

Lost 6GB worth of apps and data.

I am running android 6.0.1.

On 1st boot the rom's default launcher opened - not a good sign -, errors all over the place, google play not working, magisk din work, had no keyboard installed and no internet browser or filemanager installed, etc.

Ran mm on recovery and adk was ON even tho I had turned it off before rebooting. Nothing changed after turning it off.

No data in the media/adk folder. Log files all have 0b size, completly empty.

Magisk app was installed but not working, it only opened to the green splash screen and stayed there, same result with adk off or on.

I had 2 accounts in the phone, one created by the app "island" for sandbox purposes, after deleting that account magisk started working again and I managed to then install a keyboard, browser and filemanager.

I probly did something wrong but i find it weird that the apps and data were all deleted and not moved like i understood they would be.

Now left with the tedious task of titanium reinstalling missing apps and missing data of existing apps.
[Magisk] HermitDash:
On a OnePlus 3 here on Oreo, Magisk 16.7. I can see the appData files in /data/media/.appData but when I try to restore using

mv -f /data/media/.appData/* /data/data

I get the same as [MENTION=6074272]r0ni3[/MENTION] where the Directory isn't empty.
[Magisk] m666p:
Redmi note 5 here,

killed my data.

It might work for some but it clearly does not work for everyone, the restore command moved the data but the apps dont see it.

thanks I guess.
[Magisk] mGforCe:
So I installed this module on my Z2 Plus with Oreo 8.1 and Magisk v16.7. Rebooted and boom all apps' data gone :crying:

Worried came to this thread and read from first to last post but still no resolution :(

Yes, I see data there, so it got backed up !

Removed the ADK from Magisk manager, rebooted to TWRP. Tried using the command but getting error

mv: Can't rename Directory not empty

Same error informed by [MENTION=6074272]r0ni3[/MENTION] [MENTION=1932990]HermitDash[/MENTION] - their post quoted below

So what is solution here? Pls help & guide.
[Magisk] HermitDash:
What I ended up doing was using Root Explorer and manually moved everything that was in /data/data to another folder and then ran the command again since mv doesn't over write exidting directories even if -f was used. Or if you don't wanna mess with the command line in general just repeat using Root Explorer or which ever file explorer that you can get with Root access.

Also means the file manager in Recovery might work but a little more work involved.

After you got the files in, just reboot and you should be back to where you were before you started this mess of a Module
[Magisk] mGforCe:
Thanks.. I was thinking about using TWRP to wipe data and then without booting trying the terminal command to restore. what you say ?

Edit: Tried wiping data folder and trying command mv -f and this time got error :can't rename ....: No such file or directory"

So totally lost!! [MENTION=5228676]VR25[/MENTION] : any ideas / guidance?
[Magisk] m666p:
After trying various methods (op's recovery command, manually moving files and setting permissions, reflashing rom and trying the adk command)

Nothing worked, apps either kept crashing or didn't restore.

The most success I've had is by manually moving the files from appData to data/data. try it and see where it gets you.

I bit the bullet and restored a month old backup, since the apps did not work right and some didn't restore at all.

I wonder how many phones this module has trashed and how many collective man hours have been wasted by this module.

Its not a bad idea but, it needs way more testing than, "it works for me, let's go". And a warning about making a backup is not a good excuse since every module or mod has a warning these days, yet this is the only one out the many mods I've tried that has truly messed up my phone. Besides that, if have to backup /data beforehand why would I need this module in the first place.
[Magisk] scj20:
Okay for those people who lost their data after uninstalling, reinstalling this module should bring the data back. When I uninstalled it, the app data remained in the adk folder. So I just reinstalled the module. However, for some reason, it keeps deleting the gboard data after reboot, I've made some changes so I have to make them again and again. Could you tell me why, and what should I do?

EDIT: It also wipes the Google play data after every reboot, and I can't access the ask command/folder via the twrp terminal. The adk module can't be accessed using terminal, however the mm module works just fine.
[Magisk] mGforCe:
[MENTION=4805804]m666p[/MENTION] Completely agree. This module shouldn't be available in Magisk Manager for download and install. It is far away from being proven to be working module at this stage.

After trying multiple things, was forced to restoring some 7 days old nandroid backup. Not to mention lost around 3-4 hrs at work trying to make phone work !!
[Magisk] mGforCe:
I[MENTION=8416419]jungle35[/MENTION] I would not go that extreme. The idea is great and kudos to dev for same. BUT this modules requires lot of fine tuning and testing before public release.

[MENTION=4470081]topjohnwu[/MENTION] & [MENTION=5228676]VR25[/MENTION] pls take this module off Magisk Repo. S far many people have lost their data and countless hours fixing their phones. Further add <Alpha> to this post title.
[Magisk] ezrawk:
One piece of advice: Install it via TWRP.

It works

. I tried installing via Magisk Manager and it destroyed all my data (which of course I did a back up first). After that I tried it again, but via TWRP and cleared my cache, before I rebooted to system I rebooted back to recovery just to check if the "adk" folder existed already (it was there alright), rebooted to system, waited for it to boot and voila no data loss at all, plus "/data/data" was successfully moved to "/data/media/adk/.appData" which was perfectly symlinked to "/data/data".
[Magisk] scj20:
Okay after every reboot it resets the google system apps like gboard, play store etc. Can anyone tell me how to fix that?
[Magisk] ezrawk:
What device are you using and what was your install method? What OS are you on?