yashsingh1/xdaforums huggingface dataset:
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] Joper_:
Yes I know about it. But problem is that I've used "fastboot reboot bootloader" and "fastboot boot boot-G8441-47.2.A.10.45-hideunlock-rooted.img" commands.

$ ./Android/Sdk/platform-tools/fastboot boot temp/boot-G8441-47.2.A.10.45-hideunlock-rooted.img
Downloading 'boot.img' OKAY [ 0.837s]
booting OKAY [ 5.741s]
Finished. Total time: 6.622s

But after repatching your kernel "image boot-G8441-47.2.A.10.45-hideunlock-rooted.img" file by Magisk Manager and boot newly patched kernel via fastboot - everything is OK.

It seems that file boot-G8441-47.2.A.10.45-hideunlock-rooted.img from 2'nd post is not patched properly. Could you check it please?
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] j4nn:
[MENTION=7140676]Joper_[/MENTION], the boot-G8441-47.2.A.10.45-hideunlock-rooted.img kernel has magisk init v18.1 integrated, so it should work all right. I guess others would complain too if it did not?
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] hamsup1o:
I just did an update to 47.2.A.10.45 and had the same issue with the kernel. Magisk was not installed. Had to patch via Magisk Manager and reflash the patched kernel before it worked again.
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] j4nn:
[MENTION=240025]hamsup1o[/MENTION], did you test the original kernel only on the first boot after update or did you boot it at least twice?

In general it seems that when you boot the pre-rooted kernel right after factory reset, going through the phone's initial setup and then installing magisk manager, then magisk manager cannot detect active magisk.

But if you do a reboot and boot the pre-rooted kernel again, magisk manager now sees the magisk "installed".

I guess that is something with init scripts, that there is a difference when you need to do an initial setup vs normal boot.

It might be possible that similar behaviour could be right after fota system update?

That's why a reboot booting again the pre-rooted kernel might help.
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] j4nn:
[MENTION=240025]hamsup1o[/MENTION], could you please do a simple test?

Now that you have my original boot-G8441-47.2.A.10.45-hideunlock-rooted.img kernel and your version patched from latest magisk manager - can you try booting my original kernel, check if magisk works and then boot yours, checking it again?

adb reboot bootloader
fastboot boot boot-G8441-47.2.A.10.45-hideunlock-rooted.img

adb reboot bootloader
fastboot boot boot-G8441-47.2.A.10.45-hideunlock-rooted-repatched-by-latest-magisk-manager.img

Thanks.
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] ArdW:
Quick question - I have older phone with DRM lost (used xperifix). Can I use this just for DRM fix? Or do I need the backed up DRM? I just want PIE with DRM and "normal" boot process, with no need to use a computer for that. Thank you
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] j4nn:
[MENTION=5656057]ArdW[/MENTION], this kernel is not supposed to be used as drmfix.

It does part of the job also for devices with drm lost - the hiding of bootloader unlocked state - but that alone does not restore drm (lost device master key in TA).

When drm had been restored from locked TA backup, this kernel enables drm functions - otherwise even with drm restored, fw disables some drm features when it detects BL unlocked state.

There is one feature this kernel re-enables even with lost drm: possibility to install system fota update, as described in the op - it has been verified that it works even with drm lost devices!

The last part of your question: this kernel may be flashed and booted without PC, just following the alternate use guide. In case fota system update is to be installed, one needs to flash stock kernel (from a backup for example) to make fota succeed.
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] ArdW:
ok, thank you for the explanation. I guess my only option is to buy a new XZ1c and follow the guide from the scratch and thankfully because of your work to make this device work.
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] j4nn:
Added a poll asking about form of future releases of my unlock hiding kernel - please vote.

Thanks.
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] mad0701:
Uncomfortable I see no option to vote : nor in Tapatalk, nor in a Webbrowser.

I would prefer the 2nd option: flash Magisk for myself or the last current version....

How I've think in another thread before... It will be a lot of work for you to create at every time a new kernel after update :

Thanks a lot for your assistance and hard work, also for your spend time...
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] j4nn:
[MENTION=7055162]mad0701[/MENTION], that's unfortunate, sadly, cannot do anything about it, just using this forum options to create a poll in a thread, it's a shame it does not get showed properly in apps (complaints should go to forum admins I guess)

you are right, so many kernel variants, each needed a corresponding fw download to extract stock ramdisk, prepare and compile each model specific kernel from sources and combine it...

it would be nice if each kernel variant could get a maintainer - somebody actually using that specific kernel to produce future releases...
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] mad0701:
Uncomfortable I could not spend so much time into this issue to help you. My work is round about 300km away from home and I'm only for a very short WE at home. Till this moment, I still live with the Secd patch.... the patch worked very well and I'm happy with this solution. Hopefully I can report this also in future ;)
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] MartinX3:
[MENTION=4418980]j4nn[/MENTION] sToRm// is back ;)
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] j4nn:
[MENTION=6031898]MartinX3[/MENTION], I am not sure what are you trying to tell us here.
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] MartinX3:
The developer of https://www.xperifix.com/
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] j4nn:
[MENTION=6031898]MartinX3[/MENTION], I know, still I do not follow - he had disappeared or something?

And now he has posted something or is about to what exactly?

And somehow is that related to this kernel?
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] MartinX3:
he disappeared and is now back to crack the PIE sony DRM.

that's the relationship with your kernel crack attemption.
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] j4nn:
[MENTION=6031898]MartinX3[/MENTION], I am sorry, but it might have been better if you had it written clearly with your first post.

I assume that you know about his plans from pm or something?

Because I cannot see any new post from him...
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] MartinX3:
No problem :)

(Text) communication can sometimes be difficult :silly:

He told me it in private. :)

He'll write a news in his xperifix blog.
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] Collongite:
For XZ1 done, but not for XZ1c :(
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] j4nn:
[MENTION=9873629]Collongite[/MENTION], well that had been a blind untested kernel repack, that possibly may not have worked, released only as test to see about compatibility.

It turned up to be working, but in any case, it takes some effort for so many phone variants.

Now we are not clear about the 'form' the kernels should be released - see the poll in each kernel thread.

Would be nice if everybody voted...
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] j4nn:
Here an experimental repack of 10.45 kernel for 10.62 fw:

boot-G8441-47.2.A.10.62-hideunlock-kernel-10.45.img

(does not include magisk, patch it in your magisk manager for fota upgrade with root or just flash it and magisk over it for alt use)
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] Collongite:
I use a translator to read this forum. It's hard for me to understand technical options. I have a phone with an unlocked bootloader. DRM keys are erased. FOTA update does not work for me. The second and third voting options, I find it hard to understand what the difference is.
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] mrbeak:
Hello everybody and j4nn,

I have not read the entire 10 pages (but the first!) of the threat so I apologize if this has been answered already.

1. I feel like this guide has as a prerequisite that the xz1c is running with android oreo. is this correct? what needs to be done if android pie is already installed?

2. After executing this guide the camara is supposed to work properly which is great. What about 2a) Google Pay 2b) Other apps which do not work when the phone is rooted as the DKB Tan2go app or the S-pushTAN app from the Sparkasse?

Thanks in advance
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] j4nn:
[MENTION=9873629]Collongite[/MENTION], actually FOTA system upgrade does work even with phones that lost drm keys - it it sufficient to follow this thread kernel guide to hide bootloader unlock and have unmodified stock fw (including kernel) and fota can be installed.

Concerning voting - all options eventually may lead to possibility for FOTA system update.

With first option, booting of prepared kernel from usb is expected.

The second option allows you to "root" the kernel with your preferred magisk version, making that the same as option one then, but better flexibility - some prefer older magisk version, some the latest one.

The third option is alt use, where you need to backup kernel partition if you flash this kernel (if planning for fota later) and restore it before starting system fota update. But allows you also to flash your magisk version, the "easiest" way after kernel in twrp.
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] j4nn:
[MENTION=9959229]mrbeak[/MENTION], you need to downgrade to exploitable oreo only to backup drm keys (getting TA-locked.img via renoroot exploit).

Otherwise this kernel (and fota upgrade possibility) works with the posted kernels and corresponding fw versions.

Google pay (and possibly other apps) may work even after root if you run this bootloader unlock hiding kernel and do _not_ have your android attest key provisioned.

But obviously no guarantees - google is constantly making changes to detect rooted phones.
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] pablgonz:
First of all, a million thanks for your work, I'm one of those novice users that I unlock without reading first. Even so, I won't be able to count on FOTA update (I don't have drmkeys backup), but I can manually update to the latest version with "hiding bootloader unlock", the latter is extremely necessary for bank applications. I have installed the latest version of Magisk and TWRP (to install the patch for wifi display/miracast) and everything is perfect.

Thank you very much.
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] j4nn:
[MENTION=9588640]pablgonz[/MENTION], actually you _can_ use FOTA system upgrade even if you have lost your drm keys (just follow the howto of this kernel).

It works even without drm keys: tested with xz1c and even with XZ2 (where there is no exploit to backup TA at all) - see here please.
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] pablgonz:
Yeah, I read something about it working, including "lost drmkeys." but, in my case it didn't work, I see myself in the obligation to use Magisk due to "screen duplication" of affects unlocking OEM and is one of the favorite features of this phone :).
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] j4nn:
[MENTION=9588640]pablgonz[/MENTION], I am not sure I follow you - do you mean that you need to use a fix for wifi display (miracast) sony app to make it working on unlocked (and lost drm) phone?

And because of that you think you cannot have unmodified stock fw or magisk?

Actually you can have magisk and the fix for wifi display can work (may need to be converted to) as a magisk module, so fw would be not modified, so you could have magisk, the wifi display fixed and still have working fota system update...
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] Sukram.Pongsch:
thanks, it looks like the kernel will work fine. But, after patching with magisk manger and booting the patched image, the phone freezes after a short while. Any idea what goes wrong?
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] j4nn:
[MENTION=9968481]Sukram.Pongsch[/MENTION], which magisk version do you use?

Obviously the kernel may not be stable as it is supposed to be used with previous fw.

Normally you should wait for sony to release open source package so proper kernel could be compiled.
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] vofferz:
The new kernel repack works fine with my phone. I flashed the kernel though as I don't care about FOTA updates that much. First flashed the kernel, then booted to TWRP and flashed Magisk 19.2 (haven't tried updating to 19.3). No freezes or any other weird behavior.
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] Sukram.Pongsch:
Thanks for the answer. I have tried it with the versions that Magisk Manger has offered me - 19.2. at first and now 19.3.

With both the same the phone starts normally, after a minute or so it freezes and reboot.

Without Magisk, there are no problems. I also tried to flash the kernel instead of boot via fastboot.

Unfortunately I did not find 10.45 FW after backing up the DRM Keys so I took the 10.62.
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] vofferz:
Do you have some Magisk modules installed? One of them could be the cause...
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] Sukram.Pongsch:
No.

I have now tried the following, that worked. I flashed the image patched by the Magisk manager. After that I booted twrp via fastboot and did a wipe. After restart I opened the Magisk-Manger which then installed something. Now everything seems to run stable. A little bit strange because the phone software was nearly virgin after the flashing of firmware 10.62.

In case I want to use OTA, I have to flash the original kernel and boot hide-unlock-kernel. Is this correct?

One more question - sorry if this ist the wrong place/thread. I am no longer sure if my DRM keys are still ok after all the flashing. How can I determine this? The service menu shows me SOMC FIDO and Android Attest as Provisioned but I am missing the entries for the Keystorehash and SOMC Attest - is that ok? Can I simply flash the ta-locked.img again?
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] vofferz:
I think the new firmwares no longer display info about other keys than somc fido and Android attest. If also the suntory blobs are marked as ready and the following two lines show as active, you're fine.

And yes, you have to have the original kernel flashed and boot with the modified one if you want to install OTA updates.
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] Sukram.Pongsch:
thank you, then it all looks good now.
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] nakster:
hi guys,

pardon the n00bness, but I recently unlocked the bootloader and then flashed the G8441_47.2.A.10.80_CE firmware.

My phone is running fine, although battery life is a bit crap on Android 9, and I do have some apps that refuse to run due to the unlocked bootloader.

Can use the procedure listed in the OP to hide the unlock status?
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] vofferz:
Would it be a lot of extra work to build the kernel also without the magisk integration?

It seems that I'm in the minority, but I like to flash the kernel and update with newflasher and flash a suitable Magisk version myself. That way I can boot the device easily when needed without access to a computer and such.

Also the OTA update process seems a bit complicated as you need the new kernel ready, and as you stated Sony delays releasing them...

I have also read about some problems with banking apps with the latest magisk as magiskhide has been updated in some way(?), so for now I'm trying to stick with 19.2 as it works for everything I need.
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] MrMmmkay:
I would love a kernel without magisk integration too, I am using a magisk module which only works with magisk 18.X, so I can´t use a kernel with magisk 19.X build inside.
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] fred0r:
It works.
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] fred0r:
I was able to update to 10.62. but then accidentally installed wrong kernel+recovery by newflasher afterwards and now i'm unable to upgrade to latest 10.80.

downloaded 2 diffferent 10.62, but these are branded and i think i before installed the non-branded by OTA-Update.

I compared the sha256-sum from both other Downloaded 10.62 (Vodafone/o2) and they differed, so i think i need the files from plain G8441_Customized DE_1310-4373_47.2.A.10.62_R3C.

Can someone please provide me 2 Files from G8441_Customized DE_1310-4373_47.2.A.10.62_R3C , because its not downloadable anymore via xperifirm:

kernel_X-FLASH-ALL-C93B.sin

fotakernel_X-FLASH-ALL-C93B.sin
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] j4nn:
[MENTION=7803472]vofferz[/MENTION], I still wonder what would be the best way of further releases - in my opinion, the poll results are not that convincing. For example, if you check the XZ1 variant, you see currently 10 votes for pre-root with magisk, but then there are 7 and 3 votes for not pre-root, so that's basically equal (the 2nd and 3rd option are basically the same answers with regard to the release way, differing only with the goal a voter likes to achieve).

Problems like this would be avoided if released without magisk, it may be a bit more complicated for users following the howto including plan for system fota update, but certainly would be more flexible.

[MENTION=4353139]fred0r[/MENTION], you may download 10.62 version here for example.

[MENTION=4482064]nakster[/MENTION], you can use this kernel to hide bootloader unlock status, that's the purpose of it. But you always need a version that fits your fw version. Sony did not release 10.80 kernel sources yet unfortunately.
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] fred0r:
Can you please point me into the right direction for extracting these 2 files from that .ftf

Wow - just opend it with 7z.. . ..
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] j4nn:
[MENTION=4353139]fred0r[/MENTION], yes, it's just a renamed .zip file...
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] fred0r:
Hm - still doesnt work.

After flashing the extracted kernel.sin + fotakernel.sin from XPERIASITE.PL_XZ1_Compact_G8441_9.0_47.2.A.10.62_Germany.ftf with newflasher and then booting with boot-G8441-47.2.A.10.62-hideunlock-magisk-19.3.img, the 'checking upgrade file' after reboot takes a little bit longer than before and for first time i''ve seen the second 'upgrade file'-bar for some seconds, but then it reboots into the former version.

Looks like it need to flash the 10.80 completely :/
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] j4nn:
[MENTION=4353139]fred0r[/MENTION], you need completely not modified stock firmware in order to be able to install next fw version system fota update.

That is not only kernel (boot) and fotakernel, you need stock system and vendor too.

Did you flash any change in system or vendor?

Actually did you "flash" any zip from twrp?

There may exist flashable zip files that just mount /system or /vendor for write access even if not making any change there, just the mount makes already a modification that fails fota verification.

You can full flash 10.62 (instead of 10.80) in order to test system fota update to 10.80.
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] fred0r:
fist i used your kernel to install magisk and everything was fine - after that i reinstalled the "orig"-kernel and flashed magisk 19.3 via latest fastbooted lilac-twrp (without entering my encryption-pw)

the reason was, that i wanted to check if 'stock kernel' is rootable via booted twrp when upgraded to 10.80 (since atm theres no kernel from you)

Is there a way for me to flash this without losing anything ?
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] j4nn:
[MENTION=4353139]fred0r[/MENTION], magisk should be ok, but for fota system update, you would need to first backup stock kernel and recovery (fotakernel) partitions. Then flash magisk. Backup the rooted kernel (i.e. the boot partition).

When wanted to do fota system upgrade, restore stock kernel (i.e. boot) and fotakernel (i.e. recovery) from your backups. Obviously do not flash anything that modifies system or vendor, simply use only magisk system less modules.

If you skip flashing 'userdata.sin' your data / apps / settings would not get erased.
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] fred0r:
Sorry - to clarify - i understand it like:

unpack everything from that 10.62.ftf and just delete the 'userdata.sin' from that folder and flash it with newflasher ?

---------- Post added at 01:44 AM ---------- Previous post was at 01:21 AM ----------

was impatient and deleted the 'userdata.sin' from unpacked .ftf and newflash'ed in flashmode -> Phone booted without any errors.

Then booted your boot-G8441-47.2.A.10.62-hideunlock-magisk-19.3.img via fastboot and update worked :D
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] j4nn:
[MENTION=4353139]fred0r[/MENTION], hopefully you've skipped the persist.sin too.

I am skipping persist, Qnovo, appslog, diag, ramdump, ssd usually. Flashing userdata only in case of downgrade. Making sure bootloader is flashed with the fw too (present 'boot' subdirectory with all it's content including the .ta there). You may skip the .ta files in main directory though.
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] PeppeBove:
So, if i understand well:

(I'm on 10.80 fw unlock) if i patch this kernel with magisk manager, and than i flash it with a command prompt like "fastboot flash THISFILE", will i have a working 10.80 fw with root?

Is it right?

Inviato dal mio G8441 utilizzando Tapatalk
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] fred0r:
I deleted the "userdata.si"n and flashed everything with newflasher inside the dir from the unpacked .ftf - so i also flashed the "persist.sin".

Can you please explain whats wrong with that "persist.sin" and should i worry now, since everything seems to run fine and i didnt detect any Data-Loss.

do i need to also reflash my previous ta-backup ?
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] JDC2389:
So I recently upgraded to .80 CE1 with US oem.sin and then I installed your kernel which hasn't been truly updated for this update quite yet, is wifi calling supposed to be broken? Will wifi calling work after you get the sources and I update the kernel?
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] j4nn:
[MENTION=3616065]PeppeBove[/MENTION], for root you need to flash magisk. You can either do it from twrp after flashing (via 'fastboot flash boot' or via twrp) the discussed hideunlock kernel - that would result with dm-verity disabled.

Or you can use magisk manager to patch the kernel image file, there you can toggle the verity flag as you want and flash the resulting image.

[MENTION=4353139]fred0r[/MENTION], flashing persist.sin destroys android attest key - it's mentioned everywhere, particularly even in the backup TA guide.

So if you had not had it lost alredy even before your last flashing, you have lost it for good now.

I am sorry, but if not certain about something, it's better to wait for answers...

In any case you do not need to worry as the android attest key is useless if your phone has been unlocked - working android attest key allows google to easily see unlocked state no matter what you do - it's already leveraged by google pay. See here for more details.

[MENTION=3901166]JDC2389[/MENTION], I have no idea about wifi calling nor mixing us and eu firmwares for that, sorry.
[Sony Xperia XZ1 Compact ROMs, Kernels, Recoveries,] PeppeBove:
Ok,it's work, Magisk is ok, but I'm still not able to go on twrp recovery. was it usually on vol - at boot? (i had several xperia before, all east rooted [emoji28])

Inviato dal mio G8441 utilizzando Tapatalk