yashsingh1/xdaforums huggingface dataset:
[Sony Cross-Device General] FartyParty:
Why would you? There's literally no reason not to use Flashtool.
[Sony Cross-Device General] mirhl:
Mhh.. except the thing basically being unmaintained by now?

Anyway, I guess there should be a big disclaimer in the OP with a list of supported phones.
[Sony Cross-Device General] FartyParty:
He asked about his XZ which Flashtool supports, you can even use XZS with Flashtool.

Hence why there's no reason not to use Flashtool.

For XZP however, we sadly only have this tool.
[Sony Cross-Device General] munjeni:
I'm believing the rest of the community enjoys newflasher. I'm planning to make ui for it. If not ui maybe I will update flashtool.
[Sony Cross-Device General] munjeni:
Search for xflasher! Xflasher can be used for xz on android,linux,windows.
[Sony Cross-Device General] ch3mn3y:
Not sure, but I think he meant it coz he (and not only he) is more used to Flashtool as it's older and has GUI (which is useful for noobs).

Don't see other reason than age of the tool and habit of the users, as it doesn't matter how the tool looks when it works, right? :)
[Sony Cross-Device General] munjeni:
But he say "sadly", I think there would be a much more sadness without newflasher, right? Sad is not having xzp as me, that's sad :) Peoples must be happy having tool for flashing, it maybe look ugly but important thing is having it working.
[Sony Cross-Device General] ch3mn3y:
True, but not for me (don't have XZ Premium or XZ1/Compact, don't want to) :P

And if You want me to guess what if, than there was a chance (however very small) that someone else would create similar tool. Sadly or not, we won't see it as, thanks to You, it was unnecessary :)

EDIT: Still, I think detailed guide with pictures would be useful for users with less or nothing Terminal experience.
[Sony Cross-Device General] FartyParty:
My point was that there's no reason to use anything else than Flashtool on previous devices as Flashtool is superior for that use.

The more tools the better, so people can choose who they want to support, that's why I said sadly.

Also, since I started removing all .ta files + appslog_x.sin, diag_x.sin, qnovo_x.sin, ssd_x.sin. userdata_x.sin the "decryption failed" corruption stopped.
[Sony Cross-Device General] munjeni:
Newflasher doesn't produce coruption, its just matter of what need to be flashed or skipped. Always reccomend to flash all as like pc companion doing.
[Sony Cross-Device General] FartyParty:
How can you recommend flashing something when you don't know what they do?

If I leave all .ta files in there I get device decryption failed, if I remove them I don't.

According to google Flashtool doesn't even flash .ta files either so thats why I started removing them.

And with that, the phone could now boot up normally without having to reformat itself because of decryption error.

I'm not the only one who got that error as another guy even created a thread asking which files to remove.

I remember I wrote a post in your thread a long time ago as well but you just disregarded it as device issue.
[Sony Cross-Device General] munjeni:
You are wrong totaly! Where you found that that .ta files is not flashed??? I have made newflasher basing of the packet sniffed data catched during sony pc companion flashing, newflasher doing the same like pc companion do.

Google flashtool? Where you found google flash tool? Maybe you mean Androxyde flashtool? Yes Androxide flashtool flashes .ta files too!

Decryption isue? You have that isue since you didn't flashed all!

I wrote about cust-reset.ta and master-reset.ta, thats only thing which I have no idea for about what it do, but anyway its flashed trought pc companion, so its recommended to flash with newflasher too!

And you can't compare flashtool with newflasher because diferencie between old sony flash protocol and new one is like Mercedes and Trabant. Maybe newflasher is like a Trabant but it works.
[Sony Cross-Device General] munjeni:
Somebody need to figure out which files need to be skipped for having untouched userdata. I don't own xzp so I can tell that.

I'm believing fota-reset.ta and userdata.sin need to be deleted (in case you need to keep userdata), but there is two more .ta files which probably messes up userdata (cust-reset.ta and master-reset.ta). Somebody need to confirm.

Simplock.ta you no need to delete since its builtin skipped from newflasher (newflasher reads units from .ta and in case found units related to simlock, newlfasher skips it).

X bootloader .ta file from bootdelivery always need to be flashed in case you flash bootdelivery!

osv-restriction.ta is in fsp, so its flashed too.

reset-wipereason.ta is also in fsp so it also flashed.

reset-non-secureadb.ta also.

reset-kernel-cmd-debug.ta also.

master-setet.ta also.

autoboot.ta too.

fota-reset.ta is also in fsp and need to be flashed.

Just open .ta file with any text editor and you will see that almost all files is auto installed! master-reset.ta and fota-reset.ta as per description from .ta file is in fsp and auto flashed. Cust-reset.ta is not in fsp so I can't tell what that file do (per description it resets customisation).

Partition.zip, its used to refresh partition layout, so if you flash popartition its recommended to flash everything (in case sony changed size of the partitions you will get hard brick if you didn't flash e.g. bootloader to the new partition layout). Generaly all need to be flashed, if you need to kleep userdata keep your personal things always on external sdcard.

You must understand that newflasher is not that smart like sony tool! Newflasher is just protocol implemented thing, it didn't contains safe checks and things like sony tool does! So newflasher is just tool which reads firmware dir and flash everything which found in that dir. Some peoples moves system.sin files to partition folder (as is not per my instruction) and later says "hey something is wrong", ohhh how:confused::confused: To make thing safe alway triple check what you have doing in firmware dir, do not move sin and ta files to the wrong location...etc

Always the best idea is to add newflasher to the fresh downloaded xperifirm firmware, make partition folder, extract partition.zip to partition folder and flash all. Thats a lot easier than removing things and risking for brick just because you need to keep userdata. Again, if you need to keep your personal things move your things to the external sdcard so it will for sure not get wiped.
[Sony Cross-Device General] sToRm//:
There is an update.xml in the FTF. Maybe we can get more infos about relevant update files from that? I think it's for Sony flashtool (Emma), right?
[Sony Cross-Device General] munjeni:
ftf is flashtool property, flashtool is [MENTION=2807379]Androxyde[/MENTION] tool, its not sony tool!

I know you are working on some xzp tools, and I know you allready reverse enginer newflasher, please do not use it from reverse enginered code just ask if you need source and I will give you newflasher source code!
[Sony Cross-Device General] munjeni:
I decided to don't provide any source code, made exception and this is source code for newflasher, enjoy! https://github.com/munjeni/newflasher

I am lazy to make ui for it but if somebody have time for ui, fill free to modify my code and make peoples happy :)

Edit:

I'm pretty sure [MENTION=8363210]sToRm//[/MENTION] will do it better than me ;)
[Sony Cross-Device General] sToRm//:
No no... My thought was that the ftf archive is the firmware from Sony. And if we unpack it, there is an xml file which tells us, what files are used to flash only an upgrade (without wiping). Just an idea ?

Oh wow! Source from newflasher... That's awesome! It was not my plan to integrate it directly in my tool. But if it's okay for you, that would be nice for sure. :)
[Sony Cross-Device General] FartyParty:
But you don't even know what they do, how can you claim such things then? If they would be so important, why does it work flawlessly for me?

I don't even touch the partition.zip, I simply just put newflasher in fw folder, remove .ta files + some .sin and flash.

Flashing using your tool and including .ta files = decryption failed error on boot which means it needs to reformat itself.

Flashing using your tool and removing .ta files = no decryption failed error on boot which means I can continue using it from where i left off pre-update.

Taken from Google.

So basically, the .ta files aren't needed like you claim they are.

That would be nice!
[Sony Cross-Device General] munjeni:
You have removing files! And you didn't flash partition? What you can expect than? Did you even reflashed all as per my recommendetions?

Mate, do you believing that I would be able to make newflasher in case I don't know what I have doing? Hey, mate. Can you post google search result, I'm curious
[Sony Cross-Device General] FartyParty:
What? Now you blame it on that I remove the .ta files? You're ridiculous. Are you also blaming that It on that I don't touch the partition.zip?

I've flashed with your tool letting all files be in there = broken update.

I've flashed with removed .ta files = working update.

Here, here they say Flashtool excludes .ta files.

There seems to be literally no info on google about these mysterious .ta files.

You claim they are important = broken device. Google claim they aren't = happy device.
[Sony Cross-Device General] munjeni:
Yes sure, peoples forgetting one fact: I don't own xzp! So I can't know which files need to be skipped in case for keeping userdata! [MENTION=8004595]FartyParty[/MENTION] seems can't understand it. I want to explain that but he continues on his own thing (skipping .ta files and .sin files), I can't explain him that he can hard bricj his phone in case sony change partition layout and by that thing hi skip reflashing some important things. How can I explain that?

Yes you are right, but there is 3 month gone and nobody figured out what files need to be skipped in case for keeping userdata! I can't know that, you guys need to figure that.
[Sony Cross-Device General] munjeni:
I don't understand whats going on with you. Probably you and me are not on the same frequency, or probably google translate giving wrong translate? But you told in previous post that you didn't touched partition.zip???? Did you wrote that???
[Sony Cross-Device General] FartyParty:
Yes, I don't touch the partition.zip when I've flashed.
[Sony Cross-Device General] munjeni:
Where he say? I can't see!
[Sony Cross-Device General] FartyParty:
Open ctrl+f and search for .ta and it will take you to those posts.
[Sony Cross-Device General] munjeni:
But why mate? Did I say that partition.zip need to be skipped? Did I wrote that users need to extract partition.zip into newly created partition folder? Yes. But why you skipping files? OMG mate
[Sony Cross-Device General] FartyParty:
That has no effect on the issue at all. It doesn't matter if I touch partition.zip or not.

The phone will flash the same. It's the .ta files that causes issues.
[Sony Cross-Device General] munjeni:
That posts is buls*i*! I am using flashtool for about 5 years and I KNOW that .ta files is not skipped. You can skip it but me I will not. If you kill your phone with newflasher don't complain please, instead of that read first page red part of the post, I can't help you more (but I realy want to help you).
[Sony Cross-Device General] munjeni:
But you removed .sin files! Which one? Userdata.sin, right?
[Sony Cross-Device General] FartyParty:
appslog_x.sin, diag_x.sin, qnovo_x.sin, ssd_x.sin. userdata_x.sin.
[Sony Cross-Device General] munjeni:
Why? Can you explain why?
[Sony Cross-Device General] FartyParty:
That's what I excluded in Flashtool to keep everything 100% the same and it has always worked perfectly.

Been doing it on Z Ultra, Z1, Z2, Z3, Z5, Z5 Premium, XZ, XZS as well. Always worked 100% perfectly.
[Sony Cross-Device General] munjeni:
Ok, but than do it on your own and please don't bother me with it. Flashtool != newflasher. Old sony protocol != new sony protocol. Old firmwares doesn't have some .ta files which curently exist on xzp. And last thing, I have sniff log from pc companion, if you realy not believing me fill free to analyse byself, it will prove you that all ta files is flashed with pc companion.
[Sony Cross-Device General] FartyParty:
Well you don't even own a XZP so.

Anyway, yea, I will keep skipping problematic files because I don't want to wipe the phone each update.

I know I'm not alone with getting decryption fail error with your tool.

But I will stop here, it works for me so I will keep doing it and everyone else can do what they want.
[Sony Cross-Device General] munjeni:
Yes surre! But disclaimer is on first page. ;) Newflasher is not cause for decryption isue, hope somebody soon prove that. If you found cause fill free to tell us. You are always welcome here.

Edit:

Newflasher is opensource right now, everybody is free to modify and improve, add ui or whatever.

https://github.com/munjeni/newflasher
[Sony Cross-Device General] FartyParty:
You never wrote in your guide that you absolutely need to unzip partition.zip to a new folder called partition.

What do those files do then? Since I have been flashing with just letting the partition.zip be in the fw folder as it is.
[Sony Cross-Device General] munjeni:
Realy? Hmm but red part?

Just read some posts back to understand it better. E.g. this one https://xdaforums.com/showpost.php?p=73829038&postcount=453
[Sony Cross-Device General] FartyParty:
Yes I did read and it says that if you want to flash those files, you need to move them to a folder called partition.

It doesn't say you should unzip the zip into a folder called partition. You just say that if you want to flash those, you have to unzip it.
[Sony Cross-Device General] munjeni:
Realy? Maybe this red part?

If thats not clear, maybe I need to wrote "you need to extract context of the partition.zip to folder "partition" which you created manualy. Better?
[Sony Cross-Device General] FartyParty:
It says the same thing.

You said before that you must extract the content of the .zip into a folder called partition.

But that isn't what it says. It says that IF you want to flash those files, you have to extract them into a folder called partition.

So, are those files important and how? What do they do? Do I NEED to extract them into a folder called partition before I flash?

As I said before, I have simply put newflasher into the fw folder and double clicked the exe and it flashed fine with just letting partition.zip be there as it is.
[Sony Cross-Device General] munjeni:
Ok, I am pretty sure that my english and your english is somehow not on the same frequency, Thats seems reason why you can't understand and me can't understand you corectly. Partition zip is partition layout of the phone, that file is first one flashed. I will try to explain you (hope you can understand), these files writes all partition layout on your phone (https://en.wikipedia.org/wiki/GUID_Partition_Table) , so if somedays Sony decide to change its layout (e.g. primary bootloader offset gones to the diferent location) and you flash partition table and skip flashing bootloader, or vice versa, the same with other files, your old bootloader or ...etc will get out of the partition layout and hard brich is expected. Thats why I recommend to flash whole files...
[Sony Cross-Device General] FartyParty:
I'm gonna give it a last try, doing 100% as you wrote.

Downloaded a fresh copy of newest firmware, I extracted partition.zip to a new folder called partition.

What files did I need to remove if I wanted to keep apps/data? userdata_X.sin + fota-reset.ta yes?

Now the folder looks like this, is this how it should look like?

(The partition folder contains all the files that was inside the .zip. I've only removed userdata_X.sin + fota-reset.ta now).
[Sony Cross-Device General] munjeni:
If you realy need to keep userdata, why not just simple flash system.sin and kernel.sin? When you debrand why you skip the rest of files? Debranding reguire whole flashing, its recommended. Upgrading (e.g. Lolipop to Lolipop) not reguire whole flashing, system.sin and kernel.sin is enought I think. Moving from e.g. Lolipot to Nougat, recommended whole flash. Etc..etc
[Sony Cross-Device General] FartyParty:
So you're saying that if I only want to update the firmware I only have to flash system.sin + kernel.sin?

My phones aren't branded, all of them are 100% unlocked.
[Sony Cross-Device General] munjeni:
Updated previous post

But do in mind, if sony done some changes to bootloader...etc and you skip it than don't expect that your update will work corect. Always better idea to flash all to be sure that all is up to date. But e.g. if you installing always the same rom (e.g. you done some modifications to system partition) than you no need to flash all, just system.sin
[Sony Cross-Device General] FartyParty:
Okey so to confirm, if I only want to update the firmware version from example .120 to .137 I only need to flash system.sin + kernel. sin?

Aha, so what do you do when you update your firmware, do you wipe your phone each time? Why can't we flash our phones like normal updates and keep the apps/data intact?
[Sony Cross-Device General] munjeni:
Yes mate, always doing that, after that I'm always 100% sure that I didn't miss something.! I am not lazy to install playstore thing again and again, or to move personal data from external sdcard to the freshly formated userdata.
[Sony Cross-Device General] FartyParty:
With options like Titanium Backup where I can backup all apps+data it's really easy to restore.

So maybe I should do like you and just flash everything to be safe! Does the above picture look right in that case?

Do you also extract partition.zip to a new folder called partition inside the firmware folder?
[Sony Cross-Device General] munjeni:
You can but you guys need to figure that out! I can't since I don't own xzp! The same with trim area dump, I have implemented function but nobody gaved me info if that feature is working.
[Sony Cross-Device General] munjeni:
Yes, yes. Post your neflasher log and I will tell you if everything is right.
[Sony Cross-Device General] FartyParty:
Okey! :).
[Sony Cross-Device General] munjeni:
Read this post https://xdaforums.com/showpost.php?p=72691859&postcount=217 , that is when everything is flashed corectly, result is: all ok!
[Sony Cross-Device General] munjeni:
thats it, but I don't see that you flashed userdata
[Sony Cross-Device General] ishemes:
Guys? I think you are both thinking of a different use case for Newflasher. I have changed my firmware to a UK firmware because I wanted wifi calling. In this case because I wanted to make sure I had all the changes needed to use wifi calling I just kept all files intact in the firmware folder, extracted the partition.zip file to the partition folder and flashed with Newflasher. It factory reset my phone, but this way I was sure I had a complete firmware as it was intended.

But it sounds like FartyParty is using Newflasher to update his phones firmware to newer versions of the same firmware region, so he is selecting only the files he thinks are changed and flashes those to prevent his data being erased. I don't understand why he is not just using the OTA update in the phone, but he probably has his reasons (phone is rooted?).
[Sony Cross-Device General] munjeni:
yes it's ok now, and you are sure that you have all up to date :)
[Sony Cross-Device General] G-FACE:
So, same as under Linux i guess.

But how do you connect both phones? With usb-c to usb-c, or usb-b to usb-c cable. (depending on phone ports)? Or maybe with otg cable and normal charging cable?

P.S. Which one file exactly i need to run in the terminal from the zip? For example if the phone used for flashing is arm 64 bit.
[Sony Cross-Device General] munjeni:
I'm used simple cable like this one https://cdn.shopify.com/s/files/1/0940/3396/products/USB_OTG_1024x1024.jpg?v=1449654267 very low cost. If the phone used for flashing is arm 64 bit use newflasher.arm64 (in case you get error about only pie use newflasher.arm64_pie instead)
[Sony Cross-Device General] munjeni:
I'm believing sony didn't change flash protocol
[Sony Cross-Device General] munjeni:
V3 is out!
[Sony Cross-Device General] GFTB:
So even XZ1 Compact will need Newflasher.

Got mine XZ Premium successfully flashed by your v3. without saving the log :rolleyes: Hooray :victory:
[Sony Cross-Device General] munjeni:
Realy? I'm glad to hear that! You are first one who reported that, many thanks! Enjoy!
[Sony Cross-Device General] VeixES:
Is there some file(update.zip or something) that also gets flashed with newflasher? A file that is not signed by Sony.
[Sony Cross-Device General] munjeni:
You can't flash files if is not signed by sony private key! Don't try!
[Sony Cross-Device General] VeixES:
Yes I know that.

But my question was about some official files in the firmware, which are not signed.

partition.zip does not seem to be signed or maybe my guess is wrong. maybe other zip files?
[Sony Cross-Device General] munjeni:
Partition images is signed too. Which other zip you have?
[Sony Cross-Device General] km8j:
I'm trying to follow these instructions https://www.reddit.com/r/SonyXperia/comments/7433id/has_anyone_enabled_xz1_fingerprint_scanner/ to get VoLTE/fingerprint working in the US. Do I have to use Newflasher or can I just use xperiafirm?
[Sony Cross-Device General] ch3mn3y:
[MENTION=4997693]km8j[/MENTION]

You need both. XperiFirm to download firmware and Newflasher to flash it.
[Sony Cross-Device General] km8j:
Thanks. Its been a while since I've worked with Sony but I thought there was a UI tool to flash things. I dont ever recall using CLI. What was that?
[Sony Cross-Device General] ch3mn3y:
There is Flashtool, but it doesn't support new flashing standard, which is used in XZ Premium, XZ1 and XZ1 Compact.
[Sony Cross-Device General] km8j:
Agh so what normally happens with OTAs? Meaning what will happen if Sony releases an update and I've flashed the two files in that reddit?
[Sony Cross-Device General] ch3mn3y:
[MENTION=4997693]km8j[/MENTION]

Who knows? Probably will be overwritten by US ones. That's why I think it's better to flash an other brand fw, one which has fingerprint support and get updates faster. Like e.g. one of T-Mobile's (not US) or Orange's, they have no bloat and got update very fast, if You need unbranded one than it's hard to say which one will be in first batch next time - Turkey? Russia? They are mostly first ones to be updated, but not every time, T-Mo and Orange are more reliable.
[Sony Cross-Device General] km8j:
Im trying to get fingerprint sensor + volte so I have to keep most of the US stuff...
[Sony Cross-Device General] ch3mn3y:
Ahh. I understand. So You will just have to flash this 2 files after every OTA. It shouldn't mess with the data, so it can be performed as an update with additional step :)
[Sony Cross-Device General] km8j:
I'm so lost. I've got everything installed. Volume Down + plug in does nothing except light up the LED green. Volume Up + plug in goes to LED blue (screen never turns on). Windows recognizes it as a generic Android device. If I try and configure drivers manually from device manager, Windows 10 says no suitable drivers found even when I point to the right directory. If I try newflasher, I get the "no usb device...". What the heck do I do?
[Sony Cross-Device General] munjeni:
Try gordongate driver from newflasher itself (hope you noticed optional prompt when you double click newflasher)!
[Sony Cross-Device General] mch277:
Edit: Issue fixed never mind
[Sony Cross-Device General] munjeni:
You can't mix firmware, e.g. use system from one rom and modem or etc from totaly diferent rom! In that case you must flash whole rom including everything from that rom!