yashsingh1/xdaforums huggingface dataset:
[Xiaomi Poco F1 ROMs, Kernels, Recoveries, & Other ] elandroido:
Hey,

Inspired by the super fun I had a look at the GitHub repo in the context of your inputs here.

I think it is possible to make it cross-platform, but that would definitely have to include the firmware building process. If I see it as a potential plugin developer, I need to be able to build runable test ROMs during my plugin development, otherwise the platform would not make much sense for me, not?

Before talking too much upfront, I think it might make sense that I implement a build system proposal on a fork of your repo.

Anyhow I would be happy to receive some feedback about the basic plans I have regarding this.

- I would choose maven as build framework (just a personal choice, if you have already things in ant or gradle, I could use that too).

- Since Android actually is a Linux based system, there probably will always be functionalities that will only run perfect in a Linux environment. For example the ext4 issue you are currently referring to. So to be able to build cross platform, I would implement a kind of optional adapters during build.

Small example:

When building on Linux, you could just run

mvn build

.

This would utilize

build/make_ext4fs

for the ext4 task.

When e.g. running on Windows you would use something like

mvn build -Dlinux.rest.make_ext4fs=127.0.0.1

.

The build would then use a locally running REST webservice for the ext4 making task. The webservice could be provided e.g. by a local Linux VM (VirtualBox, HyperV/Xamarin, whatever) and would listen to the corresponding path, in this case

http://127.0.0.1/build/make_ext4fs

.

The REST Server receiving the serialized ext4 image for processing would be available as optional part of the OMP project. (optional since not needed when running on Linux).

Of course it does not have to run on the local machine, it could also be utilized like

http://some_android_phone_on_the_lan/build/make_ext4fs

or

http://a_web_server.org/build/make_ext4fs

.

The -Dlinux.rest.* adapter framework should be dynamically able to substitute any command from the build directory if needed in future (be it dex2oat or whatever).

The result of the operation would of course be given in a proper REST result (e.g. json serialized zip of extracted ext4 img in the example case).

This is not something I would implement like "finish it today", but I feel as if would be fun to dig into it.

Gr33z, elandroido
[Xiaomi Poco F1 ROMs, Kernels, Recoveries, & Other ] CosmicDan:
I can do all the building on a standard Linux machine, I don't need anything special here. Jenkins or Tomcat possibly. It's too early to worry about such things, getting it working on a local machine is the first step.

That's only for the firmware unpack/repack process, though, which is only important for updating base ROM or making a flashable ZIP. The cross-platform OAP tool itself will have capability to build + test specific firmware patches.

Nothing anybody can really help with yet, it's still at the point where I need to get my base design down and then people can look at it and make suggestions or propose ideas.
[Xiaomi Poco F1 ROMs, Kernels, Recoveries, & Other ] elandroido:
I have the feeling I might ask something obvious, but it is not clear to me yet:

Let's assume I am developing a firmware patch for Poco F1 MIUI on a Windows machine.

Now I am done with the first implementation of the patch, how do I test it on my Poco device from within Windows (I cannot build a flashable zip on Win then, not?).
[Xiaomi Poco F1 ROMs, Kernels, Recoveries, & Other ] CosmicDan:
Something like the command "oap [path-to-prepped-firmware] my-poco-mod-pack test framework.jar". You will need to have a deopted (aka deodexed) ROM installed for testing in this way, which the OAP preptool already can do (it unpacks and deopts), then the preptool can be run straight again to rebuild as a deodexed ROM. Flash that, flash Magisk (to allow hot modifications of e.g. system by disabling verity).

In summary: The OAP will have a function that can selectively compile what you tell it to, rather than patching the whole firnware, then optionally push to the device over adb and reboot (which will need to be done via recovery unless I can figure out insecure adbd on MIUI, but that's another issue).

FYI, OAP will very likely use DexPatcher as the first-class method to patch the ROM, so you could learn about that. The initial releases will contain some patches already, but I will also be making a custom OAP.jar that has some extra helpers for hacking around in Android. One example is getting resources by name rather than ID, since it won't be possible to edit APK resources with DexPatcher (I will need to make my own system to handle injecting/modifying resources).
[Xiaomi Poco F1 ROMs, Kernels, Recoveries, & Other ] elandroido:
Sounds good.

Yeah. I will eventually put on my black hacker ski mask end check out dex patcher. :cool:
[Xiaomi Poco F1 ROMs, Kernels, Recoveries, & Other ] elandroido:
Hey CosmicDan,

I began checking out your tool with latest xiaomi.eu build (xiaomi.eu_multi_POCOF1_9.1.10_v10-9.zip).

I will write my impression down when I had a look at all things, but I will create issues on github on my way if I find things so I do not forget them. ;)

I am building on freebsd, so it is a good platform-indenpendence test within POSIX, but the errors may not be there on linux.

I could double check on arch and create pulls after clarifications though.

Gr33z

---------- Post added at 10:36 PM ---------- Previous post was at 10:11 PM ----------

Okay I got stuck at some of that selinux *****ing

prep all

> prep all

[#] Extracting firmware files for beryllium-eu ...
[!] Error - file_contexts is missing and no file_contexts.bin found!

( Lunch: beryllium-eu; Rebase: NONE; Flavor: NONE )

Any idea what I can do / am doing wrong?
[Xiaomi Poco F1 ROMs, Kernels, Recoveries, & Other ] CosmicDan:
That tool is dead, don't even bother with it. It's not compatible with Pie either. I'm working on the Java rewrite still.
[Xiaomi Poco F1 ROMs, Kernels, Recoveries, & Other ] elandroido:
Thanks for the info.

Anyhow it was quite enlightening to look through it and I learned some things that will be helpful to know in future.

Impressing clean work.
[Xiaomi Poco F1 ROMs, Kernels, Recoveries, & Other ] CosmicDan:
Cheers, glad to see some dev interest. The bash scripts were getting to difficult to maintain already IMO - once I started working on the patching system I realized how difficult it will be to test and how fragile it would be down the line. At least with Java I can easily compartmentalize and use mock data to test individual functions, but with Bash I had to copy/paste/comment-out large chunks of code haha.

Downside is Java takes longer to code, but it's easier to expand, maintain and collaborate on in the end - that's important.
[Xiaomi Poco F1 ROMs, Kernels, Recoveries, & Other ] tech mashido:
Checkout super's kitchen subforum to extract raw img(s). Tool is there for Linux,windows,Mac

https://xdaforums.com/apps/superr-kitchen/kitchen-superr-s-kitchen-v1-1-50-v2-1-6-t3597434

https://xdaforums.com/apps/superr-kitchen/windows-linux-superr-s-kitchen-v3-0-0-0-t3601702
[Xiaomi Poco F1 ROMs, Kernels, Recoveries, & Other ] CosmicDan:
I know, but it's incompatible with Pie. All existing tools are, even Linux versions. It's impossible to extract them without mounting as loopback device, otherwise the extended attributes are corrupted. I tried every method out there. The kitchens all use ImgExtractor which even had problems with Oreo unpacking (incomplete/corrupt statfile dump).

Yes it works for unpacking but it's impossible to recreate a working image with any tools out there I've seen. This problem is solved for now: the unpack/repack stage must be done in Linux. Or WSL (the Linux in Windows 10 thing) should work - in fact I plan to move to that personally, so I can ditch Hyper-V.
[Xiaomi Poco F1 ROMs, Kernels, Recoveries, & Other ] theOriginalSuperl2:
Wow.

I'm really impressed with this project, and I'm excited for what it's going to let us create.

I'm a Java/Kotlin developer with a little experience in decompilation - I've made a few Xposed modules, and though the ones I've released mod AOSP itself, I have made a few private ones for closed-source apps.

I doubt this will be any use, but I'll mention it anyway - I'm very comfortable with Google's new UI toolkit, Flutter. It's fast and efficient, so there's a chance, if we were to add any apps to the ROM, it might be a good thing to use.

I'd love to help and contribute, feel free to message me on Telegram (@hacker1024) or PM me.

An idea - can we compile a list of features that we all want in MIUI, as a goal to work towards?

EDIT: Oh, and I maintain some ROMs and a Project Treble port/implementation for the Xiaomi Mi 5s Plus (natrium), too. I'l love to get this project running on that phone.
[Xiaomi Poco F1 ROMs, Kernels, Recoveries, & Other ] tech mashido:
Oh I see.

I did not use pie so no idea but I noticed some files are broken and missing while unpacking twrp backup files as well as fastboot images for Oreo .

Nice

Btw great work mate.

Looking forward to Tu out your tool when it is ready to miui for other devices :)
[Xiaomi Poco F1 ROMs, Kernels, Recoveries, & Other ] CosmicDan:
Nice, if you're familiar with AOSP framework modding in Xposed then you'll be very welcome to contribute patches that you may be interested in making.

A list is a good idea. We should figure out a platform where they can be discussed, voted on and assigned to people who volunteer to work on it (to avoid people doing duplicate work, or doing work that nobody seems to care about). I am thinking a public project on Freedcamp would be best for this, it's been a great system for my private projects - but I've not yet used their new public projects feature so I'll have to review it.

Personally I'm not focused on adding features but rather "fixing" the deep changes that MIUI makes. The aggressive memory management is a huge one. But also the double height status bar, as I teased a while back.

I've been a bit slack lately (holiday season and all) but I've been slowly chipping away it since Xmas, and shifting up gears.... I will hopefully have some news soon and get a foundation OAP tool down so everyone can start playing with it. I need to dive into DexPatcher next.

As far as apps go, I plan to create a "OAP Tweaker" app which will include a library that patches can link against in order to inject their own settings in a simple way. So instead of individual apps like Xposed modules, they will just add new categories/tabs/whatever to the single unified app UI. I've never looked at flutter, but the layouts will need to be generated at runtime or build time based on installed patches - static xml layouts wouldn't work here, so I don't think Flutter would help either. 90% of the tweaker app UI will be done in pure Java code probably, to keep it dynamic. This way the APK will rarely need to be recompiled (OAP won't support compiling APK's from source, at least not initially). The tweaker app would conditionally build a UI for options based on the installed framework patches, since the patches need to register with OAP anyway via the library. A lot of that kind of boilerplate can probably be automated with the kitchen though.

But that app is not a blocker, it will come later. At first, patch settings will need to be set manually via properties (setprop). The OAP Tweaker app will basically just be a front-end to setprop commands specific to the patches, and patches themselves define their properties. Something like oap.Status_Bar.bDouble_Height=1 (the b meaning Boolean, Status_Bar being the name of the category in the app UI, and Double_Height being the action option name.

Yeah, it fails extraction for modern ext4 images. I think it's because Oreo started using ext4 extents but the existing tools can't deduplicate them, but I'm not sure. Either way, Ubuntu/Bash on Windows will work perfectly fine :D
[Xiaomi Poco F1 ROMs, Kernels, Recoveries, & Other ] Thomas_xxxxx:
Can I flash this file in TWRP (miui-beryllium_20180916-902_V10.0.4.0.OEACNFH_debug_xiaomi.eu_dipper-port.zip) over preinstalled ROM which I bought it with (MIUI Global 9.6.22.0 stable)? What do I have to wipe if I can flash it over? I tried update in settings but it downloaded update and then POCO rebooted straight to TWRP and it did finish the update.

---------- Post added at 09:38 AM ---------- Previous post was at 09:37 AM ----------

Can I flash this file in TWRP (miui-beryllium_20180916-902_V10.0.4.0.OEACNFH_debug_xiaomi.eu_dipper-port.zip) over preinstalled ROM which I bought it with (MIUI Global 9.6.22.0 stable)? What do I have to wipe if I can flash it over? I tried update in settings but it downloaded update and then POCO rebooted straight to TWRP and it did finish the update.
[Xiaomi Poco F1 ROMs, Kernels, Recoveries, & Other ] CosmicDan:
I wouldn't recommend flashing it at all unless you're interested in developing (E.g. porting stuff from dipper). It's experimental and has all sorts of problems (major performance issues and lags for example).
[Xiaomi Poco F1 ROMs, Kernels, Recoveries, & Other ] Thomas_xxxxx:
And why the official update via settings in phone ends up in TWRP with no updated MIUI? Can you help me with this?
[Xiaomi Poco F1 ROMs, Kernels, Recoveries, & Other ] dalyer:
You mean MIUI OTA update?

Generally you need the MIUI stock recovery to flash those and they won't work in TWRP.

There may be a custom recovery that also works but I'm not clear on that at the moment.
[Xiaomi Poco F1 ROMs, Kernels, Recoveries, & Other ] CosmicDan:
Off topic, but official TWRP doesn't support MIUI OTA. You need stock Recovery or one of the TWRP forks which specifically support MIUI OTA (which have other problems AFAIK like no decryption support - unless they've fixed it).
[Xiaomi Poco F1 ROMs, Kernels, Recoveries, & Other ] elandroido:
Hey I just wanted to write here once again and leave a remark.

I personally probably will not participate in OAP in nearer future. It is for sure very interesting to dig deep in the DexPatcher de-interpreting stuff, but I am into my own Scala project now, trying to code a neuronal net from scratch }:)

What I wanted to say here is: I guess you will be probably better off with Java since it eases DexPatchet stuff, but I have some feedback for you despite this. As I said I used to maintain and improved a UNIX shell based build system once and if you need such a thing in future, I recommend to take a closer look into make/gmake. It exactly does what you need, you can define targets for code segments instead of copy/pasting code and you can assign multiple snippets to multiple targets in arbitrary order.

Just some feedback since it is nice to talk to you here.

---------- Post added at 08:28 PM ---------- Previous post was at 08:24 PM ----------

When you already have TWRP up, you have 90% done for a custom rom (referring to your initial question).

You just need to format data partition via TWRP wipe menu (wipe will not be sufficient due to encyption) and then flash your desired custom ROM.

Note: This device tends to be *****y with encryption, in case you stumble into problems, the disable fbe zip from this thread here will help.

Gr33z

---------- Post added at 08:31 PM ---------- Previous post was at 08:28 PM ----------

P.S.: Wipe Cache/Dalvik Option after Custom ROM flash never hurts.
[Xiaomi Poco F1 ROMs, Kernels, Recoveries, & Other ] Thomas_xxxxx:
And how can I flash stock recovery over TWRP to be able update MIUI? Where can I find stock recovery? I just want to have the newest version of MIUI installed. Thank you.
[Xiaomi Poco F1 ROMs, Kernels, Recoveries, & Other ] dalyer:
Download com zip of MIUI for Poco F1, open the zip, extract recovery.img, flash it in twrp.
[Xiaomi Poco F1 ROMs, Kernels, Recoveries, & Other ] CosmicDan:
Using make for a Java project? I've never seen that before lol. I don't know anything about makefiles, but I thought they're for C(++). I don't know anything about make so I'm not sure what the advantage will be over Gradle (I don't understand your explanation of advantages) and I know Gradle very well. Why would I be copy/pasting code without make? Good programming avoids code repetition and that's relatively easy to adhere to with OOP languages.

Primary development is now in WSL-Ubuntu, and Java and Gradle are very OS-independent - I already have to research a lot so don't really want to switch to a brand new build system that I've never used before without good reason.
[Xiaomi Poco F1 ROMs, Kernels, Recoveries, & Other ] Thomas_xxxxx:
Where can I download it?
[Xiaomi Poco F1 ROMs, Kernels, Recoveries, & Other ] dalyer:
Did you even Google? :-\

https://en.miui.com/download-355.html
[Xiaomi Poco F1 ROMs, Kernels, Recoveries, & Other ] CosmicDan:
Just ignore the off-topic Klingons.
[Xiaomi Poco F1 ROMs, Kernels, Recoveries, & Other ] solkarsalman:
I've been waiting for your work to be done from very long time, i always check this post to see if any updates.

Are you still working on this ROM build? Because i would love to try this one. Cheers.
[Xiaomi Poco F1 ROMs, Kernels, Recoveries, & Other ] CosmicDan:
Yup sorry, I've been even more silent that usual lately.

I actually haven't done much of anything the past few weeks because I'm quitting smoking, again, but this time actually succeeding (day 4 smoke-free now) and want to avoid all sources of stress. Rest assured I'm finding inspiration and ideas every day and making notes!

I'm also waiting to hear back from Lanchon regarding DexPatcher, which is very important for the project (unless I want to design my own patching system from scratch). He's a very busy guy though, he did respond to my PM though and hopes to get back to us soon. I'll annoy him with another PM if I fear he may have forgotten. On that note, if anybody is familiar with DexPatcher, Gradle, and/or the Android platform build system, please get in touch with me if you think you could help on adapting DexPatcher for our needs (specifically, integrating it with the Java-based OAP tool and not relying on Gradle). But don't worry if not, I'm not stuck on anything - I just haven't had the time and interested to research and examine DexPatcher in-depth, so was hoping Lanchon could answer my questions to save time.

We'll see what happens over the short future regarding that.

So, not dead, just crawling along slowly :) I think I already said in a previous post - I kind of regret starting this thread so early, because it is a long term project. I didn't expect so much interest tbh lol. On the other hand the interest everyone has keeps me motivated and gives me warm fuzzy feelings in my belly - I have to keep the promise of making MIUI great again, lest I be shamed and accused of being a jerk by XDA community and lose said warm fuzzy feelings xD
[Xiaomi Poco F1 ROMs, Kernels, Recoveries, & Other ] dalyer:
Good luck with that - some things are more important than ROMs! :D

Stick with it. :good:
[Xiaomi Poco F1 ROMs, Kernels, Recoveries, & Other ] CosmicDan:
OK I just overhauled the OP like I said I was going to a long time ago, have a look everyone - more interesting and current stuff there now :)
[Xiaomi Poco F1 ROMs, Kernels, Recoveries, & Other ] CosmicDan:
Hi guys,

No updates yet again I'm afraid, but I thought I'd make this post just in case others saw me making posts over XDA - and I didn't want to seem like I'm ignoring this.

Yes, I was actually considering abandoning the project and going to custom ROM's - but NO, after encountering issue after issue I have decided NOT to, so don't worry.

With that said, I've got the *same* real-life things going on at the moment so haven't been able to do anything new. But I've made plans to get the help I need and turn everything around (I've quit Uni and plan to move inter-state for work).

Cheers and thanks for your understanding :)
[Android Q&A, Help & Troubleshooting] wisebear:
I wanted to do an update from xiaomi.eu MIUI 9.5.X ROM to MIUI 10 on my wife's Mi Note 3. Unfortunately, I run into encryption troubles. Here are the steps I did:

1. Booted to preinstalled TWRP (I think it was 3.0.2) and did a full backup. Unfortunatelly I only saved to internal phone storage :crying:

2. Wiped Dalvik+Cache

3. Tried to install MIUI 10 Stable but got some errors in TWRP (remember it saying Error 7). Tried to wipe System as well but didn't help.

4. I updated TWRP to 3.1.1. and then managed to successfully install MIUI 10 version. First boot went OK.

Because I wiped System in TWRP I lost all app settings. My idea was to proceed with a restore from a full 9.5.X backup and then repeat the update to MIUI 10 without wiping in order to keep all applications etc.

5. So I booted again to TWRP 3.1.1 and did a restore from a backup.

After the reboot following message appeared: ''Encryption was interrupted and can't complete. As a result, the data on your phone is no longer accessible. To resume using your phone you need to perform a factory reset....''. In TWRP I can't access any files on internal storage - it shows 0 MB.

Can you please explain to me why this happened? Is it somehow related to TWRP update after performing a backup? I know that the solution is to format data in TWRP but I would like to avoid it. Is there any way of saving phone's data?? Does it make sense to try flashing MIUI 10 ROM via USB-OTG?

Any help would be highly appreciated. We really don't want to lose photos of our little baby from last holidays.

Thank you.
[Huawei P20 Pro Questions & Answers] Eambo:
Hey everyone,

I've had issues since I got my P20 Pro where The Dualshock 4/PS4 Controller won't connect via bluetooth. Using some third party programs I managed to get it to connect, but it doesn't do anything useful.

Looking through other threads, this seems like it's been an issue for a while with Huawei devices, but I can't find a fix. Is anyone able to confirm if they can get a PS4 controller working correct with the P20 Pro (Either natively or with third party apps?)

If anyone has Pie, it'd be super cool if you could test if this has been fixed too on there, as I used to enjoy playing games like Final Fantasy IX with the PS4 controller :(
[Huawei P20 Pro Questions & Answers] AlejandroGamez:
The same happens to me

I've been looking for how to fix this problem just like you, but nothing or using third-party applications with my P20 Pro have you found any solution to this problem?:crying:
[Samsung Galaxy S9+ Questions & Answers] bigray987:
ive just bought a S9+... ive spent the last 2 days trying to transfer everything from my iphone. i gave up on whatsapp and viber.

so now im looking for a program that i can do a full back up to my PC. i dont like cloud services. smart switch and Helium are not working! the **** gets stuck when trying to backup and i tried to update my OS and its frozen.

are there any simple programs where i can just click 'backup to pc' and it will save a backup? same with updating the firmware?

ive reached my limits searching online for this stuff. it was so simple on iphone, itunes did everything and worked all the time.

NOTE: the reason i dont want to use cloud backup is because they never fully backup the phone and ive always found missing pieces.

after i get a backup and update i plan to root the phone.
[Samsung Galaxy S9+ Questions & Answers] RISHI RAJ:
Download kies,Just like iTunes but for samsung
[Samsung Galaxy S9+ Questions & Answers] bigray987:
i ended up using Dr. Fone to back up and got impatient and updated via wifi on the phone.

ill try samsung Kies soon!

thanks for the reply