yashsingh1/xdaforums huggingface dataset:
[Xiaomi Mi Max 2  Guides, News, & Discussion] destroyer71:
And what is the meaning of these synthetic tests? They do not give information in full. There are so many other factors. I know 3 Roms, where there are problems with voice communication. On 2 other "departing" applications. Sense in such tests? For example, we see one of the highest scores in these tests. But there will be problems with communication and other things. What is the point then? Only because of the greatest number of points in the test? For daily use, they are not suitable. Everyone has their own personal preferences. I tested all the roms for this device. For me personally, the best of them - crDroid and AOSP Extended from pranavaryans. Now I use AOSP Extended from pranavaryans

Excellent rum. But why is it not in the survey. All this is my personal opinion. Personally for me, such a waste of time. Everyone is very individual. The test is just numbers. They do not give complete information.

But ... maybe someone will be interested. Good luck
[Xiaomi Mi Max 2  Guides, News, & Discussion] jbmc83:
this thread isnt supposed to be an "end all discussion" solution concerning the "best" rom. u said it yourself, everyone has their own personal preferences! so what if someone doesnt care about those "departing apps" because hes using different apps, but really cares about cpu / gpu performance due to gaming?

this data doesnt give you an excuse not to do your due diligence, so ALWAYS read the respective rom threads to find out what kind of bugs / functionality they have.

BUT

it helps you make a more informed choice when, say, youre stuck between 2-3 roms which might be very similar in mods and functionality / design. having more information at your disposal is always good, so this is far from being a "waste of time" :)

I dont get this negative vibe from a lot of users here. trying to shoot down threads, discourage devs or criticize projects such like this which take a LOT of time and work for their initiators to complete. And all that because "they personally" are not interested in it and think its "a waste of time"? Well guess what: not everyone shares your opinion / your everyday usage cases / your preferences concerning ROMs, Apps, settings, design choices, etc. And thats totally fine! Everyone has different requirements, so lets just collect all the info we can so that everyone can make his/her own choice.

What would you get if everything was shut down just because we have different requirements? Well then there wouldnt be ANY choices left. Congratz, youve just made XDA superfluous :p :D
[Xiaomi Mi Max 2  Guides, News, & Discussion] destroyer71:
You misunderstood what I wanted to say. I'm not against flows, quite the opposite. I expressed only a personal opinion about such tests. If it helps someone, that's fine. The results of daily use will differ from the test results. That's what I wanted to say ;)
[Xiaomi Mi Max 2  Guides, News, & Discussion] jbmc83:
yes, totally agree on that. battery life is extremely dependant on personal usage cases. still, since your own usage pattern basically stays the same no matter which rom ure using, it makes sense to compare the roms with one and the same strategy.

lets say testing shows that ROM A provides 2h more SOT than ROM B, with a total of 14h SOT on A vs. 12h SOT on B.

With your usage pattern you might only get 10h SOT on ROM A due to heavy usage of GPS and LTE mobile data. Still, due to overall higher system energy consumption on ROM B, you know based on the given testing data above that your own usage pattern will most likely net less SOT on ROM B than on ROM A. So in your case, you already know that you might get 8h SOT on ROM B just by looking at the 14h vs. 12h data from testing ;)
[Xiaomi Mi Max 2  Guides, News, & Discussion] mesarabi:
When you start to test roms?did you wait for specific vote number?I'm just doesn't unlock my device because of your test

I'm waiting to see the results then compare them to stock miui and then decide what to do because I can't see the big devlepors(with respect to all of them) or teams for this device(like leedroid or viper or eliminator purefusion for htc)

So I make a choice totally base on your tests

Thank you so much for your time spending for community
[Xiaomi Mi Max 2  Guides, News, & Discussion] jbmc83:
i can tell you right now that it will not make sense for you to wait for his tests to be complete :) this will take weeks if not months, i doubt ull wait that long ;)
[Xiaomi Mi Max 2  Guides, News, & Discussion] mesarabi:
I thought he starts soon(for example this week or next) and test roms with some scripts and then test another one

So I thought test will take at most two weeks

Am I wrong?he doesn't use script for test?or benchmark app?like gsmarena or others
[Xiaomi Mi Max 2  Guides, News, & Discussion] svbarbosa:
Yes, benchmarks are misleading most of the times. I never liked benchmarks myself. Real life usage is affected by so many factors.

But PC Mark Battery Life is not the usual benchmark. You should visit their site to better understand what it does.

PC Mark for Androd - A Better Benchmark for Android Devices

In a few words, this benchmark runs a series of simulations of day-to-day tasks , including web browsing, video watching, text writing and photo editing. The series is repeated until the battery drops below 20% and then you get an extrapolated SOT and a performance index.

I start the test with the battery precisely at 80%, so it uses about 60% of the battery charge, and the extrapolated SOT is very meaningful. The phone has to remain still during all time. If you run any app or receive a call/SMS while the benchmark is running, PC Mark simply aborts the test.

Since the benchmark runs for hours it is also a stability test. If the rom has, for example, memory leaks, it fails the test. I had it happening a few times with the two other devices I tested.

I truly believe my work produces useful info to help users make a more educated rom choice.

Of course there are many other important points that should be checked when choosing a custom rom, like customization features, active development/support, user base, etc... and the info I provide should never be the only basis for a decision.

Tests will start this weekend. I am having an unusualy tough work week, with long hours. :p

The votes will only help me defining a test sequence and have a feeling of how much people are really interested.

Running these benchmarks is a very time consuming task. The phones remain unusable for days/weeks.

The more people interested, the more motivation I have to keep benchmarking roms and kernels (yes, kernels eventually will appear for the Mi Max 2).

Right now I am benchmarking all important kernels for the mido (Redmi Note 4). There are 10+ kernels available.

The Mi Max 2 will be the third device I run benchmarks.

It all started for my main device, the venerable Samsung Galaxy Note 3, because its SOT is usually 3-4 hours, and battery life is a really important factor when choosing a rom. For the Note 3 I made a few scattered XDA posts. No dedicated thread.

Then I got my midos and decided to open a thread for my benchmarks. It was very welcome by the mido community, including developers, because the results helped them adjusting roms to better achieve their goals.

Now here I am with two Mi Max 2. Let´s see how it goes....
[Xiaomi Mi Max 2  Guides, News, & Discussion] PianoMonkey:
Xuefer's old Lineage 14.1's battery was much better than Ashwin's Lineage 15.1 battery life I found

I might test Ashwin's Lineage 14.1 tho
[Xiaomi Mi Max 2  Guides, News, & Discussion] svbarbosa:
First benchmark has just started!

Rom is AOSP Extended.

Xuefer's LA rom might be included in the future. It seems to have a lot of loyal users.
[Xiaomi Mi Max 2  Guides, News, & Discussion] svbarbosa:
My poll has 36 votes as of now. Here is the current ranking:

#Votes / ROM:

9 - LineageOS 15.1 by ashwin007

7 - AOSP Extended by eva0034

3 - LineageOS 14.1 by ashwin007

3 - XenonHD by Jay_B

2 - crDroid by pranavaryans

2 - dotOS by Jay_B

2 - Resurrection Remix 5.8.5 by iscle

2 - Resurrection Remix 5.8.5 by pranavaryans

1 - ColtOS by Jay_B

1 - Resurrection Remix 5.8.5 by kenzolo

There is still time to vote, but hurry, poll will close on 04-05-2018 at 21:30, next Friday.

If you are accessing XDA using an app the poll is not shown. At the end of my OP you will find instructions on how to vote.

Benchmarks are done for AOSP Extended, it was at the top when I picked it.

Next rom will be LA 15.1. When I finish it I will publish results for both.
[Xiaomi Mi Max 2  Guides, News, & Discussion] jbmc83:
looking forward to it :)
[Xiaomi Mi Max 2  Guides, News, & Discussion] m1n15s:
Used both and los 15 much better:pwaiting for results from all the roms great job my friend
[Xiaomi Mi Max 2  Guides, News, & Discussion] vadistar:
so which is smoother abd better xeufervs los 14.1 or ashwin's los 14.1
[Xiaomi Mi Max 2  Guides, News, & Discussion] PianoMonkey:
I'm currently on Ashwin, I had some issues with Xuefer' that I. Didn't like, like double haptic vibration, and no double tap to wake

Battery isn't great on Ashwin but I haven't tested Xuefer with my current widget setup (though I didn't change too much)

I'll have to test my phone when going to the gym, which is when my phone on Xuefer would last a long time
[Xiaomi Mi Max 2  Guides, News, & Discussion] m1n15s:
Any idea wuen u ll have results to post? Which roms u bencmarking?
[Xiaomi Mi Max 2  Guides, News, & Discussion] svbarbosa:
Time for a quick update on my progress.

Running PC Mark Battery Life benchmarks on the Mi Max 2 is a tougher job than I predicted.

I concluded the benchmarks with the first rom - AospEx. It took four days. First because I can only run one benchmark per day. Second because the second benchmark in one of my phones failed and I decided to run a few more to see if a new failure would happen. Fortunately no. All other runs were successful.

Next I installed Ashwin´s LA 15.1 on both phones. Ran 3 benchmarks in each phone. Only one ran to the end. All other runs failed. Of course, due to Murphy´s Law, the runs always fail close to the end, after running for about 9 hours. :p

Then I moved to DOT previous build (non-CAF). Tried 3 times on each phone, but all of them failed!!

Next I installed Xuefer´s LA 14.1. After initial setup I use Titanium Backup to restore my test environment apps and Titanium would simply freeze. Since I know everyone is anxious to see some results I decided to skip it and come back later. [MENTION=4294020]jbmc83[/MENTION], do you use TB? Does it work for you?

So I went back to DOT, this time the new CAF build. Before installing I updated firmware in both phones to latest development, just in case.

Guess what? Test fails again, twice on each phone. :p:p

So here I am, after one week, with results for just one rom. No point in posting because there is nothing to compare the results to.

Today I decided to go with a different rom in each phone. I installed Aswin´s LA 14.1 in one and Jay_B´s XenonHD in the other.

Tomorrow morning I will know if benchmarks are successful. Hope both are.

So please sit tight and be patient. I will not give up easily. :cowboy:
[Xiaomi Mi Max 2  Guides, News, & Discussion] jbmc83:
have u used TB in all cases to restore your testing envorinments? if thats the case, then that might be the culprit. since tests keep failing on different roms, it must be something else causing this. i know it would be way more tedious, but i found manually installing apps from playstore and then restoring only their settings from TB is more stable than direct restore...

also what kind of errors are popping up, anyways? does it display any specific error message or just abort the test and exit the app?
[Xiaomi Mi Max 2  Guides, News, & Discussion] svbarbosa:
It is very very unlikely that using Titanium Backup to restore apps is the reason for the instability.

I use TB since my first Android phone, the Samsung Galaxy S in 2010. TB was was the reason I rooted my phone.

Since then I have used TB to restore apps and data a zillion times in literally hundreds of custom roms. It never failed me.

That being said, I have just started another benchmark with XenonHD.

After a clean flash I installed PC Mark using Play Store. Nothing else. Not one extra app.

Tomorrow I will post my findings.

Nothing specific. PC Mark aborts without a message. Simply stops. It happened before with other phones a few times.

As I said before, in my not so short experience, unfortunately this is a sign of rom/kernel instability.

But since PC Mark Battery Life benchmark is a tough stress test, the problem may never show in normal day-to-day usage and the rom may be perfectly usable even if it fails the benchmark, as it seems to be the case with the ones I tested.
[Xiaomi Mi Max 2  Guides, News, & Discussion] jbmc83:
same here, been using TB since my first android phone back in 2011 (galaxy s plus) and this hasnt happened often. but sometimes there are some quirks, not sure if its exclusively TB or compatibility between TB and the respective rom. especially when it comes to backing up and restoring system apps it happens that the restore is only fully functional when restoring app data after installing the app itself from playstore.

keep us updated on your progress buddy, looking forward to your findings :) sure hope that ure not encountering more errors of this kind.
[Xiaomi Mi Max 2  Guides, News, & Discussion] ridershahmir:
Now beat this.... ? ? ???.

Dot os , performance than Los, best battery life.

Note : I was on a journey and watched 5 movies from sd card of 720p.
[Xiaomi Mi Max 2  Guides, News, & Discussion] daubh:
Stock

Would be nice to compare the ROMs you choose to benchmark if we also have the stock MIUI ROM to compare to.
[Xiaomi Mi Max 2  Guides, News, & Discussion] Horned Duckie:
Challenge accepted ?
[Xiaomi Mi Max 2  Guides, News, & Discussion] ridershahmir:
Wow. That's insane
[Xiaomi Mi Max 2  Guides, News, & Discussion] ayush4261:
Which ROM??
[Xiaomi Mi Max 2  Guides, News, & Discussion] m1n15s:
That doesnt count what u did u just keep screen awake? You didnt used any app on the phone??
[Xiaomi Mi Max 2  Guides, News, & Discussion] Horned Duckie:
Ashwin's LOS14.

About 4 hours of YT, browsing through the web, taking photos, and more than 10 hours of Tweeting, spreaded over two days ?
[Xiaomi Mi Max 2  Guides, News, & Discussion] jbmc83:
not insane at all. THAT is the SOT i expect when using a phone with a friggin 5300 mAh battery :)

i mean cmon, think about it: standard size is like 3000 mAh and with 20h SOT at 5300 mAh u should get around 11.3h SOT on 3000 mAh. not unheard of ;)
[Xiaomi Mi Max 2  Guides, News, & Discussion] m1n15s:
What r u doing with your phones since with all ROMs i get from 7 to 9 hours but with some clash of clans...
[Xiaomi Mi Max 2  Guides, News, & Discussion] Horned Duckie:
Apart from playing? Everything.
[Xiaomi Mi Max 2  Guides, News, & Discussion] jbmc83:
exactly. same.

there are four things that lower the SOT considerably (listed in order of significance):

screen brightness: when u use static brightness set to max itll eat up ur battery like theres no tomorrow!

second is gaming, puts a lot of stress on the whole system: gpu, cpu, ram, sforage, thus eats up battery.

gps, only use it when u actually need it. dont leave it switched on the whole time

mobile data eats a lot more energy than wifi. and LTE uses a LOT more energy than 3G.

thats basically it, everything else doesnt really have that much of an impact :)
[Xiaomi Mi Max 2  Guides, News, & Discussion] ridershahmir:
Well normally on WiFi I get around 11-12h sot. But 20h on WiFi, nope
[Xiaomi Mi Max 2  Guides, News, & Discussion] m1n15s:
Are bencmarks abandoned? Whats happening ?
[Xiaomi Mi Max 2  Guides, News, & Discussion] svbarbosa:
No. I am working on it.

For some reason most runs were aborting. Very frustrating. :p

I reduced my test environment to a bare minimum and tests are finishing.

I will have results soon.
[Xiaomi Mi Max 2  Guides, News, & Discussion] jbmc83:
i think OP is still trying to figure out whats wrong with the PCMark errors on the custom roms...?

edit: ha, got ninja´d by OP ^^
[Xiaomi Mi Max 2  Guides, News, & Discussion] m1n15s:
Thank mate for me this thread is more exciting than the ROMs there is a reason we bought a 5300mah battery ?
[Xiaomi Mi Max 2  Guides, News, & Discussion] svbarbosa:
OP updated.

Finally first results are up! :cool:
[Xiaomi Mi Max 2  Guides, News, & Discussion] chetchuakaka:
Can u give me link download L.A 14.1 xuefer rom? I font see link to download it. Tks so much.
[Xiaomi Mi Max 2  Guides, News, & Discussion] m1n15s:
Nice one mate but it seems normal they use same kernel... Will u do oreo roms also that Will be interesting comparing to nougat
[Xiaomi Mi Max 2  Guides, News, & Discussion] JohnTheFarm3r:
The link is removed. Use google to find the ROM.
[Xiaomi Mi Max 2  Guides, News, & Discussion] svbarbosa:
Bad news. Had to give up benchmarking ashwin's LA15.1 after five days trying. Not one completed benchmark even with all my apps removed.

Moved on to XenonHD. First benchmark ran successfully. :)
[Xiaomi Mi Max 2  Guides, News, & Discussion] jbmc83:
weird. still that same crash bug without any error message? have u checked app permissions and switched on everything manually? just checking mate, appreciate your work :)
[Xiaomi Mi Max 2  Guides, News, & Discussion] svbarbosa:
Just the standard android dialog "PCMark has stopped". :p

One time it almost completed. Benchmark stopped with battery at 21%!! Only one more percent to go. Over 9 hours running for nothing. :(

Believe me, I have tried everything possible. No clue on why it happens so often with the Mi Max 2.

With the Redmi Note 4 it happens very rarely. I have just completed a series benchmarking 12 different kernels and it happened with two kernels, and one kernel was a test build, so no surprise the bench failed. Take a look at

this post

.

XenonHD is running fine. Has completed the second benchmark. :cool:
[Xiaomi Mi Max 2  Guides, News, & Discussion] 9264:
it's a chinese website .

i think you can see them https://pan.baidu.com/s/1NaFM9vJijU...IMAX2(oxygen)/old&parentPath=/Xuefer'sAndroid
[Xiaomi Mi Max 2  Guides, News, & Discussion] jbmc83:
not recommended, since these are old xuefer builds. ill send a pm ;)
[Xiaomi Mi Max 2  Guides, News, & Discussion] all4game:
can you pm me too? lates 14.1 lineage xuefer? please?
[Xiaomi Mi Max 2  Guides, News, & Discussion] svbarbosa:
OP updated. Added three more roms to the results table.

I was so wrong when I predicted next results would come faster. :p

Lost about 10 day trying every possible way to benchmark ashwin´s LA15.1, but benchmarks would simply not finish.

Also had big variances between runs for Jay_B´s XenonHD and iscle´s RR-N. So I ran extra benchmarks to have better averages.

With more Oreo roms showing up, my plan is to focus on Oreo roms for the next benchmarks.

No need to ask. I will start with ROMFACTORY´s Official RR-O 6.1.0. :D
[Xiaomi Mi Max 2  Guides, News, & Discussion] svbarbosa:
Here is the first preview of Oreo roms benchmarks:

Bootleggers sets a new record in my Mi Max 2 benchmarks: 18:17 SOT.

Congratulations for [MENTION=5581790]pranavaryans[/MENTION] and [MENTION=6615644]Hard_Rock83[/MENTION]. :good: :good:

The bad news is that variance between runs is unusually high.

I changed my mind regarding Oreo roms benchmarks order. I am following alphabetical rom name order.

Next in bench will be crDroid.
[Xiaomi Mi Max 2  Guides, News, & Discussion] xinie:
Me Me also please please

lol

I also want to try it so bad :D:D
[Xiaomi Mi Max 2  Guides, News, & Discussion] jbmc83:
send me a pm as a reminder ;) going to bed now *yawns*
[Xiaomi Mi Max 2  Guides, News, & Discussion] svbarbosa:
Here is the second preview of Oreo roms benchmarks:

I ran a total of seven benchmarks for Bootleggers and the SOT variance between runs was the biggest I found so far.

Had to skip crDroid. During initial setup I had a lot of UI freezes followed by warm reboots. Will wait for next build.

For [MENTION=6615644]Hard_Rock83[/MENTION]'s LA15.1 I flashed v10beast of HardRock kernel before running tests. The last two tests I ran did not finish. I will keep trying until I have at least three complete benchmarks.

Next in bench will be [MENTION=4479268]Jay_B[/MENTION]'s MSM Xtended just released build.
[Xiaomi Mi Max 2  Guides, News, & Discussion] jbmc83:
awesome work man, much appreciated :)
[Xiaomi Mi Max 2  Guides, News, & Discussion] svbarbosa:
Time for a new record.

[MENTION=4479268]Jay_B[/MENTION]´s MSM Xtended first benchmark run reached 19 hours and 37 minutes SOT with a performance score of 4724.

This is fantastic because both numbers are the highest for Oreo roms tested so far.

And considering that PC Mark SOT is for 95% of battery charge, this means 20 hours and 38 minutes on 100% of battery!!

The benchmark ran for 12 hours and 25 minutes. :p

Will post full results when MSM Xtended tests are completed.
[Xiaomi Mi Max 2  Guides, News, & Discussion] jbmc83:
coming from brother [MENTION=4479268]Jay_B[/MENTION], that somehow doesnt surprise me ;) kudos to his mad skillz! :D
[Xiaomi Mi Max 2  Guides, News, & Discussion] Jay_B:
Thanks for the vote of confidence bro.

Had a lot of help from team Xtended especially [MENTION=8829870]SuperDroidBond[/MENTION] and [MENTION=7072514]mady51[/MENTION].

I would personally like to thank them a lot for their constant support and help.

Cheers..
[Xiaomi Mi Max 2  Guides, News, & Discussion] 911-Future_Maker:
Yay incredible! If the result remain like that in next tests and don't drop as in bootleggers I'm flashing this rom right away.:laugh:
[Xiaomi Mi Max 2  Guides, News, & Discussion] m1n15s:
Can we have a benchmark on how much sot miui have so we can compare also with custom roms?
[Xiaomi Mi Max 2  Guides, News, & Discussion] jbmc83:
good idea actually :)
[Xiaomi Mi Max 2  Guides, News, & Discussion] svbarbosa:
TBH I have no desire of using MIUI, but since you are asking nicely and [MENTION=4294020]jbmc83[/MENTION] endorses it I will do. :)

Anyway MIUI will probably have a good SOT since it kills background processes like crazy. :D

Which MIUI build should I benchmark?
[Xiaomi Mi Max 2  Guides, News, & Discussion] m1n15s:
Thanks barbosa me i am curently on miui 10 but any miui will do i guess so we have a reference.... Btw i almost flashed all oreo roms... It was just a thought we all appreciate the work you are doing since for most of us ending up with mi max series the battery life was a major factor... Take care
[Xiaomi Mi Max 2  Guides, News, & Discussion] jbmc83:
only if you have the nerves and time buddy :) but the idea of having a "baseline" to which custom roms can be compared to is definitely not a bad one.

i think the latest global stable miui rom would make sense, weeklies change too fast and china roms would likely not represent the MM2 userbase here sufficiently.
[Xiaomi Mi Max 2  Guides, News, & Discussion] svbarbosa:
Here is the third preview of Oreo roms benchmarks:

Unfortunately the results in first benchmark run for [MENTION=4479268]Jay_B[/MENTION]´s MSM Xtended did not happen again. Removing this first run the SOT average becomes 13:37, still a good result considering cpu governor used is performance.

[MENTION=6615644]Hard_Rock83[/MENTION]´s v10beast was the kernel used in [MENTION=8363123]ROMFACTORY[/MENTION]´s RRO and, of course, in previously benchmarked [MENTION=6615644]Hard_Rock83[/MENTION]´s LA15.1. The CPU overclock produces better performance apparently without any instability.

Running these benchmarks is taking a lot longer than I predicted. I can only run one benchmark a day. To make matters worse the results vary too much between runs, and that forces me to run more benchmarks for each rom tested. This is why it is taking so long to post results. :p

I am opening a pool to let you help me decide what to do next. Please vote.
[Xiaomi Mi Max 2  Guides, News, & Discussion] svbarbosa:
[DELETED] Double post. :silly:
[Xiaomi Mi Max 2  Guides, News, & Discussion] Jay_B:
Thank you bro for the benchmark. In the second run did you use v9 or v8.5 of Xtended? Just trying to figure out what might have gone wrong to get the SOT down.