yashsingh1/xdaforums huggingface dataset:
[HTC Incredible S] Psyloid:
Quickpic !!!
[HTC Incredible S] elecc:
Definitly QuickPic. The best gallery-app i know. Super fast and tons of options. Its worth a try...

Gesendet von meinem HTC Incredible S mit Tapatalk
[HTC Incredible S] itsbeertimenow:
I don't know, but send me those pics your hiding.
[HTC Incredible S] fallenwout:
Quickpic, you can exclude folders from scanning in setting.
[HTC Incredible S] vizzy:
Download keep safe. Works for me
[HTC Incredible S] itsbeertimenow:
Still awaiting pics.
[HTC Incredible S] sabret00the:
Thanks guys. QuickPic isn't bad, my only issue is that it feels so much like Sense and also that I prefer the AOSP layout but it is a lot more feature complete than the basic gallery. I'm going to keep it around and have a play with it.
[HTC Incredible S] sleepnd:
i suggest QuickPic, super fast:)
[HTC Incredible S] Splux:
You made my morning.

You also made me stop calling around and doing stuff I need to do, therefore I cannot thank you :(
[HTC Incredible S] Cookie Ninja:
With so many posts for quickpic you can't go wrong. Do it. Now.

Sent from my HTC Incredible S
[Nexus S General] bedalus:
Results in Google Docs Spreadsheet

All ICS ROMs Benchmarked

Any regular visitors to this thread can't have failed to notice the big changes in the spreadsheet. In particular I've been studying the effect of the kernel the ROM developer includes. If you look at column H, you will see whether I recommend flashing another kernel to improve performance at stock speeds.

REMEMBER: Performance is not everything! Many custom kernels provide extra features!

If you do decide to switch kernels, and only desire stock speeds and a reduced feature set, I recommend two kernels in this post.

If you are new to this stuff read this.

SUMMARY OF RESULTS

#1st place:

Pixel ROM 1.72

#2nd place:

CyberGR-MOD|NS.NGN ICS v10 HYBRID

#3rd place:

MIUI Catalyst 2.4.6

#4th place:

AOSP+ N.5

#5th place:

[MIUI][2.4.6] Oodie pRiMe rOcket fUeled

Where do I find all these wonderful ROMs?

Their XDA threads are all linked in the table, so click through to discover each ROM's feature set, included apps, theme, and evidence of good karma!

Looking for a Gingerbread ROM? Try this.

Where did all your other benchmarks go?

Kernel Features & Benchmarks: this thread

Battery drain: this thread

CPU Governors and I/O Schedulers: this thread

Power Saving Governors: this thread

Thanks to all the developers.
[Nexus S General] bedalus:
Reserved 4
[Nexus S General] bedalus:
Reserved 3
[Nexus S General] Ibn Saeed:
Thanks

I was waiting for this

It might lead to troll wars though

By the way, i dont see Pete ICS rom in there, im using it.
[Nexus S General] bedalus:
Thanks, and no troll wars please y'all.
[Nexus S General] SA-07:
Don't you think "popularity" is going a little too far? It will definitely lead to fights...all the devs are good and I don't think prominence is a good indicator of a good rom

But it's up to you ;)
[Nexus S General] rubyknight:
Personally, benchmarks are very misleading... Some of the most stable and well developed roms don't get the greatest scores because they weren't made with benchmarks in mind.
[Nexus S General] android_nexus:
Another great work! Thanks :)
[Nexus S General] simms22:
just remember, popular doesnt mean better. but to get angry at the truth(whatever it might be) is just silly. its lies that you should be upset with.
[Nexus S General] uansari1:
Where's Peter Alfonso's ROM? Bugless Beast is a mainstream rom, second only to Cyanogenmod in scope and breadth.. The ROM thread is in the General forum, because he links to his page at Rootzwiki, but it's a more prominent ROM than many you've listed.

Please include it in the benchmarking as well. :-)
[Nexus S General] qtwrk:
http://xdaforums.com/showthread.php?t=1430170

you didn't add and test this one
[Nexus S General] Ibn Saeed:
please add pete ics bugless beast.
[Nexus S General] bedalus:
Omissions fixed!

UPDATE: kwiboo's project removed, was an SDK port. So so tired now, got to sleep. Tomorrow begin again with Brainmaster's tweaked ICS
[Nexus S General] biotecsoul:
Which kernel is used to make the tests?

-----

Forget It...

"I'll be benchmarking them twice with whatever kernel they come with, and then with morfic's bare boned T132"
[Nexus S General] rubyknight:
Read the op.
[Nexus S General] rrohanjs:
u could also add overnite battery drainage column with sync on or somethin like that, if not overnite then a period of 2 hrs idle .. how much does it drain ..
[Nexus S General] thegtfusion:
Holy **** man, what would it be if the NS comunity didnt have you?? :D

Thumbs up!!!! :D
[Nexus S General] bedalus:
Haha, that makes me feel good. Wait, Benchmarks > XDA thread > Positive XDA user feedback > Dopamine release = Addiction to benchmarking? :eek: Time to join crackflashers anonymous...
[Nexus S General] AndroidUser00110001:
I doubt it would lead to fights between devs, well hopefully not. I can see users arguing stuff more than devs.

Benchmarks aren't that good anways.

BTW, your kernel sucks!!!!

Just kidding been running smoothly since I started using it the other day :D

-----------

Thanks for the ratings system. Looks nice!
[Nexus S General] glennkaonang:
Slim ICS 2.7 is out. Big changes this time.
[Nexus S General] rrohanjs:
shockem is back with miui, redox rom ..
[Nexus S General] :
Thanks for the heads up. I really do appreciate it. Changelog for redox:

My motivation is a little low today. Perhaps if more detail was included about what the fixes are, I'd be more willing to give it another pass. Probably he means UI fixes rather than anything to do with system performance. I'll wait for a major update with this one I think.
[Nexus S General] rrohanjs:
the last build u tested was like more than 2 weeks ago i guess, i mean the rom more than 2 weeks old .. in that time miui has also been updated few times so ya im using it i can see a big difference in smoothness, well its upon u in the end ..

carry on the great work :)
[Nexus S General] :
Just benchmarked Oodie pRiMe at Oodie's request. He made some IO tweaks. His SQL improved, but all other scores are down. This is likely to be something to do with the latest MIUI build. I'm going to continue to wait for more major updates.
[Nexus S General] :
UPDATE: Oodie pRiMe 2.2.24 updated on the sheet!
[Nexus S General] rrohanjs:
ya ur right might as well rate official miui rom, but i was hoping for rankings between the miui roms available for us like oodie, redox and brickmaker, so the users know which one is the best ..

i know too much to ask for, i wish i knew how to do it :p
[Nexus S General] :
Don't worry, it will get done soon enough. I think oodie's is highest on the sheet.

kernels ; battery ; ROM ; gov/sched
[Nexus S General] johnnski:
this thread is very helpful. Thanks!
[Nexus S General] stojshic:
I have one question, or r equest... Could you benchmark GB oxygen ROM, just for comparing it with ICS roms... I personally love ICS, and I'm not thinking about moving back to GB, but lots of people are talking about GB's better performance, so just to see if it's true that GB really had batter performance, or it's just placibo... Thanks

Sent from my Nexus S
[Nexus S General] thegtfusion:
Bedaluuussss nuhetri v3 is out!!!! :D
[Nexus S General] :
Okay, by popular demand i will attempt this.

kernels ; battery ; ROM ; gov/sched
[Nexus S General] dinos3:
bench this xdaforums.com/showthread.php?t=1416451 3.0.0 now ;)
[Nexus S General] :
I see brainmaster's tweaks are there now.

I'm just having a little think about how I might change the way I benchmark these. My 1st mate tchaari was confused by the two kernel thing, which probably means it isn't simple enough for more casual users either. From my second post:

Well, I can achieve 1% accuracy by running T132-I twice. Also, this would eliminate the kernel as a variable in ROM performance.

So I think I need to re-run all the ROMs with T132-I again. Anyone following this thread will know this is a big task. It took me several days last time, and I don't have the same level of free time now vacation is over. Is it worth it? Feedback needed please!
[Nexus S General] glennkaonang:
IMO, it's not worth it bedalus.

From what I see, this ROM benchmarking is the most time consuming.

And there are way more custom ROMs than anything else (e.g. kernels) here in Nexus S sub-forum.

For me, what I'd like to see from the spreadsheet is how well my favorite ROM performs among the others.

To be honest sometimes I don't really care whether my favorite ROM performs well.

For me there are other considerations in choosing a ROM, like customization or additional MODs and features.

So my conclusion is, let's just stick with what we have now and keep updating it from time to time.

Besides, you're not on vacation anymore, bedalus.

I'm confident enough that people would agree with me because of this particular reason :)
[Nexus S General] :
Thanks Glenn!! But you are too late! I've scrapped the default kernel data. There's no going back. :D At least I won't be bored on my lunch break.
[Nexus S General] ljordan2:
You are a hard working guy bedalus. Thank you for your devotion to benchmarks, we all appreciate your work:)

Sent from my Nexus S from Tapatalk
[Nexus S General] tchaari:
The new Nexus MV update has other interesting performance tweaks to test too :D

Maybe just separating the two columns will be fair enough for now. This will avoid comparing the scores of the ROM with its stock kernel and the T132-I scores like I did :D

I think that running T132-I twice is a very nice idea but redoing all the stuff is a huge amount of work. I propose to do it individually for the next new benchmarks when the ROMs will have significant changes in their updates.

EDIT1: I just noticed that the default kernel test has been removed. So I came a little bit late. Well, it is another good (but radical) solution to avoid confusions :)

EDIT2: I hope that you kept the old stock kernel scores somewhere. Maybe we will need them in future benchmarks :)

EDIT3: Can you also keep the best ever score of the ROMS (with their versions) like you did for the kernels? :)
[Nexus S General] :
It's alright, I'm working around it by duplicating the original T132-I score. I only have to benchmark updated ROMs, and when I do I'll do it twice. I might redo some of the top ones though just to make sure.
[Nexus S General] tchaari:
So good ideas and very interesting planning :)

Oh by the way bedalus, I propose you to change your nickname in XDA --> AndroidBenchmarkMan :D
[Nexus S General] thegtfusion:
Or ''benchmarkaddict'' hahaha :P
[Nexus S General] :
Haha, that's funny, I was sort of thinking the same thing this morning. "Benchmark Bedalus"
[Nexus S General] :
UPDATE: nuhetri-reloaded v3.0.0 (ICS 4.0.4) refreshed!

Further extends lead!
[Nexus S General] bluelyd:
bedalus, your choise is very good to many users.

I agree that "acurracy" is one of the most important for study.

but we worries about your health.

so I think "Updating it would be better when the huge update of ROMS"

take it easy, bedalus. and I always thanks to you.
[Nexus S General] xeTaiz:
haha man you're a beast!

nuhetri 3.0 released some hours ago and theres your update :D

poor guys with other phones are jealous coz of you :)

nice work
[Nexus S General] irtehun:
Wonder how much faster I can make it ;)

Sent from my Nexus S running nuhetri-reloaded
[Nexus S General] :
Thanks :) nuhetri-reloaded got special treatment because it was requested by a couple of users.
[Nexus S General] :
UPDATE: Slim ICS 2.7

Using my new system: double benchmarked with T132-I

Retains the top spot of all the 4.0.3 ROMs
[Nexus S General] ljordan2:
Hoping to see oxygen benchmark:) Very curious about oxygen's performance against ics roms.

Sent from my Nexus S from Tapatalk
[Nexus S General] tchaari:
You mean that you will make it even faster? you seem so determined to shake up android development plan :D
[Nexus S General] :
Oxygen ICS not released yet.

I'm going to be benchmarking Jonathon Grigg's Carbon which is based on Oxygen (Gingerbread) for comparison.
[Nexus S General] ljordan2:
I was talking about gb oxygen. Looking forward to see it.

Sent from my Nexus S from Tapatalk
[Nexus S General] :
Oh right. Cool. Yeah, Carbon is just oxygen with an ICS theme. Testing it now.
[Nexus S General] irtehun:
I am.

Sent from my Nexus S running nuhetri-reloaded
[Nexus S General] bluelyd:
Could you update your sheet of CyberGR v8, CNA 1.4.0, MV 2.02.26..:D

Actually so many roms updated :confused:

If you have enough time. thank you:D
[Nexus S General] :
I'm going to work my way through them all.
[Nexus S General] treyweez11:
Damn no mention of VHGomez? Lota R1?
[Nexus S General] :
GINGERBREAD: Performs 13% below the ICS average.

It performs almost 20% below the best performing ICS ROM, nuhetri-reloaded.

This was tested with matr1x kernel 11.5, with live OC at 110% and performance governor set at 1320MHz, i.e. same speeds as T132. I did try to use a T13 GB kernel by morfic to try to make a more fair comparison, but it kept rebooting on me.

But I don't think there can be any argument against GB performing worse than ICS.
[Nexus S General] glennkaonang:
I see in the spreadsheet that Grigg's Carbon doesn't perform very well.

How is that possible since many people feels that Oxygen is snappier than any ICS ROMs.

I don't mean to worship Oxygen here.

I'm just curious with the result.
[Nexus S General] :
I agree, a lot of people do feel it is faster. Personally, after so much testing of various ICS ROMs, when I recently went back to Carbon (for a previous test) I started to see that it is noticeably slower.

I think the reason it feels faster is because ICS has some transition animations between screens, or opening apps, which just adds a little delay. In Oxygen it was possible to disable a lot of the system animations.
[Nexus S General] :
I have no idea what this means? Is it a new ROM?

Sent from my SNES
[Nexus S General] bluelyd:
+1

oxygen has apsolutely rear animation. so feel fastest.:p

EDIT : and thank you, my favorite thread and member.
[Nexus S General] thegtfusion:
Its a rom for the ns4g
[Nexus S General] :
Oh right, thanks. Obviously I can't test that!
[Nexus S General] bluelyd:
I read your post about "when sheets update - policy (huge update)".

So I'm so sorry about poor asking for updating many ROMs.

But I can't find any idea of nuhetri-reloaded's base.

I think nuhetri-reloaded Rom can't stand-alone without base rom.

Which rom did you flashed before irtehun's?

Sorry for my repeated poor question and thank you for responding me.:)
[Nexus S General] :
It doesn't need a base, it just needs data. I restored my data from a Slim ICS nandroid, wiped dalvic using morfic's zip, then wiped all the app data individually once booted, then rebooted.
[Nexus S General] bluelyd:
:eek:Really didn't know that.

thanks a lot. ;)
[Nexus S General] :
Right, doing this spreadsheet is a bit like painting the Sydney Harbour Bridge. By the time you're finished, it's time to start again.

With that in mind, I'm trying not to waste time. I'll skip all the ROMs that haven't been updated, and focus on the updated ones.

For example, evilisto's stock 4.0.4 hasn't been updated, so I'll leave that. Neither has iceandfire's Ultimate ICS.

Once I've gotten all the updated ones finished, I'll go back and retest those that still haven't had updates, unless it looks like they will be getting them soon.

Don't forget, everything will need redoing AGAIN when 4.0.4 or 4.0.5 drops.

So, to summarise, this is a rolling project, and will never be up-to-the-minute correct.
[Nexus S General] :
UPDATE: somewhat contrary to the above post, evilisto's 4.0.4 had been retested! Moves to the top spot.

This is because I see it is v1.1 which i think is an update on the version i originally tested. But generally i will be sticking to my plan in the above post.
[Nexus S General] tchaari:
Bedalus, can you please do another pass? the two passes you have done gave two scores that are a little bit distant.
[Nexus S General] :
The overall variability of a pass is limited to within two percent of the true mean.

For example if I knew a ROM's true mean was 5%:

-it could get very lucky, and have a score of 7%

-or be unlucky, and score just 3%.

Those two scores would both be within 2% of the mean, but they would be 4% away from each other.

In the case of evilisto's stock 4.0.4, the scores are within 2% of each other. Averaging them provides me with a score that is 1% within the true mean (assuming normally distributed data).

I thought you knew all this? All the variability info is in the kernel thread here.

And you need to look at sheet 2 for how the variability is calculated from the standard deviation of each test: spreadsheet (see sheet 2)
[Nexus S General] tchaari:
Yes, I read the variability principle of your benchmark. It is a sound theory. Mathematically speaking, there's no doubt about the correctness of these scores. Just wanted another practical pass to be sure because the difference is a little bit confusing. As you explained, it seems that one of the two passes is in the extreme lucky or unlucky case :)

Anyway, I am "mathematically" convinced that there's no need for a further pass. Thanks again buddy ;)
[Nexus S General] :
One may be very unlucky and one bang on the mean.

Or

One may be very lucky and one bang on the mean.

Or

One about 1% up, one about 1% down. This is probably closest to the truth (assuming normally distributed data!)
[Nexus S General] ballroom dru:
GB Oxygen ROM is as stable and fast as advertised. I keep going back to it from the fastest ICS roms.
[Nexus S General] ljordan2:
But seems to perform bad on bedalus's benchmark:) Anyways ux is important.

Sent from my Nexus S from Tapatalk
[Nexus S General] :
Thank You!

bedalus, this is my first post, and I came here just to tell you how graithfull I am with all your work. This are by far the most awesome topics to the people that just like me, want to be always up to date to the best.
[Nexus S General] :
Cool. I think that earns you a personal response. GET OFF XDA WHILE YOU STILL CAN!!! Sorry, just kidding. It is like some form of drug though. Hope you enjoy your phone more for being here :)
[Nexus S General] nexusphone:
poignant :) We always appreciate you being here.
[Nexus S General] reference.phone:
"GET OFF XDA WHILE YOU STILL CAN!!!"

drug :eek::eek:
[Nexus S General] tchaari:
It seems that you are new here. Welcome in XDA addiction :D
[Nexus S General] xeTaiz:
lol you make it sound like a joke but its true :D

i prefer checking new posts on my subscribed threads before having a look at missed calls etc :D

but with these awesome guys in here theres no other choice :D

btt:

the new top surprised me... nuhetris rom is so smooth i cant think of more performance haha :D

love ur benchmarks bedalus :D
[Nexus S General] kramsac:
Nuhetri withdrew 3.0.0 and 3.0.1 due to stability issues. Shows you that benchmarks aren't everything...
[Nexus S General] xeTaiz:
i dont have problems with his 3.0.0... statistics dont work but i dont mind, 2g/3g doesnt work but the rest is awesome.

the performance is awesome and its got all the stuff i need/want :D

waiting for 3.1, will be great if noone has issues then (hopefully)

but i rly believe in irtehuns skills, hes doing a great job
[Nexus S General] wildestpixel:
There seems to be a shift again with KustomKream losing its fifth place ?

EDIT - I see a load of retests need doing.
[Nexus S General] :
Yeah, I had a slightly different way of setting up which seems to improve the scores for all ROMs, so they all need re-doing. I'm trying to do all the ones that have been updated first. I'm also trying to leave any that might be updated soon for last.
[Nexus S General] :
Having a look on the ROM threads, looks like iceandfire, kibmcz, mandaman2K, Coentje44 have all promised updates soon, so I'll leave updating those for now.
[Nexus S General] ljordan2:
Hey Bedalus, there's a typo in your benchmark sheet. In oodie miui prime rom, it says "rocket fulled" when it is suppose to be "rocket fueled".
[Nexus S General] :
Smeomtmies I jsut cna't seem to get my tpynig crorcet at all.
[Nexus S General] bluelyd:
no matter:D

thank you to doing these works.:)
[Nexus S General] ljordan2:
No problem sir:)
[Nexus S General] :
MAJOR UPDATE: I was more than two thirds of the way through completely refreshing the results, when I had a brainwave. I noticed some of the data appeared to have nothing to do with the final overall result.

Check out Cell B31 in the spreadsheet: https://docs.google.com/spreadsheet/ccc?key=0AntDDKv-lS6IdGpWaWxiUjVMbVFHWU82R0t1bWtHZ1E

I did a study of the individual test results correlation to the final overall score. (The individual results were averaged out from both passes before producing the graphs)

As you can see, the following results were not sufficiently correlated to the final overall score: AnTuTu floating point, and 2D and 3D gfx ; SQLite ; Pi ; Linpack Single ; Nenamark ; Vellamo See the Sun Canvass and Deep Sea Canvass

These have been removed from the results. I believe this is the most accurate the table has ever been!

TO DO: I'm still waiting on imminent updates for a few ROMs before I refresh those results.

Updates have been implied or promised 'soon' in these threads:

-Mandaman2k_v6 ROM

http://goo.gl/s8uA5

-Kustom Kream v6

http://goo.gl/THzzn

-Crossbones v0.2.0

http://goo.gl/REuyq

-Ultimate ICS v4.0

http://goo.gl/86bLn

-Peter Alfonso Nightlies

http://goo.gl/Jiv0g

-NexusBeam - v4.2.3

http://goo.gl/v3aLS
[Nexus S General] ljordan2:
Seems codenamedroid rom has beaten nuhetri rom. Weird, looks like v3.0.0 has slow down a little bit.
[Nexus S General] al_madd:
bugless beast is totally beast.....:o:o
[Nexus S General] bluelyd:
I really waited for it.

Thank you for your kind information of that.:D
[Nexus S General] stojshic:
One suggestion, could you add benchmarking date near rom name, it could maybe be helpful, especially now when you are redoing all benchmarks? Just a though... And, Codename is now that much faster than slim?

Sent from my Nexus S
[Nexus S General] thegtfusion:
Wondering the same thing about codename..
[Nexus S General] :
I'll try to remember to add dates when I refresh any results, I'll keep a log at the top.

Codename had some really impressive I/O results. Maybe it was a fluke. Statistically 1 in every 20 passes will exceed the limits of variability I have set. For instance, 4% for I/O. If CNA got a lucky run, it could have scored maybe 6% over the mean for I/O, and then that would add 1% to its overall score. I do state the variability can be as much as 1% though. Usually it will be less.
[Nexus S General] :
UPDATE: CyberGR-MOD ver.4 ULTIMATE (Gingerbread) benched at developer request. Scores 2% lower than the poorest performing ICS (excluding ICS ROMs awating a re-test).
[Nexus S General] ballroom dru:
Bedalus: I would really like to see which ICS ROM is the most stable. I am back on Oxygen right now because it just works.
[Nexus S General] :
They all worked fine for me, but I didn't get a status bar with DX ROM. I wasn't trying to make them crash, nor test all functions work as advertised. A lot of these ROMs are works in progress. If you take the time to read through their threads you can see what issues users report, and whether the developer responds.

kernels ; battery ; ROM ; gov/sched

Now with summaries in the first posts. Convenient for XDA app users!
[Nexus S General] :
UPDATE: Oodie pRiMe MIUI 4.0.4 (pre-release) moves into the top 5!
[Nexus S General] ohliu:
Latest nuhetri is 3.0.1 btw. Came out on the 26th of Feb.

http://goo-inside.me/devs/irtehun/nuhetri/
[Nexus S General] :
I'll take a look tomorrow if i can. Early night for me tonight!

kernels ; battery ; ROM ; gov/sched

Now with summaries in the first posts. Convenient for XDA app users!
[Nexus S General] cool_yking:
guys.. is the one 4.0.4 on the top is really that better and i will also like to knw tht do it have all d features like the other customized roms ?
[Nexus S General] :
Can you open the spreadsheet, then follow the link to the ROM's thread?

kernels ; battery ; ROM ; gov/sched

Now with summaries in the first posts. Convenient for XDA app users!