yashsingh1/xdaforums huggingface dataset:
[Nexus S General] :
I don't mind telling people that I use Slim ICS most of the time. Partly this is because I always use the same system for testing kernels. If there's no new ROMs to test, then Slim ICS stays on the phone. But even if I wasn't benchmarking everything, that is probably the ROM I would use. I like krarvind's ethos.

But I don't want to reveal my preferred kernel choice. Partly, I haven't made up my mind, but also I don't think it would be fair, because I might bias people.

Decide what features you need, and which you can live without. Narrow down the list of kernels. Do you want stock speeds, or overclock? BUS/GPU overclock? Does the dev provide pointless UV that basically saves no power and increases the risk that your phone reboots? Once you select a kernel, you may find that it just doesn't seem to work well with your ROM. Go to your second choice.

Once you've got a system that works well, get off XDA (or end up like me) :D:mad::p;):confused::):(:D
[Nexus S General] tchaari:
The problem is: when you get into XDA and you find all these awesome ROMs, kernels and benchmarks;), you can never go out. Taking a look at what's new in XDA is an addiction that I can't avoid even in my busiest times :D
[Nexus S General] glennkaonang:
Totally agree. I once even flashed a ROM during a meeting just to fiddle with the new features while pretending that I'm jotting down some notes :D
[Nexus S General] tchaari:
And what if your boss ask you to send him the notes? :D
[Nexus S General] steve.garon:
You send him the rom ... :cool:
[Nexus S General] :
Soon the company is filled with crackflashers. No work is done. Company goes bust. Nobody can afford to buy a Galaxy Nexus. Google has to throw them all on a big fire, and shut down its search engines permanently. Without Google, mankind turns back into apes. Ape men destroy the cities. Moths become the dominant form of life. They always try to fly towards the sun. After many millenia, planet Earth is dragged close to The Sun by billions of moths. Earth burns. Only gorilla glass covered phones like the iPhone 4 survive.
[Nexus S General] tchaari:
:D:D:D:D:D:D:D:D:D

What an imagination :eek:

Do you say such things to your little daughter to help her sleeping? :D

Pay attention, this can be a dangerous nightmare... The most terrifying part is the last sentence :D
[Nexus S General] Steviemac12:
bedalus,

Thank you so much for adding the date at the top!

I also have a dumb question I think... On the kernel performance sheet, in the row with "score average" and "best ever average" should we be looking for a result that is close to 0 or should I be wanting a negative or positive percentage?

Sorry if that is too noobish.

St3vi3
[Nexus S General] :
No problem. If you see a positive percentage, that's good, because it did better than average (0% would be equal to stock). The more positive the better. Negative percentages performed worse than stock.

However, there is a worst-case-scenario variability of 2% in the overall percentage. So unless it is more than 2% above zero, I cannot guarantee a performance improvement, however, because this sort of data is what we'd call "normally distributed", I'd say if it is more than 1% above zero, there's a very good chance that it is a genuine improvement.
[Nexus S General] Steviemac12:
Thank you very much. I know it should have been obvious, but I appreciate you throwing me some ordinary words.

St3vi3
[Nexus S General] :
UPDATE: I/O formula compensated for kernels with the FSYNC patch.

Correction formula details available if anyone wants them.

UPDATE: Surfwax binder being removed from calculations, not correlated to I/O score.

UPDATE: AnTuTu 2D and Quadrant 2D removed from calculations, not correlated to Gfx score.

Kernel scoring system is now so accurate it is ridiculous.
[Nexus S General] tchaari:
That's what I call benchmarking the benchmarks :D
[Nexus S General] glennkaonang:
So, the results have changed drastically, bedalus?

I saw that those which previously scored high have dropped down now.
[Nexus S General] :
Haha brilliant... I remember that idea was supposed to be a joke at first! Now it's actually happened! LOL! :D

kernels ; battery ; ROM ; gov/sched

Now with summaries in the first posts. Convenient for XDA app users!
[Nexus S General] :
Yeah, I've translated sql results so regardless of whether the kernel has an fsync patch or not, the io scores will be fair. Also two kernels offer no 56fps versions, so have been penalised 7% in gfx.
[Nexus S General] steve.garon:
Removing fsync from the equation make the result unrealiable. Removing fsync is not just to score high in benchmark, it has real world performance increase especially with database operations, especially on the stock database driver. It also has real life performance improvement on app that modify the same file over and over like logs.

The RL db benchmark app as really accurate result for db speed and I don't think you should ignore the results. You can give them a bit smaller importance but not ignore them. I hope this is what you did.
[Nexus S General] flodb113:
Many variables should be eliminated. It should be done in airplane mode, screen always on, absolutely no interraction, idealy with only stock rom. That would take a lot of time and the process would be too slow to keep up with updates. As I said before, he has a life, what he did so far is great and all credits go to him:beer:

Transmitted from somewhere in space... from my Nexus S... and Tapatalk.
[Nexus S General] brenix:
You could try this. Its made a nice improvement to my 2d/3d scores.. However, it may not play nicely if you utilize liveoc..
[Nexus S General] steve.garon:
That's not good enough. Who care about airplane mode batt life. Nobody use their phone in airplane mode. Maybe a kernel would have great batt life in Airplane mode but will just suck when everything is turned on. And usage battery life has too much variables to compare.

Yeah I saw that commit the other day. Might give it a shot! I hope it does not make the phone unstable.
[Nexus S General] :
They all work in ICS, not sure what exactly would constitute actual support as such.

Sent from my SNES
[Nexus S General] krarvind:
They all look good because of the ROM it's running on :p. Nice work bedalus, keep it up.
[Nexus S General] TheLastMirana:
amazing work thanks!
[Nexus S General] HGhertel1:
Strange!

With Matr1x v14.5 i`ve got 2900 Points in Quadrant

With Eugenes Kernel Speedy-3 i`ve got only 1600 Points
[Nexus S General] HolymighT:
Nice Job ..

Easy Way To Choose One of Em
[Nexus S General] :
I'm only speculating, but perhaps you had one overclocked more? I'm fairly certain other members can corroborate as to whether it's possible to get this score on Quadrant for Eugene's kernel?
[Nexus S General] HGhertel1:
No i don´t have other overclocks i run at 1,2Ghz. It would be nice if someone can also test it.

SIO in Matr1x is working very well i think.

Eugene doesnt have it
[Nexus S General] simms22:
thank you for your efforts!

but these results are skewed. since some kernels are clocked down, and some arent, the results arent accurate. i dont think a kernel made to be 1.1ghz but clocked down to 1ghz will perform as good as a kernel made to be 1ghz, or be able to compete with a 1.1ghz kernel that cant be clocked down. maybe you should compare 1ghz kernels against other 1ghz kernels, and 1.1ghz kernels against other 1.1ghz kernels. that said, im still impressed with your effort. thank you :)
[Nexus S General] Cybergr:
Very cool and interesting idea to post a Kernel comparison in here bedalus..!!

PS : Look in the data sheet column G line 22 and then column H same line..
[Nexus S General] :
Good save! Corrected and thanks

Sent from my SNES
[Nexus S General] :
I did wrestle with leaving morfic's work as intended, perhaps i will rerun it. I pulled the most recent 'barebones' kernel from his thread. Is there one with all the usual features to test?

Sent from my SNES
[Nexus S General] Cybergr:
Yes but it appears that there are only two kernels right now to run at 1.1 Ghz by default Steve`s and Reddv1 Lucid...So bedalus can simple move them to the end and separate them from the others!!

You welcome mate!
[Nexus S General] simms22:
no, they are all bare boned for now. but heres a new t11 compiled with a different toolchain http://goo.gl/WmJL3

---------- Post added at 02:34 PM ---------- Previous post was at 02:32 PM ----------

t11 runs at 1.1ghz by default. clocked down, its not the same. clocking any kernel down isnt the same actually.
[Nexus S General] :
Thanks sims22, i will add that one in but it'll have to wait until tomorrow morning unfortunately.

Sent from my SNES
[Nexus S General] Cybergr:
Yes u are right..T11 running at 1.1 Ghz by default..didn`t pay attention on that!
[Nexus S General] simms22:
no hurry..

i think with some time to weed out inaccuracies, this thread will be a gold mine of information. its a great idea :)
[Nexus S General] :
Got it all set up for tomorrow. Just had a dirty little go with AnTuTu and it looks promising...

Sent from my SNES
[Nexus S General] :
I think you have a point. Here's what I did:

Out of 62 kernel results with normal fsync and 19 kernel results with fsync patch, I produced a graph of SQL results against overall I/O. Have a look at the attached images. One is before the correction, the other is after.

After my correction, you can see the SQL results are all on the same trendline.

This is good because the FSYNC patch was adding 18% to the overall I/O score.

I could offer a weighted result, so that the FSYNC patch will give a small performance advantage, but not as much as 18%!

It's difficult to say how much of an improvement this is over the stock driver. If a user is working with a database centric app, then this patch will be very useful. But I bet a lot of users mostly want better gaming performance. I'm sure games need to constantly store and update data. But I just have no idea what the difference will feel like.

I will have to do an experiment with the RL benchmark you mentioned. I will compare to similar kernels with and without fsync, and establish what the percentage difference should really be.
[Nexus S General] steve.garon:
I agree that 18% on the overall IO score might be too much because it has next to none effect on actual write to SD speed. But in the other hand, it does make DB writes 2.5 times faster going from 90 sec to about 35 sec. This speed improvement is huge and actually shows in app that uses DB a lot. So the distribution in your second graph is flawed since it shows no difference between the two. I cannot come up with an actual number that would make sense. The only way I can see this resolved is actually separating IO and DB scores...
[Nexus S General] :
Yeah, I guess it makes more sense to separate them out. I'll insert a DB row in the overall scores section. Cheers Steve!
[Nexus S General] bluelyd:
Before you changed like this, I agreed to almost of result. And I absolutely trusted you and your study because I think so too.

But after you have changed the method of banchmark, it makes me feel "oh! it's not real for my experience".

I've flashed many roms over 50 times(:D) and used it daily. And I never thought "Stock-kernel performs better than custom-kernel(AIR or GlaDos)" about Gaming, web surfing, at Home-screen, app-drawer, especially some cleaning-apps, Virus scanning speed or DB reading speed, ETC. I can feel AIR(worse than stock in this benchmark) is much better than stock kernel easily.

Frankly, benchmark does not means all. But it will be the best way to know "the best performing kernel". So I think it should be closer to our feeling.:D,

How about avoiding discard the "FSync score", it would be one of the "Closer to reality".

If my article rude, please forgive me. It just because of my poor English, I really respect you and thank you always.:)

EDIT : While I am writing this article for long time(about 30min:D), Steve and you have already talked about that. I didn't know and thanks for that decision.
[Nexus S General] :
Yes, I think it is better with the Database scores separate from IO. Thanks for your article, and edit!
[Nexus S General] :
Ok, done. :)

Too bad about my compensation formula. It used (scary booming voice) "ALGEBRA".
[Nexus S General] :
Morfic T132-I bare boned @1320MHz dl. here: http://goo.gl/7dZXC

For people asking where t132-i is.

kernels ; battery ; ROM ; gov/sched

Now with summaries in the first posts. Convenient for XDA app users!
[Nexus S General] steve.garon:
I just found out today that GLbenchmark had their app in the android market. I think the result of this app would bring more accurate graphic result to your benchmarks. The rationale behind this is that test that end up being at 56 fps or 65 fps depending of your kernel hz are useless. They are maxed out by refresh rate of your screen. Most of the scores on GLBenchmark scored in the 30ish fps. Witch leaves plenty of room before reaching 56 / 65 fps. What I don't like about the results right now is that a kernel like T32 should crush a stock 1ghz kernel in 3D bench but it doesn't really show that in the results.
[Nexus S General] :
Good point Steve. It'd be nice to have more accuracy. I'll check it out!
[Nexus S General] :
Yeah ok, that's an amazing app! I've just run the full works with your 27th Feb kernel. Since it provides raw data (i.e. the number of frames displayed), I'll just run a selection of the most strenuous tests:

Egypt Offscreen

Trig balanced

Branch balanced

Triangle texture fragment lit

UPDATE: I've removed Quadrant and Nenamark, they seem irrelevant now. They're just slowing down the whole process. This GLBenchmark is far superior.

Kernels re-tested so far:

T132

T132-I

SG-NS-ICS 27FEB version

Air Kernel 3.4.5

Speedy-7

Cyanogenmod kernel 3.3

Glados 2.10

Matr1x 17.5

Simple Kernel 1.11

Stock (3.0.8)

Franco 1.2+

Thalamus r1beta

Peter Alfonso bugless beast kernel (16th feb)

Netarchy yerbamate 1.03

TEUV

T11

T12
[Nexus S General] :
UPDATE: All kernels Gfx scores retested with new more accurate system

Also updated the variability info for each test.

CPU	0.88%

RAM	0.94%

I/O	6.79%

Database	4.81% (only counts half towards overall total)

Graphics	2%

Overall variability is 2.6%
[Nexus S General] glennkaonang:
Bedalus, could we have _thalamus' latest stable kernel benchmarked?

The base's been patched to 3.0.23.

It's been confirmed to be stable and stickied to the forum by _thalamus himself.

Thanks.

Here's the link: http://forum.oxygen.im/viewtopic.php?id=2272
[Nexus S General] :
I'm on it! Thanks for the tip. Results up soon.

Glenn are you running the latest Bugless Beast nightly? Results show a significant improvement in performance.

EDIT: Done, Thalamus 3.0.23 added!
[Nexus S General] glennkaonang:
I was, and yes Bugless Beast has never let me down.

But now I'm trying to run stock 4.0.4 since I've never flashed it before.

What I noticed is that, almost all 4.0.3 ROMs keep my phone awake many times although I have disabled almost everything.

Running 4.0.4 now, and the awake time is normal, just like in GB.
[Nexus S General] :
Oh that's good news!

kernels ; battery ; ROM ; gov/sched

Now with summaries in the first posts. Convenient for XDA app users!
[Nexus S General] android_nexus:
CM9 04-MAR Default Kernel

kernel in new nighlies is smaller and faster at boot.

Also kernel is upgraded to 3.0.23

...

followed that post

http://xdaforums.com/showthread.php?p=22485600#post22485600
[Nexus S General] :
UPDATE: Cyanogenmod 9 v3.4 kernel benched!

Thanks android_nexus!
[Nexus S General] android_nexus:
Thanks a lot, bedalus :)

btw, that kernel not v3.4 but nightly 04-MAR

http://download.cyanogenmod.com/?device=crespo
[Nexus S General] :
Ok, thanks, I'll revise its title in the morning

kernels ; battery ; ROM ; gov/sched

Now with summaries in the first posts. Convenient for XDA app users!
[Nexus S General] atxbang56:
any benchmark for Anidroid Hardened kernel ?

here it is :

http://xdaforums.com/showthread.php?t=1525257
[Nexus S General] :
I'll get on it after work! Thanks for the tip!

kernels ; battery ; ROM ; gov/sched

Now with summaries in the first posts. Convenient for XDA app users!
[Nexus S General] atxbang56:
I use this kernel and it's awesome to see how fast the phone is with it (running Pixel ROM 1.60 Fully Touched)
[Nexus S General] :
Unfortunately I got home from work late, and we're going on holiday tonight, so it'll have to wait for a few days, sorry!
[Nexus S General] atxbang56:
well no probs at all for me, I just wanna say for those who would like to try that kernel that this is the best one I've ever used.
[Nexus S General] migz012788:
need tips and help guys. I am doing so many trial and errors just to fit my needs on my nexus s. I am more on HD gaming like shadowgun. Please help me from choosing a good kernel that runs smootly on HD games. Thanks :)

Edit: and help me also for rom that is good for gaming. But i am currently using aosp codename and its good
[Nexus S General] atxbang56:
I use Pixel ROM 1.60 Fully Touched and Anidroid Hardened Kernel (@1.3 GHZ, Lulzactive, noop) and Shadowgun is really smooth (the same for Sims For Free, 9mm works good too)
[Nexus S General] simms22:
heres a kernel that needs benching.. t132-muenchhausen http://goo.gl/2mXfy
[Nexus S General] :
Thanks Simms22 I'll do it as soon as I'm back from my holiday :)

kernels ; battery ; ROM ; gov/sched

Now with summaries in the first posts. Convenient for XDA app users!
[Nexus S General] simms22:
oh, your on holiday? nice!!!!!!!

enjoy :D
[Nexus S General] :
Although I'm still flashing, but only at reduced capacity. Trying not to drop phone into beer

kernels ; battery ; ROM ; gov/sched

Now with summaries in the first posts. Convenient for XDA app users!
[Nexus S General] dinos3:
Enjoy in holidays ;)
[Nexus S General] mechagodzilla:
Thanks for the stats. This is my go-to for kernel selection.

By the way, I found that the latest CM9 nightly kernel and the rdata kernel both encrypt properly, but that matr1x and trinity invariably reboot and abort the encryption process. Would it be worth adding a stat after more testing?
[Nexus S General] Harbb:
Likely more to do with the undervolting in matr1x and overclocking (or UV) in trinity. Can't really do much about trinity besides try a different trinity version. Matr1x you can raise the voltage up through NSTools.
[Nexus S General] :
UPDATE: Air Kernel 3.5 benched!
[Nexus S General] :
T132 Münchhausen results are up! Check the RAM!
[Nexus S General] simms22:
nice numbers!
[Nexus S General] DiRT_360:
please, benchmark AniDroid-Hardened beta 3 kernel.

there: http://xdaforums.com/showthread.php?t=1525257
[Nexus S General] :
I've recently posted in that thread about how I'm waiting for the stable release, which is due any minute now
[Nexus S General] Jamalsid:
Holy $*** how is that possible?
[Nexus S General] :
Morfic came up with some way of releasing RAM from the camera/video. Check his thread http://xdaforums.com/showthread.php?t=1036996&page=902 and read onward from post #9017
[Nexus S General] simms22:
ive got a challenge for you. its a t144-mh-spice http://goo.gl/lPQhU

its from the muenchhausen line of kernels. only this one is different, this one boots to 1ghz. i know how your phone doesnt like t144, but would you check if your phone like this t144?
[Nexus S General] :
It would be my pleasure!
[Nexus S General] :
Arse, no dice. Boots but after setting max to 1440 it reboots.
[Nexus S General] simms22:
oh well, was worth a try :(
[Nexus S General] :
UPDATE: Thalamus Kernel 3.0.24r1 benched!

Why the hell am I up at 4am UK time? Hope I don't get called into work tomorrow!
[Nexus S General] glennkaonang:
Bedalus, a friend of mine asked and I couldn't really give him a detailed answer.

What does Database score indicate exactly?

Am I right saying it's related to I/O?

Thanks.
[Nexus S General] :
Database performance affects a lot of apps, because most programs will store some data in a database. I used to contain database in I/O but separated it out because the scores are so wildy different on kernels with FSYNC (file sync) removed (more risk of data corruption though).
[Nexus S General] :
UPDATE: AniDroid Hardened Kernel Beta 4 by novic_dev

Has a sleep of death issue at the moment, do not flash.
[Nexus S General] bluelyd:
Matrix 18.0 is released~! :D

http://xdaforums.com/showthread.php?t=1361477

Thank you for your work, always.:)
[Nexus S General] :
It came out just as I was going to bed. 4AM, 5AM, what's the difference? Results up soon
[Nexus S General] bluelyd:
v18.0 Updated kernel base to 3.0.24, added byeonggon's Selective LiveOC, added SWAP capabilities, and added some performance tweaks.

I think kernel base update is the biggest update :p
[Nexus S General] :
No, I don't mean what is the difference between his kernel versions!

I meant that I was tired, should be in bed, but might as well stay up even later since I'm already set up to benchmark!
[Nexus S General] :
UPDATE: Matr1x v18.0 CFS benched!
[Nexus S General] :
UPDATE: Air Kenerl 3.6 benched!
[Nexus S General] AliensDroid:
so for now the kernel which is the best?
[Nexus S General] :
There's only a best kernel for you. Try them all! Let us know what you find.

kernels ; battery ; ROM ; gov/sched

Now with summaries in the first posts. Convenient for XDA app users!
[Nexus S General] glennkaonang:
I agree, try them all and see it yourself.

IMO, the best kernel is the one that works and doesn't give you random reboots.

I was once in his shoes when having this phone for the first time.

But then I just tried almost all of the kernels available and finally I found one that fits me best.

Different people have different preferences.

So just see which one suits your taste.
[Nexus S General] :
UPDATE: AniDroid Milestone 1 benchmarked (45fps)
[Nexus S General] dinos3:
Why you dont bench Morfic's t144 kernel?
[Nexus S General] simms22:
he has tried, on many occasions. his phone doesnt like t144. im still trying to figure out how to get bedalus's phone to run t144 :(
[Nexus S General] dinos3:
Good luck :D
[Nexus S General] LKNim:
I don't think it's possible, every CPU have different overclockability, I overclock so much on PC and it's my experience.

If you can figure out how every one can run 100M within 10s, you can figure out how to make every NS run 1440MHz stably.

It's glad that my phone can run 1400MHz daily but it freeze with 3D games. Even 1100MHz it still get freeze. The maximum stable frequency for my phone is 1000MHz×105%, even TEUV will give me reboots, my phone can't handle 210MHz bus, no matter how is the voltage, it can't handle it. Just like no matter how I was trained, I can't run 100M within 10s:rolleyes:
[Nexus S General] simms22:
my phone runs 1440mhz stably, never a hiccup even(t144 has a bus of 240mhz btw). maybe, just maybe, with a little more voltage we could get bedalus's phone to run t144. i dont think that its the overclock that his phone doesnt handle, i think its the bus. btw, teuv runs a 220mhz bus. teuv is pretty undervolted as it is, youre issue might not be the bus speed but that evil undervolt.
[Nexus S General] :
i have 1440 running right now on anidroid hardened. Bus is 200 of course.

But t144 did boot despite the bus, but only at 1000.

Maybe try the maximum possible volts on the arm and int?

kernels ; battery ; ROM ; gov/sched

Now with summaries in the first posts. Convenient for XDA app users!
[Nexus S General] afzalarsalan:
Could you test the SlimSG kernel here, beladus? I have heard that the slimness has really sped up the performance :D. There are two versions with and without FileSync. I would personally prefer you test the one without FileSync if you have to chose between them as that version is supposed to be faster.
[Nexus S General] :
I can't add those into the spreadsheet because they don't have ondemand as an option. All the kernels here are tested with ondemand fixed at either 1000 or whatever the intended frequency is (if 1000 not available). I wish I'd chosen performance to be honest.
[Nexus S General] afzalarsalan:
I see then. Oh well thanks for the quick reply and like they say "it's not about the benchmarks" although they help.