yashsingh1/xdaforums huggingface dataset:
[EVO 4G General] HipKat:
Yeah, King's Ultra and the Koni ROM's should be reviewed.

AS for VaelPak, it's VERY impressive, however, as is the case with all the Sense ROMs I've used, battery life is terrible. I dropped 6% in 30 minutes, 11% in an hour, nandroided back to Cm7 Nightly 12 and it's stable again.

I might give VaelPak another try, with a different kernel than the stock (I think the OP said he uses a different one, but I didn't have time before work to changeanything).
[EVO 4G General] skydeaner:
Damn I can't believe the results of the SZ .2.1's that is damn impressive on the battery front. I have noticed the battery on it being extremely good all along, but now even better, it is gonna be great for my trip to Florida this summer, even if it doesn't get any better LOL
[EVO 4G General] :
The new savagedzen kernel is damn near perfect
[EVO 4G General] skydeaner:
I agree wholeheartedly. And I am glad that all that they forgot in the 2.0 was hdmi so I didn't have to retest the 2.1 LOLOL

But yeah, it really has amazing battery life. Like HTC15 amazing, but with much more power. I don't know how they could squeeze all that out of the Evo, I mean it is a wonderful machine, but damn, they really make it work up to it's potential.
[EVO 4G General] Award Tour:
Got to agree. All that's left is for Google/HTC to release those new N1 Adreno 200 GPU drivers, then all is perfect.
[EVO 4G General] Rippley05:
Which one are you using? 2.0 SBC/no SBC, CFS/BFS?

I'm on 0.1.2 no SBC, CFS version so I thinking about trying to SBC kernels outs.
[EVO 4G General] kingdazy:
TMR;DR

(to much red, didn't read)

I love the stuff you do, but man, could you tone down the OP red+impact a bit? ;)

It makes me run away from the OP as fast as I can.
[EVO 4G General] Rippley05:
+1

I couldn't get through all of it because it hurts to read. Not at all knocking the content tho
[EVO 4G General] Atticustrd:
Does that kernel work for sense roms?
[EVO 4G General] skydeaner:
Ok i'll get rid of the red lol

edit

ok got rid of most of it LOLOL

I like red, it reminds me of the phone. But I cleaned a ton of crap up.
[EVO 4G General] daamayzn:
Wow! I tip my hat to you sir...Incredible work and write up
[EVO 4G General] raikoujin:
is the site that the link point to down for good?
[EVO 4G General] gtpguy:
Site is down

Looked like this was the info I needed .. but now the site is down. :-(
[EVO 4G General] onlinespending:
I know this thread has long been dead, but I'm curious what apps were used to perform the benchmarking done by the OP. I'd like to do a similar thing with some of the newer AOSP kernels, and would be more than happy to share the results.

How were Quadrant, Linpack, and Battery mA usage measured?

Thanks!
[EVO 4G General] PAinguINx:
Suggestions...

Hi guys, I'm about to flash MikG v3.0 to my friends EVO 4G. Any suggestions on a good, solid kernel to use with this ROM?

Thanks!!!
[EVO 4G General] daviss:
Your kids are in diapers and eat taco bell?
[EVO 4G General] skydeaner:
Dude, they love them some tacos. I have a one year old and a two year old and they both tear up some tacos. But we don't eat out very often so it is like a forbidden fruit to them, that's why they slam them down when they get them lol. The one year old puts away more food than the two year old lol. His little 8 teeth put in some work.
[EVO 4G General] iamfender:
I put it all in a google docs spreadsheet and added some columns for performance/battery usage.

sigh... I'm too new to post links, so stick h t t p s : / / on the front

spreadsheets.google.com/ccc?key=0AmSFgKikJ9qFdDFnblIzZjZfdFJWaldtTTZocjkzSUE&hl=en
[EVO 4G General] catseyenu:
skydeaner, I've flashed [Link removed due to board restrictions] Stock 3.29.651.5 OTA With Root (Odex). I don't see this build on your chart, or am I missing something?

FWIW, Fps2d showed a jump from 29 to 53 fps but the stdev is 9.35 with all bloat aboard & running. If I understand correctly this isn't so good.?
[EVO 4G General] iamfender:
catseyenu make sure setCPU is set to max(998/998) when running fps2d. You should see 1 - 3 stddev then.
[EVO 4G General] toastcfh:
Didn't see 2.6.34 tested... or did I miss it in there? Anyhow I was just wondering how it compared.

@netarchy Congrats. Looks like it dominated in benchmarks :)
[EVO 4G General] NinjaPenguin:
Amazing work Sky. Any plans to do a Sense rom vs AOSP? Like try Fresh vs Vael. Just a thought
[EVO 4G General] skydeaner:
.34 kernels haven't been tested yet. get me one that is actually stable on Htc ota builds and i'll test it tonight. It will get tested on cyanogen though when I test all the aosp kernels sometime this week or next.

@iamfender thanks for the data. What is your aim or Google voice. Pm me I have questions.
[EVO 4G General] spiicytuna:
The analogy we give in the SNAP thread is that of adding a 7200rpm hard drive to a machine that had a 4200rpm drive before. The processing power doesn't go up but the overall smoothness and efficiency does and wow what a difference. Or has anyone bought a "name brand" dept store computer i.e. Compaq, and every time it starts us it takes forever to load, then after removing all of the Compaq "crap" that loads during startup, a reboot will feel night and day.... again this wouldn't affect the over processing power of the computer, or the "linpack", but yet the user experience would be greatly improved coupled with a smoother user interface. Tweaks along these lines are what Turbo is aiming to tweak....nothing that's going to allow for more processing power, but yet gives a better, smoother, user experience. The EVO, just as a computer, is only as fast/strong as it's weakest link(s).

PS. We'd love to be included on the list. I agree with what netarchy said about being able to visually see where we could/should improve.

'tuna
[EVO 4G General] skydeaner:
I get all nervous when the "real devs" post in my thread lol. I feel like i won some sort of award or something haha.

Thanks for the response on snap turbo. You can really really tell a difference, you did an amazing job. I'll make sure to get results up by friday. I should be able to get it all done over the weekend.
[EVO 4G General] funcrusher:
This seriously made me lol.

Great thread--always nice to see comparisons.
[EVO 4G General] spiicytuna:
No rush on the results... we just wanted to be included if it wasn't too much trouble. I personally (i.e. I am flashing/nandroiding/testing like 20x, at times, when trying out new crazy ideas) know how much time/work you had to put in to test all of these kernels and run them through their paces. Excellent work.

'tuna
[EVO 4G General] skydeaner:
I redid the page in red and black evo style, laid the framework for aosp testing and a combined overview of all kernels. And i uploaded all the kernels to my server at comcast so everyone can have fast downloads of them. Dev's of individual kernels feel free to add my downloads to the mirror section of your threads. I get really aggrevated trying to download roms and whatnot from putfile and crap sites like that. They just bumped by docsis3 cable up to 100 megabits and i barely get 300Kb/sec from those type of sites.(i get 12MB/Sec from torrents lol... thats megaBYTES not megaBITS) Of course along with the kernels there is a link to vaelek's awesome rom. I will be putting cyanogenmod on there too as soon as all the testing is done.

On that note, what nightly version of cyan should i use in testing? I need it to be 100% stable but i dont want it to be as old as the final release from the 12th or whenever it was. I have used the 24th nightly for a while, does anyone have any objections to me using that, or has he made some sigjificant changes since then?

Yea spicytuna, i wish nandroiding was faster lol

I tried to make this site without any pictures other than the graphs, in case you are checking it out over 3g or slower, i don't want it to take forever.
[EVO 4G General] Award Tour:
I think that you should test on the stable version and on a nightly. IMO, you can't ignore the stable. Nightly's are not even alphas and change way too much. I know that a lot of people like to experiment but the stables are, well, stables for a reason.
[EVO 4G General] skydeaner:
Well i know the 9/24 is an excellent build. I think i'm just going to use that since i have used it a long time without any problems.

I don't want to use anything as outdated as the stable release honestly.
[EVO 4G General] -shift-:
can't wait to see the updated results with aosp kernels! nice job skydeaner!!

:D
[EVO 4G General] Award Tour:
Two days is a long time? Since when? The stable release is not outdated, it's the latest official build. Nightly's are purely experimental; I know this isn't a production level test but no company would ever handle testing like that.
[EVO 4G General] n10secapricorn:
Nice work on the comparison. I was recently running netarchy's 4.1.9.1 cfs kernel and loved it, but I switched to the Kings #9 to regain full use of my 8MP camera instead of having it downgraded to 3MP with the other kernel. I've seen the King has just dropped a new kernel, so I'm going to give that one a shot.
[EVO 4G General] skydeaner:
Maybe i wasn't clear. 9/24 was the nightly release i have been using that i deemed stable by using it myself. The last "stable" build was released on 8/28 according to the cyanogenmod thread. That IS a long time. I have read many places where performance has improved since then, and supersonic is making a rom now based off of the 9/21 nightly.

I am sure cyanogen is very close to releasing another version. The 9/24 nightly is what all the AOSP tests will be based off of because I want to give cyan a chance to include the new performance enhancements (whatever he may have done) in the results.

It would be retarded to use a month old rom that has been worked on every day since then. Any company would do it this way if they had access to newer versions before they were released.
[EVO 4G General] cruecu:
Would like to see King's cfs 9 kernel in the test. A lot of us like that one.
[EVO 4G General] skydeaner:
I'm already done with the testing on that, just need to regraph and upload. and the bfs10
[EVO 4G General] Award Tour:
You're the one doing the testing, and it seems you've already finished, so it's ultimately up to you. But no, a company wouldn't do it that way. The stable release is the public release; and under normal circumstances, would be used by more people. I could understand testing beta/alpha/pre-alpha's for comparison but it's weird to not test the public stable version. That's all I'm saying.

Nighty's have no guarantees of not being broken and only are accessible for debugging and pleasing the crack feigns.
[EVO 4G General] Android 17:
Nice job OP, lots of good info on your site.
[EVO 4G General] catseyenu:
Thank you, I hadn't installed the setCPU app.

Using setCPU dropped stddev as you said but I also noticed some screen hesitations so I pulled it for now. It may just need tweaking so until I have time to read up it's on the back burner.
[EVO 4G General] DrawnToScale:
Noob question here. I just rooted my phone over the weekend using Unrevoked3, obtained Titanium Backup, did my first backup and so far so good. I'm still using the stock rom & kernel, with recent OTA update with FPS cap fix. My question is: If I flash a new kernel and have a problem - can I go into recovery and restore my old system - including the previous kernel from Nand?

Thanks!
[EVO 4G General] jerryparid:
Where is Backed Snacks #6, Hero_over's default/best kernel?
[EVO 4G General] skydeaner:
You won't be able to do this with titanium backup, if that is what you are asking.

you can do it by going into recovery and doing a "nandroid backup". Then if anything goes wrong you can boot back into recovery and do a restore.

titanium backup doesn't go deep enough to grab the kernel, so to speak.
[EVO 4G General] skydeaner:
Yeah I guess you are right. It is weird, but cyano-users seem to be extremists. If there wasn't about to be another release based off of the current nightly's, or if there werent any performance improvements I would just use the month old one. Chances are, if you are intelligent enough to use cyanogenmod rom's and deal with the missing features to get AOSP everything and squeeze the last bit of performance out of the phone, then you probably aren't going to use a month old version of it when there is newer available that performs better.
[EVO 4G General] skydeaner:
Sorry bud, I must have missed it. I'll make sure to include it this next update for ya.

EDIT:

Ahhhh, i see what happened. there is no download link to it because it is normally included in the rom. I pm'd him to get it as a flashable update, so as long as he sends it to me I'll get it on there. Sorry again.
[EVO 4G General] kho3000:
So... another noob question.

To flash a kernel and ROM - do we just back up, wipe cache and dalvik then flash the ROM then the kernel just like we'd flash a ROM and/or theme normally?
[EVO 4G General] skydeaner:
Yeah the downloads I linked are made to be flashable like any other rom or theme after you clear dalvik/cache. Bear (bare? lol) in mind that the netarchy kernels i have available for download are the DC versions, so don't use them on any roms except dc based roms or Vaelpak.
[EVO 4G General] kho3000:
Excellent that totally helps, thank you.

Now one last question... regarding the kernels and more specifically, "BFS" and "CFS"... is there a right one or wrong one or simply just preference.

This may be something quite easy, I just couldn't' find anything that specifically explains the difference.

Thanks again.
[EVO 4G General] smarmytime:
Sub-noob question here, so much so that I feel bad asking...I'm running netarchys rom and kernel, and while I like it a lot, it's the first one I've tried, and would like to try some others as well. I've backed up my apps with Titanium; after flashing a new rom, I download titanium again and will be able to restore apps with it?
[EVO 4G General] zone23:
I thought Kings #9 seemed to be about the best overall.
[EVO 4G General] zone23:
Believe me if there was a right or a wrong the wrong wouldn't be posted.
[EVO 4G General] netarchy:
erm, 4.x builds of my kernels are not limited to 3mp and never have been. the 3.x builds were because they were based on a 2.6.29 base.
[EVO 4G General] skydeaner:
indeed. Did you make sure to clear cache and dalvik?
[EVO 4G General] skydeaner:
AOSPs including snap turbo!!! coming tonight. Will be finished for sure.

Out of the box testing will begin tonight. And although I can't find the post, thank you very much to whoever suggested it, i love this idea. Maybe you editted it away, but i can't find the post now lol. Aiming for the end of the week on that though.

Kings 9cfs and 10bfs will be uploaded tonight as well as HTC kernel 11

After that i have plans to take the best kernel from net, king, and htc11 and do a fresh vs vael, thank you very much for suggesting this ninja penguin
[EVO 4G General] toastcfh:
Ill be looking out for this aosp test. Can't wait to see the results. Good job again :)
[EVO 4G General] eldowan:
Indeed, this is a most excellent thread.
[EVO 4G General] skydeaner:
thank you all for the kind words... just waiting to get off of work... come on next shift get your tail in here. Don't make me fire a mofo over pleasing xda!

Edit

Sorry peeps. I fell asleep when i got home watxhing the cat in the hat with my 1 year old. Ill make sure tthat doesnt happen again tonight lol
[EVO 4G General] JArcher84:
the power draws is what I'm mostly looking at, all the other stuff I could care less about
[EVO 4G General] topdawgn8:
Please forgive me if this has been covered....apparently the xda servers are at max capacity and I couldn't move to the other pages.

I have an idea for a helpful metric. Give a score to each kernel on each test, add them up, and then set up a graph to compare kernels for the best "overall".

This could be as simple as running 1,2,3,4,5...etc. down the columns next to the results and then suming the totals across worksheets. Sorry if my description isn't too clear. I could pull this together if you would like...it'd only take about two minutes. I would just need the source data. PM me if interested.
[EVO 4G General] skydeaner:
I will try to think of a good way to make a composite number for each kernel based on all tests. Some of the tests higher numbers are better and some lower numbers are better, so adding them all up wouldn't work, but I'm sure it wouldn't be too hard to figure out a way, I'll look into it. Oh, just reread what you said. If you want to figure out a way and let me know that would be awesome. The less thinkin for me the better :)

UPDATE TO SITE

Notice all the graphs look different. **** you very much microsoft excel.

Some things it does great. Sorting greatest to least, averaging... easy **** like that, it is amazing at. I had to spend an hour scouring the internet finding out how instead of taking screenshots i could have it export the graphs as png/gif/jpg. If I didn't do that, the Htc/aosp combined results would have been so small from it being so long that it wouldn't be legible. So I found a vb program that i added as a macro that exports everything so that even if it extends offscreen it just ends up being a really long photo instead of being cutoff.

But I had to resize everything by hand and all that happy horsegoo, so they all look different. I tried a different graph making program and importing excel into it was such a nightmare that it wasn't worth it, so i guess everyone will just have to be happy with having the results, regardless of how ugly they are :D

Anyways, composite results are up and AOSP seperate images are uploaded and will be up later tonight. HTC seperates will be up whenever I get them graphed out, but i have to wait for a flasheable copy of HTC 11 kernel and a flasheable copy of baked kernel 6. Noone will reply to me about them. If anyone has these, please PM me or email them to ttechnology@comcast.net
[EVO 4G General] cruecu:
As soon as you get kings cfs 9 up, he puts out cfs 10 :) You can't win. How quick to get that one up? thanks for the hard work
[EVO 4G General] catseyenu:
Your "Screen Off, Minimum Freq, Idle Power Draw" is an eye popper.

Good work!
[EVO 4G General] topdawgn8:
It would be the same rating. As long as you assign the largest score to the "winner" of the cattegory and work your way down it will all aggregate fine.

Edit: Actually, a 1-10 rating based off a percentage of the top performer could be ideal. One formula and then copy the formating.

Fx=(SelectedPerformer/TopPerformerResult)*10 (Just reverse the logic for situations where smaller is better.)
[EVO 4G General] JArcher84:
could you change the background color(red) to something new, killing me eyes. lol
[EVO 4G General] Award Tour:
Looks like AOSP/CM is king. Better battery life and better performance (and IMO, better experience). Also surprising to see how much better Snap 7.5 is in regards to battery life.
[EVO 4G General] datajosh:
Seconding this suggestion, love the info on the site but it's a little hard to read sometimes :)
[EVO 4G General] skydeaner:
Ok ill change the background lol
[EVO 4G General] JArcher84:
haha Thank you...
[EVO 4G General] skydeaner:
Cfs10 lookw like it should be quite different, i'll get it up with the aosp results prolly tonight, wont have it integrated into the composite charts til tomorrow at least.

Yeah... it appears kingxklick cares little about my schedule lol

Yea i was pretty suprised by the results on that, i would say that is my favorite one, most peoples phones stay idle a majority of the time. Unless they are kids home for the summer, then they have to be attached to a wall outlet they are on it so much

Just so no one else has to test this out, i just tried it and YES the touchscreen does work with your tongue...
[EVO 4G General] tatnai:
awesome work here. looking forward to the latest HTC stock kernel results (assuming that's what you're calling #11). true contribution to the community here.
[EVO 4G General] skydeaner:
Yeah it is the most recent unreleased ota's kernel. it has an 11 in it sumwhere lol.. maybe. Someone called it number 11 haha.
[EVO 4G General] m4rk0358:
I would assume I am not seeing scores like the ones posted because you guys are testing phones with virtually no apps on them and using very particular SetCPU settings. Am I correct? Because in real world scenarios I'm not getting the type of results from kernels that I am seeing.
[EVO 4G General] skydeaner:
Download vaelpak and give it a shot. You should have very similar scores. On my everyday build of vaelpak (not the barebones one i used in testing) I get almost identical scores most of the time.

What rom are you using?

Also, Website background update is uploading right now so you might not be able to access the site for a while. It is taking significantly longer to upload cuz I'm at work. I got my upstream at home bumped up to 10mb, downstream to 100mb. here at work it is 2mb/2mb sync adsl.... VOMIT
[EVO 4G General] m4rk0358:
I'm on Baked Snack 1.8 with King's cfs #10 right now but I used a couple of other kernels with similar results I'm seeing with this one. Nothing terrible but not as good as what you're reporting.

Swyped from my EVO
[EVO 4G General] dtrammell:
DUDE! Where do you live that you get u/d of 10/100?!? Now I really hate Comcast...
[EVO 4G General] skydeaner:
LOL XFINITY IN MY AREA ROCKS

docsis3.0 is the ****. i had to get a new modem to support multichannel data or i couldnt get over 30mb, but it is far worth the 65 a month
[EVO 4G General] toastcfh:
Ah man u didn't do cm kernel :/ any chance u can test it also?
[EVO 4G General] skydeaner:
Pictures and website are being updated. Links are broken atm til I fix them.

What you mean toast? Like the kernel that is preinstalled on cm?

I have it down to a science now, adding new kernels is pretty easy at this point.
[EVO 4G General] skydeaner:
if you meant the default that comes with it, it is now included in the results :)

UPDATE TO WEBSITE::

All sections up with graphs. Updated with htc11, netarchy 5 alpha (benchs only, not battery), and cm default kernel.:D
[EVO 4G General] Sporkman:
ill stick with snaps 7.6 turbo
[EVO 4G General] skydeaner:
yeah it owns quadrant score wise.

If i could stand cyanogenmod's tiny defects then I would definitely be on the turbo.

I use my camera and camcorder several times daily, and my wifi signal is fubar and inconsistent with it, and I just cant deal with that as 90 percent of the day i'm on wifi.

Anyone wanna download from my site wanna and let me know if it saturates your bandwidth or not? If it does, does it do it with one download thread, or do you have to multithread with a download manager to saturate it? Does it allow multithread and resume?

Of course for me, i get my full bandwidth, multithread and resume, but it is straight to my isp lol, so that is to be expected.
[EVO 4G General] tpdtopcop:
Thanks op for compiling all this data. Would you know were I could download kings #6 bfs? Also thought you were gonna include baked snack 1.8 with baked snacks kernel #6?
[EVO 4G General] Minjin:
Excellent job, OP. Put your website link in your sig. You deserve more notice.
[EVO 4G General] mrcamposd:
Thanks for taking the time for testing the kernels :)
[EVO 4G General] toastcfh:
Thanx man for updating it with cm default. :) and as many have mentioned, thanx for this contribution to the community. :)
[EVO 4G General] skydeaner:
I can't get a flasheable copy of snack's 6. For some reason he didn't respond to PM. I am not going to include results from his rom as that would defeat the fairness of all kernels being tested on the same rom.

If I could get a copy of a flasheable version of baked 6 i would include it by the end of the day.

Thank you all for the kind words. Oh and kings 6 bfs is on my downloads page on the site :) along with all of the other kernels and roms.

Check out the fancy new logo i made lol. It's hilarious. Not meant to be professional lol, just kiddin around. It's on the main page of the site and first post of this thread now. he is one cool dude. That thing must weigh.. what?... like 450lb?
[EVO 4G General] kamiller42:
The new logo is awesome. Said in Arnold Schwarzenegger voice, "You cannot penetrate my muscles."