yashsingh1/xdaforums huggingface dataset:
[Captivate General] di11igaf:
No not really, this is just 1 test on 1 phone, and the results WILL vary greatly on this for other people, probably even if these test were run again they'd show different results, to the point I'm about to try this myself.

go in my Rom thread there's a user who posted a pic who's on his third day now without charging. my captivate with my Rom/ kernel is right now at 4 days, 14 hours with 30% battery left. I haven't been using it a whole lot, its only got 50 minutes screen on time but still, I'm just saying these results are not the end all of what rom has the best battery
[Captivate General] Miami_Son:
Which sounds like they are as useful as sprinklers on a rainy day.:D
[Captivate General] dizx:
I haven't done the math, but all things considered, I would guess the ROMs tested so far are pretty much even in battery life if factoring in appropriate sampling qty and standard deviation.

The tested times are all within one hour of each other.

Splitting hairs in my view.
[Captivate General] Miami_Son:
Exactly. The results are close enough that even a small error in methodology would negate their validity.

I'm not trying to be a prick. I've spent much of the past 2 decades as a magazine technical writer and product tester. I know how important test procedures and methodology are to the outcome of any comparison. While anecdotal evidence certainly has some merit, actual testing has to be under rigidly controlled conditions to be of any real value over and above what the anecdotal evidence tells you. There are just too many variable here for this to be more than just a personal exercise with little relation to our individual phones, usages and setups.
[Captivate General] mirotvorets:
hi, friends. I've tried to find any topics about the methodology of testing out devices, but i can't. so I've begun a new thread to aim to develop some algorithm of testing. if you have any thoughts about this, please welcome http://xdaforums.com/showthread.php?p=12210547 :) maybe we can develop a unified way of testing and comparison android devices
[Captivate General] dizx:
I see where you are coming from.

I still think Jivy's results are useful. Granted, it may not be the bible testing of battery life, but someone had to take the initiative to get critiqued, and thus consider other methods. This is how it always starts. :)

Kudos to Jivy for having a thick skin!

Even without the results, I've learned a few things from the posts in this thread.
[Captivate General] Miami_Son:
I hope no one takes my critique to mean I think his results are useless, that wasn't my intent. I just don't want anyone mistaking them for anything other than anecdotal no matter how rigorous he makes his methodology sound in the original post. There's so many variables, not just in the testing, but in the ROMs, connection to the network, temperatures, charging and even manufacturing of the phones and batteries that extrapolating any truly accurate result is next to impossible in this scenario. The results here should be taken as nothing more than a very rough guesstimate and the caveat of "your mileage may vary" be explicit.:cool:
[Captivate General] dizx:
Nah, I knew what you meant, and agree.
[Captivate General] askpcguy:
I happened across this thread http://xdaforums.com/showthread.php?t=935743

Maybe it'll be helpful?
[Captivate General] psycho2097:
Can you check out Juiced?? I heard its battery life is insane!!
[Captivate General] shane87:
Just stumbled accross this thread. I am glad to see someone testing battery life on these roms! I have cognition, and after three full charge cycles I am seeing pretty good battery life. Of course, I have a different modem and kernel than what shipped with cognition, and I am ocing to 1.4ghz, and uving -25mv on all oc freqs and -50 on 1ghz and below. I also run juice defender with ultimate juice, so that actually helps some I think. I am a fairly heavy user of my phone, always browsing xda!! For wat its worth, I seem to average at least 24hrs between charges, and would guess that, if left alone and not used I would see 80+ hrs. As has been posted before, though, don't expect the same results! A lot of factors go into battery life, so everyones experience will be different. Keep up the good work, and a big kudos to all the devs!!

ROM: Cognition v4.1.1

Kernel: eXistZ's KB1 #5 Voodoo Sound v4, Voodoo Color, Voodoo lagfix

Modem: I897 UCJJ4 w/ HSUPA/HSDPA enabled
[Captivate General] MikeyMike01:
Marketing.

Sent from my Captivate
[Captivate General] psycho2097:
Marketing y? What do the devs actually get from this? Its all free right? Except some donations, that is....

Anyway a lot of users reported excellent battery life.. So it may not be all marketing, no?
[Captivate General] MikeyMike01:
It's why I don't partake in the thread title look-at-me begging.

Sent from my Captivate
[Captivate General] ryude:
Oh come on, you used to do it all the time lol.
[Captivate General] di11igaf:
There's no way to optimize a Rom itself for battery besides the fixes already implemented by most(WiFi drain bug and gallery3d sensor drain bug). I'd like to know what exactly is optimized for better battery life in the Rom itself besides going through code in the framework and rewriting it which I can guarantee wasn't done, and two, even if you did that it would probably not be any better even if you could find something to help battery.
[Captivate General] bobmanfred:
Thanks!

I have been waiting for someone to do this for a while and seeing that Im in grad school couldnt/didnt have the patience to do it.
[Captivate General] diablo009:
Am I the only one seeing a pattern in declining battery life.
[Captivate General] shoman94:
You don't mind adding your 2 cents though
[Captivate General] shoman94:
I was thinking that... but I don't think that was the order of tests... but I could be wrong.
[Captivate General] psycho2097:
Only way to know for sure, test it!
[Captivate General] jivy26:
the order l listed isn't order tested
[Captivate General] MikeyMike01:
Quite the opposite, really. I put things like "slowest and most dangerous ROM"... never "SUPER FAST OMG U WILL LUV IT!!!!".

Sent from my Captivate
[Captivate General] jivy26:
Put #2 on jivy's list of nothingness lol. Dragon results posted tomorrow morning. I rarely ever test saturday because well the obvious.
[Captivate General] ryude:
There are a few things you can do, but you are correct.
[Captivate General] jivy26:
Added dragon results. Stock froyo tonight then onto new testing format :o
[Captivate General] DAGr8:
althoug I thank you for the effort ,

untill you test all roms with same kernel/modem combo it doesnt mean much.

actually take a rom and switch kernel modem combo you will see a huge diffrence.

like others have mentioned monochrome theme will also affect battery life

also the location matters as well the modem depending on the bands it will use / area it will drain battery more or less , for instance if it needs to switch bands a lot it will drain even faster .

Lastly I am curious if you test Dragon on stock kernel and stock modem how the result will differ (there attached in the thread )

what would probably the most usefull info would be to tell what is YOUR best modem/kernel combo for battery drain
[Captivate General] Miami_Son:
Dude, what happened to testing Andromeda? One of the most popular ROMs and you just quietly dropped it off the list? I've lost all respect for this test.:mad:
[Captivate General] bigsmitty64:
Front page says "currently running Andromeda"
[Captivate General] jivy26:
I'm running it tonight mis typed in the earlier post
[Captivate General] Miami_Son:
OK, you're back on my Xmas card list.:D:cool:
[Captivate General] jivy26:
All I get is a card! Lol, going to put up a poll I think to see what the majority wants as far as testing if they want same modem/kernel throughout or keep it the same way I'm doing now.
[Captivate General] ryude:
Don't know when you are doing the next test, but I hope to have Precision 4.0 done within a week or so.
[Captivate General] jivy26:
Kernel/modem combination is what the dev thought was best for his rom. Initially I intended keeping them the same, but majority wanted otherwise.

Saying results don't mean much is far from the truth simply because roms are tested how they were intended from the dev. If they wanted stock kernel/modem it would have been cooked that way. So the thing you have to keep in mind is I'm testing roms how they were released and so if you flash the rom your results "SHOULD" be similar but in no way do I guarantee that.

As for switching bands the test right now is ran over wifi and always placed in my kitchen in the same location. I will , however, be running tests utilizing data but the phone will not move from its location so switching bands will not new an issue.
[Captivate General] jivy26:
Should be starting by the weekend. Glad to hear 4.0 is coming :p
[Captivate General] Vivified:
Reading that made my day... definitely willing to beta test for you if you still need someone :)
[Captivate General] ryude:
Lol, see how many captivates I can brick huh?
[Captivate General] Vivified:
My jig says you can't perma brick me :P
[Captivate General] Miami_Son:
You have to work harder to get upgraded from just a card.:p

I think testing them as the dev made them is fine. It gives you a baseline for a ROM and adding more variables to an already highly variable and subjective test does not improve the methodology. Just do what you're doing and let people go from there if they want to mix and match.:cool:
[Captivate General] ryude:
I think it shows people that certain modems or kernels do better battery-wise than others, and also shows which ROMs have bugs that drain battery and which ROMs fixed those bugs.
[Captivate General] Miami_Son:
All those combinations could take weeks to sort out and test. If Jivy is up to it, great, but I'm not asking him to.:p
[Captivate General] Moxie3000:
Not to mention the i897 vs. i9000 issue. Your would still be testing different kernel combo.

That said, maybe testing the various kernel and modem combos could be a good idea. Pick a fairly representative ROM or two (for the base diffs mentioned above).
[Captivate General] ytt3r:
Its too bad you're testing Andromeda, we might have a new release soon...
[Captivate General] jivy26:
Power went out last night so gonna retest andromeda tonight.

After I get through my second way of testing I might very well start testing the modem/kernel combination that is commonly at the top on the worst performers and vice versa. There is so many ways to test and hopefully when I'm done I will have covered most. Also I was thinking of eventually testing modem kernels variations on stock and posting results comparative to stock.
[Captivate General] squarooticus:
Am now using the CM7 beta, and it easily blows away the previous ROMs I was using (di11i, Cognition, Perception). Having come from the original G1, I have been waiting a long time for CM to come to the Captivate. It took a long time, but it appears to have been worth it.
[Captivate General] 1tontomato:
I would like to see a similar test where the rom remains the same and the kernal and modem change that could yield some useful info
[Captivate General] jivy26:
Andromeda results posted. If stock 2.2 posts highest numbers I quit and am going home lol
[Captivate General] askpcguy:
Maybe this is asking too much but I would be very interested to see the battery life on the miui beta rom for the Captivate.
[Captivate General] Miami_Son:
Can't believe the Andromeda results. Certainly doesn't reflect my experience with it. BTW, Andromeda is running the JK4 modem, not KP1.
[Captivate General] jivy26:
Yea I was rushing this morning for work I'll fix modem today when I get home.
[Captivate General] looslip:
Thats odd. My Andromeda is using the KP1 modem and I'm pretty sure flashed 1.2. I had Perception before that I believe had JK4 so I'm not sure why that is... That said, I'm pretty surprised at the results of Andromeda as well. I feel like the battery on this is the best I've had in a ROM so far.
[Captivate General] dizx:
No need to be sad. What matters is that you are happy with the ROM you are on, regardless of test results. :)
[Captivate General] Miami_Son:
Yep. With any ROM, there will be some at the bottom of the scale, some at the top and the majority somewhere in the middle. There's just too many variables for any one test to be definitive.
[Captivate General] dizx:
Voice calls are the biggest drain for me. Too many conference calls. I'd be curious if there is a clear standout for which ROM/Kernel/Modem combo minimizes this drain. I realize that the modem choice depends on your region. Just thinking out loud.
[Captivate General] looslip:
Maybe I should try Firefly tho. Just saying... I haven't stretched my flash-frenzy like some of you have. :D
[Captivate General] jivy26:
Stock froyo looks so unappealing but will be neat to see how it compares. starting tomorrow night I'll be running the 2nd test interested to see if things stay about the same or completely flip around chaotically.
[Captivate General] PearsonDKA:
Think you could do a Stock 2.2 froyo with the HC Speedmod kernal combo? Last time I quadranted it, was around 2100 and a 14.9 MFlops. In regards to battery life, never got a chance to test it out.
[Captivate General] ryude:
These battery results posted are just one way of using the phone, there are several ways to use your phone and get drastically different battery life. Just because your ROM is at the bottom on THIS TEST, does not mean that your ROM does not get great battery life for YOUR USAGE.
[Captivate General] dizx:
Precisely why I prefer to text instead of voice call. Helps having unlimited texting. :-)
[Captivate General] jivy26:
Agree 100% with ryude. I'm going to test just web browsing until phone dies to help give more than one way the roms were tested. I'm sure they will flip around too but maybe after I test a few different ways it will help give us a better idea.
[Captivate General] jivy26:
Wondering where stock results are? Well somehow it decided to fc in the middle of the night, first time I've ever had it fc, so I will have to start it over again tonight. Already flashed onto a custom rom I cannot stand stock and with that thanks to all our devs who keep me happy with my captivate.
[Captivate General] disellusional:
someone took offense to these results..
[Captivate General] dizx:
Quite the contrary...
[Captivate General] askpcguy:
Any chance to give the beta ROM miui a test, I'd be interested to see the results.
[Captivate General] reflex01:
Really appreciate you taking the time to do this! Well written and documented!
[Captivate General] Miami_Son:
Andromeda uses the JK4 modem, not KP1.
[Captivate General] chasesavestheday:
just got 2days, 9hours, 7min, 22secs. using torch 1.5 no joke. image to prove it!
[Captivate General] randyyy:
This thread is so important. I was on Darky's 9.3 and watching the results of the OP I decided to give a try to Serendipity 6.2 ... Wow! Now, my battery life is better. Before, I did 5～7% per hour. Now I do 2.5% per hour.

So happy with this. This has been very helpfull, thanks!
[Captivate General] jivy26:
LOL I will fix it tomorrow morning gotta work late tonight
[Captivate General] ryude:
My post was in reply to someone else, and even if I did take offense I think I have the right to it don't I?
[Captivate General] askpcguy:
This is science at work, your response should prompt at least some questioning in the testing methods, or the results which can suggest an entirely new line of testing in the effort of more accurate results.
[Captivate General] jivy26:
Stock is still giving me issues with this test. So to make sure I am still giving out results tonight I will start web browsing test and tomorrow morning I am going to run the video stream while I am awake to see what the heck stock is doing. Also for the web browsing test since I am using data I am going to be running 3g since I noticed some roms didnt have HSPDA enabled.
[Captivate General] mike29892:
I think seeing CM7 tested would be interesting.
[Captivate General] ryude:
Well certain ROM's (like mine) use ad-blocking hosts file, which would reduce the amount of load placed on the 3G radio since it doesn't have to transfer as much data. Also my ROM uses a modified libwebcore.so and browser.apk, so the web browsing test should be interesting with all the customization possibilities.
[Captivate General] jivy26:
Finished testing Continuum results are posted. Keep in mind I have left GPS and Auto Sync on as im trying to give near real world results so battery life from this test and test 1 will be drastically different. Plus im running on 3g so thats a drainer too.
[Captivate General] rohith8055:
Better Among the Best

There's always gonna be a trade off between performance and battery life.

In the end, guess its gonna be a personal choice.

Glad we have a lot of choice unlike those apple fans ;)

Your tests are gonna help many peeps make that personal choice.

WTG and a BIG Thank You.

______________________

Samsung Captivate

ROM: designgear's Cognition v4.2.2

Kernel: eXistZ's KB1 #7 beta
[Captivate General] jivy26:
Yea after I went from the iphone to my captivate I quickly realized ones for boys and one was for men.
[Captivate General] ryude:
The new test seems like a better way of testing real-world battery life, can't wait to see which kernel/modem does best in this test.
[Captivate General] dizx:
I'm gonna borrow that quote, if ya don't mind.
[Captivate General] jivy26:
Lol no problem not copyrighted
[Captivate General] F1reEng1neRed:
I'm running Serendipity 6.2 and just to today moved to 6.3.

In case anyone's wondering...I'm achieving much better battery with the following:

Flashed from JK4 to JJPD to JQ1. (This was the biggest gain in battery)

After running a few days with JQ1 and seeing a good increase in battery, I decided to go to speedmod 13D. I'm seeing an even greater battery increase after this.

Before these two changes, I was at about 50% battery after 12 hrs unplugged. Now, I'm seeing between 65 and 80% depending on usage, but definitely a quite noticeable increase.
[Captivate General] jivy26:
Serendipity results posted and actually the time difference between continuum and serendipity is almost exactly the same as the first test :o
[Captivate General] chase10784:
Hmm...i wonder if that is just a coincidence or it could become a trend. if the next is the same that would say something.
[Captivate General] krazyphire:
Do you think could do Darky's new 9.5: http://www.multiupload.com/3GOGVFRY35

With the KP1 modem and speedmod? :)
[Captivate General] mirotvorets:
yesterday i tested my captivate with below spec:

° Andromeda 1.2 with Minor Kernel

° Default clockspeed 1000mhz

° 40% Brightness/Screen Timeout Turned Off

° 100% Charge

° Auto Sync off

° GPS off

° ADW EX launcher

° GSM only network, ZSJPG modem

the phone stay all day in the same place, i don't use it.

battery life from 100% till 5% is 11 H 23 min.

how do you get so little battery life in your test? do you test on white screen or with wallpaper.

I've used dark walls

, maybe because my battery life more longer then yours?
[Captivate General] disellusional:
That's why.
[Captivate General] bigsmitty64:
FROM OP: Each night I will run the exact same VERY LONG documentary using VLC stream and convert and current widge.
[Captivate General] mirotvorets:
if we play video via wi-fi we don't test the phone power consumption.

we test wi-fi power consumtion, and it depends on many factors that we cannot control: other radio & wi-fi networks around, nearest electric wires
[Captivate General] ryude:
He performs multiple tests to test different areas of phone usage, so I don't see what the problem is.
[Captivate General] jivy26:
Precision results posted

Edit: btw I hate posting results when they are on the lower end of the results because I know how much the devs work on there roms.
[Captivate General] jivy26:
Please read the entire posts and then give it a go. If your testing like test #1 download vlc stream and convert from the market and use it while you have everything setup like I did in test one. If your going test #2 read what I did there. I'd be more than happy to see you post your results, but make sure that you understand how they were tested before you post 11 hours of idle time. To turn off those settings use my settings from the market is the easiest way i've found.
[Captivate General] scooter14000:
Stock 2.2 Results for Test 1

Would it be possible to post the stock 2.2 results for test 1 if you have them? I noticed says that you are still testing it and it would be great to compare all of the custom ROMs to what initially comes on the phone.
[Captivate General] jivy26:
I'm having problems with it fc'ing on vlc so im just going to run stock tonight on test 2.
[Captivate General] scooter14000:
Oh bummer. Thanks for the update though!
[Captivate General] jivy26:
Yea but test 2 is closer to real world use anyhow so I'll post stock results tomorrow morning.
[Captivate General] ryude:
I find it interesting, I'm not upset at all. It seems that suckerpunch/onix doesn't get very good battery life, but that is to be expected from oc/uv kernels.
[Captivate General] xtremekilla09:
That is true, but I find that the battery is more stable with Onix when the phone is in idle. I think that is key factor for everyday use of your phone. With my ROM, I lose around 1 - 2% per hour in idle, and that works for me.
[Captivate General] bigsmitty64:
Agreed, I just got 1 day 23 hours and change with FF 2.7 Normal use for me.
[Captivate General] randyyy:
I'm having the best results on Serendipity, it's been the best in battery life for me, before I tried cognition and Darky's, but that Firefly is making me so curious, I like the results it gets and I'm gonna try it this week or the other.

Once again thanks a lot for this useful thread.
[Captivate General] disellusional:
is there OC/UV in base settings? I would think stock suckerpunch/onix would be similar to a non oc/uv kernel

although.i'm curious to see what phoenix/firefly with onix results are
[Captivate General] ryude:
My ROM does not use any oc/uv settings default, you have to manually edit them yourself. If you plan on not using oc/uv, then I really recommend you to use speedmod as it is better optimized for stock settings.
[Captivate General] jivy26:
Stock 2.2 results added.
[Captivate General] jmoline2:
Regardless of the numbers, i like my experience with phoenix. That may be until I flash MIUI.
[Captivate General] jivy26:
I've been thinking of trying out MIUI and seeing how stable it is and possibly throwing it in the mix as well.
[Captivate General] Vivified:
It has the same issues that CM7 does currently. If you consider MIUI stable, then by logic so is CM7, though I won't flash either until they are official releases.
[Captivate General] jivy26:
I know miui rc released today. I'll test and see
[Captivate General] TheSopranos16:
Which stock rom did you use? AT&T 2.2 doesn't use JK4 modem. I'm assuming you used a canadian stock 2.2?
[Captivate General] disellusional:
isnt the oc/uv kernels based on speedmod but with the option of oc/uv? To my understanding, if left at stock, onix/sp should perform the same as speedmod shouldn't it?
[Captivate General] jivy26:
Att if I typed jk4 my bad I'll fix this evening

Edit yea I see I put jk4 will fix that
[Captivate General] askpcguy:
Wow I was asking about miui days ago just to see how the numbers look.

If you don't mind a rom where you have to make minor tweaks to make small problems go away, I'd wait on miui.

I think its worth trying for a day.
[Captivate General] jivy26:
Posted Firefly results and fixed modem on stock :P
[Captivate General] bigsmitty64:
Firefly 3.7 is out already? :D
[Captivate General] jivy26:
Lol it's the new super duper beta...i will fix that tonight I focus so much on making sure the numbers r right I seem to be messing up names lol
[Captivate General] tkjeeper:
Great work! Thanks for all the effort! Really good resource to check in on, subscribed! I like the looks of firefly but I cant see me getting away from Serendipity. Thanks again.
[Captivate General] xtremekilla09:
WHOA!!! How did that get leaked?? ;)