yashsingh1/xdaforums huggingface dataset:
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
Sorry, you're right only about performance.

Well maybe there's someone else who wants to test this, I don't. I spend much time in benchmarking, testing batteries takes too much extra time.
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
hi, first post I see...

Tomorrow a new benchmark, Dutty's v.4.
[Touch Diamond, MDA Compact IV ROM Development] Sergy330:
Good news!!! ;)
[Touch Diamond, MDA Compact IV ROM Development] band27:
Should be interesting to see the slue of chefs playing with Rom 2.03 (20764) and how this impacts the results on your chart.
[Touch Diamond, MDA Compact IV ROM Development] christonge:
I don´t honestly believe there will be much difference between the 2.03 and 2.00.... but we´ll see.
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
I do think the new 2.00 and 2.04 ROMs are better, meaning more solid, more stabile, some new functionality.

But I'm not convinced (yet) that they are faster... than the 1.9x versions. My first benchmarks also show this.

Perhaps our cooks can proove I'm wrong...
[Touch Diamond, MDA Compact IV ROM Development] alphazero:
dear pietrucci,

i have one question because i think your rating regaring the roms and your benchmark scoring is a little bit faulty.

as you remember aztor v7 got a vsbenchmark score of 7000. ALL OTHER ROMS got 2800 or 2900 @ max. But trust me and you know :D my rom isnt 2,5 times faster than this roms.

i think its time to move forward and not to suggest to get back to the 1.93 or even 1.37 roms. as you have mentioned earlier on this thread the feeling of 2.xx roms is better even if benchmarks report us diffrent things. just my 2 cent.
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
hi alphazero,

maybe some misunderstanding here...

1. I never said that your ROMs are 2,5 times faster! In fact because results were so strange I made a special totalindex where I left this extreme results out.

2. I never suggested to go back to 1.93 of 1.37. Off course we must go on with the new versions.

3. The new 2.0x ROMs feel good and smooth, indeed I already said that.

But... I still think these benchmarks say sómething about speed, maybe even much. And I really think that when we would measure the allday use performance of some 1.97 ROMs compared to the new 2.0x ROMs the 1,97 would perform better.

As already stated: my opinion is that the completeness and steadyness of the new 2.0x ROMs somehow has it's price.

Then about my benchmarks: I'm always open for suggestions to get more objective and realistic benchmarks results than the one we have now!

Keep up the good 2.0x ROM cooking alphazero!!!
[Touch Diamond, MDA Compact IV ROM Development] cyron_at:
..which new functionality? I haven't found any one until now?
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
Phone with slider?

See also http://xdaforums.com/showpost.php?p=3139374&postcount=151
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
New ROM

Benchmarked Dutty's V4 CVSD Full.

See post #1
[Touch Diamond, MDA Compact IV ROM Development] Dynomite232:
just got a :confused:question will u bencmark SHAKS 3.00 Rom u no what i think it will have some good Marks plz give it a go if u got time than man
[Touch Diamond, MDA Compact IV ROM Development] duttythroy:
thank you bro, I see the CPU benchmarks 2341.28 beat my last one :),
[Touch Diamond, MDA Compact IV ROM Development] iRiKi:
Shaks 3 will pwn.. you'll see !:D
[Touch Diamond, MDA Compact IV ROM Development] Flip78:
Thanks hc_blacki for your highly value adding contributions. Clearly, I couldn't live without it !
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
New ROM

New ROM: Swtos V2.5 WWE Full (20764).

First post.
[Touch Diamond, MDA Compact IV ROM Development] band27:
Yep...ur predictions are quite accurate.
[Touch Diamond, MDA Compact IV ROM Development] mttcee:
Would love to see shaks latest ROM being tested
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
2 Shaks.P ROMs

Benchmarked Shaks.P V3.00 rom.

Right after that shaks published his new 3.10 version. So I tested that too...

See post #1.
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
Benchmarks 2.03 ROMs

hi,

Have been testing 7 2.03 based ROMs by now.

One of them was with radio .23 (AZTOR's), it had the worst results.

But the other all have very simular results: about 93, 94%, only udK a bit higher (97%).

Does this mean it's harder to gain extra speed in cooked 2.03 ROMs???
[Touch Diamond, MDA Compact IV ROM Development] iRiKi:
Thanks a lot, seems Shaks is a nice and fast ROM. It's on par with other 2.03 i guess ^^
[Touch Diamond, MDA Compact IV ROM Development] EazyVG:
Please test latest VIC and SONE ROMs ... would love to see them against other 2.03 ROMs, as well as in general. Both ROMs are getting quite an attentention. Thanks.
[Touch Diamond, MDA Compact IV ROM Development] band27:
Just curious as to how much dynamic pooling plays a role in these results because I noticed some 2.03 roms are using it while others are not.

I know this, there are pros and cons to everything. The question here I guess is, are there more pros or cons in enabling dynamic pooling on memory.

Would some of the chefs or anyone share your their thoughts on this ...
[Touch Diamond, MDA Compact IV ROM Development] alphazero:
a rom with dynamic pagepool

pro: loads all tools once launched to memmory. "!relaunching!" this tools / apps is faster.

con: loading things to memmory makes it full. after a few tools / apps are launched the rom gets slow and sluggish.

I suggest Dynamic Pagepool on roms without Manila or roms that have lot of FREE RAM (Light roms)

On full roms its not suggested and has bad influence. benchmarks can be influenced of dynamic pagepoools casue the "testfiles" used for benchmark get cached. means wrong results ... but thats just a sidenote

cheers alpha
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
Yes, on my list are VIC, Dia Duit, CT's (he's bringing a new ROM soon), Mary ONE and SONE.

But it takes much time to test...
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
New ROM

hi, benchmarked the HTC 2.03 ship ROM.
[Touch Diamond, MDA Compact IV ROM Development] pokevitek:
Hi, first, great work man! I just want to ask you, it seems that I have on ym Diamond always less free RAM than you have in you tests. For Example, I flashed A.Z.T.O.R. X, disabled Touch Flo 3D and all I get was 60 MB of free RAM, but after some using all I have is 44 MB of free RAM. I know, that you are trying ROMs after soft-reset, but in case of A.Z.T.O.R. X ROM, I have 5 MB of free RAM less than you. How it that possible? Do I have some problem with my Diamond?
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
Well in my tests I always disable TF3D, set keyboard to default and, most important, I set the phone skin to OFF. This last setting results in about 10Mb of extra memory...
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
New ROMs

Benchmarks two more girls:

Dia Duit V0.9-pre8 (20764)

Vic V3.3.1b Classic TF3D (21009)
[Touch Diamond, MDA Compact IV ROM Development] cyron_at:
...pls upload the new excel file!

thx
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
Sorry, forgot the files. Replaced them...
[Touch Diamond, MDA Compact IV ROM Development] astrolito:
.

In their benchmarks.., you note any significant difference between the versions 2.00 and 2.03..?

Thank a lot for your work...:cool:
[Touch Diamond, MDA Compact IV ROM Development] suiller:
4 me not... sincerely there isn't much difference starting from 1.95 up to 2.03, of course newer should be better... but should be :)
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
I agree, there's not much difference (also look at the charts...).

As i stated before newer should be "better" and it usually is.

But in what view? It has more functionality (and therefore is bigger), is more stabile or whatever.

And therefore often NOT faster...

Look at Windows: Vista really isn't faster then XP on a normal machine (well: in fact on any machine!).
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
2 New ROMs

2 More new 2.03 ROMs: both fassssttt!

CT's V6.4 Full Original TF3D

SONE V2.1 WWE (21109)

CT's almost as fast as the fastest ever (mondilv's 1.9x ROM).

See post #1.
[Touch Diamond, MDA Compact IV ROM Development] christonge:
Thanks my pietrucci!!! Excellent service to the community... I would like to ask one favour.... Could you please please please test the Lite Org TFl version of this ROM as well?? I know it´s a big request but only if you can find the time :D
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
Haha, you hope you get past mondilv's with this??? I'll test it as soon as I have time (think tomorrow).
[Touch Diamond, MDA Compact IV ROM Development] christonge:
Thanks mate ;)
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
New ROMs...

Three new more ROMs:

CT's V6.4 Lite Original TF3D

HTC Official 2.03 NLD (20764)

udK Syrius HD RO Beta 8 (20765)

Some remarks:

- CT's Lite ROM gives kind of strange results: it slower than the Full version. I've tested and tested and tested again, always the same results, slower than the Full one...

- udK's new ROM is very fast, álmost as fast as the fastest...

See post #1.
[Touch Diamond, MDA Compact IV ROM Development] KraFT_mk:
Great job!

One question.

Do you install SPB Benchmark on Internal Storage?

Keep up the good job.

K

P.S.

Stilll waiting for 2.03.405.2 - 1.09.25.23 :rolleyes: .
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
No, I install both SPB and VS on device. So you can add about 6Mb of space to my Storage figures...

I don't think it's of any use to test the different versions of 2.03, they will all be about the same speed.

But there's a difference between radio .05 and .23: radio .05 is faster. See my previous tests.

I don't use radio .23 for 2 reasons: 1) I tested almost every ROM with radio .05 and 2) radio .23 drains my device very fast.
[Touch Diamond, MDA Compact IV ROM Development] udK:
Oh yeah! :D :cool:
[Touch Diamond, MDA Compact IV ROM Development] Knoore:
Please try the Nataly version 1.1.1 Full.
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
I already did a week ago. The testresults were slightly slower than 1.1 Full. But before I could publish I lost the results and while they weren't better I didn't test it again. Sorry...
[Touch Diamond, MDA Compact IV ROM Development] Knoore:
Ok thank you :)

So for a nearly full rom, this one is very fast? :)
[Touch Diamond, MDA Compact IV ROM Development] WiZARD7:
early winmo 6.5 benchmark?
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
yes Nathalie is fast, both 1.1 and 1.1.1.
[Touch Diamond, MDA Compact IV ROM Development] ascorpion:
what about new udk's ROM :D
[Touch Diamond, MDA Compact IV ROM Development] CarlosT:
Based on my personal experience, udk's latest (both Beta8 and R0) are the fastest ones around, and they are stable of course. AZTOR X2, despite all this fuss around it, is still at an inferior level. :)
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
You can't say that AZTOR's at an inferior level, because it's NOT!

I've been using X2 for three days now at's it's one of the best ROMs I eveer had: fast and stabile and everything works.

True: udK's ROMs also are very good and fast.

Any some others...

Most 2.03 ROMs are much alike in speed and stability.
[Touch Diamond, MDA Compact IV ROM Development] NLCrookM:
How about Skippycentraal v3.5

I have been using Skippy Centraal 3.5 Beta 3 now for a few days and it is running fine too, but I have not been able to find any benchmark testing recently. Any chance of this happening??!!
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
I could do a benchmark on this if you really want but I'm almost 100% sure it get's about the same results as all other recent ROMs.

I don't do that much benchmarks anymore, because they all get the same results (more of less). And that's because the base of the current ROMs is always the same.

It takes much time to do these tests so if it's not of extra value I won't do it.

Hope you understand...
[Touch Diamond, MDA Compact IV ROM Development] losdrivare:
It's really nice to see how the benchmark scores clearly improve over time. I got my diamond in August and then the highest SPB scores were like 470-480. By November the fastest topped out at 500. Now they're at 520-530 points!

While benchmark is just a synthetic test and the scores has "just" increased some 10%, I still like to see this clear improvement in scores over time.

Placebo or not, I claim to feel the difference. In August, I thought that even the fastest cooked ROM was not fast enough. But now, my diamond feels as fast as I need it to be. Only GPS fix could be quicker, which is why I havent flashed a new ROM since November but tried 5 different radios... :D

Presently running udK beta 5 with some added reg edits for increased sensitivity and scrolling speed and radio 1.10.25.25

Thank you for your work, Pietrucci. I always check this thread when you update it. :)
[Touch Diamond, MDA Compact IV ROM Development] CarlosT:
First of all what I said is, again, based on personal experience. Both udK's R0 and A.Z.T.O.R X2 are bug free but you can't but notice when using both that udK's is more responsive (and that doesn't deny at all that X2 is also noticeably snappy).
[Touch Diamond, MDA Compact IV ROM Development] cloudedhopes:
X2 benchmarking?

hey pietrucci - any changes of benchmarking the X2? :) i know it doesn't really make a difference (+- 5%), but it's good to see how they match up in numbers :)

btw - if u want to check which ones are updated - check out here

http://xdaforums.com/showpost.php?p=3164447&postcount=2

thanks for ur work!!
[Touch Diamond, MDA Compact IV ROM Development] materijalmen:
Hello. Finally i decided to sell my diamond..it is not for me...bytheway, i want to put a superfast rom on it...but i dont know which one to choose from these. i red the test...but i cannot understand.

Nyway, when i sell it the device must be fast enough. Thboy who will buy it is a usual user, so he wont need any extras...i want a rom, which has the original diamond menu and programs, but to be superfast, because when i will show how works the device i dont want to freeze when example ishow how can he roll with fingers the pics in the tfl3d...

so...please give me some godd advice.
[Touch Diamond, MDA Compact IV ROM Development] Sergy330:
"NATALY". V.2.0.RC1 UC Ready

Hi pietrucci!

could you benchmark "NATALY". V.2.0.RC1 UC Ready please? ;)

Thanx for your work buddy!
[Touch Diamond, MDA Compact IV ROM Development] losdrivare:
Mondilv is already cooking next release, might be better to wait until he's done... :)
[Touch Diamond, MDA Compact IV ROM Development] mondilv:
Op op op...!

Don't hurry, please, it's not the FINAL release, just the test.:D

Even in RC2 will be many & big changes.

But it'll interesting for me too: mainboard of my device had changed.

The NAND looks bit slower, then previous. So I can't to compare the new rom correctly.

Need something, like coefficient.
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
I don't know exactly what you're saying: should I test RC1 or not?

Well I'll do a test, just to compare 2.03 with your previous one.

I predict that this one wil be a bit slower than 1.1.1!!!
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
VERY strange: this is the first ROM which doesn't pass the VS Benchmark test!!! In test 3, the JPG test, it just terminates the test...

This means I can't compare with the others.

I will do the SPB Benchmark anyway.

Report back...
[Touch Diamond, MDA Compact IV ROM Development] mondilv:
Only for own pleasure.:D

And for me too - I can't to compare it to previous.

Not for public, I think - many changes ahead.

Yes, it's possible.

But hope for interface responsibility.
[Touch Diamond, MDA Compact IV ROM Development] mondilv:
Hm. Strange.

Try without install Opera browser.

I did the jpeg test now - passed (on rc2)
[Touch Diamond, MDA Compact IV ROM Development] Sergy330:
Ops! sorry about that, I thought that RC1 was a final release :)
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
Big problem...

Another big problem: SPB removed their site to analyze the testresults.

On their site http://www.spbsoftwarehouse.com/products/benchmark/handleresult.php?en I always get the SPB indices, but now they replaces this with another site.

So now I can do my tests anymore. I just finished mondilv's 2.0 RC1 test, but can''t complete it.

Hope their site get's back soon!
[Touch Diamond, MDA Compact IV ROM Development] djcedric:
can you do a test with the newest rom of skippycentraal please because i want see the scores of is new rom to compare with the others?

is this possible?

thx in advance
[Touch Diamond, MDA Compact IV ROM Development] danny_and_2:
If I remember rightm pietrucci don't test roms that not are WWE Lang. So if you want to do it, you have to do it by yourself. ;).
[Touch Diamond, MDA Compact IV ROM Development] djcedric:
on first post :

tested roms so far SC 3.1 NLDTT7 Extreme (20753) :)
[Touch Diamond, MDA Compact IV ROM Development] danny_and_2:
Oh my bad then. ;)
[Touch Diamond, MDA Compact IV ROM Development] luk-a-sz:
Hi,

Could You test:

"NATALY". V.2.0.FINAL

http://xdaforums.com/showthread.php?t=459854
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
No I can't anymore. As I already stated a few posts before SPB removde the analyze page to get the SPB indices. Don't know why they removed it, but now I can't get the calculated indices...

So no more testing for now...
[Touch Diamond, MDA Compact IV ROM Development] charly_mx:
please continue with your work pietrucci :D
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
Sorry I can't anymore!

I can do my tests, but after these test I always go to the analyze page from SPB where the SPB indices are calculated.

But SBP has removed this page since a few days (I really son't know why, now their benchmark tool is useless), so my totalindices can't be calculated anymore...
[Touch Diamond, MDA Compact IV ROM Development] band27:
Is there no other App that can be used to do the same ? I guess not, as you would have by now, moved to that App. Does anyone else know of any App to be used for this purpose?
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
And if there was such an application, then all previous results can't be used anymore to compare with.
[Touch Diamond, MDA Compact IV ROM Development] mondilv:
Nataly

I tried to compare previous (1.1.1) "Nataly' ROM & 2.0. By SPB bench. With absolutely the same packages/OS/Build.

Performance looks very close.

But, by my opinion, 2.03 is bit more responsible.
[Touch Diamond, MDA Compact IV ROM Development] band27:
True, hmmm..... I guess the forum is in a bit of a bind..... as I too found your statistical data very informative. Especially when you are surrounded by subjective comments when discussing these ROMs.

Your services will be missed...:(
[Touch Diamond, MDA Compact IV ROM Development] losdrivare:
Perhaps it's possible to run only VS benchmark? Then at least those can be compared.

I would truly miss your work, Pietrucci.
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
As some people ask for it: I could calculate the SPB indices myself, based on the info SPB give on their description page: http://www.spbsoftwarehouse.com/products/benchmark/indices_descriptions.html.

Takes a few hours to bring in and test the calculations in Excel. Maybe tomorrow I'll give it a try.

I'll report back..
[Touch Diamond, MDA Compact IV ROM Development] Dr.Tenma:
Hey, good work,

could you post also results for this rom http://xdaforums.com/showthread.php?t=459854 ? Because in the excel file, there is only the v1.1 light.

Thank's man !
[Touch Diamond, MDA Compact IV ROM Development] EazyVG:
How about testing Nataly 2.0 FINAL ... tnx.
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
I'm back...

Hi, I'm back!

Finally I managed to translate index calculations from SPB to my Excel spreadsheet. I have a small difference in calculations but that's within a range of < 1%.

I tested Nataly's v2.0 RC1 and final, see post #1.

Now I'm going tio test my first 6.5, Cloudyfa_6.5.01.
[Touch Diamond, MDA Compact IV ROM Development] mondilv:
Could you try "Nataly" on the old 1.00.25.05 radio?

It'll be more correct:)
[Touch Diamond, MDA Compact IV ROM Development] mondilv:
And, at all, I glad to see your work is continue.

Very useful for developers too.

Thanks!
[Touch Diamond, MDA Compact IV ROM Development] mondilv:
Interesting, what do you install to "Nataly" except Opera (default UC)?

In default variant - 136.7M is free.
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
When testing I install SPB Benchmark and VS Benchmark and Mortscript. All of them are about 10-12 Mb.
[Touch Diamond, MDA Compact IV ROM Development] mondilv:
Clear.

P.S. Mortscript present allready inside.:)
[Touch Diamond, MDA Compact IV ROM Development] losdrivare:
Glad to see you back! :)
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
I just checked it: SPB consumes about 3 Mb, VS consumes about 12,5 Mb! This means all Storage memory reports in my benchmarks are about 15,5 Mb to low. I will correct this right now (hope people don't get confused...).
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
I corrected the Storage memory figures (+15,5 Mb), new report in post 1
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
2 more new ROMs

hi,

Tested two more new roms:

Cloudyfa_6.5.01 Full WWE (21159)

Nataly v2.0 Final Full WWE (20769), radio 1.00.25.05

Cloudyfa ROM is the first 6.5 ROM I tested. Results not so good (it also doesn't feel that fast). VS Benchmark gives extreme result on test3, like some ROMs from alphazero's and swtos.

Nataly v2.0 Final Full WWE (20769) with radio 1.00.25.05 has about the same figures as the same ROM with radio 1.08.25.20.

Just a fraction slower, like I expected.
[Touch Diamond, MDA Compact IV ROM Development] mondilv:
Bad news. Hope, because it's not the final & official WM release.

Looks bit strange. 1.00.25.05 always faster about 10% at file operations at least. Even on my new (and slow) flash.
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
Yes, maybe it IS strange (but maybe it is NOT). And therefore I re-tested twice extra (I always do each SPB test 5 times, in this case 10!): always worse results for the 25.05 radio. Finally I even did a complete new flash+hardrest last night, just to be 100% sure. Still the same results: 25.20 slightly faster.

On the other hand: I'm using radio 25.20 for a while now, it feels very good and solid, no huge battery consumption. Yes, radio 25.08 was slower then 25.05, but this 25.20 one... I don't know, I like it.

At the moment I'm using radio 1.09.25.23, see what that does....
[Touch Diamond, MDA Compact IV ROM Development] nicholas99:
Hey Man, Thanks for the results but the attach file u post on to download is for January not February. Hope u can change it. Cheers.
[Touch Diamond, MDA Compact IV ROM Development] mondilv:
Want to explain my opinion about 1.00.25.05/others radio:

(note: results for "slow" flash, on Pietrucci's device should be faster at write/copy operations). Not the test. Comparison only!

SPB bench 1.00.25.05

"Write 1 MB file" - 524 ms

"Read 1 MB file" - 31 ms

"Copy 1M file" - 628 ms

SPB bench 1.08.25.20

"Write 1 MB file" - 603 ms

"Read 1 MB file" - 32 ms

"Copy 1M file" - 746 ms

I haven't enough experience (and patience:D) for make FULL test. Possible, the ALL tests make summary 1.08.25.20 radio faster.

But "short" results make me puzzled.:)
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
Sorry, indeed the wrong file! Corrected it, see post #1,
[Touch Diamond, MDA Compact IV ROM Development] pietrucci:
hi mondilv,

I don't doubt the results on your device, this is very possible.

My experience is that if you run SPB Benchmark 5 times, you get 5 different results! Sometimes slightly different, sometimes huge difference... That's why I always test 5 times nowadays and take the best values from it.

Did you test only once?