yashsingh1/xdaforums huggingface dataset:
[Touch HD Windows Mobile ROM Development] SatScan:
What a wasted off time and server room !!!!

Hi there,

Yes i'm a junk for more than 5 years now. I admit!

And yes i'm a havy user...

Speed is the first thing i want! So i tested almost every rom out there... beta and non-beta!

With testing i mean 1 or more days so i can compare speed, batt-live, stability and so on.

Strange to see ROMs overhere scored so low and in my REAL FIELD test that ROMs are the fastest to find on XDA.

So this benching is a real fake!

Don`t ask me! Just stop this fake testing roms.

So Cooks take a beer! I saluut you!

MOD`s close this kiddie thread with FAKE benching roms...!

Grtz,

SatScan
[Touch HD Windows Mobile ROM Development] MAMeingast:
Well, I know I didn't fake the results for the Topix ROM I contributed... And since they fit very well with the other results, I have no reason to believe anything is being faked here...

So, please, if you don't have any proof for such a daring accusation, STFU.
[Touch HD Windows Mobile ROM Development] SatScan:
This Bench means nothing ya absolute nothing!!

Hi there,

Read it again and again!!!

The bench itself is fake it means nothing!

So with that test you can say nothing about speed, batt live, stability and so on!

Or do you claim you can...

Grtz,

SatScan
[Touch HD Windows Mobile ROM Development] vorenius:
Buddy,

I do not say you cheat BUT... I use topix 2.2.1 and I am very, very, very hapy with it. But why the hell this rom floats up and down and up and down again as a torpedo-hit submarine against some other roms, which by all means sink and swim above again... Let me cry this out - THIS IS BECAUSE THERe IS IS STILL NOT A THRUSTY BENCHMARKS TO GIVE SIMILAR RESULTS ALL THE TIME. And that is why this thread SUCKS. Apologies to all for my bad language and greets to all chefs and contributors that make this nice site.

Salute
[Touch HD Windows Mobile ROM Development] KukurikU:
first u don't need to shout! the great majority here are young ppl with good eye sight.

second, i don't think there are enough blind colors forum members here so, the brownish color u are using (brown nose from kissing some bright cook's ass, maybe?) is also unnecessary and not at least very not eye candy.

third u might think what u want but do not use this tone and do not throw accusations. if u don't believe or trust this benchmark...don't use it. it was stated many, many times that this a speed only benchmark. read the whole thread and count how many times!

don't try and impose yr opinion on others. me and i guess many, many more are using this benchmark. it never let me down, it was always was right.

now please, go somewhere and else to shout or stay put. what a strange coincidence....u are one of the many Laurentius's ROM users.....:confused:;);)
[Touch HD Windows Mobile ROM Development] KukurikU:
i wonder why from all the cookers that are not in the first 3 places only 2-3 are complaining? why are they different?

i watched this thread from the beginning and i've seen dutty's post (what a gentlemen!!), i've seen onkolog's posts at the beginning and his lack of posts after the giant leap he did after using this benchmark (respect, onkolog!) and i've read many constructive posts that step by step made (imho) this benchmark better.

why so few can make such a mess and spoil something good for everybody else?

why? because they don't like the results? the easier thing to say is not "i'm going to be better", the easiest thing is to say "u are wrong". the unsatisfied one come in packs, with their devoted funs ready to tear down everything they don't like.

i am ashamed by the way some pll are treating the authors of this thread\benchmark. this is sooooooo NOT xda-developers!
[Touch HD Windows Mobile ROM Development] EpiphanyNL:
I have been following this thread for a while now, and reading through it I think there are a lot of mis-interpetated words flying around.

Like johnpatcher says, "but objective tests show that it isnt that good at all". If something is good or bad isnt objective at all! Speed is objective, but being good or bad isnt, thats something personal. (Im not attacking you btw johnpatcher).

I'm a Laurentius26 ROM user aswell, but Im not participating in this flame war. I have no intent in blaming somebody of anything.

Only thing I want to ask is dont throw with terms like "good" "bad" as those terms are personal. Speed is something objective, maybe Leo's ROM doesnt come out to be one of the speediest ROMS, but using it for a while I havent had any major issues with it (except for not being able to pair it with my carkit).

So please people, respect each other and discuss everything in a rational matter, we are one community!
[Touch HD Windows Mobile ROM Development] SatScan:
Field test Dutty WM 6.5 R3 ROM right now

Ola,

Except as childish comments do not include things you said.

Apparently, the quality of your response equal to the reliability of the tests. That I knew already and you confirm that now. Thanks for that!

Therefore, I believe that the free thread may be closed mine.

If you have substantive arguments I've heard they like! Until then I continue with my practice test of the new DUTTY WM6.5 R3 ROM.

Yes, this test takes a few days!

Happy life!
[Touch HD Windows Mobile ROM Development] johnpatcher:
Why do all these people post non-sense before reading the thread, or at least some of the last posts? No one has ever claimed that our benchmarks are the only criteria to judge a rom by.

You can put as much (or less) emphasis on these benchmarks as you want to, in the worst case just ignore them. Its a collection of some parameters of the roms, which are, at least for me, in a way representative for the "speed" of the rom. They can be helpful if you need to choose a rom, so you certainly can gain benefit from it.

Removing them, closing the thread and doing all the other stuff you guys propose, would be simply nothing more than censorship, which shouldn't take place outside from China ;).

So my advice to all the people who think that this is garbage: Just ignore it, no one cares about you :D.
[Touch HD Windows Mobile ROM Development] EpiphanyNL:
I dont know if you are referring to my last post, but I think I need to elaborate myself a bit more. I didnt say and will never say that the benchmarks are rubbish, I see them as a good starting point in choosing what ROM would suite when looking for a ROM.

I agree with you that this thread should go on I even think that the flaming should stop, I see a good task for the mods there.

I dont know if its in the OP, but maybe there should be a disclaimer that the benchmarks don't represent the usability of a ROM just some basic speed tests. (just think of super overclocked CPU's, they are benchmarked awesomly fast, but after a while will crash..)
[Touch HD Windows Mobile ROM Development] bobsbbq:
It has nothing to do with who the cookers are and where they are placed in the list. My ROM's have been some of the fastest of the WM 6.5 group. The fact is the methods for collecting data and the fact that these results vary so much and throw in the multiple testers and cooks who send in their own results and they are posted says these test are not credible.

Secondly these test only measure some read and write data and some 3D graphics test. The show no real world benefit to a user.

I don't cook 6.1 ROM's but I'm sure if I wanted too I could cook a ROM only for the purpose to be on the Top of this chart, but for what? It doesn't prove anything. Having the fastest read write speed doesn't mean Sh*t. Yes a good balance and a smooth working collaboration of running software is more important.

For Example if a cook wanted to put his ROM at the top of this Stupid Benchmark Test, you make a light ROM increase all the Data cache sizes, Font Cache and other Boot.rgu settings etc, raise the Page Pool etc. Now you have a fast ROM. Don't worry about Mem usage as it is only for the pleasing of those who rely on these stupid test.

Third I don't like the fact that if a cook disagrees with a method or results the OP displays a attitude and disrespect by not removing the results if asked.

I'm sorry dearon.be you brought this on yourself. If you had removed the results of the cooks who asked you there would be no problem. Now you will not get rid of me until my results are off your test or this thread is closed. I don't believe in your test or your methods and I think these test don't show any real benefit to a ROM user.
[Touch HD Windows Mobile ROM Development] daeron.be:
Added:

_HTC_Touch_HD_MR_2009_RUU_BlackStone_Telstra_WWE_1.59.841.5_Radio_52.64.25.34_1.14.25.24_Ship

Kwbr_Topix_2.5

RUU_Dutty's_HD_WM6.5_5.2.21820.5.0.40_1.59.709.0_Radio_52.62.25.34_1.14.25.24_R3

Miri_WM65_21820_V20.1_Premium

Kwbr_Topix_2.4.1

M-Amine_V3_RC2

benches, by Houms. Enjoy and don't take part in this flame war. Everything was already stated... Registering there is a lot easier than reading with comprehension. Keep it in mind and don't let users provoke you.

daeron
[Touch HD Windows Mobile ROM Development] johnpatcher:
So you have proofed to behave like a child ;).

Fortunately you don't have to believe in them. Unlike many other things they are objective measurements. They may vary a little bit from test to test, but the discrepancy is not that big as you claim it all the time.

Actually you haven't brought up any new argument in the last few "comments", you are just repeating the same non sense again and again.
[Touch HD Windows Mobile ROM Development] bobsbbq:
John you believe what you want and I will believe what I want and just leave it that we disagree. It is not only the fact that the results vary but the way they are collected. The fact remains that if you are going to use a cooks ROM and you won't listen to them when they make creative suggestion then If the cook chooses to have his ROM's removed out of disagreement then you should out of respect.

Your Right I don't have to belivee them and I don't which is why I requested to have my ROM's excluded from the test.
[Touch HD Windows Mobile ROM Development] Fallen Spartan:
Whatever your opinions on these benchmarks, can we leave all the childish behaviour in the playground?

I know everyone isn't going to agree with these benchmarks, and their will always be differences in opinion, but for whats its worth I personal believe that all chef's should be praised for all their hard work. Without them this sites popularity would diminish severely.

I would suggest that if a chef does not want his rom included in the benchmarks that the creator would be so kind as to oblige. This way harmony would return.....would this be so hard?
[Touch HD Windows Mobile ROM Development] Carl1971:
Good to had roms...

but is it a Miri with ou without manila, both existing on premium version since V19 :)

Thanks for your benchs
[Touch HD Windows Mobile ROM Development] johnpatcher:
Fortunately these benchmarks aren't about personal believe!

I don't think its wrong to accept results from other persons. houms and daeron are validatin these results and testify them later on. Right now there are only two benchmarks not done by houms or daeron, out of 65, so that is a ridicilious claim.

Its up to daeron to make use of your "creative" suggestions, or not. He has started this "project", and he can do whatever he want to. If you come up with suggestions he also likes, he will implement them for sure.

I don't think that it has to do something with respect to remove some results. This would be nothing else than censorship. The results don't harm anyone. If any cook has problems with his results to be published then he should leave this forums. The benchmarks can improve a ROM (has happened already), and that's what xda-devs is about.
[Touch HD Windows Mobile ROM Development] bobsbbq:
Well it sure does. He is using ROM's created or customized by other cooks not by him. If the cook for whatever reason disagrees or feels the results are not credible then he should have the right to have them removed
[Touch HD Windows Mobile ROM Development] KukurikU:
i wonder...if yr ROM would be one the first 5-3 speediest ROMs, you'll still be here every 2-3 posts, fighting and kicking???? :p

it seems to me that the benchmark is not going to be good enough for u until then...

just to have a little quiet here i'll ask daeron (with kwbr's approval, of course) to put u first place. anything for a little peace and quiet around here :D

you and yr kind are pathetic....have a little pride, suck it in, chin up and back to the designing table. u are wasting yr time and ours. show us that u can more than shout and whine at others. i dare u!
[Touch HD Windows Mobile ROM Development] Dredd67:
Well well, people come on. What's your age here ? Can't everyone take a deep breath and start to THINK ?

Whatever you are benchmarking, benchmark have always been controversed. There are many reasons for that: reliability of the benchmark itself, reproductibility, methodology, personal interests of the testers etc... Hundreds of reasons why benchmarks, like statistics, are subject to INTERPRETATION. Numbers don't mean anything alone.

Moreover, if you look closely most of the roms tested are so close that the difference isn't even significative. Come on, who would tell the speed difference by eye between two roms that are only separated in the benches by 10%.

Keep also in mind that some improvements are not reflected by the benches: When GFXBoost is enabled, some benches show bad performances even if by eye you can obviously tell that things are better...

Now please everyone take those benches for what they are: a measure of one little and very specific aspect of a ROM. This doesn't and will never be related to what is a "good rom".

All of the roms out there have their pros and cons. I'll just give you some exemples:

If I want equally speed, stability, and something close to stock plus some extras, I'll go for say, Dutty's or Leo's or even Panosha's.

If I want the newest features, or try new things, I would go for instance for a 6.5 ROM and try Miri's or Energy's roms.

If I want to have stripped down version because I just care about speed, or I have ONE application that needs that (plenty of free RAM, space and so on) I would go for Kwbr's lite versions.

If i feel the need of having a rom with my native language, french, I'll go somewhere else than XDA's...

See ? I've tried almost every rom out there, and I was almost never disapointed, because I had the opportunity to have what I needed at the time beeing.

Even if the previous statements are quite caricatural (and subjective, this is MY opinion), you cannot judge a rom with just a bench. It's just another parameter among many others.

Hope everyone can now go back in the kitchen and test tons of new roms...
[Touch HD Windows Mobile ROM Development] Fallen Spartan:
Well said mate, agree 100%
[Touch HD Windows Mobile ROM Development] bobsbbq:
You are the one that is pathetic if you think these results are true accurate and credible. My being quiet is none of your business. First of all if the sheet were done in the manner it should with a separate section for WM 6.5 I would be in the top 3. My ROMs are good and the results are not why I'm making my point. The fact is people should know that these results have been erroneous and will never be credible with the methods in place now. That is my opinion and as a cook I have the right to my own opinion. And thus I have the right to ask for my results not to be included. You don't like it that's tuff.
[Touch HD Windows Mobile ROM Development] Fallen Spartan:
Guys, guys, need to take a step back and relax. Leave your handbags at home and try to behave like adults.
[Touch HD Windows Mobile ROM Development] DaveShaw:
There's a reason why these sort of threads arn't normally allowed... because they lead to flaming.;);)

Can everyone chill out, take 5 minutes to re-read the rules (Rule 2), and remeber why we are here - to have fun and make our phones better.

Thanks

Dave
[Touch HD Windows Mobile ROM Development] michoob:
Wouldn't be the best just to remove the percentage column and the ROM classification?

Let each user perform his own classification based on those benchmarks.

Moreover, it would be even better if each ROM would be benchmarked several times by each benchmarker, since the benchmark results seem to vary so much.

Then, with a spreadsheet having no classification, and several benchmarks for each ROM, I think that I would be more objective.

Because the more I read this thread, the more I think the problem is not the benchmark itself but the classification process that seems absolutely not reliable.
[Touch HD Windows Mobile ROM Development] pzucchel:
Understood your point of view - Thank you. Please respect others and don't pollute this thread with requests to close it - simply walk away if you don't like it. I find it very valuable because i understand what this test does and there is no intent of criticizing anybody. The ranking is explained and is an objective MEASUREMENT e.g. with its own error and limitations.

Do you really think that people uses this test for battery life evaluation or stability? Look, we are not complete idiots...Good bye ;)
[Touch HD Windows Mobile ROM Development] itje:
Agree with dave here, calm down guys, there is really no need for this kind of behaviour.

I have a rom on my HD wich scores ok on BM, not the best, but its faster then others I have tried with higher scores. But I am not claiming that my roms are better/faster, not at all..its just a personal observation

BM is only a lowclass tool to get a idea of the performance, not the leading tool to determine what is the best rom.

just my humble thoughts :p
[Touch HD Windows Mobile ROM Development] SatScan:
SALUUT to all GREAT COOKS !!

Hi Dutty,

Can I ask, do you specific (only for this matter) Patching/Hexediting to get better benchmark results?

Grtz,

SatScan
[Touch HD Windows Mobile ROM Development] yung_vu:
bobsbbq

Hypothically, lets assume I'm using a ROM customised by a cook. I experience some issues in using the ROM, like it has a timebomb or memory leak or constant freezing etc. I then post these issues in the cooks ROM thread. Would you advocate that the cook is able to "for whatever reason disagrees or feels the results are not credible then he should have the right to have them (my comments) removed"?

It would be a sad day for xda-developers if this were the case :(

The people calling for this thread to be shut down are starting to remind me of microsoft/HTC :eek:
[Touch HD Windows Mobile ROM Development] bobsbbq:
No that is not the same thing. Problems, bugs etc are welcome in the specific ROM thread.

The problem here is these results and methods are IMHO bad. The meaning of benchmark is to be a point of reference or a standard which can be accurately measured against. So the first problem with this thread is the fact that there are multiple testers testing on multiple different devices. There can be no standard in testing on multiple devices as all of them may vary slightly in quality. So to have a accurate baseline to test against they must all be tested on the same device, and by the same person.

It has been proven that some of these test that if let to run longer produce higher results. The only way this can be controlled is if it is done by one person.

The other biggest flaw is the fact that cooks are sending in their own results and were posted to the sheet without even being checked.

And finally what actual good does this thread do for a user? Nothing, it does no real world test which would help a user in selecting a ROM.

The OP wanting to be arrogant and unwilling to listen to some helpful comments from cooks to try and better the thread chooses instead to ignore some of the facts that the methods are bad. He refuses to at the request of cooks to remove the results. Remember these benchmark tools are meant for individual users to use to test their own ROM or others for their purposes. But the moment you decide to publicly List them in a manner which could cause a negative outlook or negative view then you will be scrutinized on the Methods and results if they are not fair and accurate.
[Touch HD Windows Mobile ROM Development] KukurikU:
Correct. Fail to see what this have to do with the benchmark. Please don't bother to explain.

100% right!!

this is not for u to decide. i am starting from the bench mark. if the ROM has flows/bugs i return here and try the next one. i am still stuck:p with kwbr's ROM for more than 3 weeks because:

1. the benchmark results are the best and according to the way the ROM feels during usage the results are 100% correct.

2. no bugs

3. almost no tweaks necessary.

without the benchmark i will still be on Dutty's ROM. the benchmark made me change my mind. if tomorrow yr ROM will be first place i'll drop kwbr's and try yours.

let the users decide if they want to try a ROM tested, not tested, from the first 3-5 places or from the last one.

stop trying to censor what u do not like.

it is like the producers of a "not so good movie" that got bad reviews are trying to get all the magazines out from the paper stands. major BS!

you made something, you got reviewed ...the end!
[Touch HD Windows Mobile ROM Development] Fallen Spartan:
Think more info needs to be added to the benchmarks results including:

1. Separate spreadsheet/results for WM6.5

2. Distinction between Lite/Heavy roms or even better separate spreadsheet/results

This would give a more accurate idea of how similar roms are competing against each other
[Touch HD Windows Mobile ROM Development] bobsbbq:
First of all you are never seeing the point. I don't have any problems with any of the ROM's here or the Cooks. Kwbr and many of the others are friends and very knowledgeable and great cooks just to clear the air about that.

It is about Poor methods and methods that produce results that are not credible. Plain and Simple I don't want to be a part of something that I feel is not credible. If daeron will remove and no longer include my results I have nothing else to say but Bye, and good luck.
[Touch HD Windows Mobile ROM Development] KukurikU:
why separate? if i am looking for a wm6.5 i can look at the benchmark and checkout (without looking at the wm6.1 ones) who is the first one, the second one...and so on. no need to separate. same for light heavy and don't forget that u have vanilla, light, super light, barebone and pic only of an OS...lol!

competing?:eek::eek: there is no such thing! stop drinking before u r posting!:D

alooo! earth to Fallen Spartan: this is a benchmark. our cookers never compete they only share, share, share:p
[Touch HD Windows Mobile ROM Development] sonydesouza:
LOL, Mr Engineer has always an answer for everything but he prefers shut his mouth when he's wrong...

Anyway,

Why daeron doesn't want to separate WM 6.1/6.5....Why he doesn't want to remove roms from cookers who ask him ???

Because he's a child...It's really pathetic...

Cookers share their roms...Respect them...and respect their opinion...
[Touch HD Windows Mobile ROM Development] KukurikU:
me? mouth shut? lol! n e v e r !!:p

about removing, allow me to quote myself:
[Touch HD Windows Mobile ROM Development] bobsbbq:
It has nothing to due with poor or bad results. At least not for me anyway. My ROMS are good and my results are good. You still Don't get it. It's Poor organization and poor methods.
[Touch HD Windows Mobile ROM Development] Fallen Spartan:
OK, let me rephrase that.......I don't mean compete, what I mean is a better comparison between different roms

Also, I know the spreadsheet does list Lite, Heavy, WM6.1 etc but for quick reading it IMO it would be easier to read through these if they were split into groups/sections. Again this is only an opinion.

Oh and another thing...there'zzz nuffthin wrung wit darinkin (hicup) befour pustin