yashsingh1/xdaforums huggingface dataset:
[HD2 Windows Mobile 6.5 ROM Development] pietrucci:
A few thoughts on this.

1. The SPB CPU index is based on 4 components:

Compress 1Mb file using ZIP

Decompress 1024x768 JPEG file

Whetstones MWIPS

Copy 1 Mb using memcpy.

Look at these individual values, is there one value with abnormal results or are all fluctuating very much?

2. This is important to know, I guess you already do: SPB is very very very very sensitive on device, time, status after flash, battery, sim-card, ect. Even just looking at my device from a distance seems to give different results!:p Sometimes it's just like a woman...

That's the reason why I perform so much tests under exact the same condition (is that even possible?) AND also with different settings. Nowadays I perform at least 8 tests!

Also imprtant to know: I always take the

best

individual results from all of the tests and then use them as endresult (so I skip the bad results). We could discuss again wheather I should take the average, but I make this dicision a long time ago so there's no way back.

What I'm saying: it just isn't reliable to do just 1, 2 or 3 tests. Repeat tests, try to do tests under different circumstances, are you sure there are no disturbing resident processes?, remove simcard, batterylevel at least 50%, disable sound, try also with Manila disabled, set screen and power to max (or min).

Choose a fixed set of settings and try different ROMS or even different devices if you have a willing friend with a HD2 or if you are very rich.

One thing you could do is make a backup using Sprite. Put this on one device en do the CPU part of SPB Benchmark (6 times or so with softresets in between). Then put the same ROM and Sprite backup on another device and follow exactly the same procedure. Are results comparable then your device seems ok. If not I'm afraid you should call HTC (or bring it to their Belgium partner Eurotwice in Hasselt... I once could collect my broken device within 3 hours!).

A long story, I hope it adds to a solution for you.
[HD2 Windows Mobile 6.5 ROM Development] pietrucci:
I did extensive tests on Chainfire more than once (last time a week ago), both in SPB and Coreplayer. In my case there never was a substantial difference in results (sometimes even a littlebit slower). Probably there are people out there with other experience, that's fine I can't discuss on that my results are my results.

I agree with you that cooks should ask permission to use it or at least mention it 9so that Chainfire can get mad...). You understand that I don't agree that cooks really get better graphic results in (my) benchmarks.
[HD2 Windows Mobile 6.5 ROM Development] pietrucci:
I test ROMs which I like (and I like the 23/28xxx most..), ROMs which were fast in previous tests, RMs from "famous" cooks and sometimes ROM which people ask me for.

But most of all I test when I have the time...:cool:
[HD2 Windows Mobile 6.5 ROM Development] pietrucci:
No that's NOT real. Obviously I made a mistake (I think it was 4 or 5), I have to check my testresults later when I'm at home.
[HD2 Windows Mobile 6.5 ROM Development] pietrucci:
You can think that I did think that but I really didn't think that (???)

It's always tricky to think for other people.

I did FLASH without sd-card (using ActiveSync and SSPL). Then I did several tests with four hardresets in between. Before some of these tests I inserted the sd-card shortly to install my testprograms, before some tests I made q quick ActiveSync to get my testprograms on the device.

Whatever, however and how much I tested XannyTech's Evolution RC1, I néver got better results than the original results with sd-card.

I'm sorry I can't confirm your theories, that's the way it is. Maybe with other ROMs there is a difference but you'll understand I'm in doubt...:rolleyes:
[HD2 Windows Mobile 6.5 ROM Development] Laurentius26:
Thank you Pietrucci very nice tips. :)

Tomorrow I'm not working so I have all day todo some tests.

I will let you know when I find something important.

Cheers!

Leo :)
[HD2 Windows Mobile 6.5 ROM Development] mightymn:
I assume you install spb benchmark on the device right?

Interesting thing is, if you install it on SD it gives the exact score you say (4000) for CPU index becase of the "Compress 1MB" test :D
[HD2 Windows Mobile 6.5 ROM Development] Laurentius26:
Yeah on the device I install, never on storage card.

But interesting what you mention there, thanks. :)

Edit;

attached my current benchmark with bad CPU Index.
[HD2 Windows Mobile 6.5 ROM Development] mightymn:
here are the results for one of my better runs:

Compress 1 MB file using ZIP-----------775 ms---------1307 KB/sec

Decompress 1024x768 JPEG file--------171 ms----------1645 KB/sec

Arkaball frames per second-------------5.09 ms--------197 frames/sec

CPU test: Whetstones MFLOPS---------1461 ms-------0.255 Mop/sec

CPU test: Whetstones MOPS-----------443 ms---------142 Mop/sec

CPU test: Whetstones MWIPS----------2878 ms--------17.4 Mop/sec

Memory test: copy 1 MB using memcpy--3.29 ms-------304 MB/sec

the only area where this differs considerably from yours is "Decompress 1024x768..."

by the way, I'm getting quite low results for file-system... around 800 (Miri ROM v1.2)
[HD2 Windows Mobile 6.5 ROM Development] Laurentius26:
Yeah if I verify with earlier benchmark and good CPU Index (7072.28) decompress took:

134ms 2098 Kb/sec 657%

Now with CPU Index of 4414.07 it's taking:

336ms 838 Kb/sec 262%

There's the bottleneck I think but weird as storage card is out during test :confused:

About the file system index, on a normal CPU Index of 7072.28 I have:

2376.26

But with a CPU index (4414.07) the one I'm having now:

1488.31

I'm testing atm with SYS and XIP 21889
[HD2 Windows Mobile 6.5 ROM Development] Thiago Fialho:
Hi pietrucci wha't method you use to flash all this roms? Flash rom SD or Flash from pc with usb and active synk? I am asking that because i see some people with problems after flash then i want to know what method are safer. (Sorry for bad english)
[HD2 Windows Mobile 6.5 ROM Development] Savag3Vim:
some benchmarking of topix rom pls
[HD2 Windows Mobile 6.5 ROM Development] mightymn:
So you found the culprit ?
[HD2 Windows Mobile 6.5 ROM Development] Laurentius26:
Hi, this is something that makes me nuts. :(

Suddenly out of nothing my CPU Index is ok again. :confused:

I follow the same steps....... and it has nothing todo with cooking as it happens on a stock rom as well. :confused:

Sorry friend but I realy can not explain what's the culprit. :(

But thanks for your help.
[HD2 Windows Mobile 6.5 ROM Development] mightymn:
Oh...

I really hope it's not hardware related :(

you're welcome:)
[HD2 Windows Mobile 6.5 ROM Development] pietrucci:
No more benchmarking for now...

As you all can read in this thread http://xdaforums.com/showthread.php?t=618938 benchmarks are useless and funny, all HD2 ROMs are fast.

I'm very happy with the extra free time.

And happy with the 23/28xxx interface (right now Xannytech's Evolution RC1).

No more 21xxx ROM for me.
[HD2 Windows Mobile 6.5 ROM Development] Laurentius26:
That's a pitty but I do understand your decission.

Thanks for your work.

Leo
[HD2 Windows Mobile 6.5 ROM Development] tonband:
Please check on this one:

http://xdaforums.com/showthread.php?t=612580
[HD2 Windows Mobile 6.5 ROM Development] bobsbbq:
Thanks for the work you have done. I in know way wanted this to happen. But some people will stop at nothing to try and get on the TOP no matter the cost in stability. I never said they were funny and useless someone else did. I think there has been to much fighting and bickering over it. They are good for some people as a reference. Personally I don't see how you can spend that much your time doing it. My hat is off to anyone who spends that much time of there day testing. The problem is once you start there is so much pressure put on you to continue.

I wish you all the best
[HD2 Windows Mobile 6.5 ROM Development] simranjits:
time to delete this silly thread.
[HD2 Windows Mobile 6.5 ROM Development] Laurentius26:
OMG Bob now you start here again, how sad. :(
[HD2 Windows Mobile 6.5 ROM Development] bobsbbq:
Not starting nothing just making a statement. It seems you are the one with all the post in both threads stirring up trouble.
[HD2 Windows Mobile 6.5 ROM Development] Bouloama:
pietrucci , big ups for all the benchmarks you did.. Now its time to give the "read only memory" of your HD2 some rest and go start enjoying your device ;)

I'll think you will find or already have found by now, the best ROM that suites your needs and you will enjoy the HD2.

All the best mate!
[HD2 Windows Mobile 6.5 ROM Development] Thiago Fialho:
Hey bob congratulations for get what you want. You say lot of bullshits and now benchmarking are ended. :mad:
[HD2 Windows Mobile 6.5 ROM Development] bobsbbq:
Don't blame this on me. Everybody has there choice of what they want to do.

Number 2 I do not talk bull****. I can back up anything I say. The one thing I can't backup is opinion. Everybody has a different opinion.
[HD2 Windows Mobile 6.5 ROM Development] KB24@CL:
what the hell?

I think this thread was great.

The benchmarks were not soo important but one could see all the details about ROM and RAM use...

but due to immaturity the thread derailed many pages ago and ever since it seems like there is a war between the cooks.

lets remember ONE THING....this is a goddamn community and the word community includes supporting eachother and helping eachother for the same goal which is the best possible experience with your device.

Instead of working together and feeding off eachother it seems like there is a war between the members. A little bit of unity and corporate feeling wouldn't hurt.

pietrucci invested lots of time to keep this thread alive and a lot of people here made sure it goes be a waste now...
[HD2 Windows Mobile 6.5 ROM Development] skr_xd:
I really feel hurted to see devs fighting between:(

This is not going to be good for anyone. Not for dev/user/community.

Please for god sake stop further discussions on this:(

Let's concentrate on something productive.

I/no one want to lose any dev again for whatever reason.
[HD2 Windows Mobile 6.5 ROM Development] Laurentius26:
XIP BS

Well you shure have what you want.

According to this post I understand that you removed the wrong dll from XIP yourself.

http://xdaforums.com/showpost.php?p=5383852&postcount=69

Together with the boot.rgu I shared with you in pm probably now your Manila 2.02 will load and Sync notes will work.

HURAAAAAAA :D

No bench and your XIP patch which you asume not using and blaming that it's wrong! :p

Great work dude you can be prouwed on yourself.

And you asked to close thread as well with you as final word?

Wow!

That's my final word.
[HD2 Windows Mobile 6.5 ROM Development] bobsbbq:
Laurentius you are so full of it. You have this fsreplxfilt.dll removed from your ROM as well if anyone doubts me just dump his ROM it's not in there. Now you are trying to make it out to be my fault. Look I shared what I used and that was the point of the thread. You for some reason felt offended. Maybe you didn't like me telling everyone what tweaks you are using and the problems that come with it. I guess now all your users know your ROM is not stable and can't sync Notes. Now they know Why you won't use 2.02. So why are you whining? Just go back to building you fast yet unstable ROM's
[HD2 Windows Mobile 6.5 ROM Development] Laurentius26:
It's not removed Bob, go dump it and yes it's all your fault. ;)
[HD2 Windows Mobile 6.5 ROM Development] bobsbbq:
I already have. It's not in there. Every veteran cook here knows you have removed that filter which increases the file system read indexes. They also know this causes Notes not to sync. Now that people see, you are trying to change your story and you don't want to admit using these things.
[HD2 Windows Mobile 6.5 ROM Development] freyberry:
Bob, it's also possible to exclude folders from the filter, instead of removing it.

About it all being Bob's fault: Definitely not. Sorry Laurentius, he only did what people wanted him to do, which is sharing the tweaks (that were easy to find on the forums, but some people are just too lazy and rather accuse others instead of doing a quick search themselves).

Much of what's going on is your fault. You should stop bragging about your benchmark results and instead concentrate on making good ROMs. If those tweaks are more important to you than stability, then use them. I'm sure some people will like that. But you also have to accept that other chefs have different priorities, and I can totally understand why those other chefs get upset by you.

Now, everybody, stop that BS and get back to the important things.
[HD2 Windows Mobile 6.5 ROM Development] makeveral:
this is pathetic, if you want to argue use pm.

We dont care!
[HD2 Windows Mobile 6.5 ROM Development] bobsbbq:
I know. But believe me it is not included I have his dump in front of me. Now he wants to lie about it. It don't make a difference to me what he uses, but don't lie.
[HD2 Windows Mobile 6.5 ROM Development] bobsbbq:
I agree and I'm sorry. I'm responding to claims that this was my fault, which it is not.
[HD2 Windows Mobile 6.5 ROM Development] Laurentius26:
Well I have to make a apologie here as I have removed fsreplfilt.dll.

It's not my intention to change story but I realy taught is was in.

The dll responsible to sync notes has a slight different name and I have mixed them.

fsreplxfilt.dll is the dll to fix sync notes and that's the one I'm using in rom.

Tonight I will upload WWE rom with fixed sync notes and no fsreplfilt.dll in rom.

So sorry Bob :(
[HD2 Windows Mobile 6.5 ROM Development] freyberry:
Can we all go on with the important things now? We could achieve much more if everyone was friendly and willing to share.
[HD2 Windows Mobile 6.5 ROM Development] Laurentius26:
That's not fair as well as I'm not bragging at all.

I'm only defending these funny XIP story's you are telling and you make it look like XIP patching is bad and that's just not the case.

We all use XIP patches so why you keep bringing this up?
[HD2 Windows Mobile 6.5 ROM Development] freyberry:
Don't you think that you're misinterpreting things? I just warn people, because XIP hacking DOES have negative effects and is is MUCH MORE important to guarantee stability instead of hunting for the benchmark scores.

Yes, I have done some of the tweks in my ROM, after hours and hours of testing in order to guarantee stability. I do NOT say that using the tweaks is always bad, but people must be warned, so that they do testing before they apply all the tweaks.

Finally, can we stop that now and concentrate on making good ROMs?
[HD2 Windows Mobile 6.5 ROM Development] Laurentius26:
And why would you like to warn people just because other chefs who do XIP patching cook a bad rom?

Can't you respect the other chefs instead of bribbing XIP patching is bad?

Don't you think they do a lot of research too before they publish a rom?

Don't you think these chefs know the same as you know?

That's the whole point I'm having a difficulty with and that's what I don't understand in this whole story.

And yes offcourse XIP patching can have a negative effect, actualy the whole rom cooking can have that, it depends who cooks don't you think?

And yes offcourse we can stop now.
[HD2 Windows Mobile 6.5 ROM Development] freyberry:
I never said that. Stop lying and misinterpreting things. I said it can and will have bad effects if not used with care, and that's a fact.

My opinion is that people should use the tweaks with care instead of hunting for the benchmark crown, which says absolutely nothing about the quality of their ROMs.

And no, judging from the posts here, I do NOT think that all chefs are aware that hunting for benchmark scores with XIP hacking can hurt the quality of their ROMs.

That's my opinion and that's why I warn people, and you have to accept that.

I can't talk to someone who misinterprets my words. Anyway, this leads nowhere, so I'm not going to comment anymore.
[HD2 Windows Mobile 6.5 ROM Development] Laurentius26:
How you said it doesn't mather the point is it makes no sence what you are talking.

If you cook a rom without care do you think it will work even if you have a not patched XIP?
[HD2 Windows Mobile 6.5 ROM Development] freyberry:
It does make sense, believe it or not. -END-
[HD2 Windows Mobile 6.5 ROM Development] Laurentius26:
Cool, uploading rom. :)
[HD2 Windows Mobile 6.5 ROM Development] thanas:
is it possible for somebody who knows according to the device conditions to benchmark the latest version of the artemis rom for the leo?
[HD2 Windows Mobile 6.5 ROM Development] firaX:
From a normal users perspective, i think the stock leo rom is already fast enough. Benchmarks don't matter to me. I don't like dirty hacks to get higher ratings in benchmark software. I would prefer roms to be as close to original as possible. The interesting roms for Leo are those with newer Manila/ newer WM builds. That's what interests me. At the same time the challenge for cooks is mostly to make their roms stable.
[HD2 Windows Mobile 6.5 ROM Development] thanas:
http://xdaforums.com/showthread.php?t=612580
[HD2 Windows Mobile 6.5 ROM Development] itje:
@Pietrucci

Never ment my comment in the other thread to be offencive to your work with testing roms..I appreciate what you are doing in this thread..but...

Im not a beliver in benchmarking due to the tools testing it, is in my view, not good enough.

So if I have offended you with what I said in the other thread, I appologoize for it, was not ment to be an attack on what you do here.

What I see as "soap" is the circus that comes with the benchmarking, and how it fires up on some ppl, thats my soap :)

edit:

And as you can see from the argumenting in the last pages, its soap :) Thats what always happens in benchmarking threads..soap :)
[HD2 Windows Mobile 6.5 ROM Development] pietrucci:
itje, I'm not offended (anymore), but all this made me think about what I was doing and for who. That's the reason I didn't benchmark that much last week.

Indeed a lot of work, indeed the tooling isn't that good, indeed all ROMs on the HD2 are fast.

So at the moment I don't have the energy and urge to bench everything, especially not the 21xxx builds with Sense 1921, I'm just not into them anymore.

Indeed this all is a soap, a lot of conflicts between people defending their domain.

Hope eventually some good stuff will come off this all.
[HD2 Windows Mobile 6.5 ROM Development] Thiago Fialho:
Now you get the point. Everybody has a different opinion, so shut up and stop with your annoying and repetitive bullshits against XIP tweaking. Benchmarking are important to me and your destructive criticism ended with this. Thank you a lot for nothing. :mad:
[HD2 Windows Mobile 6.5 ROM Development] Laurentius26:
If you would have done your job ok and closed the thread earlier with all this BS it wouldn't have come that far and now it's a total mess.

I mean who opens a thread with the message 'I have been accused' and a lot of BS about XIP patching which every ppl already know for about a year.

Tell me Itje what's the 'extra' about that and why is it opened in HD2 section and not in General or Development?

If you where a good mod you shouldn't love soap here at XDA in the first place and closed it immidiatly don't you think? ;)

And now your trying to be funny right.

Pfff... your a real hot shot. :D

If you ask me your not sorry at all you just wanted to say your thingy isn't? :D

The fact you love soap doesn't have to do with this post?

Did I hurt your feelings there maybe? ;)

http://xdaforums.com/showthread.php?t=612206&page=8

Here's the soap thread one more time because you love it that much: ;)

http://xdaforums.com/showthread.php?t=618938

And your love soap reply where you did nothing and just let it go to the next day.

http://xdaforums.com/showthread.php?t=618938&page=4
[HD2 Windows Mobile 6.5 ROM Development] pietrucci:
while we were arguing with each other I did a few benches on some new 23/28 Roms:

Miri v1.2 and Artemis v2.5. Miri's wasn't very fast in the bench, Artemis was the fastest I ever tested.

But.. both were very unstable, I had many many freezes and lockups and font issues, especially while modifying the intrrface. Till now Xannytech's Evolution RC1 seems to me the only stabile 23/28 Rom.
[HD2 Windows Mobile 6.5 ROM Development] Laurentius26:
Cool that's very nice of you.

I'm happy you found the spirit to do benchmarks again. ;)
[HD2 Windows Mobile 6.5 ROM Development] Mikulec:
I am using Miris rom and had no freezes or lockups. This is probably because of the modifing, so probably its the new Sense that is causing it.
[HD2 Windows Mobile 6.5 ROM Development] appelflap:
Maybe it is better to report your problems with those roms in the specific ROM treads, so other users can verify/falsify your problems and chefs can sort out your problems. (BTW Miri 1.2 works fine for me, even though I added much modifications myself)
[HD2 Windows Mobile 6.5 ROM Development] Laurentius26:
Good point and avoid a lot of misunderstandings. :)
[HD2 Windows Mobile 6.5 ROM Development] miri:
pietrucci, just read your last post now and to tell the truth I don't know how you come in conclussions of this type "the rom is very unstable" !!!

I've been using the V 1.2 for 2 days without any soft reset, and the same as me other users too.

Who are you to say that a ROM is unstable with 10 minutes of testing it?

I never said anything about your benchmarks because they are never important for me, but to say in a benchmarking thread that a ROM is unstable that is to much my friend.

Are there any hidden intentions?

I'm writing this for public view because you do some "pseudo tests" and publish your "pseudo results" in public.

Till now I never took part in a benchmarking thing but let the things go as others were discussing, but your statement "the rom is very unstable" made me come to this.

So, in my opinion and it will be my pleasure for you to not benchmark or flash any of my ROMs, but I know that it's your right to do whatever you like as we are in a free world.

If it happen that you flash any of my ROMs please just post the numbers and don't give your comments.

The comments are true when said by someone who uses the ROM for more than a day.

Hope to be clear on this.
[HD2 Windows Mobile 6.5 ROM Development] bobsbbq:
I have to agree with Miri on this. Let the numbers speak for themselves. When you start to put your personal opinion criticizing one ROM and then Praise another in the same paragraph it looks like you are being judgmental.
[HD2 Windows Mobile 6.5 ROM Development] miri:
He can come to my 1.2 thread and say that the ROM is unstable, that is his right to do, but he can't give his 10 minute experience on a Public Benchmarking thread.

Because like this I can do the same, make a "Benchmarking thread" and say for every rom unstable, would it be fair ???

I never came to his "Benchmarking thread" and said that his benchmarks are a bull... or false.
[HD2 Windows Mobile 6.5 ROM Development] Laurentius26:
But that's what's happening here all the time isn't?

The endless discussion about speed and instability?

The discussions about being number one in the bench isn't good as the rom could be very unstable....... :D
[HD2 Windows Mobile 6.5 ROM Development] miri:
Laurentius, as you said here that is correct, being number 1 in benchmarks doesn't mean the ROM is stable...

The whole posting of mine is because someone who tests my ROM for 10 minutes comes to this public "Benchmark thread" created by himself and says the ROM is unstable, what would be your reaction if it was your ROM?
[HD2 Windows Mobile 6.5 ROM Development] Laurentius26:
You still didn't notice my reaction on all this BS? :confused:
[HD2 Windows Mobile 6.5 ROM Development] miri:
I noticed that since 2 days ago, and I have to agree that this thread did NOT served it's purpose.

It all started fine and after that the thread owner did NOT knew how to manage it and it came where it is today.
[HD2 Windows Mobile 6.5 ROM Development] Laurentius26:
Edited my post above, sorry needed to say something more.

Edited one more time and removed last comment.

I'm happy I finally made my point.