yashsingh1/xdaforums huggingface dataset:
[HD2 Windows Mobile 6.5 ROM Development] miri:
I don't see a bad thing that you are number one in benchmarks and your ROM is stable, it's a great thing.

Sorry haven't followed all your discussion with other people so really can't comment on that.

What I can say is that you don't have to answer to every people that can say something for you. You patched XIP, that's fine what problems does it have for your ROM? Nothing. So, go ahead and don't listen to people, it's simple :)
[HD2 Windows Mobile 6.5 ROM Development] Mikulec:
Guys, I think its enough now. Why not just ignore such comments? There are plenty of people that like your roms (including me) even if someone tells its not stable, its bad or anything alse. There are people that try roms and judge them depending on their personal experience and not depending on others experience.

So move on and do not add fuel to the fire, please.
[HD2 Windows Mobile 6.5 ROM Development] miri:
Mikulec, I've closed my discussion on this (until piettrucii explains his intentions when judging a ROM as not stable by using it for 10 minutes).

As explained before for me it would have not been a problem if the famous piettrucii would have come to my thread and said to me that the rom is not stable, but he shouldn't post that in a general benchmarking thread created by him (he should not be judging) and says "that is not stable"

Benchmarks = Numbers

Opinions = After some use you can share opinions on the ROM's thread

Anyway, enough is enough...I agree with that.

In my opinion as I said before to Laurentius this thread has caused many people to go out of themselves. What are the points I see in this thread:

1- didn't serve it's purpose, because of bad management by it's owner

2- caused many key people of the forum to go out of themselves

3- caused missunderstanding in Custom ROM users

4- created a lot of confussion amongs members
[HD2 Windows Mobile 6.5 ROM Development] itje:
wow, the **** hits the fan...

Laurentius, you could not hurt my feelings even if u wanted too :rolleyes:

But you are right in this, this thread should be closed, and the other one should have been closed earlier.
[HD2 Windows Mobile 6.5 ROM Development] Enonoid:
Thank you for the hard work Pietrucci.

About the cooked rom thing. I do agree with Tnyynt.

The device got almost everythin I need. And It works.

As with previous Phones from HTC. Well lets say that this wasnt exactly true.

Remember MDA Vario? when it came to the markent the stock rom was really slow. And renderd the device almost unusable.

A cooked rom was a good choice then.

Now with the HD2. I think now at this time that the only reason I would flash a cooked rom is.

- newer version

- remove some twitches (sms/text lag)

Or even WinMo7 but thats A long time ahead
[HD2 Windows Mobile 6.5 ROM Development] crazy cat:
I have added my benchmarks. All devices have the oldest OEM-ROM (original, without tweaks).

*Updated attach file!*
[HD2 Windows Mobile 6.5 ROM Development] pietrucci:
THis file isn't readable. Perhaps put in Excel and then zip?
[HD2 Windows Mobile 6.5 ROM Development] jisin:
could we please get a readable version? :)
[HD2 Windows Mobile 6.5 ROM Development] pckshd:
Very noticeable. Can't imagine how fast would a "lite" cooked ROM be!
[HD2 Windows Mobile 6.5 ROM Development] pietrucci:
Benchmarked the (Dutch) 1.48 version. It's about 10% faster than 1.43.

At least: according to the benchmark...

Will publish later.
[HD2 Windows Mobile 6.5 ROM Development] crazy cat:
Sorry for the delay. I was out-of-office :p

Excel-Filed zipped and uploaded. Check out the attach file.
[HD2 Windows Mobile 6.5 ROM Development] pietrucci:
New ROM: 1.48

Added the benchmark of the Dutch 1.48 ROM. According to the benchmark it's about 6% faster than 1.43.

See post #1.
[HD2 Windows Mobile 6.5 ROM Development] Biffy:
Is the max draw on battery difference quite significant for battery life?
[HD2 Windows Mobile 6.5 ROM Development] djcedric:
Me too,no flash because the look is changed without flash,apps needed working fine,NO BUGS very important!and wow SOOO FAST! but i like so much to flash,i hope i can resist because like tnyynt says there is no need to flash :)
[HD2 Windows Mobile 6.5 ROM Development] pietrucci:
New ROM: WWE-TUR 1.61

Benchmarked the WWE-TUR ROM 1.61.

It's a bit faster than 1.48, memory is less I think mainly because of the two languages files.

See post #1.
[HD2 Windows Mobile 6.5 ROM Development] Steve0007:
Hi Pietrucci,

After Topaz, we now meet in HD2 forum.

So now we have the proof that Leo 1.61 WWE/Turq is a bit faster and uses less Program storage than 1.48 :)

Thank you for your work.

Hope to see this thread sticky soon :D
[HD2 Windows Mobile 6.5 ROM Development] SatScan:
VID speed... multimedia phone HD2??

Hey There,

Did you see the graphics score...

Will the HD2 be a multimedia phone?

HTC did get a wakeup call...

Grtz,
[HD2 Windows Mobile 6.5 ROM Development] Steve0007:
Yep saw it but look in the benchmark, a cooked Diamond 2 Rom makes the index indicator twice higher than the current 1.61 so let's expect our chef to provide us a real multimedia device :D

Nice article:

www.pocketnow.com/thought/htc-improving-the-hd2-rom-by-rom
[HD2 Windows Mobile 6.5 ROM Development] pietrucci:
New ROM: TouchIT v1.1, first cooked ROM

Benchmarked the first Leo cooked ROM:

Touch-IT Black Leo WWE v1.1 (21887, Sense 2.5.1922)

Fast but not as fast as the stock 1.16 WWE-TUR ROM (at least: according my benchmarks...). Much more storage memory.

Now I'll test PDAVIET.

See first post.
[HD2 Windows Mobile 6.5 ROM Development] l3v5y:
Any chance of flashing my ROM for a test?

It's a later (post UI change) ROM, and has Extendir! :)
[HD2 Windows Mobile 6.5 ROM Development] pietrucci:
Off course I'll test it! Tomorrow.
[HD2 Windows Mobile 6.5 ROM Development] D.O.C:
it is time to test topix now, that it is online, on the HD it was always the fastest, lets hope he keeps up
[HD2 Windows Mobile 6.5 ROM Development] pietrucci:
New cooked ROMs

Two more cooked babies:

PDAVIET 2.01.531.02 v27-12 (21887, Sense 2.5.1922)

Topix v0.1.1 (21887, Sense 2.5.1921)

Topix is the fastest till now!

EDIT 28-12: Sorry the rom I tested was Topix ROM and NOT l3v5y's.

Will benchmark l3v5y tomorrow!

EDIT 28-12: Don't worry l3v5y, your ROM benchmarks even faster than Topix!

Will publish later.
[HD2 Windows Mobile 6.5 ROM Development] Toss3:
Heh Topix was just a "little" bit faster. :D Xda ftw!
[HD2 Windows Mobile 6.5 ROM Development] pietrucci:
Well... if you look at the totalsheet, you'll see that it is so fast mainly because of the file system index. Some of the benchmark tests give such a speedy result that that the total benchmark index is very high compared to the others. That's just the way SPB decided to benchmark.

So it surely doesn't mean that Topix is almost twice as fast as the others!

Certainly not in daily use.
[HD2 Windows Mobile 6.5 ROM Development] l3v5y:
Excellent! :)

Which version? Full, Light or Vanilla? Can't wait to see what I have to improve for the next build! :D
[HD2 Windows Mobile 6.5 ROM Development] pietrucci:
I tested the full, so I guess the light and Vanilla are even a bit faster (?). It takes a lot of time testing them all and I want to test ROMs from others too.

Your file system index is very very high...
[HD2 Windows Mobile 6.5 ROM Development] appelflap:
I don't know what the author of this ROM did and how (s)he did it but it's extremely responsive. I tried them all (except the Miri Roms), but this ROM is lightning fast. Fast, in the sense that it responds extremely fast on screen taps. No lags whatsoever. Not even a little lag at the lock screen when comming out of standby.

Would be nice to have some benchmarking based on a more realistic setting. Don't know if it's possible, but I can imagine that for just one device it must be possible to come up with some tests that would mimic everyday use.

Anyway, thanks for the benchmark tests!
[HD2 Windows Mobile 6.5 ROM Development] THE GRIZZ:
WHOA... Topix benchmarks is showing more than %40 performance increase over stock ROM. im not sure how much of that will translate to real world performance difference. hope the other cookers are taking notice to bridge the unacceptably high performance gap between the ROMs.

what did he do different than the rest? is it just the use of extendir

pietrucci, would you consider adding an additional benchmark the measures the video playback performance in Core player. basically just get a short DVD quality clip and leave it in the SDcard. and just run the benchmark tool in core player. very effective in highlighting real differences. i used to notice as much as %15 difference between different cooked ROMs on the X1
[HD2 Windows Mobile 6.5 ROM Development] pietrucci:
I guess I could do that, but it's really too much work to do this test on the ROMs I already tested.

I did an attempt, see attach. I choose a mp4 testfile, video_test.mp4, used before on this forum.

I could add this test to my future benchmarks if you people like it.
[HD2 Windows Mobile 6.5 ROM Development] l3v5y:
Benchmarking the full ROM is probably best, as it'll be the slowest.

I think everyone on here appreciates the time you spent benchmarking ROMs, so thanks a lot! :)
[HD2 Windows Mobile 6.5 ROM Development] pietrucci:
New test: Coreplayer

Hi everyone,

As you can read (and see) in the first post I'm planning to add an extra Coreplayer test. Starting today with l3v5y's ROM. I will also do the Coreplayer test on the HTC Stock 1.161 WWE-TUR ROM as a reference.

I will integrate the Coreplayer results in the main page later.
[HD2 Windows Mobile 6.5 ROM Development] pietrucci:
New ROM: l3v5y Full

I benchmarked l3v5y's Full ROM: it the fastest till now!!!

Added an extra worksheet with Coreplayer results (see the Legenda worksheet for more details on this test).

See post #1.

Congratz l3v5y!
[HD2 Windows Mobile 6.5 ROM Development] THE GRIZZ:
thanks. should be very helpful to many. but i dont think you should dedicate a full sheet for Core player. since the video information is identical for for all roms there is no need to even mention it. a single field for "CorePlayer Average speed(%)" in the origonal sheet is enough since its the only relevant information that matters anyway

btw, whats the resolution of that test video? and why not change it to a very short (<1 minute) to simplify and speed up the test
[HD2 Windows Mobile 6.5 ROM Development] D.O.C:
How are u measuring coreplayer?, I did a benchmark on coreplayer with miris rom and it shown nearly 400% average speed..... I dont think it is real, I find it impossible to make such a big gap in relation to other roms.... are u using a special video file?..
[HD2 Windows Mobile 6.5 ROM Development] D.O.C:
sorry, double posted.... anyways, how about making this thread a stickie?
[HD2 Windows Mobile 6.5 ROM Development] yosi199:
its funny... so far i've tested i3v5y both full versions roms and they where very sluggish but they recieved the best scores in your benchmarks...

I'm trying topix now and will see how it feels.

anyway, great work for the dev and chefs.
[HD2 Windows Mobile 6.5 ROM Development] manuelcalavera:
please do the same for new miri rom
[HD2 Windows Mobile 6.5 ROM Development] pietrucci:
Look at the Legenda worksheet in the Benchmark sheet, there I explain some more about the video (mp4, 800x480). I use video_test.mp4, a HD movie from about 1 minute about some nice models...

doctorcete, the point is as long as I test the same video on the same device I get results I can compare.

THE GRIZZ, I was planning to integrate the Coreplayer results in the main sheet so indeed no need for a separate sheet.
[HD2 Windows Mobile 6.5 ROM Development] D.O.C:
you are right bro, same video, same device, different rom should give us benchmarking..... sorry, I am not going through everything, my fault.... anyway, will search the video and post coreplayer result with miri's rom, unless yo beat me to it.... thanks!.
[HD2 Windows Mobile 6.5 ROM Development] l3v5y:
I think he tested the 09122701 ROMs from yesterday, and I think I changed the pagepool which broke everything!
[HD2 Windows Mobile 6.5 ROM Development] pietrucci:
yes I did, look in the description of your ROM it says v27-12.
[HD2 Windows Mobile 6.5 ROM Development] pietrucci:
New ROMs

Benchmarked two more new ROMs:

Miri HD2 WM6.5 v1.0 (21887, Sense 2.5.1921)

Sone HD2 v1.0 (28014, Sense 2.5.1921)

See first post.
[HD2 Windows Mobile 6.5 ROM Development] tossero:
nc

Thank you , you are doing a wonderful job! Would think of testing Topix 1.0 in the near future ?:)

Thank you in advance!
[HD2 Windows Mobile 6.5 ROM Development] drewX2:
Thanks for providing these benchmarks. I receive my HD2 tomorrow and cant wait to try some roms out.
[HD2 Windows Mobile 6.5 ROM Development] Caste23:
Thanks a lot for your great work !

Can you make the same with v1.1 Miri's ROM ?

Regards.

Caste23
[HD2 Windows Mobile 6.5 ROM Development] Ultimaex:
Its easy to do it yourself ;)

@pietrucci

Maybe it will be easier to make a google docs sheet and place the benchmark results there.
[HD2 Windows Mobile 6.5 ROM Development] pietrucci:
hi,

for all of you cooks who never tried shadrac's extendir I think you should visit his thread, http://xdaforums.com/showthread.php?t=530710 and try it out. It gives your file system a big boost, al least according to my benchmarks.

When I look at my benchmark results I guess l3v5y and kwbr already use it...
[HD2 Windows Mobile 6.5 ROM Development] Ultimaex:
I know from Touch HD ROMs that kwbr usually dont want to use it because its not perfect. Please correct me if im wrong :)
[HD2 Windows Mobile 6.5 ROM Development] pietrucci:
Could be, but I never noticed any disadvantage.
[HD2 Windows Mobile 6.5 ROM Development] pietrucci:
New ROM

Benchmarked new ROM: Topix v1.1 Sense 2.5 (21887, Sense 2.5.1921)

Fast as his previous...
[HD2 Windows Mobile 6.5 ROM Development] kwbr:
Current extendir has some drawbacks which I spoke about with shadrac some months ago. New version will fix that like directory filters etc. In certain setups you may get lag or sync problems. Real life experience is different from benchmarks :)
[HD2 Windows Mobile 6.5 ROM Development] l3v5y:
Your file system results are amazing if that's the case... I'm using extendir (though whether it's working I'm not sure).
[HD2 Windows Mobile 6.5 ROM Development] kwbr:
I don't use extendir atm. Used it in the past but we can see what it does on Leo.

No new rom though this week :)
[HD2 Windows Mobile 6.5 ROM Development] Bib_x:
Can you make some benchmark testing with video driver installed and fpu enabled? Would be interesting.
[HD2 Windows Mobile 6.5 ROM Development] DuperMan:
Seconded and bumped.
[HD2 Windows Mobile 6.5 ROM Development] appelflap:
With so much roms and so much version of these roms, isn't it much easier when people benchmark newly installed roms themselves and post the results in this thread?

Pietrucci is appearently using the SPB Benchark software, so in principle everyone can test his/her rom. One can get SPB Benchmark for free on the SPB site.

Only thing one has to know is which "laboratory settings" Pietrucci is using (i.e. what the settings are of the context variables, such as: which version of SPB Benchmark has to be used, what is installed during the test, does the phone has to be in flightmode, micro-sd card installed or not etc. etc. )
[HD2 Windows Mobile 6.5 ROM Development] pietrucci:
I'm very willing to share my benchmarks procedures. But there are a few remarks on that...

First of all: these benchmarks are very very sensitive. Testing under exactly the same conditions gives (slightly) different results every time I test. Even the battery condition and the time after flash an the number of softresets are a factor. Means that I have to follow exactly the same procedure every time. I always perform 6 tests with pairwise different setup and then take the best results of them. All in all it takes me about 2 hours for every test.

Secondly: every device is different. Even two devices bought in the same shop give (agina slightly) different testresults. Perhaps you can imagine what devices from different countries and different build dates do.

So I think you understand that spreading the benchmarks over different devices and different people brings an extra factor of unreliability. Does everyone follow exact the same procedures? How can we tell? If only one person is unreliable the whole benchmarks are unreliable... What device is used? Which model, which build date? And how does it perform compared to the others? If only one device is a bit different froim the others the whole benchmark is worthless...

Again, I'm very willing to describe my testprocedures (it should save me a lot of time afterwards when I don't have to test alone anymore!). But it will take a lot of time to describe everything in detail so I have to be sure it makes sense to do so.
[HD2 Windows Mobile 6.5 ROM Development] appelflap:
First of all I want to show my gratitude for your benchmarking, like I did before. Now I know how much time you're are puting into it, I appreciate your tests even more.

I did a little test myself on the new PDAViet Rom today and I got results that so much deviated from your results, that I almost thought that I had a crippled device or that the new Rom was really, really bad. So, I completely understand what you're saying.

But, if people are willing to investigate some time in it, it surely can save you a lot of time and we can all benefit from it, because. Let's be fair, it is fairly impossible to place the burden of testing all those roms on the shoulder of just one man.

First of all we can do some preliminary research in how well the different devices compare to eachother. Maybe you can come up with a simple testprocedure that everyone can do (immediately) after he/she flashed his/her device, so that we can investigate if it is possible at all. Just to check if it's feasible.

What do you think of a little testprocedure which only tests the filesystem i/o? That takes just 5 min., right? If we could compare the results of say ten users, we pretty much have an idea of how much the several devices differentiates from eachother. On the basis of this result you could decide if you want to "publish" your detailed testprocedures.
[HD2 Windows Mobile 6.5 ROM Development] pietrucci:
Ok, I suggest we could do the following test:

0. Make sure the battery is loaded between 70 and 100%

1. Remove the sim-card

2. Flash to WWE-TUR 1.61 Stock ROM

3. Do another hardreset after flash

Do the following immediately after hardreset:

4. Answer all questions negative (so no connections etc.) untill Sense is started

5. Disable sound

6. Install SPB Benchmark v1.6 (the version currently on the SPB site)

7. Run SPB Benchmark and only enable the first tests (file system) and note the results

8. Run the same tests again and note the results again

9. Softreset and immediately repeat step 7 and 8.

10. Now you've got 4 results of each test, take the

best

result of each test and publish it here.

When 3 or more people are willing to do this test we get a first impression of our differences...
[HD2 Windows Mobile 6.5 ROM Development] pietrucci:
To proove my point: see attach.

I did the File system part from SPB Benchmark, all on my own device, ALL UNDER THE SAME SETUP: sim-card removed, no sound, battery > 70%, nothing installed or uninstalled. Only differences are softresets in between.

The first six tests are right after the first hardreset, the second six tests are right after the second hardreset, exactly under the same conditions ad the first hardreset.

So one would think all test would be the same more or less... So one would think the second six test are equal to the first six... NOT!
[HD2 Windows Mobile 6.5 ROM Development] ctman:
HD2Ov1.2 is missing... any of HD2Owner roms are missing.

Thanks for sharing. Keep up the good work.
[HD2 Windows Mobile 6.5 ROM Development] drewX2:
Thanks for doing this for us. Definitely makes a difference.
[HD2 Windows Mobile 6.5 ROM Development] le_paulo:
I agree with you 100% - the purpose of these tests is to test the ROM, not the device. If everyone starts doing tests of ROMs, we are adding another variable into the mix we don't need (i.e. the Hardware) and that will make the test results less reliable, unless a lot of people all do identical tests and we average all results out to exclude the hardware variable.

I doubt many will do the tests as seriously and conscientiously as you do! :cool:

Just out of curiosity - I assume the HD2 is polling the G-Sensor, light sensor, proximity sensor, [compass?] etc, etc frequently so that must have an impact on results depending on your particular environment and how often you handle the device...or does it?
[HD2 Windows Mobile 6.5 ROM Development] pietrucci:
That's because I only test WWE (and sometimes Dutch) ROMs... But because I like my German friends I'll test the 28205 1.2 version for this once.
[HD2 Windows Mobile 6.5 ROM Development] pietrucci:
That's because I only test WWE ROMs (and sometimes Dutch).

But because I like my German friends I will test the 28205 1.2 version for this once...
[HD2 Windows Mobile 6.5 ROM Development] appelflap:
You've convinced me, the differences between test-cycles on just 1 device makes it clear that spreading the tests over more devices is unfeasable. Nontheless, out of curiousity I did some testing, using the procedure described by you. (I did just one test-cycle. That is, I didn't perform a hardreset. Just 3 x 2 filesystem tests with 2 softresets in between).

After seeing this results I am more convinced that my proposition to share the testing should be completely ignored :)

Keep up the good work, pietrucci.

---
[HD2 Windows Mobile 6.5 ROM Development] Tzeunis:
Can we make this thread sticky like in the Diamond2 forum.. very usefull imo.

Ga zo door kerel! Toppie! Respect!
[HD2 Windows Mobile 6.5 ROM Development] ctman:
THX its the first (nearly working) 28205 Rom here

Thx for the effort!
[HD2 Windows Mobile 6.5 ROM Development] Jibreil:
Adding PhamQuangs ROM would be also ncie
[HD2 Windows Mobile 6.5 ROM Development] ctman:
I have tested it.. V04 not stable at all!

no caller id

... hangs up randomly..... and..... and much more problems...:mad:
[HD2 Windows Mobile 6.5 ROM Development] pietrucci:
New ROMs

Added two more ROMs to my benchmarks:

HD2O v1.2 28205 GER (28205, Sense 2.5.1922)

Xannitech's Pandora 1.0 (21887, Sense 2.5.1922)

Xannitech's is the fastest ROM ever (till now...)!!!

See post #1.
[HD2 Windows Mobile 6.5 ROM Development] pietrucci:
Indeed

nearly

working... The graphics aren't lined out very well, sizes are to small. Still some work to do.
[HD2 Windows Mobile 6.5 ROM Development] ctman:
I hope so... but these minor bugs, i dont mind

posted problems i have found in his thread...

When he solves the filesystem problem...(and the other bugs) his would be the fastest here :rolleyes:

would deserve a wwe version for sure!

THX
[HD2 Windows Mobile 6.5 ROM Development] Xannytech:
Thanks a lot for the bench... ;)

I think that after my Pandora now many cookers are digging and dissassembling my rom and soon also the others will go fast as mine, but i can do better :D
[HD2 Windows Mobile 6.5 ROM Development] houms:
My bench results

Hello, I was used to doing Daeron benchmark for my touch HD.

http://xdaforums.com/showthread.php?t=516190

Now, I'm on HD2 and do some bench on the HD2 with HD2 roms.

Hope it can help.

You should add opengl bench, Some surprises!

As the HD2 is very fast, not sure if speed will be a so critical parameter as it was for the HD.
[HD2 Windows Mobile 6.5 ROM Development] ctman:
Hmm... strange surprises

OK... that throws the old benchmarks over the haufen ... it messes it completle up... :confused::eek: