yashsingh1/xdaforums huggingface dataset:
[Touch HD General] dazza9075:
Okie dokie, simple plan to directly compare clean ROMs from the cooks without opinions or bias.

I believe the general idea was to either add a new table to the Wiki or modify the existing tables in the ROMs section, to display standardised benchmark result, ie all from the same version following a set of instructions

those might be, flash ROM, hard reset, install bench mark programs, softrest, softrest run benches with radio on/off

Could be expanded to include basic battery life i dont think having call time / sms count would be helpful as its too unpredictable. but perhaps standby time and or wifi/bluetooth turned on but not connected.

I dont think its about real world tests since we cant have opinions, its a simple OS comparison.

course, for all i know there will be almost nothing between any of them making it redundant so this is why im making this thread, to talk it out and see if its worth while.
[Touch HD General] noris08:
and you are starting this "new" thread as a result of my ideea and proposal:D

wouldn't have been nice to mention?:)
[Touch HD General] scotchua:
Benchmarking will give you a very incomplete picture of how a rom is actually going to perform, and therefore will be a virtually worthless use of your time. The real performance of a rom is gonna very significantly based on what software you use, which versions of the software you use, and sometimes even the order in which you install it. There is no consistent reliable benchmarking tool that i have seen as any useful indicator of actual speed of a rom.

The best way to find out about what rom will suit your needs is to read the frist couple posts, then kinda browse through the thread to see which bugs people are posting most regularly. When i was testing the WM6.5 roms, I had no issues with the fact that some people had exchange issues, because I was not having them, but eventually the fact that the notifications weren't working correctly caused me to change to something else. I tried another rom with some TP2 features, and generally liked it, but MyPhone didn't work correctly on that roms for whatever reason.

The point I'm trying to make is that there is no such thing as an unbiased benchmarking, because if we only test them all with no software installed, running clean then you're gonna find that almost all roms score similarly. Even more to the point, I simply have never seen a benchmarking program which had results which were indicative of any real world performance, and as such, I have disregarded the use of them entirely.

If you're happy with the rom you're on, then keep it. If not then read a few threads, see what is out there and then based on a little bit of research try one. If you don't like it, then try another one or even go back to the old one.
[Touch HD General] dazza9075:
Sorry, looking after my 3 year old today, pulling my hair out, damn cheeky monkey!but yes totally based on your idea, just wanted to make the link in the old post before it got the chop ill edit the original post in a min
[Touch HD General] KukurikU:
amen to that!

just making a little bit of reading and got scared by the possibility of threads about "witch ROM is better" beeing aloud:eek:

this is going to end badly as i already know that from the trinity forum and from the diamond forum. the forum is going to be cluttered only because a few lazy sobs are not ready to spend a few moments reading the ROM's threads and drawing their own conclusions. it is enough to read the first page, one of every 3 pages and the last one in a ROM thread to understand what is all about.

not only that but when the thread is going to be too long some smart ass is going to open another (he has no time to read a l l those pages)...and than another. please, stop the madness:p
[Touch HD General] dazza9075:
I agree, to compare ROMs completely requires opinions and subjectional review but since ive not tried this idea on different ROMs i couldnt say for sure what the results would hold.
[Touch HD General] sergiopi:
Once upon a time, before the internet age, there were "Informatics" and "personal computers"

We had a problem: every shop sell HIS PC, assembling HW and assessing "My PC is the faster one". Also many TWEAKS were proposed for DOS and applications (This was before Egyptians I believe...)

The solution?

We built a SUITE, using a scripting tecnique, EMULATING REAL LIFE USER and measuring time, memory usage, battery load, CPU load... :)

Instead of using commercial benchmarks, because we don't care really about the file system speed, scrolling a large DIR matters, or rotating the screen speed.

We emulated a PRO user and a FUN user, opening a standard office file, starting and closing TT7 or video player speed with standard app (es. TCPMP) , opening an IE page, internet speed, scrolling a LOOOONG contact list, anything you consider as normal life usage.

A script could be used to start every single task and measuring the time.

AND IMHO THIS will be the killer application, comparing different ROM, devices, Diamond is faster than HD? and Kaiser? WVGA how slower is in REAL LIFE? :cool:
[Touch HD General] noris08:
i belive you miss the point

this is supposed to be a tool helping people with less time or experience to choose the rom that is more appropiate to them

and maybe even help the developers to improve their work

as in the original thread is mentioned it isn't ment to say which rom "rules"

but, as i already said, if people will find this useless, or discussion will degenerate, a mod can close the thread anytime
[Touch HD General] scotchua:
I don't think we missed the point, just trying to share from experience why benchmarking isn't a particularly useful gauge to users trying to pick a rom. If you don't have the time to look around then i'd actually suggest just picking a rom based on what you read in the first couple posts describing it. Also that type of users should just pick a rom that is fuller with more programs installed by default.
[Touch HD General] stepw:
Great idea, but will it ever be real?

While it's possible to devise a set of benchmarks and some kind of subjective scoring algorithm, the measurement accuracy will depend on too many factors and the result is likely to be unreliable and inconsistent. Seeing how many various ROMs based on the same OS builds are getting very different ratings in ROM benchmarking threads, real life performance seems to depend on every modification implemented in a ROM. E.g. even if the difference between ROMs is merely in a few files or a few registry keys, you'll probably end up comparing apples to oranges so this won't be very useful.
[Touch HD General] tnyynt:
I must agree to that! At the end of the day, it all comes down to what started this thread: the personal feeling a user gets when using a ROM in his own particular way of using it, which is totally different and uncomparable with other's.
[Touch HD General] noris08:
it seems that i can not make you see my point

i will say it for the last time

my original ideea was NOT to compare one rom to another rom.

that will only lead us to square one - which rom is best

AND THIS IS NOT THE POINT!

whatever!

i'll give up

cheers!
[Touch HD General] sergiopi:
Benchmarking suite....

1) Free memory, storage mem at first start

2) Boot up time (measured with a simple program started at the end of the boot)

3) Search a string (time)

4) Open a complex word document (time)

5) open a complex excel document (time)

5) Active sync connected, open a simple web page, time, open a a Complex web page (success, time) (IE)

6) Open a LOCAL complex web page, scrolling, (time)

7) Restoring 4000 contacts (pimbackup, success, time)

8) Restoring 2000 SMS (pimbackup, success, time)

9) TT7 startup and close (or other BIG software, time)

10) TCPMP standard video player performance (direct draw, accelerated)

3 times each test, % of battery resulting startin with a full charge (these are only examples, just to explain better the point) :)
[Touch HD General] autdev:
i agree to noris08!

this thread is not what was the original intention

i doen't want to know if some rom is about 10ms faster than other rom as i have readed in other threads where one published his benchmark score 2635. and a user posted the question if his device fails because he comes "only" to score 2450 e.g.

no, for example i testet 5 ROMs from 4 chefs.

i would be able to tell the reason for choosing the actual ROM on my HD. There where many facts hardly subjective opinions for choosen that! I think if a user would describe his decision respectfully to the hard work of the cockers this will help all of us.

if the guy is wrong other users can reply with their opposite experiences he knows it is worth to look for the reason on his device(configuration).

We all know speed, good feeling depends on many factors. so only a respectful discussion will help users and chefs.

even when user are telling a specific ROM is slower than other specific rom, other users can agree or disagree. if one is telling it is slow and many others reply the opposite this is a useful information for the user and the chef. chef get the response his rom seems to work fine. otherwise the chief get the information his rom leaks in speed and there are further tuning possibilities because other rom look to be faster.

I would find a thread e.g.

"Your experences with different ROMS" or

"what rom do you use and which property or feature do you like extra"

maybe useful.

If someone is posting: "ROM X ist the best" useres are old enough to know that this is not a meaningful post.

I would like to read postings like:

I am using ROM XY - has great looking german keyboard with äöüÄÖÜß - very stable (softreset max. 1 in 2 Weeks ) Battery: without Backligth and no running program and no dataconnection only 60mA i experienced a "normal" value, in suspendmode over night max. 1% Power loss although G-Alarm and phone active ) overall good responses.
[Touch HD General] zuadao:
are you guys so scared of whos rom will be the fastest??

end of the line the fastest rom will be the one better built. (the one more tweaked)

its like talking to ppl :

"wow its stupid comparing a dell pc to a alienware pc with the same hardware"

why??

its like if someone is a fanboy of ati and never admits a nvidia car will perform better & vice-versa

and of course as like the nvidia & ati cards, not only hardware will make a difference.
[Touch HD General] KukurikU:
do you want to know how it really should look a ROM review?! did you ever imagine how complex a ROM is to build a ROM? do you know what is the difference between a good and a bad ROM? here u have an example from one expert i'll trust with an opinion!:D

the-equinoxe said:

the whole post is here:

http://xdaforums.com/showpost.php?p=3387292&postcount=76
[Touch HD General] autdev:
sorry, but this does not subject this thread and nobody doubts about ROM cooking is not a simple job! thanks to all chefs!!!!

from the user's viewpoint i think its clear and software is made for users. user do not mandatory want to know whats behind the scenery in deepth. user want a device with software with basic properties and naturally many cool features - lets say:

a stable ROM with all features he needs for daily use, cool features for fun and suitable speed. if the userinterface have a appealing design also it's nearly perfect!

and here we are back again:

"what features or properties do you like most"

would help users to find out, what is the best for him!

this is naturaly only my opinion

P.S: Sorry for my suggestion to open a thread, i just found a thread with such a Subject!!!!!
[Touch HD General] KukurikU:
cool features and appealing design in a rotten ROM means high battey consumption, frequent freezes and soft resets and so on...

i think i wasn't clear enough in my previous post. what i meant (in a nut shell) was that because of it's complexity deciding that a ROM is good, less good or bad is a professional's job. only an expert can give you a trustworthy opinion.

the moment somebody starts a "what is the best ROM for me" everybody will jump in and push the ROM he is using. after a while the thread will be cluttered with hundreds of honest but unprofessional opinions and you'll have on one page 8-9 different opinions. does this make yr decision of choosing a ROM easier?? i don't think so! so, back to square one:p

in my wet dreams i see a thread filled with posts of "ROM critics" that are analyzing each new ROM. reading such reviews could be very useful indeed.

in short: if u are a chef and own a kitchen than beware of the "food" critics that are visiting yr restaurant. they can kill yr business in tomorrows front page ROM review or make you a very, very rich and famous chef:)
[Touch HD General] dazza9075:
ok So to conclude,

we cant use benchmarks since the difference between them would be next to nothing

we cant judge a ROM based on its funtionality since its purely opinionated

we could potential use a script to run a series of real world tests that become useless after a few resets and number of programs installed

That pretty much knocks the idea on the head then?
[Touch HD General] tnyynt:
:) sure looks that way.

I would all come down to every user deciding on his own. Would you believe that after trying lots of ROMs I've reverted to a certain Stock ROM because I find that it offers close to perfection for my needs? I could praise the speed and stability and I'd advise you to use it, but you 'd most probably find that it would not suit your needs.

Anyways, I've offered to support a thread that is civilized and based on factual opinions, I will keep my word in doing so, if there's be such thread.

Here's another idea for you all: a good factor to take into consideration when judging a ROM is the number of users using it. It's a good indicator of the ROM's value, since X no. of users are hangin' on to that. Why not post and maintain a simple poll with the most common ROMs (stock and cooked) and see where it gets you?
[Touch HD General] stepw:
There were threads with ROM popularity polls already, some cookers complained the results are skewed and are getting even more skewed in the end. The more hype, the higher the ROM will end up in the poll, which is a questionable indicator of ROM quality and usefullness.

IMO if the original posters can present a reasonable ROM comparison based on unbiased facts, describe their approach and prove it's credible, we'll all adopt it happily. Giving up at first sight of criticism is not an effective way to prove your point guys.

Are you up for this challenge or not?
[Touch HD General] noris08:
it seems that this thread has stucked. i am wondering if the majority of the users are so good in reflashing new roms and if they have so much time to do that so they would not be interested in having a tool like that one we are talking about:confused:

or me and a bunch of other guys are the only n00bs who need it?

why no rom developer is posting an opinion here? i realy would like to know one or two opinions of the most involved people around

if i am wrong, maybe it is for the best someone to close the thread.

cheers!
[Touch HD General] Fallen Spartan:
I believe what you are trying to acheive is a excellent idea, but I think where the problem lies is how do you implement this?

As previously mentioned we cant use benchmarks since the difference between them would be next to nothing

We cant judge a ROM based on its funtionality since its purely opinionated

We could potential use a script to run a series of real world tests that become useless after a few resets and number of programs installed

So what way do we implement this to acheive our goal??
[General Topics] GutterFaceMobile:
SOMEONE PLEASE HELP!!! I've been all over the place trying to find any one with some info on how to make my samsung epix compatable with T-mobiles (US) 3G network. The problem is, this phone is an ATT phone so its set to ATT's configuration. Somebody had told me that, AT&T always has Windows devices disabled for HSUPA/HSDPA 3G speed in the registry. T-Mo has only deployed the faster HSUPA/HSDPA 3G network and the phone has it disabled. So..... now with that info, all i need is some help with some one familiar with registry editing software with this phone. if anyone has any info for me i would be more than greatful!!!

PLEASE HELP!!!!:(
[Touch Dual, MDA Touch Plus General] montanamansv6:
Good Day everbody i am new here and a newbie to this type of phone where can i go to get new applications or skins for my Touch \

Thank you
[Touch Dual, MDA Touch Plus General] Romantok:
Also a Telus Touch Dual

I also have a Telus HTC Touch Dual and have problem finding anything on it on any forums I checked :confused:

It is a new one and we will have to wait it seems.

Mine has no SIM, is a NEON400 not a Nike and the speed is 528 MHz so nothing as showned here. :(
[Touch Dual, MDA Touch Plus General] Brocko12:
HTC Touch Dual...

I am having the same problem as well on these forums and sites.... seems everywhere i look everyone is complaining about a similar phone.. im just trying to find different things i can do with these new phones... First pocket pc i owned so im just sold on the weather feature.. hahaha...

anyways gentlemen you hear anything new and exciting and anything this phone can do feel free to post it or send me a message...
[Touch Dual, MDA Touch Plus General] masalma:
Bump :) does someone need to unlock it in order to change the ESN, my Bell touch crapped out on me, and was hoping to use the Telus Touch Dual, but with my luck i bought the only phone out there that is unlockable lol
[XPERIA X1 General] bartveld:
I have an Xperia with a UK ROM. Can I upgrade with a newer Dutch ROM (simple, official firmware)? Or will it brick my phone?
[XPERIA X1 General] Lokatho:
Possible, but with hard-spl.
[XPERIA X1 General] kwiateusz:
on another forum few people updated en rom with polish official rom without hardspl and it's work fine :)

certs are correct so why that shouldn't work?
[XPERIA X1 General] Ronniebiggs:
I myself went from original TMO NL ROM to SE UK GENERIC newer version without Hard SPL, so should work without no problem.

On a sidenote, now I do have Hard SPL and Itje's Touch-IT 4 RC1.1 :P
[XPERIA X1 General] bartveld:
OK, thanks for your replies. I'll consider my options.
[XPERIA X1 General] Lokatho:
You can always try to flash without hrd-spl, if it isn't possible you get an error saying that (before bricking your phone).
[iPAQ rw6828, XDA Atom General] kosmodisk:
hi can someone help me?

http://216.139.221.18/downloads/mobile_speak_pocket/release/MSP_RemoteAlignment.zip

please run this, click retrieve go into:

"C:\Program Files\Code Factory\Remote Screen Alignment\"

then the program folder and just copy me the files:

"HP ipaq 6815.dat"

or

something like this...

can you post it there? or send to nofxsak@seznam.cz thaks i really need it

maybe i can use also Atom´s calibration data so if you can help me

thanks
[P3470 General] Parkerc:
The problem is:

I really don't know exact course...I have Win 6.1 (Pharos_WWE_ROM_5.2.20226.by.poldo)

I've started installation of sls2009, firstly it installed Windows CF 2, then SQL and asked for Soft Reset, but I continued installation - and then installation program installed the sls2009. Then I performed soft reset by default built-in (by poldo) program 'softreset'.

So, when my device turned of & on again - it froze on black screen with red-colored letters - GSM module version etc... and that's all....nothing further....still that black screen with red letters...

And I don't know either it happened be course of SQL installation or Win CE 2, or be course of 'softreset' program... and I can't flash any ROM as I have no hard SPL. I've flashed ROM by using Jump SPL only.!
[P3470 General] Parkerc:
Correction: PHAROS_WM6.1_V05_B20275 by poldo...

and it seems device to be online..partly....as there is green led-diode flashing as if it loaded and online. then - when I press&hold Power button - I hear Beep sound as if I trying to turn device off....(but when I use central Hardware button to reboot, but It still don't responding - still black screen with red letters...
[P3470 General] Parkerc:
Sorry for panic....Hard Reset saved my ass....
[Touch Diamond, MDA Compact IV ROM Development] kissman21:
Hi, i am dumped ROM parts (00-03) from my Diamond and now i want rebuilt. I was tried many xda how-to but nothing worked for me (buildos.exe still crashing)... can any1 rebuilt my rom from my raw & nbh files please? :confused:

Part01.raw - 83b713c3832cb3d7aa50d1ddcad10a1d

Part02.raw - 7b46546ef449a85327aa8cb01d2928ce

RUU_signed.nbh - 730ce591b387af50e8810a71e9d0cc29 - can be downloaded too from HTC site here with this serial - ht836gn41032 . Must be WWE_EastEurope

(upload done, nbh can be extracted with winrar from HTC file & pls check the md5 sums, my connection is sometime unstable)
[Touch Diamond, MDA Compact IV ROM Development] okokur:
the ruu_signed.nbh ... what is it?

is it a cooked rom?

if yes

{

you need the original rom, which made the cooked rom.

i.e.: mr. cookiman takes orig. rom from provider "have-to-much-money-telefonica" - after cooking mr. cookiman shares his cooked rom.

you flash it.

for rebuilt dumped roms you need the orig. rom from provider "have-to-much-money-telefonica"

}

else {use rapidshare for uploading}
[Touch Diamond, MDA Compact IV ROM Development] kissman21:
no, its original ROM shipped with my device (eastern europe rom, downloaded from htc site) uploading now... but with this rom is CZ o2 branding with CZ language packs (dumped). rapidshare is for me very slow, mediafire is ok, but no more than 100mb, uloz.to is ok, speed is ok and download is easy, just click the link and than retype captha code and click "Stahnout FREE"
[Touch Diamond, MDA Compact IV ROM Development] okokur:
o.k.,

i do it.

but i dont know if i understand you right.

only rebuilding (extract than building)?

now i am thinking, how or where i upload it ... ?

are you online?
[Touch Diamond, MDA Compact IV ROM Development] kissman21:
yes, i am here :) my situation: i buyed new device, and want reflash with customized rom. But I buyed device from my operator and in future when I want return device for repair, i need flash original rom to device. My original shipped rom is from HTC and with added CZ customization (CZ languages etc, operator branding)... I dumped this ROM and downloaded original ROM and now i need make flashable ROM :) u can upload anywhere. srry for my bad english
[Touch Diamond, MDA Compact IV ROM Development] okokur:
no problem, i will try upload to rapidshare.

theoreticle i have give ftp-support, but checking will gives no access.

you can try okimoto.ath.cx/webcam or only okimoto.ath.cx.

(webcam is an old name so dont panic)
[Touch Diamond, MDA Compact IV ROM Development] kissman21:
i tried, but oki have no acces and oka have no annonymous acces... if u like rapid, its ok... i can dowload long time, but upload for 12hours :D:mad:
[Touch Diamond, MDA Compact IV ROM Development] okokur:
now 95% ready.

but for flashing you have to "hard-flash". its like a key that is needed for flashing other roms. and this is marking in bootloader-mode a text which provider can see that the device was flashing.

o.k., now 100%

hope, link is http://rapidshare.com/files/206198322/ruu_signed.rar.html
[Touch Diamond, MDA Compact IV ROM Development] kissman21:
thanks a lot... but srry i dont understand you... "hard-flash"?

/edit ahh, u mean hard-spl? :) after flash, i can return original spl, i am right?
[Touch Diamond, MDA Compact IV ROM Development] okokur:
hmmm ... theoretical yes, but this was one of the things, that i have never tried. :-(

okokur
[Touch Diamond, MDA Compact IV ROM Development] kissman21:
ok, again, thanks a lot :)