yashsingh1/xdaforums huggingface dataset:
[Galaxy S I9000 Themes and Apps] jjwa:
Version 1.2. XWJM5 Hackeclair, Project Voodoo beta1. With 54 installed apps.

The results do not look great. The first tests were done without restarting, it's been running quite a while, and I used and installed quite a bunch of stuff since last time I restarted the phone. So a nice worst case scenarie.

It takes 30~60 seconds of black screen before it starts, LMFPS 11.72, LPWF 3.53 sec.

Second time it closed after a 30~60 sec black screen, third time it FCs after 30~60 sec black screen. Fourth attempt it simply closed itself after a duration of black screen. Oh, and a FC error comes like 20 seconds after it actually closed...

I guess that at least this means it stresses the phone really well! ;)

(The first run it was plugged into my PC, with the SD mounted, btw. In case we find out that actually matters.)

Time to try it from a fresh boot.

Meh. Last minute 10.22. Longest without frames 4.62 seconds.

Edit:

Version 1.4.

Starts pretty much instantly. FC after running for about 20 seconds. I did have an orientation change or two during the this, no idea of that's related.

Second run, no black screen, initating takes 5 seconds or so.

Longest without frames started out really well, 0.45 sec. And then it froze for 3.14 sec. FPS is all over the place. Between 1 (displayed after a freeze) and 55. Last minute FPS 34.60. Last minute FPS is 23.90 a few minutes later... Total average FPS went from 32 to 27. No crashes, after running for at least 5 minutes.

Oh, and then it gave me an FC when I used the hardware Back button to close it.

Third run with version 1.4.

Longest withuot frames was 0.82, until I had another 3 second freeze. Several freezes. Last minute FPS 22.65. The whole thing is not running smooth at all. Sometimes it runs fine for a few seconds, and that 'normal' FPS seems to be around 50~60, but then it will start become laggy again (many smaller and larger freezes) resulting in 20~26 FPS averages. And FC at close again.
[Galaxy S I9000 Themes and Apps] ed10000:
v1.4 on stock JPC

Last minute FPS: 26.98

Longest without frames: 1.4s

Crashes after a minute and a half.

EDIT:

Tried again. 30.79 LM FPS. Longest time without frames - 0.7s. Crashed after a minute and a half again though.
[Galaxy S I9000 Themes and Apps] CazeW:
v1.2 on JM5 + root + voodoo

Last minute: 11-14fps

Longest period: ~0.9s but did jump to over 3s at one point when fps dropped to 1.

From watching the benchmark, as it being a repetative one, I'd expect it give roughly the same fps all the time but it keeps jumping between 7 and +50 fps.
[Galaxy S I9000 Themes and Apps] RyanZA:
Crashes are pretty strange, since mine running on JP8 does not crash. Left it running a few minutes. It could be highlighting a bug in JPC for all I know, though. ;)

Anyway I'm going to leave 1.4 up without changes for now, and hopefully people with some time can run it on different phones and post their results. The info from these benchmarks should hopefully prove helpful in the future. Specially when compared with different devices. :D
[Galaxy S I9000 Themes and Apps] RyanZA:
Looks can be deceiving. ;) Each image you see flying past is chosen randomly from a list of 1000 images. This means that buffering can't be playing a role in the results.

As far as the fps jumping, this is from

a) Garbage collection being very heavily stressed out by this. :D

b) filesystem caches/other
[Galaxy S I9000 Themes and Apps] tristecire:
1000 images ?

hi

many fc, often.

all i can see is three images :

green cross ( right of rectangle)

red cross (same)

grey ... or gray ?

randomly

about 23/24/25fps average, slowly getting lower.

And then fc.

JPC stock, no lagfix.
[Galaxy S I9000 Themes and Apps] CazeW:
Update with V1.4

Last Minute: ~28fps

Longest without: 1,18s

Ran it for several minutes without problems.

UPDATE: After a few min, the screen got "stuck" and the images stopped scrolling though the test kept running. I'm guessing it couldn't display any more images.

Last Minute rose to ~39fps at this point.
[Galaxy S I9000 Themes and Apps] NeoXTC:
oohhh there's a JP8?????? where's that?
[Galaxy S I9000 Themes and Apps] cba1986:
It's JG8 surely Ryanza made a mistake.

This results are strange.

can feel a difference in everyday usage with voodoo (in the good way) that with One click lag fix.

Market and other applications such widgetlocker and beatifulweather (both in startup) doesn't have the hicup that had with Ryanza Click. And overall performance is better. I'm very confused. :confused:
[Galaxy S I9000 Themes and Apps] DocRambone:
Realbench 1,4,1

I9000HVJH1 docmod v4, 1,20 oc, Ryan lag fix 2,3 (faster than with voodoo lagfix)

last min fps 52,88

tot average fps 49,53

longest 11,25s
[Galaxy S I9000 Themes and Apps] lyno:
Retest With 1.4.1

JPC OCLF apk

Last minute - 52.63 fps

Longest - 0.78

HTC Desire official froyo, unrooted

Now runs

Last minute - 24.40

Longest - 0.48
[Galaxy S I9000 Themes and Apps] RyanZA:
Yup, that's what this benchmark is for. To try and figure these kind of things out. :D

Oh, and screen rotations will also make the app close. It's not a FC - it's actually on purpose for now since I wanted to be sure that the app closed properly for now. :D

Anyway, goal is to keep improving it until we have a tool that is really useful. It's not there yet, but it's a start. :)
[Galaxy S I9000 Themes and Apps] lyno:
How Come my desire gets slow fps yet feels 10x faster? Is it because of the low "longest time"?
[Galaxy S I9000 Themes and Apps] yuliusaje:
mine got stucked and still running

??

JPC + OCLF apk

last minute : 55.67

longest: 1,92 s
[Galaxy S I9000 Themes and Apps] neldar:
The test run between 7 and 10 minutes, i didn't have a look on the clock. Than the slider on right reached bottom and it stopped.

version 1.4.1

results:

just before it stops:

current fps: 56

last minute fps. 52,10

longest periode without frames: 0,13sec

one minute after stop:

current fps: 40

last minute fps. 40,38

longest periode without frames: 0,15sec

On my backlightNotification kernel and CLagFix 1.80.
[Galaxy S I9000 Themes and Apps] raimondomartire:
1.4.1

Last Minute FPS: ~22, Average 15, Longest period without frames: 3.52 sec
[Galaxy S I9000 Themes and Apps] cba1986:
Re did the test with 1.4.1.

This time with better results.

Same config as before.

JM7 + voodoo beta 1

Last Minute FPS: ~53

Average FPS: ~52

Longest period: 0.64 sec

it seems that voodoo is not that bad after all-
[Galaxy S I9000 Themes and Apps] ykkfive:
i think it will be better to test both read and write time, with different file size
[Galaxy S I9000 Themes and Apps] ivanchin99:
JPC rooted with Ryanza lagfix

Last minute: 53.9

Total Average: 50.3

Longest Period without frames: 0.42sec
[Galaxy S I9000 Themes and Apps] taapires:
JM7 + voodoo lagfix

Total Average FPS: 39,68

Longest Period without frames: 0,79sec
[Galaxy S I9000 Themes and Apps] icemac:
JPC

after 30 second application stopped with error "close the application"
[Galaxy S I9000 Themes and Apps] emelie:
TAF 12

LPWF 3.71sec
[Galaxy S I9000 Themes and Apps] g00ndu:
JPC, rooted with no lagfix

crashed. :D

before it crashed, the last fps = 1

longest period without frame = 4.3sec
[Galaxy S I9000 Themes and Apps] celeronix:
JPC rooted and lag fixed

Last Minute FPS: 53.05

Total Average FPS: 51.60

Longest Period without frames: 0.95sec
[Galaxy S I9000 Themes and Apps] drunkeneti:
EXT4 is a journaled filesystem..so the file has to be written and then the journal, that means the disk is accessed 2 times wile one write process

the EXT2 system is non-journaled so just the file has to be written, just one write access

it is possible to run ext4 without a journal, but i do not know which filesystem is faster
[Galaxy S I9000 Themes and Apps] yaocheng:
JPC rooted with Ryanza lagfix 2.3

RealBench 1.4.1

Last Minute FPS: 55.00

Total Average FPS: 53.33

Longest Period without frames: 1.08sec
[Galaxy S I9000 Themes and Apps] RyanZA:
Goal of this benchmark was to create a benchmark that tries to mimic real phone use. It maybe does it a bit too well though, because the results seem to be about as random as actually using the phone...

I think I might go thw other direction and make a SynthBench that tests everything individually.

I understand that, but should EXT4 have well under half the performance of EXT2 for writing images to disk??
[Galaxy S I9000 Themes and Apps] jodue:
first of all, cool idea to make a more realistic benchmark as most others are just completely irrelevant for daily use. thank you.

i gave it a try (1.4.1) but it didn't terminate in 25 minutes...?! at the end of the list it just bounced over and over again?

i'm on JM2 + original lagfix by paul (/data/data on /dbdata/data)

i have some other ideas for a real benchmark:

* open intents (activities)

* open some rendering/javascript intense websites in a browserview
[Galaxy S I9000 Themes and Apps] RyanZA:
It never terminates, it runs till you stop it. You can see the score as it's going at the top. It's still really rough though. If I have the time, plan is to add a whole lot of different benchmarks, with a free google appspot server for collecting people's results, and then a score browser in the app so that you can compare your device with others.

Anybody who wants to help out with

1) Benchmarks in C code/java code

2) Ideas for benchmarks

3) Anything else you can think of

Go right ahead and post it in this thread. If you're interested in (1) and need a SVN/GIT to upload code to, just post in this thread and I'll set it up. :)
[Galaxy S I9000 Themes and Apps] ykkfive:
i just have random read/write in my mind with file size choosen by the users, eg 1k, 512b, 10M, etc, just like others

and, probably the read write time for "each" partition
[Galaxy S I9000 Themes and Apps] RyanZA:
Partitions other than /data need root... I guess the app should have some tests that are only available if your phone is rooted.
[Galaxy S I9000 Themes and Apps] ykkfive:
rite, u r correct
[Galaxy S I9000 Themes and Apps] lsevald:
JM5 rooted with Voodoo beta 1

RealBench 1.4.1

Last Minute FPS: 53.17

Total Average FPS: 51.50

Longest Period without frames: 0.29sec
[Galaxy S I9000 Themes and Apps] bajica:
RealBench 1.4.1

JM7 voodoo fix

C FPS:54

LM FPS:33,65

TA FPS: 32.85

LPwf: 1.39sec

ran it all the way, stopped scrolling, no more list :)
[Galaxy S I9000 Themes and Apps] Segitz:
Bog standard (recently formatted) vanilla JM1 (new) with few apps installed (and taskkilled everything before benching) on international GT-i9000

lm_fps = 16.87, 8.50, 8.33, 10.68, 6.42

ta_fps = 13, 12.66, 11.25, 11.00, 9.98

lp w/o f = 2.90, ?, 3.65, 3.75, 3.75

Ran the test 5 minutes

As you can see... it WILDLY differs because it really matters WHEN you take your numbers... as a viable test, this is not yet working.

BUT... the wildly varying numbers also indicate exactly the problem... it SHOULD be much more leveled, but it isn't.
[Galaxy S I9000 Themes and Apps] RyanZA:
Yep -- the wildly varying numbers are not really fixable. This benchmark is trying to duplicate a phone under very heavy stress, such as when downloading an app in the background while scrolling through your facebook, etc.

I believe the app is doing a very good job at this though, and the numbers really do seem to correlate roughly to real world performance. As can be seen, voodoo has a very large effect on this benchmark, and so does OCLF/EXT2. OCLF/EXT2 actually produces higher FPS because of it writes much faster than voodoo. However, you will notice that OCLF occasionally pauses for up to 5 seconds - this is the buffer being overrun and EXT2 being forced to write to disk through RFS.

So I'm marking this benchmark as a success even at this stage. If you want to know if a change you have made to your phone will translate to better real world performance, this is probably the benchmark to use.

Of course, it still needs a lot more work, but it is already useful. :)
[Galaxy S I9000 Themes and Apps] drunkeneti:
The performance difference is hugh but when the storage is slow in burst writing then it is possible....two years ago i bought a netbook with a ssd and it was incredible slow with a journaled filesystem..

Nevermind, your realbenchmark is a really cool idea...maybe some additional database querys to stress even further, but i do not really know how often the database is used in everyday use...
[Galaxy S I9000 Themes and Apps] Kryptyx:
Ryan you want me to toss this up on the market too?
[Galaxy S I9000 Themes and Apps] meanm50:
Good work!

Droid Eris KaosFroyo V32

Last Minute FPS: 14.67

Longest periord w/o frames: .95sec

App F/C every 5 uses...only after about 30 or 40 seconds though.
[Galaxy S I9000 Themes and Apps] LostAlone:
Im running JM5 with Samset 1.9 and I'm seeing seriously random results.

Depending on my phones mood I get 18f/min and 0.09 second with no frames , or 0.12 f/min and 14 secs with no frames. Kinda weird.

Just as a thought, if you could add a force close button, it'd be appreciated. I find that if you try and close it when its stopped (ie not scrolling) then it can take a long time to get rid of it. I know thats when its at max load and such, but I'm finding that it won't do anything for far longer than just the 'time without frame' time. Either that or it needs to stop by itself sometime :P
[Galaxy S I9000 Themes and Apps] RyanZA:
Nah, it isn't really that useful yet. Eventually it'll get there. :)

I'm starting to think that when supercurio finishes up his lagfix, I'll make an EXT2 version and just not pull out the battery when the phone is on. :D

If it works on the iphone, it should work fine here.
[Galaxy S I9000 Themes and Apps] RyanZA:
There isn't a force close option for a reason! ;)

It makes about 35mb of files on disk, and when you close it, it removes those files.

Force close would leave that 35mb behind.

It should probably run for 2 minutes and then stop and give you a 'final score' I guess. :D
[Galaxy S I9000 Themes and Apps] nxt:
I just tried this on my Nexus One. Left it running a minute or two couple times, and it inflated to 40megs in size.

Also if I touch/move the screen whatever those bars are, it crashes.
[Galaxy S I9000 Themes and Apps] alexandruvlad:
Average : 9.86

Longest Period : 8.84

Is this bad or ?

Jm7 with Ryan's fix :)
[Galaxy S I9000 Themes and Apps] lyno:
That's really bad lol.

with the same setup as you I get;

Average: 52.64

Longest Period: 0.78
[Galaxy S I9000 Themes and Apps] alexandruvlad:
Well , here comes the question

Why is my result like that?

Should i close other apps , like ...Battery Indicator / Antivirus / whatever i have in background - during the bench ?
[Galaxy S I9000 Themes and Apps] Bloodflame:
I'm really pushing my phone to it's limits as it is, so I wasn't surprised to see bad results. Well here they are:

HTC Magic 32B (the one with low RAM)

running Chromatic 4.5 (Froyo)

Rooted + Engineering SPL

RealBench v1.4.1

Last minute FPS: 11.62

Total Average FPS: 11.42

Longest period without frames: 0.60sec
[Galaxy S I9000 Themes and Apps] Bajo76:
Dont know maybe it´s a Bug. At the very end of the benchmark the benchmark screen jumps one point up and down and so on, it seems that the benchmark wont end, it hangs?

So far:

JM7 Voodoo LagFix b1

Last minute FPS: 56

Total Average FPS: 48

Longest Period without frames: 2.65
[Galaxy S I9000 Themes and Apps] itsdaartman2303:
ok i see this is on an Galaxy s .. forum.. but as you ask i tried it on my driod. Im not really sure what the numbers mean good or bad.. is there a scale you go by. Run 3 time. watch it scroll from the top to the bottom never actually gave me a final score but i jotted down the numbers on the top..well how did it do ..that"s with everything running..Real nice app , just not sure where i stand...keep up the good work..

Realbench 1.4.1

Current FPS: 60

Last min FPS: 59.17

Longest without frame: .69

Moto Driod 2.2 FRG22D rooted

Smoke Glass 7.01

2.6.32 low voltage 1-1 ghz chevyno1 kernel

SetCpU set at 250 mhz-900 mhz -on demand
[Galaxy S I9000 Themes and Apps] Chino_Mafioso:
Jp3 prerroted with LagFix 2-3

Last 1 minute: 53

Total AVG: 50

Max time without FPS: 3,99s
[Galaxy S I9000 Themes and Apps] cnstarz:
HTC Evo with CyanogenMOD 6.

[YOUTUBE]_RkOWL0mu6g[/YOUTUBE]
[Galaxy S I9000 Themes and Apps] RyanZA:
Nice.

Smoothness between that and stock SGS is like night and day. ;)

EXT2 Lagfixed SGS looks about the same as that though, while EXT4 SGS looks a lot worse. I'm starting to think EXT4 is a bad idea, as it doesn't bring the SGS's performance in-line with devices like the Evo.

Thanks for posting that! :)
[Galaxy S I9000 Themes and Apps] vitalij:
Jpc with ext2 on external sd card: 52fps, time without frames 0.17s. By the way, isn't benchmark limited by screen refresh of 57fps? That's why all high results look alike.
[Galaxy S I9000 Themes and Apps] g00ndu:
reflash jpc again, this time didn't apply any lagfix. It runs real smooth.

55.33fps

0.12sec
[Galaxy S I9000 Themes and Apps] RyanZA:
Yep. It shows a pretty big difference from stock though, which is what I was aiming for. Most of the lagfixes give fairly similar performance in this benchmark, which shows that multithreaded RFS really is the difference.

As far as write/read speed goes, with 50%-50% write/read, EXT2 is more than twice the speed of EXT4 - even with EXT4 native, and EXT2 virtual. Native EXT4 is not actually much faster at writing than native RFS, while native EXT2 is far faster. Phones usually are more read than write though.

Basically, this benchmark has given the following very very useful info:

1. RFS has adequate write speed for a journaled filesystem.

2. RFS breaks down when faced with multi-threaded read/writes.

3. The internal SD card takes very poorly to traditional journaling. Could be the bus size? Just about anything really.

EXT2 may or may not be a good choice, depending on data safety. This needs testing though, it may be perfectly fine as long as the battery is not pulled out when the device is on, which would be enough for me.

Otherwise, we could try test different filesystems. Maybe J/XFS, or something else?
[Galaxy S I9000 Themes and Apps] gbishop18:
I got

last minute 57.45

current fps 58

total average fp3 40.04

longest period without .37 seconds

incredible running skyraider 3.1rc3 s-off, setcpu at 115
[Galaxy S I9000 Themes and Apps] AllGamer:
Feature Request

it needs a start and stop option

right now, it starts running as soon as you click the App, so you have no clue if that is even normal or not.

also there should be an option to choose for how long to run, or what sort of tests to run
[Galaxy S I9000 Themes and Apps] RyanZA:
What, you mean turn it into a real app? :D

I'm working on it. :) It's really difficult constructing good benchmarks though, and I'm only one guy, so it's going to take me some time. ;)

Here is what is planned though:

- Server that the app will post results to.

- Result browser, giving average times for each device/firmware per test, hopefully as a bar chart.

- Menu with categories of different test types, such as I/O, RAM, Graphics, etc.

- Decent I/O tests, including multithreaded tests, read and write at once tests, etc.

- CPU tests written in both Java and C code, so that JIT and no JIT performance can be compared.

What is done so far:

- The menu. :D

Help (in any form) is welcome. :)
[Galaxy S I9000 Themes and Apps] ed10000:
Running it on DDJG4 with mimocan's lag fix (around 75 apps installed). After 10 minutes,

LMFPS: 55.46

Total Average: 55.34

Longest Period: 0.06s (which I think is REALLY good, isn't it? :eek:

But, I can't see the colors scrolling by anymore, just lines :confused:
[Galaxy S I9000 Themes and Apps] bloodrider:
JM6 with OCLF and diedline scheduler, after reboot.

Last Minute FPS: 52.04

Total Average FPS: 48.73

Longest Period without frames: 0.19 sec
[Galaxy S I9000 Themes and Apps] ericerk:
:

It force closes on me, no results just goes to the end and forcecloses.... moto droid 2
[Galaxy S I9000 Themes and Apps] Bobler420:
did it to the bottom i got

last minute fps 40

total average fps 36

longest period without frames: 10.25 secs

JH2 rooted with the oclf app and the lagfix
[Galaxy S I9000 Themes and Apps] alexandruvlad:
As i got no reply , quoting myself :)

:rolleyes:
[Galaxy S I9000 Themes and Apps] jjwa:
I don't know why your result is like that. But to get higher results, it could help to restart the phone, and close anything you don't need. Anything could slow it down during the test.

But if you keep the programs running that you normally have running, the situation is much more like you would normally your phone, so it will be more 'realistic'.
[Galaxy S I9000 Themes and Apps] Rain_1:
I was getting horrible results aswell. I'm currently running I9000XWJM7 with RyanZAEXT2LagFix BETA 2-3.

I booted the phone and bam, it's running pretty well right now:

Last Minute: 45.03

Longest Period withotu frames: 0.23s

Running for about 2 minutes.

Anything that you do to the phone messes it up (which is expected). Even variation on the signal quality/sensor change.

I guess the phone needs a boot a day to clear the file system cache?
[Galaxy S I9000 Themes and Apps] Segitz:
(Current) Samdroid Kitchen JPC

lm_fps: 28.58,

ta_fps: 25.60,

lp_f:2.22,

crashed after 1.5 minutes...
[Galaxy S I9000 Themes and Apps] LinuxNewb:
----RealBench 1.4.1----

Before Reboot

Current FPS - 24

Last Minute FPS - 8.67

Total Average FPS - 9.79

Longest Period without frames - 5.84 sec

After Reboot

Current FPS - 42

Last Minute FPS - 15.90

Total Average FPS - 16.12

Longest Period without frames - 4.94 sec

I hope Samsung fixes all these IO issues when 2.2 is out.
[Galaxy S I9000 Themes and Apps] jana999:
Yay! I feel happy for some reason :p

Sorry but i'm just a dumb layman~

Eagerly waiting for free toys to play with from the Great Almighty RyanZA:eek::eek::eek:
[Galaxy S I9000 Themes and Apps] tazman171:
Thanks for the app, my results were so horrible that I'm not posting yet.Captivate has got some issues.
[Galaxy S I9000 Themes and Apps] Arise:
JF5 (never updated) with OCLF.

At the end I have something like Last Minute FPS 39 FPS. During the test it was around 50 FPS for Average and Last Minute FPS.

Longest Period without frames: 0.16sec.

Test was running with most apps closed.
[Galaxy S I9000 Themes and Apps] Arise:
Is this project dead?

If this is dead can the owner make sources public?

Thx, I'm interested.
[General Questions and Answers] DJAnt1320:
Buddy of mine gave me his Behold because he said it 'didn't work,' but after doing some looking, I figured out that one of his friends who, 'knew phones' mucked around with some setting(s) and botched the job, making the phone unable to find ANY network and never reads any signal... ANYWHERE.

Does anyone know how to completely reflash the phone back to out-of-the-box? I've already done a 'phone reset, from the settings menu, but that only wipes the user settings in the OS, not the background process.

And before anyone suggests that I 'YouTube' it, I already have, to no avail. ;þ

This is driving me nucking futs!

Haaaaaaaaaaaaaalp!

*** This message is also posted on Yahoo! Answers ***
[General Questions and Answers] DJAnt1320:
Nobody? Anybody?