yashsingh1/xdaforums huggingface dataset:
[Epic 4G General] Acei:
Are you still facing this issues? I've yet to receive any reports on this particular issue so far.

Oh and by the way, I am the author of Smartbench 2010. I am here to observe some results and collect some feedback from everyone so that I can improve it further. If anyone has any ideas on improving the app, please let me know. :D
[Epic 4G General] Acei:
Yes, that's because one of the phones I own is the Nexus One, running Cyanogen 6.1.1. :D

I am in the process of collecting results for more phones. I should be able to update the app with more results in few weeks.
[Epic 4G General] Acei:
This may have to do with how fast the camera is passing through the scenes. I am pretty sure even if you get above 3000 for games index, you are not reaching 60 fps yet.

If someone can tell me how long the GLCave test ran, I can probably calculate the fps manually. Or wait for the future version which will probably report the fps number. :p
[Epic 4G General] Acei:
Pretty much yes. Remember though, Productivity index is mainly a CPU performance related with some dependence in I/O. Games index is mainly the GPU performance plus a bit of I/O. Lag fix on Galaxy S series phones does increase the I/O component of Smartbench numbers but due to the way it has been weighted, the final number doesn't swing as much as Quadrant does. Plus, the I/O test itself doesn't see that much improvement when Lag fixes are applied.
[Epic 4G General] chris378:
Midnight ROM 2.8 (CW3) EXT4

1129 Productivity

2683 Game
[Epic 4G General] Electrofreak:
Lag fixes aren't really relevant with the Epic 4G; Samsung mounted the file system differently and the problem does not exist as it does with the Vibrant / Captivate / Fascinate.

That said, thank you very much for joining us here; we've been complaining about Quadrant so long it's a breath of fresh air to see an author actually join the community and gather feedback on a benchmark tool. Thank you. We're particularly happy to see a benchmark that doesn't produce terrible I/O scores simply for running on the RFS file system... it's been a point of frustration for us for some time now.

I do have a mystery for you however; it's with some scores I got on a friend's Fascinate today. See the following post: http://xdaforums.com/showthread.php?t=908370 specifically post #8.
[Epic 4G General] Acei:
Small correction - it does base on I/O, just that it is far less than what you are accustomed to. I had to add some components of I/O since both productivity app and games do access I/O, but I do recognize that improvements in I/O should not double or even triple the final number.
[Epic 4G General] || Acer ||:
Silly, yet curious question.

why is it called Smart Benchmark 2010 if it's 2011?

Just curious lol
[Epic 4G General] Electrofreak:
If I may step in on that one, the answer lies here: http://smartphonebenchmarks.com/for...ch-2010-benchmark-app/page__pid__393#entry393
[Epic 4G General] Acei:
Are you running 2.1 or 2.2? That does seem rather low for the Epic.
[Epic 4G General] Acei:
There are some (just over 20) results that have been posted at SmartphoneBenchmarks.com. Although not comprehensive yet, its a start. I am actively collecting more results from different sources, so in a month or two, we should have plenty of results to compare against.
[Epic 4G General] Acei:
I wouldn't either. I want to see how it holds up and make further adjustments if needed. There is a reason why I called it v2010. If I need to re-baseline the algorithm behind it, I want to call it v2011. :D

This I don't agree with. SGX540 is a powerful GPU and I think it is producing a pretty realistic result for Galaxy S series phones. Theoretical fill rates are also significantly higher than Adreno 200 and even 205.

I've also noticed this on this thread as well. But out of all the phones I've tried, at least on the same phone, the results are fairly consistent. Perhaps the result is affected by the different settings/apps/services each users are running on their phones? Very curious to find out.
[Epic 4G General] Acei:
Pretty much correct. The fact is that since the introduction of Qualcomm QSD8250 (in N1), GPU has seen much more significant improvement than the CPU (well, at least through Hummingbird design), so these numbers are not unreasonable. For the future versions of Smartbench, I may create a baseline on another phone, so these numbers will change for each phones. If you get 3000, all it means is that for games that utilizes GPU, your phone is about 3 times as powerful as the N1 with CM6 ROM.
[Epic 4G General] Acei:
Good to know. I actually had a Vibrant as well. I owned N1, G2, Vibrant and Optimus One when I was developing Smartbench 2010. All of these phones were used heavily to tune this app. On Vibrant, I/O itself was almost twice as fast and the type of test I did on I/O was very a common method - I would read/write files in such a manner when I write apps.

We share the same feelings. :D I do intend to improve this app over time so if you do see any faults with the app, I'd appreciate if you could point them out for me.

When 2.1 was used on Vibrant, I received pretty bad result as well. Combine slower file system and 2.1 brought down the score further. But not to the extreme your friend is observing right now. Once I upgraded it to 2.2 and applied the lag fix, I was able to consistently hit above 1000 in Productivity Index. Games Index, of course, was less dependent since the bottleneck was mostly in the GPU.

Unfortunately my Vibrant is a dead brick now as when I upgraded it to 2.2, eventually it was permanently bricked (internal SD error!). Oh well.
[Epic 4G General] Electrofreak:
What's interesting that we've been noting over on that Fascinate forum is that scores in Smartbench 2010 seem to sometimes drastically plummet after a reboot. Not sure why that is, and if it's related to an actual phone issue or if it's an application problem.
[Epic 4G General] muyoso:
When will there be an option to submit the score from the app itself and have it posted to the website?
[Epic 4G General] dreamsforgotten:
Great find! I'm really liking this app but I'm going to note to the dev if you hit home and re-enter the app (like opening shootme) out force closes and restarts but that is minor

1027 2202

Team on stock dk28 with froyo window theme.
[Epic 4G General] Acei:
Correct. :D

I do intend to release Smartbench 2011 in the near future. But before that, I need to know what are the issues with the 2010 version.
[Epic 4G General] Acei:
Does it plummet and come back after successive runs? Usually after the reboot, some services may not be completely loaded so there might be some contention on the CPU load with Smartbench app.

I've also noticed that the 2nd run almost always produces the best result by a small margin on all 4 phones I own.
[Epic 4G General] Acei:
This is coming for sure - one of the reason for the existence of the website. But I need to think through a bit on what needs to be collected and transmitted to the site so that I don't end up with pile of garbage data. I will probably implement it as part of Smartbench 2011.
[Epic 4G General] Acei:
Thanks. I've noticed this too, just after releasing the code. It is in the list of todo for the next version.
[Epic 4G General] dreamsforgotten:
Great that's the only issue I noticed I'm sure this is on the list as well but a score history in the future would b be nice
[Epic 4G General] mr2noshoes:
Vibrant owner here:

1137/2523

Team Whiskey's Nero v3 w/ext4 (Voodo)
[Epic 4G General] drewX2:
Quantom 2.7

1159

2659

Ext4
[Epic 4G General] Mammon88:
Bonsai V1.1.4

EXT4-no journal-special items

Productivity index:1203

Game Index: 2767
[Epic 4G General] PokeAsheep:
2.1

Epic is as Epic does
[Epic 4G General] Acei:
Is anyone running 2.2 consistently getting less than 1000 for the Productivity Index?
[Epic 4G General] ecooce:
After letting it sit for 4 hours...Also using MeatCurtains recompiled dvm.so still.
[Epic 4G General] Mjacobsen:
1.1.4?!? Come on Mammon, and post that baby!

;)
[Epic 4G General] ungovernable1977:
MidNIGHT v2.6 ext4

PI 1155

GI 2632

Second glitchy run: 1204 and 2758... works for me

SWEET. After source and cm6 comes, have fun w that evo you swapped your epic for!

Dev.- ran again after closing all other apps, and did a funky thing where it said it was doing the next test before it got there, did all 3 graphic tests twice, and at the end displayed 'show results' and 'run again' twice...
[Epic 4G General] Electrofreak:
No, that's the interesting part. Fascinate owners can install the app, run it and get good scores, but then as soon as they reboot, they start getting really bad I/O performance, sometimes black screens, and this persists even after further reboots and even reinstallation of the software.

EDIT - Just checked over to that thread and I notice you're there already. :)
[Epic 4G General] Acei:
Yup, I am actively collecting info from that thread - thanks. :D
[Epic 4G General] tpma4life:
1120/2654

Using Quantum Rom v 2.7 EXT 4
[Epic 4G General] A_Flying_Fox:
I have a thread inthe nexus s forums. They're posting scores too.

Theirs seem to be getting higher scores, so I'm guessing gingerbread did improve things under the hood :D
[Epic 4G General] A_Flying_Fox:
Actually nevermind I just went to it and saw you were there lol

A dev who's really into feedback! Nice!
[Epic 4G General] Neckberg:
1123/2596

dk28 bonsai 1.1.3 EXT4 (no mod) with EB Theme.
[Epic 4G General] jpj526:
I'm running Midnight 2.6 w/ EXT4 (dual)

SmartBench:

1050 Productivity Index

2525 Games Index

-------

Quadrant Score (with the new Midnight ROM (and Ext 4)...my phone is SOOO much faster than it ever has been. My quadrant score on my stock Epic was like 800ish)

1600-1800.

-------

Linpack score:

MFLOPS: 13.954

Time: 6.01 seconds

Norm Res: 5.68

(I'm not familiar with Linpack and have no idea what these numbers mean..or how good they are. Someone want to fill me in?)
[Epic 4G General] Acei:
Yup, thanks for posting over there. :D
[Epic 4G General] CobraR17:
Midnight 2.8 w/ EXT4

Just For Fun...
[Epic 4G General] kgbcapthowdy:
Bonsai v 1.1.3 (no mod) ext4

SmartBench 2010:

1104/2730

Linpack:

Mflops: 14.042

Time: 5.97

Norm Res: 5.68

Quadrant:

1645
[Epic 4G General] kenvan19:
I am really growing to like this benchmark however I have one gripe (though its one that can only be fixed over time): It doesn't offer enough comparison. Sure, the difference between 2500 on a test and 2700 sounds like a lot given the 'quadrant conditioning' however once I ran this on my wife's brand new shift I saw what a real difference felt like (the graphics score on the epic was nearly 250% that of the shift). Without an accurate comparison to a similarly specced device these numbers mean nothing.
[Epic 4G General] Acei:
Agreed. It was #1 on my todo list, and I am accumulating them on SmartphoneBenchmarks.com as well. As part of next release, I will select some of these results and show them in the graphical chart. Should be quite simple.

Those issues related to black screen and super-low results on some Galaxy S devices need to be fixed though.
[Epic 4G General] kenvan19:
Is there a way to help with the accumulation of scores? I have an epic and a shift now and I'll have an evo tomorrow to test.
[Epic 4G General] ecooce:
I guess your going to use stock numbers only??? I just got 1342p and 3047g as I rebooted,cleared memory and ran test...EXT4 with journaling turned back on.
[Epic 4G General] Electrofreak:
Smartphonebenchmark.com takes modded numbers provided you describe what ROM you're running and what kind of overclock.
[Epic 4G General] gzub:
Midnight 2.8 w/ext4 and a few random tweaks

1209/2726
[Epic 4G General] Mjacobsen:
All scores are average of 3 benchmarks.

Reflashed Stock DI18

PI: 715

GI: 2408

Stock DK28

PI: 1064

GI: 2396

Stock DK28, rooted

PI: 1093

GI: 2385

Bonsai V1.1.3 EXT4 w/ journaling

PI: 1141

GI: 2764

Bonsai V1.1.3 EXT4 w/ journaling, w/ fast transitions enabled

PI: 1215

GI: 2822

For comparison (with final ROM config):

Quadrant: 1590 (double stock DI18 score, usually 700-800)

Linpack: 14.284 (double stock DI18 count, usually ~7MFLOPS)

Neocore: 55.6fps (same as stock DI18 fps)
[Epic 4G General] boominz28:
I must be doing something wrong cuz my pi on stock DI18 is 600 everyone elses is over that
[Epic 4G General] apatcas:
well at least you can see your score! i can't even do that with Syndicate's rom.
[Epic 4G General] Whosdaman:
Finally, now people will realize that alot of have been right the entire time. EXT4 really doesn't do anything, and the Epic IS the best device out.
[Epic 4G General] muyoso:
Wut?

Taken from this thread:

Epic 4G running Nebula ROM 1.0.6 (RFS)

Product: 1103

Game: 2508

ROM: Nebula 1.0.6 ext4

Productivity 1152 (4.4% gain)

Game 2674 (6.6% gain)

This is just from one example, but EXT4 absolutely does something. I'll take any 5% across the board gain I can. I wonder what evidence you can POSSIBLY be drawing from to come up with your conclusion, as there is not a single RFS score that beats an EXT4 score in this entire thread.
[Epic 4G General] Acei:
Yes, the best way is to go to SmartphoneBenchmarks.com and submit your scores. I will be taking sample scores from that list. Currently, we now have 29 results. I will probably take stock numbers though - not sure if it makes sense to display overclocked results in the standard chart.

I have the results for Epic, but I don't have any for the Evo or Shift yet.
[Epic 4G General] Acid_Bomb:
PI:1051

GI:2475

Frankenstein FROYO 2.2.1 v17
[Epic 4G General] jaronow:
Bonsai 1.1.4 with theme update, ext 4 with no journaling mod

1st run with basics apps running

1157

2739

2nd run right after

1134

2574

Then I ran level 2 ram clean

3rd run

1183

2728

4th run

1184

2801

and my phone was also warm to the touch after running the test 4 times, it took about 10 min to cool back down
[Epic 4G General] camarojones:
Same here with no results. Seems to be random. Stock di18 with oe click root...no results.
[Epic 4G General] nvertigo:
2.2 froyo leak

1059

2384

4 more runs were consistent with those numbers aside from one which i did after reboot.
[Epic 4G General] Acei:
For those who aren't seeing any results, are you guys using an ad blocker of some sort? If so, could you try disabling it and run it again?

(I realize this is not a long term solution, but at least it will help me narrow down the scope of the issue)

Thanks! :)
[Epic 4G General] camarojones:
Bingo! Disabled my adblocker and it now works. To get my scores, ill gladly see some ads.

Thanks for the tip!!
[Epic 4G General] RushAOZ:
I get a blank screen at the end everytime. I just updated and still the same result. Sucks cuz im extremely curious. How do I disable the adblocker?
[Epic 4G General] ianover9000:
first test

912

1875

second test after closing all apps

890

1946

third after opening browser and alchemy game

856

1767

running the first release of dk28 that doesnt work properly lol.

hopefully in the next day or 2 i will be flashing bonsai. ill post some new scores then.
[Epic 4G General] Electrofreak:
An update is now available for the application that has several more devices listed in the comparison list.
[Epic 4G General] apatcas:
Anyway to get my host file to a normal one? please?
[Epic 4G General] sweepingzero:
i just installed 2.1 syndicateRom and when the test is done where it normally says show results is just a blank screen...
[Epic 4G General] dreamsforgotten:
Discussed up a few posts, there is most likely an ad blocker on your rom. You need a stock host file to stop blocking it.
[Epic 4G General] MedicStuder:
Here's mine:

ROM=midNIGHT 2.7 EXT4

Theme=Gingerbread

MODS=EXT4, leaked 2.2, CWM3, Rooted

Before moving apps 2 sd:

Productivity=1013

Gaming=2538

After moving what apps I could to sd:

Prductivity=1135

Gaming=2557

Sent from my EXT4 Rooted CWM3 Samsung Epic 4g running midNIGHT ROM with Gingerbread theme
[Epic 4G General] Mushmaster:
Lol at mod trying to turn thread into filesystem flame war. "Alot of people have been right the entire time."

Can we dump this guy already?
[Epic 4G General] sweepingzero:
Man I can't wait to overclock

Beamed from my 2172 Chevelle SS 454k
[Epic 4G General] Acei:
Do you have any ads blocker installed? So far, just about everyone who experienced this has one installed, and since ads don't always show up (only displays when there's a matching inventory), you might be experiencing this.

Could you try disabling your ad blocker and try again? I want to narrow down the scenario for this problem.

Thanks!
[Epic 4G General] Acei:
Guys, a new version (v1.2) has been published. This version should fix the "blank screen" issue for those who are experiencing this while using ad blocker.

I've also made the APK file smaller, and now the device graph scrolls!

Note: Still looking into the performance issue on _some_ of the Galaxy S devices...
[Epic 4G General] Electrofreak:
Nice, looking good, lots more devices to compare to now. And the Epic is still king of the hill... :D
[Epic 4G General] BWFBezerk:
Nebula 1.0.6 EXT4

PI: 1150

GI: 2597
[Epic 4G General] rafa3L:
I'm running stock DI18.

I ran the test a few times and was getting disappointing results of around

577 Productivity and 1625 Games. And even lower.

I uninstalled a couple of large applications (google earth and a game), to free up some internal space. I went from approx 50MB available to 100MB.

Now I'm getting scores such as:

682 Productivity

2208 Games

Does that make sense? Can the amount of internal free space cause such a difference?

EDIT:

Maybe it wasn't related to free space, I just got a 551 and 1472. I've rebooted several times and killed apps with the default task manager. Maybe I'll try a task killer app for comparison.

617

1823

584

1601

501

1307

My phone is all over the place, especially on the lower end.

EDIT2:

I couldn't take it anymore :) After a factory reset, my scores are on par with other stock 2.1 devices.
[Epic 4G General] yhbae01:
I think there is a general tendency of Smartbench slowing down as you run more and more tests.
[Epic 4G General] muyoso:
Just a thought to the developer, but the scores included in the benchmark should only be from devices running their stock rom. Too much variance to include scores from devices running custom roms. Also, this will allow people to judge how much better their custom rom is than stock.
[Epic 4G General] Acei:
Agreed.

There's already been few suggestions on adding an option to display only the stock result vs overclocked results. I will be adding this feature to the http://SmartphoneBenchmarks.com in the near future.
[Epic 4G General] muyoso:
That would be great. Don't get me wrong, I love that the Epic has an awesome score in the benchmark, but realistically, it should be MUCH lower. Pretty sure the score that is given as a comparison is not only from a custom rom, but from a custom 2.2 rom probably with EXT4. Until the Epic gets updated to Froyo officially, it should have a much lower score.
[Epic 4G General] gTen:
Why do you assume that it should be much lower?

So far by the results 650-800 seems to be around the productivity for Di18 and Gaming seems to be 2300-2500

For those running stock dk28.. Productivity 1000-1100 and gaming seems to be around same..

I do not see custom roms even with EXT4 making HUGE differences on scores overall :/
[Epic 4G General] muyoso:
Well yea, I call a productivity score cut in half "much lower".
[Epic 4G General] toypaj:
here is what i got running a 2.1 rom
[Epic 4G General] Electrofreak:
Holy gaming score batman.
[Epic 4G General] Acei:
This cannot be produced from a 1GHz setup. Was it overclocked? :eek:
[Epic 4G General] muyoso:
Somebody posted a score with over 5000 gaming score in a thread called "I love cm".
[Epic 4G General] toypaj:
Yes its from acs 2.1 rom with their lucy kernel. I personal feel it runs smoother for then the froyo leaks I've tested
[Epic 4G General] gTen:
Judging by the gaming score..thats with FPS unlocked? cause I know the 1.6ghz part was stepped back to 1.3ghz but not clear what happened to the FPS unlock...
[Epic 4G General] Acei:
I just released a new version of Smartbench, mostly with minor fixes but this time, I've also released "Smartbench Donate" which removes ads and unlocks some new features.

Hopefully, this one won't cause any problems with invalid runs.

I realize it's not worth much but as a small token of appreciation, I will be giving away the "Donate Key" free to those who helped me one way or another (helping me directly, reporting bugs, suggestions, etc). This key will be good for all future versions of Smartbench and I intend to eventually trickle most of the features of the Donated version into the Free version as well.

If you sent me any useful messages to me before but I haven't gotten back to you within the next 24 hours, please do contact me - there are rather many messages I need to go through and I may have missed you. Thanks!
[Epic 4G General] Electrofreak:
Seems to be working well but for some reason my scores have dropped. Since I've been doing a lot of screwing around with my Epic recently, more than likely this is my fault. I would like to see someone who has benchmarked on SmartBench 2010 check their scores on the latest build to be certain.
[Epic 4G General] boominz28:
no kidding mine too

but mine have always been low, not sure what you guys are doing.

my scores have always been around 600 pi and 2100 for the other

im on stock eclair unrooted.
[Epic 4G General] Acei:
Is anyone else getting lower scores than before? On my phones (all 3 of them), they aren't showing this problem.

Thanks!
[Epic 4G General] amwworks:
http://i79.photobucket.com/albums/j149/amwworks/snap20110213_222517.png

I just wanted to post this. It beat the 2x!
[Epic 4G General] muyoso:
1.6ghz huh?
[Epic 4G General] iSaint:
My guess is he's running acs syndicate with DevinXtreme kernel v.1
[Epic 4G General] amwworks:
Yes sir!
[Epic 4G General] iSaint:
Lol...spending to much time on these forums :p
[Epic 4G General] Electrofreak:
That's because you're on Eclair. Froyo has optimizations to the JIT compiler on the Dalvik VM that allow for better performance.
[Epic 4G General] boominz28:
well that explains it lol , notttttt! , but hey I will take your word for it man lol.

Im not too worried about it , I already know my phone is a great phone.
[Off-topic] Deleted member 2758866:
So, I think we need to settle this battle the old fashioned way; with our fists. We need a meeting place and bystanders to drag away the losers. The losing team will pay travel expenses and doctor bills for those who apply.

EDIT: Team Llama got left high and dry. No more Purple, No more Drama, No more Llama.
[Off-topic] VeryCoolAlan:
Llamatown, Nebraska.

8:00 p.m.

Friday, January 14.

In front of the Home Depot next to the Burger King.
[Off-topic] Deleted member 2758866:
It's going to look like this. Man in gonna love free travel.

http://www.youtube.com/watch?v=LtyehuBMAks&feature=youtube_gdata_player
[Off-topic] sakai4eva:
I'm free to fight llamas on 29th February. Name the place. I'll be there.
[Off-topic] Deleted member 2758866:
You better ask off for the 14th. Don't make us hunt you.
[Off-topic] sakai4eva:
Zzzz.... I'm not free Fridays, especially at nights. The reason is simple. It's Friday.
[Off-topic] vbetts:
And if you bring any weapons, we have secret agents in disguise that will take you out in an instant.
[Off-topic] sakai4eva:
Please... I AM the weapon.
[Off-topic] Deleted member 2758866:
Looks like I found my first fight at the fight party.
[Off-topic] sakai4eva:
Some ground rules first.

THERE ARE NO RULES!!!!

*punches Coldskiesfullofblue in the testicles. Marriage will no longer hold the same meaning*
[Off-topic] jaszek:
ICBM.

/thread
[Off-topic] sakai4eva:
I prefer precision. My SEAL teams are on their way:
[Off-topic] Deleted member 2758866:
You think we get married in th US? It's only temporary anyway.

*surprises Sakai4eva with a left hook and kicks him in the testicles like GOOOOOAAAAAAAAALLLLLLLLL!!!!!!!!! *
[Off-topic] Deleted member 2758866:
My gopher will murder those seals.
[Off-topic] jaszek:
Also, what's the point of fighting, if we already won?