[Galaxy Note II General] joytest:
Monthly Ranking and Methodology Description

Rules:

No posts regarding which ROM / kernel is best.

No posts regarding the sheet statistics.

Only post if something is not included in the sheets that should be (like what lyldz posts in the [INDEX] thread)

================================================== ================

2013-06-03

This summary is planned for monthly updates. Since it is currently beta, I will update more frequently for testing.

Current Top 3 for Kernels (May 2013):

1. Perseus

2. Redpill

3. N.E.A.K Note II

Current Top 3 for ROMs (May 2013 result)

1. Assassin

2. BoBCaTROM

3. PhoeniX

267 responses for May 2013.

Methodology

Description of Features for Scoring:

Default Look - the default themes, wallpapers etc that come with the ROM. This is a subjective measure but you can give your rating

Installation - feature richness of the installation process. Full selection with Aroma should be rated a "5"

Included Kernel(s) - if the ROM comes only with Stock kernel, it will be a "1". For each additional Kernel included, add 1, for a max score of 5.

Slimness - AOSP based ROMs should be either "4" or "5". ROMs which are close to Stock should be rated based on how you think the chef removed bloatware

Stability - does the ROM FC a lot?

Battery Life - If you can get at least 3.5 hrs Screen On Time, it will be a "3"

Speedy Updates - If the ROM is updated at least once a month, it should get a "3". Nightlies should get a "5"

Developer Responsiveness - is the dev friendly and responds quickly? Daily responses from the dev should get a "5".

Overall Impression - Your overall impression and rating of the ROM

There are 2 presentations of results list:

https://docs.google.com/spreadsheet/ccc?key=0As-peidjMwx4dEJhUGJoTTBVcHlEaG1KRUhVcEs3bXc&pli=1#gid=0

Most Popular

The first one, used by the Most Popular ROMs bar charts, are a simple count of all entries of a particular ROM. Ie, Column E "Choose Your ROM from dropdown list". It does not distinguish between different versions of a ROM. More entries means the count gets higher.

Features Score

The second one, used by the ROM Features score Table and Graph, is the average of all scores per ROM Version. Ie Columns G to O are summed, result displayed in Column Q "Summary Score". Due to the nature of how Google Forms inputs entries into the sheet, I need to manually update the formula for every entry. I do it several times daily, so by day's end, all submissions should have the Summary Score available.

NOTE: My timezone is +8 UTC (Kuala Lumpur) so please consider this if you are looking for the score update for your submission.

This score is a better indicator of the "quality" of a ROM, as it is the aggregated quantitative feedback from all users.

A pivot table sorts by ROM Name as Row1, Version as Column 1 and Summary Score as values. The Summary Score values are displayed by the AVERAGE pivot table function in Google Sheets.

This is then displayed in 2 ways.

The first is simply a Table display of the same pivot table. This is done to allow faster sort and view of the pivot data.

The second one is where it is displayed as a chart with the AVERAGE score on left axis, ROM Name on bottom axis, and data points of the Value are plotted.

ROMs which have data for different versions will have multiple dots along the same axis but at different score points.

Hope that clarifies how the results were obtained.

NOTE: My timezone is +8 UTC (Kuala Lumpur) so please consider this if you are looking for the score update for your submission.