assaf/vanity — pull request #121 by hellochar (2012-08-11 00:18:36+00:00)
Title: Several features from our fork

Hi assaf,

A coworker (@shuqunzhang) and I have been working on a fork of vanity which introduces several new features; we're making this pull request to see if you would consider incorporating some of the changes. The biggest things are:

* Ab tests can now be "enabled" or "disabled". While disabled, a "default" option will always be chosen and no metrics/participants will be tracked. The dashboard shows the status and also lets users change it by clicking a link. Tests also have a different colored background depending on if they're enabled, disabled, or finished.
* Tests can be "reset", which removes participant/conversion data (same as `destroy`) but also re-initializes the experiment (setting its `created_at` again). The dashboard shows a "reset" button for each experiment.
* Users can manually select which option should be the outcome; the dashboard shows a "complete" button for each alternative.
* Support for tracking multiple metrics per experiment.

A couple other miscellaneous notes:
* We added two ActiveRecord migrations to accomodate our features.
* Experiments are sorted alphabetically instead of by creation date in the report
* `AbTest#save` may only be called once; this is clearly not optimal but wanted your input as to how important it is (we personally don't ever call it more than once)
* Documentation is missing except for in the README.rdoc; we have not modified any code in the /doc folder.

Thanks for your time!

Xiaohan Zhang, Sherry Zhang
Vertical Brands