Add ability for end users to activate/deactivate tests

https://www.pivotaltracker.com/story/show/82239060