CLC-1209 Feature toggling

JIRA: https://jira.media.berkeley.edu/jira/browse/CLC-1209

Design explained in the JIRA.