Allow features to be disabled explicitly on preview

We're enabling features by default on preview, but sometimes we might
want to explicitly disable one to compare the behaviour both with and
without the feature.