fix app features test by only testing a fixed set of features

Don't need to update the tests now every time we add features.