move config test to before initial release

This is so that we can test the new functionality introduced
in #625. Thanks go to clocKwize on IRC for catching this!