Clean up full config after each testcase