Only have extras rerun config if it was successfully run before. Config can create the build directory even if cmake isn't found.