Better remove the exe too, if compilation failed you don't know what that file is and you hopefully checked before compilation that it wasn't there already.