Only remove current build directory