Remove the build directory from sync