Remove source files from build dirs