Exclude compiled binaries and portaudio folder (if present)