Remove patches dir.

The bm_poseur Abstract-kvm-executable-names.patch landed.
Only apply patches if dir exists.