ao/wasapi: improve exclusive mode format search

fixes #1376