Revert "Fallback on failed audio stream (#78)"

This reverts commit e3692aceba328597b9bc0c208fe52e5e8d169c9e.
Simpler fix for #78