alsa_source: Undo the proxy/latency changes