Improve refresh handling for sdl_audio consumer.

This may eventually be applied as well to sdl_preview.