Revert "hal: Add speaker backend case handling"

This reverts commit 143e58db945bf609ccfdd2e2b4008be2824fd45e.