Remove torchaudio remnants from code

Remove torchaudio remnants from code.

Follow-up on:
- #5573