GitHub repository: mtkresearch/TASTE-SpokenLM
Primary language: Python
Description: A method that directly addresses the modality gap by aligning speech token with the corresponding text transcription during the tokenization stage.