skit-ai
/

speechllm-1.5B

Feature Extraction

speech-language

Model card Files Files and versions Community

shangeth commited on Jun 25

Commit

90ce71a

•

1 Parent(s): f5f12a4

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -125,7 +125,7 @@ Try the model in [Google Colab Notebook](https://colab.research.google.com/drive
 - **Finetuned from model:** [WavLM](https://huggingface.co/microsoft/wavlm-large), [TinyLlama](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0)
 - **Model Size:** 1.5 B
 - **Checkpoint:** 2000 k steps (bs=1)
-- **Adapters:** r=4, alpha=8
 - **lr** : 1e-4
 - **gradient accumulation steps:** 8

 - **Finetuned from model:** [WavLM](https://huggingface.co/microsoft/wavlm-large), [TinyLlama](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0)
 - **Model Size:** 1.5 B
 - **Checkpoint:** 2000 k steps (bs=1)
+- **Adapters:** r=8, alpha=16
 - **lr** : 1e-4
 - **gradient accumulation steps:** 8