|
--- |
|
library_name: transformers |
|
datasets: |
|
- BramVanroy/alpaca-cleaned-dutch |
|
language: |
|
- nl |
|
license: cc-by-nc-4.0 |
|
--- |
|
|
|
## gemma2b-it-dutch-v1 |
|
|
|
|
|
## Model description |
|
Really shitty finetune of [gemma-2b-it](https://huggingface.co/google/gemma-2b-it) using [BramVanroy/alpaca-cleaned-dutch](https://huggingface.co/datasets/BramVanroy/alpaca-cleaned-dutch). |
|
|
|
## Intended uses & limitations |
|
Its finetuned on [gemma-2b-it](https://huggingface.co/google/gemma-2b-it) which is an english model. However because gemma has a large vocab size i thought it to be interessting to see if it could learn dutch. |
|
|
|
## Training and evaluation data |
|
Trained on [BramVanroy/alpaca-cleaned-dutch](https://huggingface.co/datasets/BramVanroy/alpaca-cleaned-dutch) dataset. |
|
Therefore, commercial use of this model is forbidden. The model is intended for research purposes only. |
|
|
|
## Training procedure |
|
|
|
Trained with QLoRA and merged before upload. |
|
|
|
### Training hyperparameters |
|
idk anymore tbh (i think it has been trained on 400 steps) |
