|
--- |
|
datasets: |
|
- neph1/bellman-7b-finetune |
|
language: |
|
- sv |
|
tags: |
|
- unsloth |
|
license: llama3 |
|
--- |
|
|
|
License: https://llama.meta.com/llama3/license |
|
|
|
240608: Now deprecated in favor of https://huggingface.co/neph1/llama-3-instruct-bellman-8b-swedish |
|
|
|
240508: Where is the real version? |
|
|
|
There's been a number of issues with llama 3 finetuning, and most recently an issue with the tokenizer for ggufs. I'm holding back any release until the situation has stabilizied. |
|
|
|
240421: Bellman's back! |
|
This is a preliminary test run, run on mostly the same settings and dataset as bellman-mistral-instruct (But not the dpo pass). Context length is 3072. |
|
I've done some basic testing, and it's not a total mess. Whether it's an improvement to llama-3-instruct, I'm not sure, because that's REALLY good. |
|
|
|
I'll try to make a pass on full context length soon. And hopefully improve the results more. |
|
|
|
Make sure to use the correct chat template (llama-3) for best results. I tested with koboldcpp. |
|
|
|
Let me know if you'd like any specific version. To save time I only put the one up for this 'preview'. |
|
|
|
Trained with Unsloth (https://github.com/unslothai/unsloth). |
|
|
|
|
|
 |
|
|
|
User: Vem var Edward Teach? |
|
|
|
AI: Edward Teach, även känd som Svartskägg, var en engelsk sjörövare och piratkapten under 1700-talet. Han anses vara en av de mest berömda sjörövarna i historien. |
|
|
|
User: Träffade han Gustav Vasa? |
|
|
|
AI: Nej, Edward Teach, även känd som Svartskägg, levde mellan ca 1680-1720, medan Gustav Vasa dog 1560. Deras tidslinjer korsades inte. |
|
|
|
|
|
User: Berätta om selma lagerlöf |
|
|
|
AI: Selma Lagerlöf var en svensk författare som vann Nobelpriset i litteratur 1909. Hon är mest känd för sina verk 'Nils Holgerssons underbara resa genom Sverige' och 'Jerusalem'. Hennes skrivande inspirerades ofta av den svenska naturen och folket. |
