Update README.md

README.md

@@ -15,6 +15,8 @@ language:
 # VerwaltungsAnthologie_Disco_7B
 This is my first "usable" POC of a german based text summarizer after the [VA_talky_7B](https://huggingface.co/MarcGrumpyOlejak/VerwaltungsAnthologie_talky_7B) and the intermediate [VA_clear_7B](https://huggingface.co/MarcGrumpyOlejak/VerwaltungsAnthologie_clear_7B)-versions.
 In a short direct comparison to [DiscoResearch/DiscoLM_German_7b_v1](https://huggingface.co/DiscoResearch/DiscoLM_German_7b_v1) using ROUGE1, 2 and L, VA_Disco_7B in combination with [hiig-piai/simba-v01c](https://huggingface.co/hiig-piai/simba-v01c) is capable of writing 'better' (more fluently) summaries.
+### GGUF-versions
+For usage with f.ex. llama.cpp you can find the most popular GGUF-versions from Q2 up to Q8 in a seperate repository: [VerwaltungsAnthologie_Disco_7B_GGUF](https://huggingface.co/MarcGrumpyOlejak/VerwaltungsAnthologie_Disco_7B_GGUF)
 ### mlsum-DE only for testing
 Only for testing I used the [mlsum-DE](https://huggingface.co/datasets/mlsum/viewer/de/test)-test-subset. As the whole [mlsum](mlsum)-set is under copyright restrictions, I do hope noone use(s/d) this for finetuning.
 |Model|Rouge-1 F|Rouge-2 F|Rouge-L F|