MarcGrumpyOlejak
/

VerwaltungsAnthologie_Disco_simbad_7B

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

MarcGrumpyOlejak commited on Jul 2

Commit

6641300

•

1 Parent(s): 172eff7

Update README.md

Added the link to the GGUF repository.

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -18,8 +18,8 @@ This is my second "usable" POC of a german based text summarizer based upon 6 di
 This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
 ### GGUF-versions
-(to be created)
 ## Prompts for Retrieval
 Mainly based on DiscoLM, you can use their provided examples – and simplify it a little bit. For possible problems with the "EOT"-Tag I'll just always add the sentence to finish the answer with 3 ###.
 ### Prompt example

 This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
 ### GGUF-versions
+For usage with f.ex. llama.cpp you can find the most popular GGUF-versions from Q2 up to Q8 in a seperate repository: [
+VerwaltungsAnthologie_Disco_simbad_7B_GGUF](https://huggingface.co/MarcGrumpyOlejak/VerwaltungsAnthologie_Disco_simbad_7B_GGUF)
 ## Prompts for Retrieval
 Mainly based on DiscoLM, you can use their provided examples – and simplify it a little bit. For possible problems with the "EOT"-Tag I'll just always add the sentence to finish the answer with 3 ###.
 ### Prompt example