dranger003
/

bagel-34b-v0.4-iMat.GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

dranger003 commited on Feb 17, 2024

Commit

d0f2a83

•

1 Parent(s): fa87de1

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -8,6 +8,7 @@ library_name: gguf
 GGUF importance matrix (imatrix) quants for https://huggingface.co/jondurbin/bagel-34b-v0.4
 The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.
 Prompt template: Llama-2 chat (recommended)
 ```
 [INST] <<SYS>>

 GGUF importance matrix (imatrix) quants for https://huggingface.co/jondurbin/bagel-34b-v0.4
 The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.
+Context length: 200K
 Prompt template: Llama-2 chat (recommended)
 ```
 [INST] <<SYS>>