Hugging Face's logo

dranger003
/
bagel-34b-v0.4-iMat.GGUF

Text Generation
GGUF
Inference Endpoints
conversational
Model card Files Community
1
dranger003 commited on
Commit
128e0a0
·
verified ·
1 Parent(s): b6e21b4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -2
README.md CHANGED
@@ -8,8 +8,9 @@ library_name: gguf
8
  GGUF importance matrix (imatrix) quants for https://huggingface.co/jondurbin/bagel-34b-v0.4
9
  The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.
10
 
11
- Context length: 200K
12
- Prompt strategies: https://huggingface.co/jondurbin/bagel-34b-v0.4#prompting-strategies
 
13
 
14
  | Layers | Context | [Template](https://huggingface.co/jondurbin/bagel-34b-v0.4#prompt-formatting) |
15
  | --- | --- | --- |
 
8
  GGUF importance matrix (imatrix) quants for https://huggingface.co/jondurbin/bagel-34b-v0.4
9
  The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.
10
 
11
+ Prompt strategies: https://huggingface.co/jondurbin/bagel-34b-v0.4#prompting-strategies
12
+
13
+ Feb. 21, 2024: Updating quants from [latest commit](https://huggingface.co/jondurbin/bagel-34b-v0.4/commit/94054270c89880c5fbc7e8d9d7b7540fcfdcbbeb).
14
 
15
  | Layers | Context | [Template](https://huggingface.co/jondurbin/bagel-34b-v0.4#prompt-formatting) |
16
  | --- | --- | --- |