GGUF
Not-For-All-Audiences
Inference Endpoints
conversational
TheDrummer commited on
Commit
78df198
1 Parent(s): de77525

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -2
README.md CHANGED
@@ -4,9 +4,17 @@ tags:
4
  - not-for-all-audiences
5
  ---
6
 
7
- # BROKEN QUANT
8
 
9
- Fixed quants incoming
 
 
 
 
 
 
 
 
10
 
11
  Introducing the [BeaverAI](https://huggingface.co/BeaverAI) team: Drummer, ToastyPigeon, xzuyn, MarsupialAI, Twistedshadows, and concedo
12
 
 
4
  - not-for-all-audiences
5
  ---
6
 
7
+ # QUANTS FIXED
8
 
9
+ Thank you to [MarsupialAI](https://huggingface.co/MarsupialAI) for the new f16 GGUF!
10
+
11
+ > PPL on fp16 GGUFs:
12
+ >
13
+ > 3some old: 12.7648 +/- 0.19850
14
+ >
15
+ > 3some new: 8.5832 +/- 0.12397
16
+
17
+ ---
18
 
19
  Introducing the [BeaverAI](https://huggingface.co/BeaverAI) team: Drummer, ToastyPigeon, xzuyn, MarsupialAI, Twistedshadows, and concedo
20