ayoubkirouane commited on
Commit
d3bc3b7
1 Parent(s): 60cb22e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -1
README.md CHANGED
@@ -13,4 +13,13 @@ tags:
13
  - Q8_0
14
  - ayoubkirouane/Mistral-Depth-UP-Scaled-9B
15
  - llama.cpp
16
- ---
 
 
 
 
 
 
 
 
 
 
13
  - Q8_0
14
  - ayoubkirouane/Mistral-Depth-UP-Scaled-9B
15
  - llama.cpp
16
+ ---
17
+
18
+
19
+ # GGUF
20
+
21
+ GGUF is a file format for storing models for inference with GGML and executors based on GGML. GGUF is a binary format that is designed for fast loading and saving of models, and for ease of reading. Models are traditionally developed using PyTorch or another framework, and then converted to GGUF for use in GGML.
22
+
23
+ It is a successor file format to GGML, GGMF and GGJT, and is designed to be unambiguous by containing all the information needed to load a model. It is also designed to be extensible, so that new information can be added to models without breaking compatibility.
24
+
25
+ - [for More info ](https://github.com/ggerganov/ggml/blob/master/docs/gguf.md)