gaianet
/

Phi-3-mini-128k-instruct-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

apepkuss79 commited on Jul 9, 2024

Commit

0383971

·

verified ·

1 Parent(s): b0801bb

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -30,7 +30,7 @@ prompt template: `phi-3-chat`
 **Context size**
-chat_ctx_size: `3072`
 **Run with GaiaNet**
@@ -56,4 +56,4 @@ chat_ctx_size: `3072`
 | [Phi-3-mini-128k-instruct-Q8_0.gguf](https://huggingface.co/gaianet/Phi-3-mini-128k-instruct-GGUF/blob/main/Phi-3-mini-128k-instruct-Q8_0.gguf)     | Q8_0   | 8 | 4.06 GB| very large, extremely low quality loss - not recommended |
 | [Phi-3-mini-128k-instruct-f16.gguf](https://huggingface.co/gaianet/Phi-3-mini-128k-instruct-GGUF/blob/main/Phi-3-mini-128k-instruct-f16.gguf)     | f16   | 16 | 7.64 GB|  |
-*Quantized with llama.cpp b2961.*

 **Context size**
+chat_ctx_size: `128000`
 **Run with GaiaNet**
 | [Phi-3-mini-128k-instruct-Q8_0.gguf](https://huggingface.co/gaianet/Phi-3-mini-128k-instruct-GGUF/blob/main/Phi-3-mini-128k-instruct-Q8_0.gguf)     | Q8_0   | 8 | 4.06 GB| very large, extremely low quality loss - not recommended |
 | [Phi-3-mini-128k-instruct-f16.gguf](https://huggingface.co/gaianet/Phi-3-mini-128k-instruct-GGUF/blob/main/Phi-3-mini-128k-instruct-f16.gguf)     | f16   | 16 | 7.64 GB|  |
+*Quantized with llama.cpp b3333.*