aifeifei798
/

llama3-8B-DarkIdol-2.1-Uncensored-32K

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

aifeifei798 commited on Jun 28

Commit

55b7e6c

•

1 Parent(s): 24ea3d8

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -16,7 +16,7 @@ tags:
 # fast quantizations
  - The difference with normal quantizations is that I quantize the output and embed tensors to f16.and the other tensors to 15_k,q6_k or q8_0.This creates models that are little or not degraded at all and have a smaller size.They run at about 3-6 t/sec on CPU only using llama.cpp And obviously faster on computers with potent GPUs
- - ZeroWw/llama3-8B-DarkIdol-2.1-Uncensored-32K-GGUF
  - More models here: https://huggingface.co/RobertSinclair
 # Model Description:

 # fast quantizations
  - The difference with normal quantizations is that I quantize the output and embed tensors to f16.and the other tensors to 15_k,q6_k or q8_0.This creates models that are little or not degraded at all and have a smaller size.They run at about 3-6 t/sec on CPU only using llama.cpp And obviously faster on computers with potent GPUs
+ - https://huggingface.co/ZeroWw/llama3-8B-DarkIdol-2.1-Uncensored-32K-GGUF
  - More models here: https://huggingface.co/RobertSinclair
 # Model Description: