Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

Lewdiculous
/
opus-v1.2-7b-GGUF-IQ-Imatrix

Text Generation
Transformers
GGUF
English
mistral
quantized
text-generation-inference
rp
roleplay
uncensored
conversational
Model card Files Files and versions Community
1
opus-v1.2-7b-GGUF-IQ-Imatrix
Ctrl+K
Ctrl+K
  • 1 contributor
History: 9 commits
Lewdiculous's picture
Lewdiculous
Add: IQ3_S
d82db96 verified about 1 year ago
  • .gitattributes
    2.33 kB
    Add: IQ3_S about 1 year ago
  • README.md
    9.55 kB
    Update README.md about 1 year ago
  • imatrix-base.txt
    201 kB
    Add: F16-GGUF, imatrix-data about 1 year ago
  • imatrix-opus-v1.2-7b-F16.dat
    4.99 MB
    LFS
    Add: F16-GGUF, imatrix-data about 1 year ago
  • opus-v1.2-7b-F16.gguf
    14.5 GB
    LFS
    Add: F16-GGUF, imatrix-data about 1 year ago
  • opus-v1.2-7b-IQ3_M-imatrix.gguf
    3.28 GB
    LFS
    Add: IQ3_M about 1 year ago
  • opus-v1.2-7b-IQ3_S-imatrix.gguf
    3.18 GB
    LFS
    Add: IQ3_S about 1 year ago
  • opus-v1.2-7b-IQ4_NL-imatrix.gguf
    4.13 GB
    LFS
    Add: IQ4 quants about 1 year ago
  • opus-v1.2-7b-IQ4_XS-imatrix.gguf
    3.91 GB
    LFS
    Add: IQ4 quants about 1 year ago
  • opus-v1.2-7b-Q4_K_M-imatrix.gguf
    4.37 GB
    LFS
    Add: Q4_K quants about 1 year ago
  • opus-v1.2-7b-Q4_K_S-imatrix.gguf
    4.14 GB
    LFS
    Add: Q4_K quants about 1 year ago
  • opus-v1.2-7b-Q5_K_M-imatrix.gguf
    5.13 GB
    LFS
    Add: Q5, Q6, Q8 about 1 year ago
  • opus-v1.2-7b-Q5_K_S-imatrix.gguf
    5 GB
    LFS
    Add: Q5, Q6, Q8 about 1 year ago
  • opus-v1.2-7b-Q6_K-imatrix.gguf
    5.94 GB
    LFS
    Add: Q5, Q6, Q8 about 1 year ago
  • opus-v1.2-7b-Q8_0-imatrix.gguf
    7.7 GB
    LFS
    Add: Q5, Q6, Q8 about 1 year ago