Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Reset Other
quantized
text-generation-inference
4-bit precision
AutoTrain Compatible
Inference Endpoints
8-bit precision
Merge
Eval Results
Mixture of Experts
custom_code
Carbon Emissions
Apply filters
Models
1,094
Full-text search
Edit filters
Sort: Trending
Active filters:
quantized
Clear all
Mozilla/mxbai-embed-large-v1-llamafile
Feature Extraction
•
Updated
9 days ago
•
1
afrideva/kappa-3-phi-abliterated-GGUF
Text Generation
•
Updated
8 days ago
•
1.27k
•
1
afrideva/Orca-2.0-Tau-1.8B-GGUF
Text Generation
•
Updated
8 days ago
•
1.43k
•
1
afrideva/Yi-1.5-6B-GGUF
Text Generation
•
Updated
7 days ago
•
1.05k
•
2
afrideva/Meta-Llama-3-8Bee-GGUF
Text Generation
•
Updated
7 days ago
•
849
•
1
MaziyarPanahi/Llama-3-70B-Instruct-v0.1-GGUF
Text Generation
•
Updated
about 19 hours ago
ravenscroftj/CodeGen-350M-multi-ggml-quant
Text Generation
•
Updated
Apr 24, 2023
•
2
ravenscroftj/CodeGen-2B-multi-ggml-quant
Text Generation
•
Updated
Aug 5, 2023
•
2
ravenscroftj/CodeGen-6B-multi-ggml-quant
Text Generation
•
Updated
Apr 24, 2023
•
9
ethzanalytics/dolly-v2-12b-sharded-8bit
Text Generation
•
Updated
Apr 29, 2023
•
4
•
4
ethzanalytics/dolly-v2-7b-sharded-8bit
Text Generation
•
Updated
Jun 28, 2023
•
4
•
1
pszemraj/long-t5-tglobal-xl-16384-book-summary-8bit
Summarization
•
Updated
May 5, 2023
•
12
ethzanalytics/stablelm-tuned-alpha-7b-sharded-8bit
Text Generation
•
Updated
May 4, 2023
•
3
•
2
rozek/OpenLLaMA_7B_300BT_q4
Text Generation
•
Updated
May 5, 2023
•
1
ethzanalytics/stablelm-tuned-alpha-3b-gptq-4bit-128g
Text Generation
•
Updated
May 7, 2023
•
2
rirv938/GPTQ-LLaMa-65B-4bit-triton
Text Generation
•
Updated
May 25, 2023
•
3
kyo-takano/open-calm-7b-8bit
Text Generation
•
Updated
May 28, 2023
•
5
•
10
CalderaAI/13B-Ouroboros-GPTQ4bit-128g-CUDA
Text Generation
•
Updated
Jul 20, 2023
•
3
CONCISE/LLaMa_V2-13B-Chat-Uncensored-GGML
Text Generation
•
Updated
Aug 7, 2023
•
3
•
7
CONCISE/LLaMa_V2-13B-Instruct-Uncensored-GGML
Text Generation
•
Updated
Aug 17, 2023
•
4
•
5
rozek/LLaMA-2-7B-32K_GGUF
Text Generation
•
Updated
Aug 31, 2023
•
1.04k
•
9
rozek/LLaMA-2-7B-32K-Instruct_GGUF
Text Generation
•
Updated
Aug 31, 2023
•
1.49k
•
5
neuralmagic/bge-small-en-v1.5-quant
Feature Extraction
•
Updated
Nov 13, 2023
•
9.87k
•
9
neuralmagic/bge-base-en-v1.5-quant
Feature Extraction
•
Updated
Nov 13, 2023
•
6.6k
•
4
neuralmagic/bge-large-en-v1.5-quant
Feature Extraction
•
Updated
Nov 13, 2023
•
16.6k
•
20
afrideva/TinyLlama-1.1B-intermediate-step-715k-1.5T-GGUF
Updated
Nov 4, 2023
•
79
afrideva/tinyllama-colorist-v2-GGUF
Text Generation
•
Updated
Nov 4, 2023
•
95
afrideva/stablelm-3b-4e1t-GGUF
Text Generation
•
Updated
Nov 5, 2023
•
116
•
1
afrideva/tiny-llama-miniguanaco-1.5T-GGUF
Text Generation
•
Updated
Nov 6, 2023
•
119
afrideva/Hermes-Trismegistus-Mistral-7B-GGUF
Text Generation
•
Updated
Nov 5, 2023
•
110
Previous
1
2
3
4
...
37
Next