1 billion parameter models, quantized with AWQ.
SolidRusT Networks
company
Verified
AI & ML interests
Self-hosting, Open Source and AI Unalignment
Organization Card
Organization for sorting and categorizing collections of quantized models, featured on solidrust.net.
Currently focused on models that can be quantized by AWQ from: https://github.com/casper-hansen/AutoAWQ
models
443
solidrust/Qwen2-7B-Instruct-v0.8-AWQ
Text Generation
•
Updated
•
12
solidrust/Yi-1.5-9B-Chat-AWQ
Text Generation
•
Updated
•
14
solidrust/Phi-3-mini-4k-instruct-AWQ
Text Generation
•
Updated
•
57
solidrust/Phi-3-mini-128k-instruct-AWQ
Text Generation
•
Updated
•
48
solidrust/dolphin-2.9.3-mistral-7B-32k-AWQ
Text Generation
•
Updated
•
10
solidrust/MadWizardOrpoMistral-7b-v0.3-AWQ
Text Generation
•
Updated
•
3
solidrust/Hathor-L3-8B-v.02-AWQ
Text Generation
•
Updated
•
19
solidrust/Llama-3-8B-AWQ
Text Generation
•
Updated
•
8
solidrust/Llama-3-NeuralHercules-5.0-8B-AWQ
Text Generation
•
Updated
•
17
solidrust/Inixion-2x8B-AWQ
Text Generation
•
Updated
•
2
datasets
None public yet