1 billion parameter models, quantized with AWQ.
SolidRusT Networks
company
Verified
AI & ML interests
Self-hosting, Open Source and AI Unalignment
Organization Card
Organization for sorting and categorizing collections of quantized models, featured on solidrust.net.
Currently focused on models that can be quantized by AWQ from: https://github.com/casper-hansen/AutoAWQ using https://github.com/SolidRusT/srt-model-quantizing/tree/main/awq
models
509
solidrust/Llama-3-8B-Stroganoff-4.0-AWQ
Text Generation
•
Updated
•
7
solidrust/Llama-3.1-8B-TitanFusion-Mix-AWQ
Text Generation
•
Updated
•
7
solidrust/Llama-3.1-8B-TitanFusion-v3-AWQ
Text Generation
•
Updated
•
8
solidrust/Fatgirl_v2_8B-AWQ
Text Generation
•
Updated
•
7
solidrust/L3-Super-Nova-RP-8B-AWQ
Text Generation
•
Updated
•
5
solidrust/L3-Umbral-Mind-RP-v0.3-8B-AWQ
Text Generation
•
Updated
•
6
solidrust/Chili_Dog_8B-AWQ
Text Generation
•
Updated
•
5
solidrust/L3-Luna-8B-AWQ
Text Generation
•
Updated
•
8
solidrust/Magic_v2_8B-AWQ
Text Generation
•
Updated
•
8
solidrust/Llama-3SOME-8B-v2-AWQ
Text Generation
•
Updated
•
10
datasets
None public yet