1 billion parameter models, quantized with AWQ.
SolidRusT Networks
company
Verified
AI & ML interests
Self-hosting, Open Source and AI Unalignment
Organization Card
About org cards
Organization for sorting and categorizing collections of quantized models, featured on solidrust.net.
Currently focused on 7B models that can be quantized by AWQ from: https://github.com/casper-hansen/AutoAWQ
Collections
8
These models are selected for their compatibility with small 12GB memory GPUs.
-
solidrust/Starling-LM-7B-beta-AWQ
Text Generation • Updated • 881 • 3 -
solidrust/dolphin-2.8-mistral-7b-v02-AWQ
Text Generation • Updated • 1.18k • 2 -
solidrust/Hermes-2-Pro-Mistral-7B-AWQ
Text Generation • Updated • 235 • 2 -
solidrust/dolphin-2.8-experiment26-7b-AWQ
Text Generation • Updated • 115 • 1
models
287
solidrust/StrangeMerges_16-7B-slerp-AWQ
Text Generation
•
Updated
solidrust/dolphin-2.9-llama3-8b-1m-AWQ
Text Generation
•
Updated
solidrust/flammen-mistral-7B-AWQ
Text Generation
•
Updated
solidrust/Llama-3-RPMerge-8B-SLERP-AWQ
Text Generation
•
Updated
solidrust/LuminariX-8B-AWQ
Text Generation
•
Updated
solidrust/Cognitron-8B-AWQ
Text Generation
•
Updated
solidrust/WestTemptressTensor-10.7B-v0.2a-SLERP-AWQ
Text Generation
•
Updated
solidrust/Llama-3-Orca-2.0-8B-AWQ
Text Generation
•
Updated
solidrust/flammen15-gutenberg-DPO-v1-7B-AWQ
Text Generation
•
Updated
solidrust/flammen16-mistral-7B-AWQ
Text Generation
•
Updated
datasets
None public yet