Hugging Face model: mradermacher/Azathoth-16x7B-bf16-GGUF
Author: mradermacher
Created: 2024-11-22 10:44:25
Last modified: 2024-11-25 09:01:50
Library: transformers
Likes: 1 | Downloads: 9
Tags: transformers, gguf, moe, merge, en, base_model:Kquant03/Azathoth-16x7B-bf16, base_model:quantized:Kquant03/Azathoth-16x7B-bf16, license:apache-2.0, endpoints_compatible, region:us, conversational
Base model relation: quantized
Base models: id: Kquant03/Azathoth-16x7B-bf16
Card metadata:
base_model: Kquant03/Azathoth-16x7B-bf16
language: en
library_name: transformers
license: apache-2.0
no_imatrix: Missing importance matrix for tensor blk.0.ffn_gate_exps.weight in a very low-bit quantization
quantized_by: mradermacher
tags: moe, merge