vihangd
/

smartsolmix-4x10.7b-v1

Text Generation

Mixture of Experts

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

Edit model card

SmartSolMix-4x10.7b-v1

An experimental MOE of various 10.7b models made with mergekit

Experts

TBD

Prompt Template

Should work with chatml as well as alpaca style prompt templates

Downloads last month: 2,947

Safetensors

Model size

36.1B params

Tensor type

FP16

·