This is fully exp model!

base_model: beomi/EXAONE-3.5-2.4B-Instruct-Llamafied
gate_mode: random
architecture: mixtral
experts_per_token: 2
dtype: bfloat16
experts:
  - source_model: beomi/EXAONE-3.5-2.4B-Instruct-Llamafied
  - source_model: unsloth/Phi-3.5-mini-instruct

Downloads last month: 6

Safetensors

Model size

4.93B params

Tensor type

BF16

Inference Providers NEW

Other

This model is not currently available via any of the supported Inference Providers.

The model cannot be deployed to the HF Inference API: The HF Inference API does not support other models for transformers library.