AIChenKai
/

TinyLlama-1.1B-Chat-v1.0-x2-MoE

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Edit model card

Testing model.

Config:

base_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
gate_mode: hidden
dtype: bfloat16
experts:
  - source_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
    positive_prompts: [""]
  - source_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
    positive_prompts: [""]

Downloads last month: 1,232

Safetensors

Model size

1.86B params

Tensor type

BF16

·