jieunhan
/

solar_merge_test_1

Text Generation

Mixture of Experts

beomi/OPEN-SOLAR-KO-10.7B

hyeogi/SOLAR-10.7B-dpo-v1

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

solar_merge_test_1 / mergekit_moe_config.yml

jieunhan's picture

Upload folder using huggingface_hub

e971e60 verified 10 months ago

385 Bytes


	base_model: beomi/OPEN-SOLAR-KO-10.7B
	dtype: float16
	experts:
	- source_model: beomi/OPEN-SOLAR-KO-10.7B
	positive_prompts: ["당신은 다방면으로 답변을 잘하는 어시스턴트이다."]
	- source_model: hyeogi/SOLAR-10.7B-dpo-v1
	positive_prompts: ["당신은 사람들에게 도움을 주는 어시스턴트이다."]
	gate_mode: cheap_embed
	tokenizer_source: base