lodrick-the-lafted
/

Grafted-Llama2-2x70B

Text Generation

Mixture of Experts

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Grafted-Llama2-2x70B / mergekit_moe_config.yml

lodrick-the-lafted's picture

lodrick-the-lafted

Upload folder using huggingface_hub

6a0247f verified 10 months ago

225 Bytes


	base_model: /workspace/WG
	gate_mode: hidden
	dtype: float16

	experts:
	- source_model: /workspace/AN
	positive_prompts: ["merged roleplay. erp"]

	- source_model: /workspace/WG
	positive_prompts: ["roleplay, code"]