Edit model card

Model Card for ME-MOE-7Bx2_test

Developed by : ๋ฉ”๊ฐ€์Šคํ„ฐ๋””๊ต์œก, ํ”„๋ฆฌ๋”•์…˜, ๋งˆ์ด์Šค

Base Model : megastudyedu/ME-dpo-7B-v1.0

Expert Models : megastudyedu/ME-dpo-7B-v1.1, macadeliccc/WestLake-7B-v2-laser-truthy-dpo

Method : merge-kit์„ ํ™œ์šฉํ•˜์—ฌ MOE๋ฅผ ๊ตฌํ˜„ํ–ˆ์Šต๋‹ˆ๋‹ค.


ME-7B-v1.0 -> ME-dpo-7B-v1.0, ME-7B-v1.1 -> ME-dpo-7B-v1.1 ๋กœ ์ˆ˜์ •ํ–ˆ์Šต๋‹ˆ๋‹ค.

Downloads last month
1,228
Safetensors
Model size
12.9B params
Tensor type
BF16
ยท