Model Card for ME-MOE-7Bx2_test

Developed by : 메가스터디교육, 프리딕션, 마이스

Base Model : megastudyedu/ME-dpo-7B-v1.0

Expert Models : megastudyedu/ME-dpo-7B-v1.1, macadeliccc/WestLake-7B-v2-laser-truthy-dpo

Method : merge-kit을 활용하여 MOE를 구현했습니다.

ME-7B-v1.0 -> ME-dpo-7B-v1.0, ME-7B-v1.1 -> ME-dpo-7B-v1.1 로 수정했습니다.

Downloads last month: 2,287

Safetensors

Model size

12.9B params

Tensor type

BF16

Inference API

Text Generation

This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.