Model: JuncaiL/llama-8x265m-moe
Author: JuncaiL
Pipeline: text-generation
Library: transformers
Tags: transformers, pytorch, llama_moe, text-generation, MoE, custom_code, en, dataset:wikipedia, dataset:allenai/c4, arxiv:2305.09781, region:us
Card metadata: datasets: wikipedia, allenai/c4
language: en
tags: MoE
Likes: 3 | All-time downloads: 637
Created: 2024-03-24 12:31:50