Hugging Face model: JuncaiL/llama-8x265m-moe
Author: JuncaiL
Created: 2024-03-24 12:31:50
Last modified: 2024-03-25 18:32:37
Pipeline: text-generation
Library: transformers
Likes: 3 | Downloads: 6
Tags: transformers, pytorch, llama_moe, text-generation, MoE, custom_code, en, dataset:wikipedia, dataset:allenai/c4, arxiv:2305.09781, region:us
Card metadata:
datasets: wikipedia, allenai/c4
language: en
tags: MoE