Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
JuncaiL
/
llama-8x265m-moe
like
2
Text Generation
Transformers
PyTorch
wikipedia
allenai/c4
English
llama_moe
MoE
custom_code
arxiv:
2305.09781
Model card
Files
Files and versions
Community
Train
Use this model
main
llama-8x265m-moe
/
modeling_llama_moe_hf.py
Commit History
fix state_dict loading in MoE model
d8d97b0
verified
JuncaiL
commited on
Mar 25
upload llama-8x265m-moe model checkpoint
1ffa590
verified
JuncaiL
commited on
Mar 24