JuncaiL
/

llama-8x265m-moe

Text Generation

Model card Files Files and versions Community

llama-8x265m-moe

1 contributor

History: 4 commits

JuncaiL's picture

fix state_dict loading in MoE model

d8d97b0 verified 7 months ago

.gitattributes

1.52 kB

initial commit 7 months ago
README.md

1 Bytes

upload llama-8x265m-moe model checkpoint 7 months ago
config.json

1.56 kB

fix state_dict loading in MoE model 7 months ago
configuration_llama_moe.py

4.41 kB

upload llama-8x265m-moe model checkpoint 7 months ago
generation_config.json

132 Bytes

upload llama-8x265m-moe model checkpoint 7 months ago
modeling_llama_moe_hf.py

66.7 kB

fix state_dict loading in MoE model 7 months ago
pytorch_model.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage"
What is a pickle import?
3.88 GB
LFS

upload llama-8x265m-moe model checkpoint 7 months ago
special_tokens_map.json

411 Bytes

upload llama-8x265m-moe model checkpoint 7 months ago
tokenizer.model

500 kB
LFS

upload llama-8x265m-moe model checkpoint 7 months ago
tokenizer_config.json

720 Bytes

upload llama-8x265m-moe model checkpoint 7 months ago
trainer_state.json

71.7 kB

upload llama-8x265m-moe model checkpoint 7 months ago
training_args.bin
Detected Pickle imports (8)
- "torch.device",
- "accelerate.utils.dataclasses.DistributedType",
- "transformers.trainer_utils.HubStrategy",
- "transformers.trainer_utils.IntervalStrategy",
- "transformers.trainer_utils.SchedulerType",
- "transformers.training_args.TrainingArguments",
- "accelerate.state.PartialState",
- "transformers.training_args.OptimizerNames"
How to fix it?
3.95 kB
LFS

upload llama-8x265m-moe model checkpoint 7 months ago