2 contributors

History: 4 commits

lichenglu

Move tokenizer files to root

95739ab over 2 years ago

.gitattributes

1.18 kB

initial commit over 2 years ago
.gitignore

78 Bytes

Move tokenizer files to root over 2 years ago
added_tokens.json

308 Bytes

Move tokenizer files to root over 2 years ago
config.json

854 Bytes

commit from chengluli over 2 years ago
merges.txt

456 kB

Move tokenizer files to root over 2 years ago
pytorch_model.bin
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "torch.FloatStorage"
What is a pickle import?
6.28 GB
LFS

commit from chengluli over 2 years ago
rng_state.pth
Detected Pickle imports (7)
- "torch._utils._rebuild_tensor_v2",
- "numpy.core.multiarray._reconstruct",
- "numpy.dtype",
- "numpy.ndarray",
- "collections.OrderedDict",
- "_codecs.encode",
- "torch.ByteStorage"
How to fix it?
21.6 kB
LFS

commit from chengluli over 2 years ago
scheduler.pt

623 Bytes
LFS

commit from chengluli over 2 years ago
special_tokens_map.json

283 Bytes

Move tokenizer files to root over 2 years ago
tokenizer.json

2.11 MB

Move tokenizer files to root over 2 years ago
tokenizer_config.json

239 Bytes

Move tokenizer files to root over 2 years ago
trainer_state.json

16.1 kB

commit from chengluli over 2 years ago
training_args.bin
Detected Pickle imports (5)
- "transformers.trainer_utils.HubStrategy",
- "transformers.trainer_utils.IntervalStrategy",
- "torch.device",
- "transformers.training_args.TrainingArguments",
- "transformers.trainer_utils.SchedulerType"
How to fix it?
2.93 kB
LFS

commit from chengluli over 2 years ago
vocab.json

798 kB

Move tokenizer files to root over 2 years ago

Detected Pickle imports (4)

Detected Pickle imports (7)

Detected Pickle imports (5)