1 contributor

History: 3 commits

sonquoctran

Upload tokenizer

4f66364 verified 5 months ago

.gitattributes

1.52 kB

initial commit 5 months ago
README.md

5.17 kB

Upload tokenizer 5 months ago
config.json

770 Bytes

Upload folder using huggingface_hub 5 months ago
merges.txt

456 kB

Upload tokenizer 5 months ago
optimizer.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.FloatStorage"
What is a pickle import?
997 MB
LFS

Upload folder using huggingface_hub 5 months ago
pytorch_model.bin
Detected Pickle imports (4)
- "torch.FloatStorage",
- "torch.LongStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
499 MB
LFS

Upload folder using huggingface_hub 5 months ago
rng_state.pth
Detected Pickle imports (7)
- "_codecs.encode",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "numpy.core.multiarray._reconstruct",
- "numpy.dtype",
- "numpy.ndarray",
- "collections.OrderedDict"
How to fix it?
14.1 kB
LFS

Upload folder using huggingface_hub 5 months ago
scheduler.pt
Pickle imports
- No problematic imports detected
What is a pickle import?
326 Bytes
LFS

Upload folder using huggingface_hub 5 months ago
special_tokens_map.json

964 Bytes

Upload tokenizer 5 months ago
tokenizer.json

2.11 MB

Upload tokenizer 5 months ago
tokenizer_config.json

1.28 kB

Upload tokenizer 5 months ago
trainer_state.json

248 kB

Upload folder using huggingface_hub 5 months ago
training_args.bin
Detected Pickle imports (4)
- "transformers.trainer_utils.IntervalStrategy",
- "transformers.trainer_utils.SchedulerType",
- "torch.device",
- "transformers.training_args.TrainingArguments"
How to fix it?
2.46 kB
LFS

Upload folder using huggingface_hub 5 months ago
vocab.json

798 kB

Upload folder using huggingface_hub 5 months ago

Detected Pickle imports (3)

Detected Pickle imports (4)

Detected Pickle imports (7)

Pickle imports

Detected Pickle imports (4)