Add Char model
4871469
-
1.18 kB
initial commit
-
1.05 GB
Add more tokenization methods
-
1.05 GB
Add Char model
-
1.05 GB
Add pinyin
-
1.05 GB
Add wubi and no index model
-
1.05 GB
Add more tokenization methods
-
1.05 GB
Add wubi and no index model
-
1.05 GB
Add wubi and no index model
-
1.05 GB
Add more tokenization methods
zhuyin.pt
Detected Pickle imports (13)
- "torch._utils._rebuild_tensor_v2",
- "torch.utils.data.dataloader.DataLoader",
- "numpy.core.multiarray._reconstruct",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "__main__.WorkerInitObj",
- "numpy.dtype",
- "__main__.pretraining_dataset",
- "numpy.ndarray",
- "torch.utils.data.sampler.BatchSampler",
- "torch.utils.data.sampler.RandomSampler",
- "torch.utils.data._utils.collate.default_collate",
- "_codecs.encode"
How to fix it?
1.44 GB
Add more tokenization methods
