TokenBender
/

qwen_tokenizer_test

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

qwen_tokenizer_test

1 contributor

History: 2 commits

TokenBender's picture

Upload folder using huggingface_hub

dcfe98d verified 8 months ago

.ipynb_checkpoints
Upload folder using huggingface_hub 8 months ago
.gitattributes

1.52 kB

initial commit 8 months ago
added_tokens.json

80 Bytes

Upload folder using huggingface_hub 8 months ago
config.json

701 Bytes

Upload folder using huggingface_hub 8 months ago
generation_config.json

143 Bytes

Upload folder using huggingface_hub 8 months ago
merges.txt

1.67 MB

Upload folder using huggingface_hub 8 months ago
model.safetensors

927 MB
LFS

Upload folder using huggingface_hub 8 months ago
special_tokens_map.json

419 Bytes

Upload folder using huggingface_hub 8 months ago
tokenizer.json

7.03 MB

Upload folder using huggingface_hub 8 months ago
tokenizer_config.json

1.17 kB

Upload folder using huggingface_hub 8 months ago
training_args.bin
Detected Pickle imports (9)
- "torch.device",
- "transformers.trainer_utils.HubStrategy",
- "accelerate.utils.dataclasses.DistributedType",
- "transformers.training_args.TrainingArguments",
- "transformers.training_args.OptimizerNames",
- "accelerate.state.PartialState",
- "transformers.trainer_utils.SchedulerType",
- "transformers.trainer_utils.IntervalStrategy",
- "transformers.trainer_pt_utils.AcceleratorConfig"
How to fix it?
4.92 kB
LFS

Upload folder using huggingface_hub 8 months ago
vocab.json

2.78 MB

Upload folder using huggingface_hub 8 months ago