Update tokenizer_config.json

tokenizer_config.json

@@ -1,66 +1,3 @@
-Hugging Face's logo
-Hugging Face
-Search models, datasets, users...
-Models
-Datasets
-Spaces
-Posts
-Docs
-Solutions
-Pricing
-
-
-
-
-meta-llama
-/
-Meta-Llama-3.1-8B-Instruct 
-
-like
-1.66k
-Text Generation
-Transformers
-Safetensors
-PyTorch
-8 languages
-llama
-facebook
-meta
-llama-3
-conversational
-text-generation-inference
-Inference Endpoints
-
-arxiv:
-2204.05149
-
-License:
-llama3.1
-Model card
-Files and versions
-Community
-92
-Meta-Llama-3.1-8B-Instruct
-/
-tokenizer_config.json
-
-Rocketknight1's picture
-Rocketknight1
-HF STAFF
-Add tool use example to README (#64)
-8c22764
-VERIFIED
-10 days ago
-raw
-
-Copy download link
-history
-blame
-contribute
-delete
-No virus
-
-55.4 kB
 {
   "added_tokens_decoder": {
     "128000": {
@@ -2122,5 +2059,4 @@ No virus
   ],
   "model_max_length": 131072,
   "tokenizer_class": "PreTrainedTokenizerFast"
-}
-
+}