Text Generation
Transformers
PyTorch
English
llama
code
Inference Endpoints
text-generation-inference
Pasta009 commited on
Commit
b0d2c40
1 Parent(s): 297eb2e

Upload added_tokens.json with huggingface_hub

Browse files
Files changed (1) hide show
  1. added_tokens.json +7 -0
added_tokens.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "[PAD]": 32004,
3
+ "▁<EOT>": 32003,
4
+ "▁<MID>": 32001,
5
+ "▁<PRE>": 32000,
6
+ "▁<SUF>": 32002
7
+ }