File size: 190 Bytes
4c3e062
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
{
    "model_max_length": 8192,
    "tokenizer_class": "MuPTTokenizer",
    "auto_map": {
      "AutoTokenizer": [
        "tokenization_mupt.MuPTTokenizer",
        null
        ]
    }
  }