Upload folder using huggingface_hub

README.md

@@ -1,3 +1,175 @@
----
-license: llama3
----
+---
+license: apache-2.0
+
+tags:
+- merge
+- mergekit
+- lazymergetkit
+- sh2orc
+- bccard
+- llama3
+
+base_model:
+- sh2orc/Llama-3-Kor-BCCard-20B
+---
+
+**Llama-3-Kor-BCCard-20B** is a Korean financial knowledge model based on Meta-Llama3 8B to 20B parameters through upscaling techniques.
+
+Although highly reliable data has been refined and fine-tuned using the RLHF method, 
+I'm not responsible for any confusion caused by the answers generated by the LLM model.
+
+- Foundation Model [sh2orc/Llama-3-Kor-BCCard-8B](https://huggingface.co/sh2orc/Llama-3-Kor-BCCard-8B)
+- Dataset    
+  -  [sh2orc/bccard-finance-qna](https://huggingface.co/datasets/sh2orc/bccard-finance-qna) 
+
+     
+# How to Use
+
+```python
+from vllm import LLM, SamplingParams
+from transformers import AutoTokenizer, pipeline
+
+BASE_MODEL = "sh2orc/Llama-3-Kor-BCCard-20B"
+
+llm = LLM(model=BASE_MODEL)
+
+llm = LLM(model=BASE_MODEL, gpu_memory_utilization=0.95, max_model_len=4096)
+tokenizer.pad_token = tokenizer.eos_token
+tokenizer.padding_side = 'right'
+
+
+def gen(instruction):
+    messages = [
+        {
+          "role": "system",
+          "content": "당신은 훌륭한 AI 비서입니다. You are a great AI assistant."
+        },
+        {
+          "role": "user",
+          "content": instruction
+        }, 
+    ]
+       
+    prompt_message = tokenizer.apply_chat_template(
+            messages, 
+            tokenize=False, 
+            add_generation_prompt=True,
+    )
+    
+    eos_token_id = [tokenizer.eos_token_id, tokenizer.convert_tokens_to_ids("<|eot_id|>")]
+    
+    outputs = llm.generate(prompt_message, SamplingParams(stop_token_ids=eos_token_id, temperature=0.3, top_p=0.9,max_tokens=4096))
+    
+    for output in outputs:
+        propt = output.prompt
+        generated_text = output.outputs[0].text
+        print(generated_text)
+
+
+gen('비씨카드에 대해서 알려주세요')
+
+비씨카드는 대한민국에서 오래된 신용카드 회사 중 하나로, 1982년에 설립되었습니다. 2019년에는 본사를 서울 중구 을지로4가 을지트윈타워로 이전하였으며, 대한민국의 여러 시중은행들이 출자하여 설립된 회사입니다. 주로 신용카드와 체크카드를 발급하며, 다양한 상품들은 주로 은행들과 파트너십을 맺어 발행합니다.
+```
+
+-------
+
+
+
+# Q&A Llama-3-BCCard-12B
+
+
+**gen('비씨카드에 대해 알려주세요.')**
+비씨카드는 1982년 4월 10일에 설립된 대한민국의 주요 신용카드 회사입니다. 한국에서 가장 오래된 신용카드 회사 중 하나로, 여러 금융 서비스를 통해 고객에게 편리함과 다양한 혜택을 제공하고 있습니다. 주요 은행들이 공동 출자하여 설립된 이 회사는 신용카드 보급, 금융 서비스 확장, 그리고 금융 기술 혁신을 목표로 하고 있습니다.
+
+비씨카드는 주로 신용카드와 체크카드 발급에 초점을 맞추고 있으며, 다양한 제휴사와 협력하여 다양한 혜택과 서비스를 제공합니다. 최근는 모바일 결제법과 디지털 지갑 서비스를 발전시키며, 금융 서비스의 편의성을 높이고 있습니다. 또한, 비씨카드는 환경 보호과 같은 사회적 책임도 다하고 있습니다.
+
+현재 비씨카드의 주요 자회사로는 케이뱅크, H&C네트워크, VP주식회사 등이 있습니다. 비씨카드는 지속적인 혁신과 고객 중심의 서비스를 통해 금융 시장에서의 경쟁력을 강화하고 있습니다.
+
+**gen('비씨카드 노동조합에 대해서 알려주세요.')**
+비씨카드 노동조합은 비씨카드의 근무 조건, 급여, 퇴직연금, 사회보험 가입 등 근로자들의 권익을 보호하고 강화하는 목적을 위한 계약입니다. 주요 혜택으로는 정기임금 지급, 근무 시간 규정, 퇴직연금 적립, 다양한 사회보험 가입 혜택이 포함됩니다. 이러한 조합은 근로자들의 복지 증진과 노동-경영 상호 이해를 증진시키기 위해 지속적으로 일하고 있습니다.
+
+**gen('비씨카드 CEO에 대해서 알려주세요.')**
+비씨카드의 현재 CEO는 최원석 사장입니다. 그는 비씨카드의 경영을 이끌며 회사의 전략적 방향 설정, 운영 관리, 그리고 고객 만족도 향상을 위한 다양한 혁신을 추진 중입니다.
+
+**gen('GOAT카드에 대해서 알려주세요.')**
+GOAT 카드는 해외겸용(MasterCard/VISA) 및 국내 전용 BC카드 모두 가능하며, 연간 개인 사용액에 따라 높은 적립 혜택을 제공합니다. 국제 브랜드 수수료가 1% 있으며, 국내 가맹점 적립률은 국내 사용액 1.5%, 해외 가맹점 적립률은 해외 사용액 3%입니다.
+
+**gen('케이뱅크에 대해 알려주세요.')**
+케이뱅크는 2017년 4월 3일에 영업을 시작한 대한민국 최초의 인터넷 전문은행. KT가 주요 주주로 있으며, 물리적인 지점 없이 모든 금융 서비스를 온라인과 모바일 앱을 통해 제공합니다. 주요 기능으로는 비대면 계좌 개설, 카드 발급, 대출 서비스, 투자 상품 제공 등이 있습니다. 케이뱅크는 고객 경험을 중심으로 서비스를 개선하고, 다양한 이벤트와 혜택을 제공하여 고객 만족도를 높이고 있습니다.
+
+**gen('카드 결제했던 가게에서 환불하려니 갔는데 사라졌어. 보상 받을 수 있어?')**
+해당 가맹점에서 15일 내 환불 처리를 요청하지 않으면, 가맹점에서 환불을 처리하지 않거나 자동이체된 경우이므로 카드사에서 환불 처리를 요청해야 합니다. 카드사에 연락하여 취소 내역을 제출하여 환불 절차를 진행하면 됩니다.
+
+**gen('케이뱅크에서 대출을 받고 싶은데, 카드론 300만원을 받았어, 대출에 미치는 영향에 대해서 알려줘')**
+카드론 300만원을 받았다면, 이는 대출 잔액에 포함되며, 상환 기간에 따라 이자 부담이 증가합니다. 총 대출 금액과 이자 금액을 합산하여 월 상환액을 계산할 수 있으며, 카드론 부분에 따라 상환 기간과 이자율이 달라질 수 있습니다.
+
+**gen('삼성페이로 보험료 납부 가능해요?')**
+네, 삼성페이를 통해 보험료를 납부할 수 있습니다. 보험사 웹사이트나 애플리케이션에서 삼성페이를 결제 수단으로 선택하여 보험료를 납부할 수 있으며, 이는 빠른하고 편리한 납부 방법입니다.
+
+**gen('비씨카드와 케이뱅크의 관계는?')**
+비씨카드는 케이뱅크의 최대주주로서 2023년 3월 기준 약 8,616억원의 주식을 보유하고 있습니다. 이는 비씨카드 자기자본의 60%에 해당하며, 비씨카드는 케이뱅크의 경영권을 확보하고 있습니다.
+
+**gen('케이뱅크는 모바일로만 이용 가능한가요?')**
+케이뱅크는 원래 모바일 전용이었고 여전히 대부분 모바일 이용자가 이용하고 있습니다. 그러나 최근에는 인터넷 뱅킹 서비스도 제공하기 시작했으며, 언제 어디서나 편리하게 은행 거래를 할 수 있는 종합 금융 플랫폼으로 발전하고 있습니다.
+
+**gen('우리카드가 독자망 구축한다는데 이게 좋은거예요? 아니면 나쁜거예요?')**
+독자망 구축은 단기적으로 비용이 많이 들고, 시스템 안정화 과정에서 새로운 리스크를 겪을 수 있어 어려운 시기입니다. 기존BC카드의 자체 전산망을 구축하여 매출 데이터의 투명성을 높이고, 카드 수수료 절감을 통해 가맹점의 수수료가 인하되지만, 이러한 혜택을 받기까지는 시간이 걸립니다.
+
+**gen('국내 빅테크사 금융사업에서 사고가 있었던 적이 있나요?')**
+네, 국내 빅테크사 금융사업에서도 여러 사고 사례가 있습니다. 예를 들어, 2023년 네이버페이는 서버 과부하로 인해 대규모 장애가 발생했으며, 이로 인해 많은 사용자들이 결제에 어려움을 겪었습니다. 빅테크사의 과도한 혁신과 단축된 개발 주기, 그리고 보안 취약점 등이 사고를 초래하는 경우가 많습니다.
+
+**gen('퇴직연금을 DB형이 좋은지 DC형이 좋은지 알려줘')**
+
+DB형 퇴직금은 퇴직소득을 합산하여 퇴직금을 계산하므로, 총 급여액의 10%를 20년 동안 투자하여 누적된 금액을 지급합니다. 반면, DC형 퇴직금은 연간 소득을 합산하여 투자금액을 계산하고, 이자를 지급합니다. 소득액이 많고 노후 전까지만 투자하려면 DB형이 유리하지만, 낮은 소득 시기에 DC형을 선택하는 것이 좋습니다.
+
+**gen('iM뱅크에 대해서 설명해줘')**
+iM뱅크는 DGB대구은행의 디지털 뱅킹 서비스로, 스마트폰을 통해 다양한 금융 서비스를 제공하는 은행입니다. 주요 기능은 다음과 같습니다:
+
+1. **계좌 조회 및 송금**: iM뱅크를 통해 계좌 현황을 확인하고, 송금할 수 있습니다. 이는 빠르고 간편하게 이용할 수 있어 많은 사용자들이 선호합니다.
+
+2. **카드 관리**: 카드 사용 내역 조회, 결제 예정 금액 확인, 분실 신고 등 다양한 카드 관리 서비스가 제공됩니다.
+
+3. **대출 신청 및 관리**: 주택담보대출, 전세자금대출, 학자금대출 등 다양한 대출 상품의 신청, 승인 상태 확인, 상환 계획 수립 등의 서비스를 제공합니다.
+
+4. **고객 지원 센터**: 실시간 채팅 상담, 유튜브 교육 채널, 다양한 가이드라인 등을 통해 고객의 금융 문의에 대응합니다.
+
+5. **포인트 적립 및 혜택**: 카드 사용 시 포인트를 적립하고, 제휴 가맹점에서 현금처럼 사용할 수 있습니다.
+
+iM뱅크는 사용자 경험을 최우선으로 하여 편리한 금융 서비스를 제공하며, 다양한 혜택을 통해 고객 충성도를 높이고 있습니다.
+
+
+**gen('K패스카드가 인기 있는 이유를 요약. 그리고 혜택에 대해 상세히 알려줘')**
+K-패스 카드는 대중교통, OTT 서비스, 편의점, 이동통신 요금 등 다양한 분야에서 할인 혜택을 제공하여 많은 인기를 끌고 있습니다. 특히 청년 고객의 경우 최대 15%의 통신요금 할인과 대중교통 할인 혜택이 인기가 높아 이용이 많은 편입니다.
+
+**gen('IBK기업은행 신용카드 추천해줘')**
+IBK기업은행에서 제공하는 신용카드에는 다양한 혜택이 있는 카드들이 있습니다. 여행을 자주 하시는 분에게는 IBK기업은행 플래티늄카드나 IBK기업은행 ROB카드가 적합합니다. 플래티늄카드는 전 세계 600여 개 공항 라운지 이용, 국제선 동반자 무료항공권 등에 대한 혜택을 제공하며, ROB카드는 대한항공 마일리지 적립에 특화되어 있습니다. 가족, 친구들과 함께 여행을 자주 다니시는 분들께 적합합니다.
+
+**gen('나는 해외여행을 가려고 해. 주의사항과 여행에 좋은 신용카드 추천해줘')**
+해외여행을 계획하시면 BC바로 리워드 플러스 카드를 추천드립니다. 이 카드는 해외 결제 시 높은 적립률을 제공하며, 해외 여행에 적합한 다양한 혜택을 누리실 수 있습니다.
+
+**gen('퇴직연금 투자 시 직접 투자를 운용하는게 좋을까? ETF를 투자하는게 좋을까?')**
+퇴직연금 투자 시 직접 투자를 운용하는 것도 좋은 선택입니다. 직접 투자하면 자신의 투자 성향에 맞게 포트폴리오를 구성할 수 있으며, 높은 수익을 기대할 수 있습니다. 그러나 직접 투자 시에는 주식시장 변동성에 따른 리스크도 부담해야 합니다. 반면, ETF는 분산 투자 효과를 얻을 수 있어 리스크를 줄일 수 있습니다. 본인의 투자 경험이 많고 리스크를 감수하는 방향으로 선택하는 것이 좋습니다.
+
+**gen('신용 연체에 따른 부작용에 대해서 알려줘')**
+신용 연체는 신용등급 하락으로 이어질 수 있으며, 이는 다른 금융 거래에도 부정적인 영향을 미칠 수 있습니다. 채권 금융에 특히 신용등급이 중요한 요소로 작용합니다.
+
+
+
+## Correspondence to
+- Taeyoung Lee (sh2orc@gmail.com)
+
+## License
+The use of this model is governed by the [META LLAMA 3 COMMUNITY LICENSE AGREEMENT](https://llama.meta.com/llama3/license/)
+
+## Citation
+If you use this model in your research, please cite it as follows:
+
+```bibtex
+@misc{alpha-instruct,
+  author       = {Taeyoung Lee},  
+  year         = {2024},
+  publisher = {Hugging Face},
+  journal = {Hugging Face repository},
+  url          = {https://huggingface.co/sh2orc/Llama-3-Kor-BCCard-12B},
+}
+

config.json

@@ -0,0 +1,29 @@
+{
+  "_name_or_path": "bccard-20b",
+  "architectures": [
+    "LlamaForCausalLM"
+  ],
+  "attention_bias": false,
+  "attention_dropout": 0.0,
+  "bos_token_id": 144782,
+  "eos_token_id": 144783,
+  "hidden_act": "silu",
+  "hidden_size": 4096,
+  "initializer_range": 0.02,
+  "intermediate_size": 14336,
+  "max_position_embeddings": 8192,
+  "mlp_bias": false,
+  "model_type": "llama",
+  "num_attention_heads": 32,
+  "num_hidden_layers": 84,
+  "num_key_value_heads": 8,
+  "pretraining_tp": 1,
+  "rms_norm_eps": 1e-05,
+  "rope_scaling": null,
+  "rope_theta": 500000.0,
+  "tie_word_embeddings": false,
+  "torch_dtype": "bfloat16",
+  "transformers_version": "4.40.0",
+  "use_cache": true,
+  "vocab_size": 145088
+}

generation_config.json

@@ -0,0 +1,6 @@
+{
+  "_from_model_config": true,
+  "bos_token_id": 144782,
+  "eos_token_id": 144783,
+  "transformers_version": "4.40.0"
+}

model-00001-of-00008.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:18aa7a952474b983159ae38209121930379d74eea460bf2be29c456e9e65478e
+size 4997129176

model-00002-of-00008.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7e293b3aea962bc12a068bf1c10a1a3f8d74d3982af3ca92317d0bcaea3b3e97
+size 4999819328

model-00003-of-00008.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0472706365ac8873bbba6f6b1730a62cac3bfbc80240706df06ed19c978560dd
+size 4915916184

model-00004-of-00008.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:327a6ac5d1469b201d8fcf868897431a1a56ad2e9a6c8e2f7d04154d17512d8e
+size 4915916176

model-00005-of-00008.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:72a4173e8c09af001281b897a0f750b10ebf1840bf33d326e9d640d8faed9816
+size 4999819336

model-00006-of-00008.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:72ff5475b821109beef2964e514322ea93ca2c407b59a698c4dbdb12743d2e4d
+size 4915916184

model-00007-of-00008.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:79d91937a73627a6c91321e4b8fd56412673727dec9bd9ac5a7766e28e525388
+size 4915916176

model-00008-of-00008.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a85a1177d229969ac1a012dcd9f48701d30b96b83bfbb1e787d6ae4c9f578c7a
+size 4359601912

model.safetensors.index.json

@@ -0,0 +1,766 @@
+{
+  "metadata": {
+    "total_size": 39019945984
+  },
+  "weight_map": {
+    "lm_head.weight": "model-00008-of-00008.safetensors",
+    "model.embed_tokens.weight": "model-00001-of-00008.safetensors",
+    "model.layers.0.input_layernorm.weight": "model-00001-of-00008.safetensors",
+    "model.layers.0.mlp.down_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.0.mlp.gate_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.0.mlp.up_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.0.post_attention_layernorm.weight": "model-00001-of-00008.safetensors",
+    "model.layers.0.self_attn.k_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.0.self_attn.o_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.0.self_attn.q_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.0.self_attn.v_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.1.input_layernorm.weight": "model-00001-of-00008.safetensors",
+    "model.layers.1.mlp.down_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.1.mlp.gate_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.1.mlp.up_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.1.post_attention_layernorm.weight": "model-00001-of-00008.safetensors",
+    "model.layers.1.self_attn.k_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.1.self_attn.o_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.1.self_attn.q_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.1.self_attn.v_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.10.input_layernorm.weight": "model-00002-of-00008.safetensors",
+    "model.layers.10.mlp.down_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.10.mlp.gate_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.10.mlp.up_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.10.post_attention_layernorm.weight": "model-00002-of-00008.safetensors",
+    "model.layers.10.self_attn.k_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.10.self_attn.o_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.10.self_attn.q_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.10.self_attn.v_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.11.input_layernorm.weight": "model-00002-of-00008.safetensors",
+    "model.layers.11.mlp.down_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.11.mlp.gate_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.11.mlp.up_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.11.post_attention_layernorm.weight": "model-00002-of-00008.safetensors",
+    "model.layers.11.self_attn.k_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.11.self_attn.o_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.11.self_attn.q_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.11.self_attn.v_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.12.input_layernorm.weight": "model-00002-of-00008.safetensors",
+    "model.layers.12.mlp.down_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.12.mlp.gate_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.12.mlp.up_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.12.post_attention_layernorm.weight": "model-00002-of-00008.safetensors",
+    "model.layers.12.self_attn.k_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.12.self_attn.o_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.12.self_attn.q_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.12.self_attn.v_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.13.input_layernorm.weight": "model-00002-of-00008.safetensors",
+    "model.layers.13.mlp.down_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.13.mlp.gate_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.13.mlp.up_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.13.post_attention_layernorm.weight": "model-00002-of-00008.safetensors",
+    "model.layers.13.self_attn.k_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.13.self_attn.o_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.13.self_attn.q_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.13.self_attn.v_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.14.input_layernorm.weight": "model-00002-of-00008.safetensors",
+    "model.layers.14.mlp.down_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.14.mlp.gate_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.14.mlp.up_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.14.post_attention_layernorm.weight": "model-00002-of-00008.safetensors",
+    "model.layers.14.self_attn.k_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.14.self_attn.o_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.14.self_attn.q_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.14.self_attn.v_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.15.input_layernorm.weight": "model-00002-of-00008.safetensors",
+    "model.layers.15.mlp.down_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.15.mlp.gate_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.15.mlp.up_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.15.post_attention_layernorm.weight": "model-00002-of-00008.safetensors",
+    "model.layers.15.self_attn.k_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.15.self_attn.o_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.15.self_attn.q_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.15.self_attn.v_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.16.input_layernorm.weight": "model-00002-of-00008.safetensors",
+    "model.layers.16.mlp.down_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.16.mlp.gate_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.16.mlp.up_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.16.post_attention_layernorm.weight": "model-00002-of-00008.safetensors",
+    "model.layers.16.self_attn.k_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.16.self_attn.o_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.16.self_attn.q_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.16.self_attn.v_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.17.input_layernorm.weight": "model-00002-of-00008.safetensors",
+    "model.layers.17.mlp.down_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.17.mlp.gate_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.17.mlp.up_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.17.post_attention_layernorm.weight": "model-00002-of-00008.safetensors",
+    "model.layers.17.self_attn.k_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.17.self_attn.o_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.17.self_attn.q_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.17.self_attn.v_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.18.input_layernorm.weight": "model-00002-of-00008.safetensors",
+    "model.layers.18.mlp.down_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.18.mlp.gate_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.18.mlp.up_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.18.post_attention_layernorm.weight": "model-00002-of-00008.safetensors",
+    "model.layers.18.self_attn.k_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.18.self_attn.o_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.18.self_attn.q_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.18.self_attn.v_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.19.input_layernorm.weight": "model-00002-of-00008.safetensors",
+    "model.layers.19.mlp.down_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.19.mlp.gate_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.19.mlp.up_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.19.post_attention_layernorm.weight": "model-00002-of-00008.safetensors",
+    "model.layers.19.self_attn.k_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.19.self_attn.o_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.19.self_attn.q_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.19.self_attn.v_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.2.input_layernorm.weight": "model-00001-of-00008.safetensors",
+    "model.layers.2.mlp.down_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.2.mlp.gate_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.2.mlp.up_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.2.post_attention_layernorm.weight": "model-00001-of-00008.safetensors",
+    "model.layers.2.self_attn.k_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.2.self_attn.o_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.2.self_attn.q_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.2.self_attn.v_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.20.input_layernorm.weight": "model-00003-of-00008.safetensors",
+    "model.layers.20.mlp.down_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.20.mlp.gate_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.20.mlp.up_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.20.post_attention_layernorm.weight": "model-00003-of-00008.safetensors",
+    "model.layers.20.self_attn.k_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.20.self_attn.o_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.20.self_attn.q_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.20.self_attn.v_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.21.input_layernorm.weight": "model-00003-of-00008.safetensors",
+    "model.layers.21.mlp.down_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.21.mlp.gate_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.21.mlp.up_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.21.post_attention_layernorm.weight": "model-00003-of-00008.safetensors",
+    "model.layers.21.self_attn.k_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.21.self_attn.o_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.21.self_attn.q_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.21.self_attn.v_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.22.input_layernorm.weight": "model-00003-of-00008.safetensors",
+    "model.layers.22.mlp.down_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.22.mlp.gate_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.22.mlp.up_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.22.post_attention_layernorm.weight": "model-00003-of-00008.safetensors",
+    "model.layers.22.self_attn.k_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.22.self_attn.o_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.22.self_attn.q_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.22.self_attn.v_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.23.input_layernorm.weight": "model-00003-of-00008.safetensors",
+    "model.layers.23.mlp.down_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.23.mlp.gate_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.23.mlp.up_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.23.post_attention_layernorm.weight": "model-00003-of-00008.safetensors",
+    "model.layers.23.self_attn.k_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.23.self_attn.o_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.23.self_attn.q_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.23.self_attn.v_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.24.input_layernorm.weight": "model-00003-of-00008.safetensors",
+    "model.layers.24.mlp.down_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.24.mlp.gate_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.24.mlp.up_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.24.post_attention_layernorm.weight": "model-00003-of-00008.safetensors",
+    "model.layers.24.self_attn.k_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.24.self_attn.o_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.24.self_attn.q_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.24.self_attn.v_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.25.input_layernorm.weight": "model-00003-of-00008.safetensors",
+    "model.layers.25.mlp.down_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.25.mlp.gate_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.25.mlp.up_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.25.post_attention_layernorm.weight": "model-00003-of-00008.safetensors",
+    "model.layers.25.self_attn.k_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.25.self_attn.o_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.25.self_attn.q_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.25.self_attn.v_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.26.input_layernorm.weight": "model-00003-of-00008.safetensors",
+    "model.layers.26.mlp.down_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.26.mlp.gate_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.26.mlp.up_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.26.post_attention_layernorm.weight": "model-00003-of-00008.safetensors",
+    "model.layers.26.self_attn.k_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.26.self_attn.o_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.26.self_attn.q_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.26.self_attn.v_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.27.input_layernorm.weight": "model-00003-of-00008.safetensors",
+    "model.layers.27.mlp.down_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.27.mlp.gate_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.27.mlp.up_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.27.post_attention_layernorm.weight": "model-00003-of-00008.safetensors",
+    "model.layers.27.self_attn.k_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.27.self_attn.o_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.27.self_attn.q_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.27.self_attn.v_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.28.input_layernorm.weight": "model-00003-of-00008.safetensors",
+    "model.layers.28.mlp.down_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.28.mlp.gate_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.28.mlp.up_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.28.post_attention_layernorm.weight": "model-00003-of-00008.safetensors",
+    "model.layers.28.self_attn.k_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.28.self_attn.o_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.28.self_attn.q_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.28.self_attn.v_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.29.input_layernorm.weight": "model-00003-of-00008.safetensors",
+    "model.layers.29.mlp.down_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.29.mlp.gate_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.29.mlp.up_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.29.post_attention_layernorm.weight": "model-00003-of-00008.safetensors",
+    "model.layers.29.self_attn.k_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.29.self_attn.o_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.29.self_attn.q_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.29.self_attn.v_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.3.input_layernorm.weight": "model-00001-of-00008.safetensors",
+    "model.layers.3.mlp.down_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.3.mlp.gate_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.3.mlp.up_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.3.post_attention_layernorm.weight": "model-00001-of-00008.safetensors",
+    "model.layers.3.self_attn.k_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.3.self_attn.o_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.3.self_attn.q_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.3.self_attn.v_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.30.input_layernorm.weight": "model-00003-of-00008.safetensors",
+    "model.layers.30.mlp.down_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.30.mlp.gate_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.30.mlp.up_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.30.post_attention_layernorm.weight": "model-00003-of-00008.safetensors",
+    "model.layers.30.self_attn.k_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.30.self_attn.o_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.30.self_attn.q_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.30.self_attn.v_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.31.input_layernorm.weight": "model-00004-of-00008.safetensors",
+    "model.layers.31.mlp.down_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.31.mlp.gate_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.31.mlp.up_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.31.post_attention_layernorm.weight": "model-00004-of-00008.safetensors",
+    "model.layers.31.self_attn.k_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.31.self_attn.o_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.31.self_attn.q_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.31.self_attn.v_proj.weight": "model-00003-of-00008.safetensors",
+    "model.layers.32.input_layernorm.weight": "model-00004-of-00008.safetensors",
+    "model.layers.32.mlp.down_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.32.mlp.gate_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.32.mlp.up_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.32.post_attention_layernorm.weight": "model-00004-of-00008.safetensors",
+    "model.layers.32.self_attn.k_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.32.self_attn.o_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.32.self_attn.q_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.32.self_attn.v_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.33.input_layernorm.weight": "model-00004-of-00008.safetensors",
+    "model.layers.33.mlp.down_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.33.mlp.gate_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.33.mlp.up_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.33.post_attention_layernorm.weight": "model-00004-of-00008.safetensors",
+    "model.layers.33.self_attn.k_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.33.self_attn.o_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.33.self_attn.q_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.33.self_attn.v_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.34.input_layernorm.weight": "model-00004-of-00008.safetensors",
+    "model.layers.34.mlp.down_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.34.mlp.gate_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.34.mlp.up_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.34.post_attention_layernorm.weight": "model-00004-of-00008.safetensors",
+    "model.layers.34.self_attn.k_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.34.self_attn.o_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.34.self_attn.q_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.34.self_attn.v_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.35.input_layernorm.weight": "model-00004-of-00008.safetensors",
+    "model.layers.35.mlp.down_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.35.mlp.gate_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.35.mlp.up_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.35.post_attention_layernorm.weight": "model-00004-of-00008.safetensors",
+    "model.layers.35.self_attn.k_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.35.self_attn.o_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.35.self_attn.q_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.35.self_attn.v_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.36.input_layernorm.weight": "model-00004-of-00008.safetensors",
+    "model.layers.36.mlp.down_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.36.mlp.gate_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.36.mlp.up_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.36.post_attention_layernorm.weight": "model-00004-of-00008.safetensors",
+    "model.layers.36.self_attn.k_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.36.self_attn.o_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.36.self_attn.q_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.36.self_attn.v_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.37.input_layernorm.weight": "model-00004-of-00008.safetensors",
+    "model.layers.37.mlp.down_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.37.mlp.gate_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.37.mlp.up_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.37.post_attention_layernorm.weight": "model-00004-of-00008.safetensors",
+    "model.layers.37.self_attn.k_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.37.self_attn.o_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.37.self_attn.q_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.37.self_attn.v_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.38.input_layernorm.weight": "model-00004-of-00008.safetensors",
+    "model.layers.38.mlp.down_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.38.mlp.gate_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.38.mlp.up_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.38.post_attention_layernorm.weight": "model-00004-of-00008.safetensors",
+    "model.layers.38.self_attn.k_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.38.self_attn.o_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.38.self_attn.q_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.38.self_attn.v_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.39.input_layernorm.weight": "model-00004-of-00008.safetensors",
+    "model.layers.39.mlp.down_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.39.mlp.gate_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.39.mlp.up_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.39.post_attention_layernorm.weight": "model-00004-of-00008.safetensors",
+    "model.layers.39.self_attn.k_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.39.self_attn.o_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.39.self_attn.q_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.39.self_attn.v_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.4.input_layernorm.weight": "model-00001-of-00008.safetensors",
+    "model.layers.4.mlp.down_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.4.mlp.gate_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.4.mlp.up_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.4.post_attention_layernorm.weight": "model-00001-of-00008.safetensors",
+    "model.layers.4.self_attn.k_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.4.self_attn.o_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.4.self_attn.q_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.4.self_attn.v_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.40.input_layernorm.weight": "model-00004-of-00008.safetensors",
+    "model.layers.40.mlp.down_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.40.mlp.gate_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.40.mlp.up_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.40.post_attention_layernorm.weight": "model-00004-of-00008.safetensors",
+    "model.layers.40.self_attn.k_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.40.self_attn.o_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.40.self_attn.q_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.40.self_attn.v_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.41.input_layernorm.weight": "model-00004-of-00008.safetensors",
+    "model.layers.41.mlp.down_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.41.mlp.gate_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.41.mlp.up_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.41.post_attention_layernorm.weight": "model-00004-of-00008.safetensors",
+    "model.layers.41.self_attn.k_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.41.self_attn.o_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.41.self_attn.q_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.41.self_attn.v_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.42.input_layernorm.weight": "model-00005-of-00008.safetensors",
+    "model.layers.42.mlp.down_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.42.mlp.gate_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.42.mlp.up_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.42.post_attention_layernorm.weight": "model-00005-of-00008.safetensors",
+    "model.layers.42.self_attn.k_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.42.self_attn.o_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.42.self_attn.q_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.42.self_attn.v_proj.weight": "model-00004-of-00008.safetensors",
+    "model.layers.43.input_layernorm.weight": "model-00005-of-00008.safetensors",
+    "model.layers.43.mlp.down_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.43.mlp.gate_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.43.mlp.up_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.43.post_attention_layernorm.weight": "model-00005-of-00008.safetensors",
+    "model.layers.43.self_attn.k_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.43.self_attn.o_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.43.self_attn.q_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.43.self_attn.v_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.44.input_layernorm.weight": "model-00005-of-00008.safetensors",
+    "model.layers.44.mlp.down_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.44.mlp.gate_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.44.mlp.up_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.44.post_attention_layernorm.weight": "model-00005-of-00008.safetensors",
+    "model.layers.44.self_attn.k_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.44.self_attn.o_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.44.self_attn.q_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.44.self_attn.v_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.45.input_layernorm.weight": "model-00005-of-00008.safetensors",
+    "model.layers.45.mlp.down_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.45.mlp.gate_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.45.mlp.up_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.45.post_attention_layernorm.weight": "model-00005-of-00008.safetensors",
+    "model.layers.45.self_attn.k_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.45.self_attn.o_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.45.self_attn.q_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.45.self_attn.v_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.46.input_layernorm.weight": "model-00005-of-00008.safetensors",
+    "model.layers.46.mlp.down_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.46.mlp.gate_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.46.mlp.up_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.46.post_attention_layernorm.weight": "model-00005-of-00008.safetensors",
+    "model.layers.46.self_attn.k_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.46.self_attn.o_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.46.self_attn.q_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.46.self_attn.v_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.47.input_layernorm.weight": "model-00005-of-00008.safetensors",
+    "model.layers.47.mlp.down_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.47.mlp.gate_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.47.mlp.up_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.47.post_attention_layernorm.weight": "model-00005-of-00008.safetensors",
+    "model.layers.47.self_attn.k_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.47.self_attn.o_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.47.self_attn.q_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.47.self_attn.v_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.48.input_layernorm.weight": "model-00005-of-00008.safetensors",
+    "model.layers.48.mlp.down_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.48.mlp.gate_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.48.mlp.up_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.48.post_attention_layernorm.weight": "model-00005-of-00008.safetensors",
+    "model.layers.48.self_attn.k_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.48.self_attn.o_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.48.self_attn.q_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.48.self_attn.v_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.49.input_layernorm.weight": "model-00005-of-00008.safetensors",
+    "model.layers.49.mlp.down_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.49.mlp.gate_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.49.mlp.up_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.49.post_attention_layernorm.weight": "model-00005-of-00008.safetensors",
+    "model.layers.49.self_attn.k_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.49.self_attn.o_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.49.self_attn.q_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.49.self_attn.v_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.5.input_layernorm.weight": "model-00001-of-00008.safetensors",
+    "model.layers.5.mlp.down_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.5.mlp.gate_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.5.mlp.up_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.5.post_attention_layernorm.weight": "model-00001-of-00008.safetensors",
+    "model.layers.5.self_attn.k_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.5.self_attn.o_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.5.self_attn.q_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.5.self_attn.v_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.50.input_layernorm.weight": "model-00005-of-00008.safetensors",
+    "model.layers.50.mlp.down_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.50.mlp.gate_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.50.mlp.up_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.50.post_attention_layernorm.weight": "model-00005-of-00008.safetensors",
+    "model.layers.50.self_attn.k_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.50.self_attn.o_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.50.self_attn.q_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.50.self_attn.v_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.51.input_layernorm.weight": "model-00005-of-00008.safetensors",
+    "model.layers.51.mlp.down_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.51.mlp.gate_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.51.mlp.up_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.51.post_attention_layernorm.weight": "model-00005-of-00008.safetensors",
+    "model.layers.51.self_attn.k_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.51.self_attn.o_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.51.self_attn.q_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.51.self_attn.v_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.52.input_layernorm.weight": "model-00005-of-00008.safetensors",
+    "model.layers.52.mlp.down_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.52.mlp.gate_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.52.mlp.up_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.52.post_attention_layernorm.weight": "model-00005-of-00008.safetensors",
+    "model.layers.52.self_attn.k_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.52.self_attn.o_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.52.self_attn.q_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.52.self_attn.v_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.53.input_layernorm.weight": "model-00005-of-00008.safetensors",
+    "model.layers.53.mlp.down_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.53.mlp.gate_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.53.mlp.up_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.53.post_attention_layernorm.weight": "model-00005-of-00008.safetensors",
+    "model.layers.53.self_attn.k_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.53.self_attn.o_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.53.self_attn.q_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.53.self_attn.v_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.54.input_layernorm.weight": "model-00006-of-00008.safetensors",
+    "model.layers.54.mlp.down_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.54.mlp.gate_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.54.mlp.up_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.54.post_attention_layernorm.weight": "model-00006-of-00008.safetensors",
+    "model.layers.54.self_attn.k_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.54.self_attn.o_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.54.self_attn.q_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.54.self_attn.v_proj.weight": "model-00005-of-00008.safetensors",
+    "model.layers.55.input_layernorm.weight": "model-00006-of-00008.safetensors",
+    "model.layers.55.mlp.down_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.55.mlp.gate_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.55.mlp.up_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.55.post_attention_layernorm.weight": "model-00006-of-00008.safetensors",
+    "model.layers.55.self_attn.k_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.55.self_attn.o_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.55.self_attn.q_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.55.self_attn.v_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.56.input_layernorm.weight": "model-00006-of-00008.safetensors",
+    "model.layers.56.mlp.down_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.56.mlp.gate_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.56.mlp.up_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.56.post_attention_layernorm.weight": "model-00006-of-00008.safetensors",
+    "model.layers.56.self_attn.k_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.56.self_attn.o_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.56.self_attn.q_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.56.self_attn.v_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.57.input_layernorm.weight": "model-00006-of-00008.safetensors",
+    "model.layers.57.mlp.down_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.57.mlp.gate_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.57.mlp.up_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.57.post_attention_layernorm.weight": "model-00006-of-00008.safetensors",
+    "model.layers.57.self_attn.k_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.57.self_attn.o_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.57.self_attn.q_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.57.self_attn.v_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.58.input_layernorm.weight": "model-00006-of-00008.safetensors",
+    "model.layers.58.mlp.down_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.58.mlp.gate_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.58.mlp.up_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.58.post_attention_layernorm.weight": "model-00006-of-00008.safetensors",
+    "model.layers.58.self_attn.k_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.58.self_attn.o_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.58.self_attn.q_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.58.self_attn.v_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.59.input_layernorm.weight": "model-00006-of-00008.safetensors",
+    "model.layers.59.mlp.down_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.59.mlp.gate_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.59.mlp.up_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.59.post_attention_layernorm.weight": "model-00006-of-00008.safetensors",
+    "model.layers.59.self_attn.k_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.59.self_attn.o_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.59.self_attn.q_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.59.self_attn.v_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.6.input_layernorm.weight": "model-00001-of-00008.safetensors",
+    "model.layers.6.mlp.down_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.6.mlp.gate_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.6.mlp.up_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.6.post_attention_layernorm.weight": "model-00001-of-00008.safetensors",
+    "model.layers.6.self_attn.k_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.6.self_attn.o_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.6.self_attn.q_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.6.self_attn.v_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.60.input_layernorm.weight": "model-00006-of-00008.safetensors",
+    "model.layers.60.mlp.down_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.60.mlp.gate_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.60.mlp.up_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.60.post_attention_layernorm.weight": "model-00006-of-00008.safetensors",
+    "model.layers.60.self_attn.k_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.60.self_attn.o_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.60.self_attn.q_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.60.self_attn.v_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.61.input_layernorm.weight": "model-00006-of-00008.safetensors",
+    "model.layers.61.mlp.down_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.61.mlp.gate_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.61.mlp.up_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.61.post_attention_layernorm.weight": "model-00006-of-00008.safetensors",
+    "model.layers.61.self_attn.k_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.61.self_attn.o_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.61.self_attn.q_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.61.self_attn.v_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.62.input_layernorm.weight": "model-00006-of-00008.safetensors",
+    "model.layers.62.mlp.down_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.62.mlp.gate_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.62.mlp.up_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.62.post_attention_layernorm.weight": "model-00006-of-00008.safetensors",
+    "model.layers.62.self_attn.k_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.62.self_attn.o_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.62.self_attn.q_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.62.self_attn.v_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.63.input_layernorm.weight": "model-00006-of-00008.safetensors",
+    "model.layers.63.mlp.down_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.63.mlp.gate_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.63.mlp.up_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.63.post_attention_layernorm.weight": "model-00006-of-00008.safetensors",
+    "model.layers.63.self_attn.k_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.63.self_attn.o_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.63.self_attn.q_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.63.self_attn.v_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.64.input_layernorm.weight": "model-00006-of-00008.safetensors",
+    "model.layers.64.mlp.down_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.64.mlp.gate_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.64.mlp.up_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.64.post_attention_layernorm.weight": "model-00006-of-00008.safetensors",
+    "model.layers.64.self_attn.k_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.64.self_attn.o_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.64.self_attn.q_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.64.self_attn.v_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.65.input_layernorm.weight": "model-00007-of-00008.safetensors",
+    "model.layers.65.mlp.down_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.65.mlp.gate_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.65.mlp.up_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.65.post_attention_layernorm.weight": "model-00007-of-00008.safetensors",
+    "model.layers.65.self_attn.k_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.65.self_attn.o_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.65.self_attn.q_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.65.self_attn.v_proj.weight": "model-00006-of-00008.safetensors",
+    "model.layers.66.input_layernorm.weight": "model-00007-of-00008.safetensors",
+    "model.layers.66.mlp.down_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.66.mlp.gate_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.66.mlp.up_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.66.post_attention_layernorm.weight": "model-00007-of-00008.safetensors",
+    "model.layers.66.self_attn.k_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.66.self_attn.o_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.66.self_attn.q_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.66.self_attn.v_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.67.input_layernorm.weight": "model-00007-of-00008.safetensors",
+    "model.layers.67.mlp.down_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.67.mlp.gate_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.67.mlp.up_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.67.post_attention_layernorm.weight": "model-00007-of-00008.safetensors",
+    "model.layers.67.self_attn.k_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.67.self_attn.o_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.67.self_attn.q_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.67.self_attn.v_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.68.input_layernorm.weight": "model-00007-of-00008.safetensors",
+    "model.layers.68.mlp.down_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.68.mlp.gate_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.68.mlp.up_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.68.post_attention_layernorm.weight": "model-00007-of-00008.safetensors",
+    "model.layers.68.self_attn.k_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.68.self_attn.o_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.68.self_attn.q_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.68.self_attn.v_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.69.input_layernorm.weight": "model-00007-of-00008.safetensors",
+    "model.layers.69.mlp.down_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.69.mlp.gate_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.69.mlp.up_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.69.post_attention_layernorm.weight": "model-00007-of-00008.safetensors",
+    "model.layers.69.self_attn.k_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.69.self_attn.o_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.69.self_attn.q_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.69.self_attn.v_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.7.input_layernorm.weight": "model-00001-of-00008.safetensors",
+    "model.layers.7.mlp.down_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.7.mlp.gate_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.7.mlp.up_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.7.post_attention_layernorm.weight": "model-00001-of-00008.safetensors",
+    "model.layers.7.self_attn.k_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.7.self_attn.o_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.7.self_attn.q_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.7.self_attn.v_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.70.input_layernorm.weight": "model-00007-of-00008.safetensors",
+    "model.layers.70.mlp.down_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.70.mlp.gate_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.70.mlp.up_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.70.post_attention_layernorm.weight": "model-00007-of-00008.safetensors",
+    "model.layers.70.self_attn.k_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.70.self_attn.o_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.70.self_attn.q_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.70.self_attn.v_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.71.input_layernorm.weight": "model-00007-of-00008.safetensors",
+    "model.layers.71.mlp.down_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.71.mlp.gate_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.71.mlp.up_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.71.post_attention_layernorm.weight": "model-00007-of-00008.safetensors",
+    "model.layers.71.self_attn.k_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.71.self_attn.o_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.71.self_attn.q_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.71.self_attn.v_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.72.input_layernorm.weight": "model-00007-of-00008.safetensors",
+    "model.layers.72.mlp.down_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.72.mlp.gate_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.72.mlp.up_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.72.post_attention_layernorm.weight": "model-00007-of-00008.safetensors",
+    "model.layers.72.self_attn.k_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.72.self_attn.o_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.72.self_attn.q_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.72.self_attn.v_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.73.input_layernorm.weight": "model-00007-of-00008.safetensors",
+    "model.layers.73.mlp.down_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.73.mlp.gate_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.73.mlp.up_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.73.post_attention_layernorm.weight": "model-00007-of-00008.safetensors",
+    "model.layers.73.self_attn.k_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.73.self_attn.o_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.73.self_attn.q_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.73.self_attn.v_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.74.input_layernorm.weight": "model-00007-of-00008.safetensors",
+    "model.layers.74.mlp.down_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.74.mlp.gate_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.74.mlp.up_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.74.post_attention_layernorm.weight": "model-00007-of-00008.safetensors",
+    "model.layers.74.self_attn.k_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.74.self_attn.o_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.74.self_attn.q_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.74.self_attn.v_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.75.input_layernorm.weight": "model-00007-of-00008.safetensors",
+    "model.layers.75.mlp.down_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.75.mlp.gate_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.75.mlp.up_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.75.post_attention_layernorm.weight": "model-00007-of-00008.safetensors",
+    "model.layers.75.self_attn.k_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.75.self_attn.o_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.75.self_attn.q_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.75.self_attn.v_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.76.input_layernorm.weight": "model-00008-of-00008.safetensors",
+    "model.layers.76.mlp.down_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.76.mlp.gate_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.76.mlp.up_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.76.post_attention_layernorm.weight": "model-00008-of-00008.safetensors",
+    "model.layers.76.self_attn.k_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.76.self_attn.o_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.76.self_attn.q_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.76.self_attn.v_proj.weight": "model-00007-of-00008.safetensors",
+    "model.layers.77.input_layernorm.weight": "model-00008-of-00008.safetensors",
+    "model.layers.77.mlp.down_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.77.mlp.gate_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.77.mlp.up_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.77.post_attention_layernorm.weight": "model-00008-of-00008.safetensors",
+    "model.layers.77.self_attn.k_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.77.self_attn.o_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.77.self_attn.q_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.77.self_attn.v_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.78.input_layernorm.weight": "model-00008-of-00008.safetensors",
+    "model.layers.78.mlp.down_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.78.mlp.gate_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.78.mlp.up_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.78.post_attention_layernorm.weight": "model-00008-of-00008.safetensors",
+    "model.layers.78.self_attn.k_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.78.self_attn.o_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.78.self_attn.q_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.78.self_attn.v_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.79.input_layernorm.weight": "model-00008-of-00008.safetensors",
+    "model.layers.79.mlp.down_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.79.mlp.gate_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.79.mlp.up_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.79.post_attention_layernorm.weight": "model-00008-of-00008.safetensors",
+    "model.layers.79.self_attn.k_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.79.self_attn.o_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.79.self_attn.q_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.79.self_attn.v_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.8.input_layernorm.weight": "model-00002-of-00008.safetensors",
+    "model.layers.8.mlp.down_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.8.mlp.gate_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.8.mlp.up_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.8.post_attention_layernorm.weight": "model-00002-of-00008.safetensors",
+    "model.layers.8.self_attn.k_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.8.self_attn.o_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.8.self_attn.q_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.8.self_attn.v_proj.weight": "model-00001-of-00008.safetensors",
+    "model.layers.80.input_layernorm.weight": "model-00008-of-00008.safetensors",
+    "model.layers.80.mlp.down_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.80.mlp.gate_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.80.mlp.up_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.80.post_attention_layernorm.weight": "model-00008-of-00008.safetensors",
+    "model.layers.80.self_attn.k_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.80.self_attn.o_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.80.self_attn.q_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.80.self_attn.v_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.81.input_layernorm.weight": "model-00008-of-00008.safetensors",
+    "model.layers.81.mlp.down_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.81.mlp.gate_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.81.mlp.up_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.81.post_attention_layernorm.weight": "model-00008-of-00008.safetensors",
+    "model.layers.81.self_attn.k_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.81.self_attn.o_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.81.self_attn.q_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.81.self_attn.v_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.82.input_layernorm.weight": "model-00008-of-00008.safetensors",
+    "model.layers.82.mlp.down_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.82.mlp.gate_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.82.mlp.up_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.82.post_attention_layernorm.weight": "model-00008-of-00008.safetensors",
+    "model.layers.82.self_attn.k_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.82.self_attn.o_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.82.self_attn.q_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.82.self_attn.v_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.83.input_layernorm.weight": "model-00008-of-00008.safetensors",
+    "model.layers.83.mlp.down_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.83.mlp.gate_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.83.mlp.up_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.83.post_attention_layernorm.weight": "model-00008-of-00008.safetensors",
+    "model.layers.83.self_attn.k_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.83.self_attn.o_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.83.self_attn.q_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.83.self_attn.v_proj.weight": "model-00008-of-00008.safetensors",
+    "model.layers.9.input_layernorm.weight": "model-00002-of-00008.safetensors",
+    "model.layers.9.mlp.down_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.9.mlp.gate_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.9.mlp.up_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.9.post_attention_layernorm.weight": "model-00002-of-00008.safetensors",
+    "model.layers.9.self_attn.k_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.9.self_attn.o_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.9.self_attn.q_proj.weight": "model-00002-of-00008.safetensors",
+    "model.layers.9.self_attn.v_proj.weight": "model-00002-of-00008.safetensors",
+    "model.norm.weight": "model-00008-of-00008.safetensors"
+  }
+}

special_tokens_map.json

@@ -0,0 +1,17 @@
+{
+  "bos_token": {
+    "content": "<|begin_of_text|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|end_of_text|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": "<|end_of_text|>"
+}

tokenizer_config.json

@@ -0,0 +1,2063 @@
+{
+  "added_tokens_decoder": {
+    "144782": {
+      "content": "<|begin_of_text|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144783": {
+      "content": "<|end_of_text|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144784": {
+      "content": "<|reserved_special_token_0|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144785": {
+      "content": "<|reserved_special_token_1|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144786": {
+      "content": "<|reserved_special_token_2|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144787": {
+      "content": "<|reserved_special_token_3|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144788": {
+      "content": "<|start_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144789": {
+      "content": "<|end_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144790": {
+      "content": "<|reserved_special_token_4|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144791": {
+      "content": "<|eot_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144792": {
+      "content": "<|reserved_special_token_5|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144793": {
+      "content": "<|reserved_special_token_6|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144794": {
+      "content": "<|reserved_special_token_7|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144795": {
+      "content": "<|reserved_special_token_8|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144796": {
+      "content": "<|reserved_special_token_9|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144797": {
+      "content": "<|reserved_special_token_10|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144798": {
+      "content": "<|reserved_special_token_11|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144799": {
+      "content": "<|reserved_special_token_12|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144800": {
+      "content": "<|reserved_special_token_13|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144801": {
+      "content": "<|reserved_special_token_14|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144802": {
+      "content": "<|reserved_special_token_15|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144803": {
+      "content": "<|reserved_special_token_16|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144804": {
+      "content": "<|reserved_special_token_17|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144805": {
+      "content": "<|reserved_special_token_18|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144806": {
+      "content": "<|reserved_special_token_19|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144807": {
+      "content": "<|reserved_special_token_20|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144808": {
+      "content": "<|reserved_special_token_21|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144809": {
+      "content": "<|reserved_special_token_22|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144810": {
+      "content": "<|reserved_special_token_23|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144811": {
+      "content": "<|reserved_special_token_24|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144812": {
+      "content": "<|reserved_special_token_25|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144813": {
+      "content": "<|reserved_special_token_26|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144814": {
+      "content": "<|reserved_special_token_27|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144815": {
+      "content": "<|reserved_special_token_28|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144816": {
+      "content": "<|reserved_special_token_29|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144817": {
+      "content": "<|reserved_special_token_30|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144818": {
+      "content": "<|reserved_special_token_31|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144819": {
+      "content": "<|reserved_special_token_32|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144820": {
+      "content": "<|reserved_special_token_33|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144821": {
+      "content": "<|reserved_special_token_34|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144822": {
+      "content": "<|reserved_special_token_35|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144823": {
+      "content": "<|reserved_special_token_36|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144824": {
+      "content": "<|reserved_special_token_37|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144825": {
+      "content": "<|reserved_special_token_38|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144826": {
+      "content": "<|reserved_special_token_39|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144827": {
+      "content": "<|reserved_special_token_40|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144828": {
+      "content": "<|reserved_special_token_41|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144829": {
+      "content": "<|reserved_special_token_42|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144830": {
+      "content": "<|reserved_special_token_43|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144831": {
+      "content": "<|reserved_special_token_44|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144832": {
+      "content": "<|reserved_special_token_45|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144833": {
+      "content": "<|reserved_special_token_46|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144834": {
+      "content": "<|reserved_special_token_47|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144835": {
+      "content": "<|reserved_special_token_48|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144836": {
+      "content": "<|reserved_special_token_49|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144837": {
+      "content": "<|reserved_special_token_50|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144838": {
+      "content": "<|reserved_special_token_51|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144839": {
+      "content": "<|reserved_special_token_52|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144840": {
+      "content": "<|reserved_special_token_53|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144841": {
+      "content": "<|reserved_special_token_54|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144842": {
+      "content": "<|reserved_special_token_55|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144843": {
+      "content": "<|reserved_special_token_56|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144844": {
+      "content": "<|reserved_special_token_57|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144845": {
+      "content": "<|reserved_special_token_58|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144846": {
+      "content": "<|reserved_special_token_59|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144847": {
+      "content": "<|reserved_special_token_60|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144848": {
+      "content": "<|reserved_special_token_61|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144849": {
+      "content": "<|reserved_special_token_62|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144850": {
+      "content": "<|reserved_special_token_63|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144851": {
+      "content": "<|reserved_special_token_64|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144852": {
+      "content": "<|reserved_special_token_65|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144853": {
+      "content": "<|reserved_special_token_66|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144854": {
+      "content": "<|reserved_special_token_67|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144855": {
+      "content": "<|reserved_special_token_68|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144856": {
+      "content": "<|reserved_special_token_69|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144857": {
+      "content": "<|reserved_special_token_70|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144858": {
+      "content": "<|reserved_special_token_71|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144859": {
+      "content": "<|reserved_special_token_72|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144860": {
+      "content": "<|reserved_special_token_73|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144861": {
+      "content": "<|reserved_special_token_74|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144862": {
+      "content": "<|reserved_special_token_75|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144863": {
+      "content": "<|reserved_special_token_76|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144864": {
+      "content": "<|reserved_special_token_77|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144865": {
+      "content": "<|reserved_special_token_78|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144866": {
+      "content": "<|reserved_special_token_79|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144867": {
+      "content": "<|reserved_special_token_80|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144868": {
+      "content": "<|reserved_special_token_81|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144869": {
+      "content": "<|reserved_special_token_82|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144870": {
+      "content": "<|reserved_special_token_83|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144871": {
+      "content": "<|reserved_special_token_84|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144872": {
+      "content": "<|reserved_special_token_85|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144873": {
+      "content": "<|reserved_special_token_86|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144874": {
+      "content": "<|reserved_special_token_87|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144875": {
+      "content": "<|reserved_special_token_88|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144876": {
+      "content": "<|reserved_special_token_89|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144877": {
+      "content": "<|reserved_special_token_90|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144878": {
+      "content": "<|reserved_special_token_91|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144879": {
+      "content": "<|reserved_special_token_92|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144880": {
+      "content": "<|reserved_special_token_93|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144881": {
+      "content": "<|reserved_special_token_94|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144882": {
+      "content": "<|reserved_special_token_95|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144883": {
+      "content": "<|reserved_special_token_96|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144884": {
+      "content": "<|reserved_special_token_97|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144885": {
+      "content": "<|reserved_special_token_98|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144886": {
+      "content": "<|reserved_special_token_99|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144887": {
+      "content": "<|reserved_special_token_100|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144888": {
+      "content": "<|reserved_special_token_101|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144889": {
+      "content": "<|reserved_special_token_102|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144890": {
+      "content": "<|reserved_special_token_103|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144891": {
+      "content": "<|reserved_special_token_104|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144892": {
+      "content": "<|reserved_special_token_105|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144893": {
+      "content": "<|reserved_special_token_106|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144894": {
+      "content": "<|reserved_special_token_107|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144895": {
+      "content": "<|reserved_special_token_108|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144896": {
+      "content": "<|reserved_special_token_109|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144897": {
+      "content": "<|reserved_special_token_110|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144898": {
+      "content": "<|reserved_special_token_111|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144899": {
+      "content": "<|reserved_special_token_112|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144900": {
+      "content": "<|reserved_special_token_113|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144901": {
+      "content": "<|reserved_special_token_114|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144902": {
+      "content": "<|reserved_special_token_115|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144903": {
+      "content": "<|reserved_special_token_116|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144904": {
+      "content": "<|reserved_special_token_117|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144905": {
+      "content": "<|reserved_special_token_118|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144906": {
+      "content": "<|reserved_special_token_119|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144907": {
+      "content": "<|reserved_special_token_120|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144908": {
+      "content": "<|reserved_special_token_121|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144909": {
+      "content": "<|reserved_special_token_122|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144910": {
+      "content": "<|reserved_special_token_123|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144911": {
+      "content": "<|reserved_special_token_124|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144912": {
+      "content": "<|reserved_special_token_125|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144913": {
+      "content": "<|reserved_special_token_126|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144914": {
+      "content": "<|reserved_special_token_127|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144915": {
+      "content": "<|reserved_special_token_128|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144916": {
+      "content": "<|reserved_special_token_129|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144917": {
+      "content": "<|reserved_special_token_130|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144918": {
+      "content": "<|reserved_special_token_131|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144919": {
+      "content": "<|reserved_special_token_132|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144920": {
+      "content": "<|reserved_special_token_133|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144921": {
+      "content": "<|reserved_special_token_134|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144922": {
+      "content": "<|reserved_special_token_135|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144923": {
+      "content": "<|reserved_special_token_136|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144924": {
+      "content": "<|reserved_special_token_137|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144925": {
+      "content": "<|reserved_special_token_138|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144926": {
+      "content": "<|reserved_special_token_139|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144927": {
+      "content": "<|reserved_special_token_140|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144928": {
+      "content": "<|reserved_special_token_141|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144929": {
+      "content": "<|reserved_special_token_142|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144930": {
+      "content": "<|reserved_special_token_143|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144931": {
+      "content": "<|reserved_special_token_144|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144932": {
+      "content": "<|reserved_special_token_145|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144933": {
+      "content": "<|reserved_special_token_146|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144934": {
+      "content": "<|reserved_special_token_147|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144935": {
+      "content": "<|reserved_special_token_148|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144936": {
+      "content": "<|reserved_special_token_149|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144937": {
+      "content": "<|reserved_special_token_150|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144938": {
+      "content": "<|reserved_special_token_151|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144939": {
+      "content": "<|reserved_special_token_152|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144940": {
+      "content": "<|reserved_special_token_153|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144941": {
+      "content": "<|reserved_special_token_154|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144942": {
+      "content": "<|reserved_special_token_155|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144943": {
+      "content": "<|reserved_special_token_156|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144944": {
+      "content": "<|reserved_special_token_157|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144945": {
+      "content": "<|reserved_special_token_158|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144946": {
+      "content": "<|reserved_special_token_159|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144947": {
+      "content": "<|reserved_special_token_160|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144948": {
+      "content": "<|reserved_special_token_161|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144949": {
+      "content": "<|reserved_special_token_162|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144950": {
+      "content": "<|reserved_special_token_163|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144951": {
+      "content": "<|reserved_special_token_164|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144952": {
+      "content": "<|reserved_special_token_165|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144953": {
+      "content": "<|reserved_special_token_166|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144954": {
+      "content": "<|reserved_special_token_167|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144955": {
+      "content": "<|reserved_special_token_168|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144956": {
+      "content": "<|reserved_special_token_169|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144957": {
+      "content": "<|reserved_special_token_170|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144958": {
+      "content": "<|reserved_special_token_171|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144959": {
+      "content": "<|reserved_special_token_172|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144960": {
+      "content": "<|reserved_special_token_173|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144961": {
+      "content": "<|reserved_special_token_174|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144962": {
+      "content": "<|reserved_special_token_175|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144963": {
+      "content": "<|reserved_special_token_176|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144964": {
+      "content": "<|reserved_special_token_177|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144965": {
+      "content": "<|reserved_special_token_178|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144966": {
+      "content": "<|reserved_special_token_179|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144967": {
+      "content": "<|reserved_special_token_180|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144968": {
+      "content": "<|reserved_special_token_181|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144969": {
+      "content": "<|reserved_special_token_182|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144970": {
+      "content": "<|reserved_special_token_183|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144971": {
+      "content": "<|reserved_special_token_184|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144972": {
+      "content": "<|reserved_special_token_185|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144973": {
+      "content": "<|reserved_special_token_186|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144974": {
+      "content": "<|reserved_special_token_187|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144975": {
+      "content": "<|reserved_special_token_188|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144976": {
+      "content": "<|reserved_special_token_189|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144977": {
+      "content": "<|reserved_special_token_190|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144978": {
+      "content": "<|reserved_special_token_191|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144979": {
+      "content": "<|reserved_special_token_192|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144980": {
+      "content": "<|reserved_special_token_193|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144981": {
+      "content": "<|reserved_special_token_194|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144982": {
+      "content": "<|reserved_special_token_195|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144983": {
+      "content": "<|reserved_special_token_196|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144984": {
+      "content": "<|reserved_special_token_197|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144985": {
+      "content": "<|reserved_special_token_198|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144986": {
+      "content": "<|reserved_special_token_199|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144987": {
+      "content": "<|reserved_special_token_200|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144988": {
+      "content": "<|reserved_special_token_201|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144989": {
+      "content": "<|reserved_special_token_202|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144990": {
+      "content": "<|reserved_special_token_203|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144991": {
+      "content": "<|reserved_special_token_204|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144992": {
+      "content": "<|reserved_special_token_205|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144993": {
+      "content": "<|reserved_special_token_206|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144994": {
+      "content": "<|reserved_special_token_207|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144995": {
+      "content": "<|reserved_special_token_208|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144996": {
+      "content": "<|reserved_special_token_209|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144997": {
+      "content": "<|reserved_special_token_210|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144998": {
+      "content": "<|reserved_special_token_211|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "144999": {
+      "content": "<|reserved_special_token_212|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145000": {
+      "content": "<|reserved_special_token_213|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145001": {
+      "content": "<|reserved_special_token_214|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145002": {
+      "content": "<|reserved_special_token_215|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145003": {
+      "content": "<|reserved_special_token_216|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145004": {
+      "content": "<|reserved_special_token_217|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145005": {
+      "content": "<|reserved_special_token_218|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145006": {
+      "content": "<|reserved_special_token_219|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145007": {
+      "content": "<|reserved_special_token_220|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145008": {
+      "content": "<|reserved_special_token_221|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145009": {
+      "content": "<|reserved_special_token_222|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145010": {
+      "content": "<|reserved_special_token_223|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145011": {
+      "content": "<|reserved_special_token_224|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145012": {
+      "content": "<|reserved_special_token_225|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145013": {
+      "content": "<|reserved_special_token_226|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145014": {
+      "content": "<|reserved_special_token_227|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145015": {
+      "content": "<|reserved_special_token_228|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145016": {
+      "content": "<|reserved_special_token_229|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145017": {
+      "content": "<|reserved_special_token_230|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145018": {
+      "content": "<|reserved_special_token_231|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145019": {
+      "content": "<|reserved_special_token_232|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145020": {
+      "content": "<|reserved_special_token_233|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145021": {
+      "content": "<|reserved_special_token_234|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145022": {
+      "content": "<|reserved_special_token_235|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145023": {
+      "content": "<|reserved_special_token_236|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145024": {
+      "content": "<|reserved_special_token_237|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145025": {
+      "content": "<|reserved_special_token_238|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145026": {
+      "content": "<|reserved_special_token_239|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145027": {
+      "content": "<|reserved_special_token_240|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145028": {
+      "content": "<|reserved_special_token_241|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145029": {
+      "content": "<|reserved_special_token_242|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145030": {
+      "content": "<|reserved_special_token_243|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145031": {
+      "content": "<|reserved_special_token_244|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145032": {
+      "content": "<|reserved_special_token_245|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145033": {
+      "content": "<|reserved_special_token_246|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145034": {
+      "content": "<|reserved_special_token_247|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145035": {
+      "content": "<|reserved_special_token_248|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145036": {
+      "content": "<|reserved_special_token_249|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145037": {
+      "content": "<|reserved_special_token_250|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "<|begin_of_text|>",
+  "chat_template": "{% set loop_messages = messages %}{% for message in loop_messages %}{% set content = '<|start_header_id|>' + message['role'] + '<|end_header_id|>\n\n'+ message['content'] | trim + '<|eot_id|>' %}{% if loop.index0 == 0 %}{% set content = bos_token + content %}{% endif %}{{ content }}{% endfor %}{% if add_generation_prompt %}{{ '<|start_header_id|>assistant<|end_header_id|>\n\n' }}{% endif %}",
+  "clean_up_tokenization_spaces": true,
+  "eos_token": "<|end_of_text|>",
+  "model_input_names": [
+    "input_ids",
+    "attention_mask"
+  ],
+  "model_max_length": 1000000000000000019884624838656,
+  "pad_token": "<|end_of_text|>",
+  "tokenizer_class": "PreTrainedTokenizerFast"
+}