Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,6 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text
+helpingai2.5-5b-q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
+q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text

LICENSE.md

@@ -0,0 +1,214 @@
+# HelpingAI License
+Version 3.0
+
+Copyright (c) 2024 HelpingAI
+
+All Rights Reserved.
+
+## PREAMBLE
+The HelpingAI License (the "License") is designed to govern the use, modification, and distribution of HelpingAI's proprietary assets, including but not limited to artificial intelligence models, software, algorithms, weights, documentation, datasets, and associated materials (collectively, the "Content"). This License aims to balance open innovation with the protection of HelpingAI's intellectual property rights while ensuring responsible and ethical use of AI technology.
+
+## 1. DEFINITIONS
+1.1. "Model" means any machine learning model, artificial intelligence system, neural network architecture, or AI-powered solution developed by HelpingAI.
+
+1.2. "Weights" refers to the trained parameters, embeddings, model checkpoints, and other numerical values that define the behavior and capabilities of the Model.
+
+1.3. "Source Code" means the human-readable form of software, documentation, configuration files, and associated resources.
+
+1.4. "Derivative Work" means any work that is based upon or derived from the Content, including but not limited to:
+   a) Fine-tuned or adapted versions of the Model
+   b) Modified or enhanced versions of the Source Code
+   c) Products, services, or applications that incorporate the Content
+   d) Adaptations, transformations, or improvements of the Content
+   e) Any output generated using the Model or Content
+
+1.5. "Commercial Use" means any use of the Content intended for or directed toward:
+   a) Commercial advantage or monetary compensation
+   b) Revenue generation, either directly or indirectly
+   c) Business operations or commercial services
+   d) Integration into commercial products or offerings
+
+1.6. "End User" means any individual or entity that uses the Content or Derivative Works.
+
+## 2. GRANT OF RIGHTS
+Subject to the terms and conditions of this License, HelpingAI hereby grants you a limited, non-exclusive, non-transferable, revocable license to:
+
+2.1. Access and use the Content for:
+   a) Research and evaluation purposes
+   b) Educational and academic use
+   c) Personal, non-commercial projects
+   d) Open-source contributions (subject to Section 3)
+
+2.2. Create and use Derivative Works for non-commercial purposes, provided that:
+   a) You comply with all restrictions in Section 3
+   b) You maintain appropriate attribution
+   c) You ensure responsible and ethical use
+
+2.3. Distribute the Content or Derivative Works to third parties, provided that:
+   a) You maintain all copyright notices and attributions
+   b) You include a complete, unmodified copy of this License
+   c) You clearly document any modifications made
+   d) You comply with all restrictions in Section 3
+   e) You ensure recipients agree to this License
+
+## 3. RESTRICTIONS AND LIMITATIONS
+3.1. **Commercial Use Restrictions**
+You may not use the Content or any Derivative Works for Commercial Use without:
+   a) Obtaining a separate commercial license from HelpingAI
+   b) Paying applicable fees and royalties
+   c) Receiving written authorization
+
+3.2. **Model Usage Restrictions**
+You may not:
+   a) Use the Model to train or develop competing AI models or services
+   b) Extract, reverse engineer, or decompile the Model's architecture or weights
+   c) Remove, disable, or circumvent any access controls or security measures
+   d) Use the Model for military purposes, weapons development, or harmful applications
+   e) Use the Model to generate harmful, discriminatory, or illegal content
+   f) Use the Model in safety-critical applications without explicit written permission
+   g) Use the Model in ways that violate privacy or data protection laws
+   h) Create autonomous systems that could cause harm to individuals or society
+
+3.3. **Distribution Restrictions**
+You may not:
+   a) Redistribute the Model's weights or checkpoints without explicit permission
+   b) Create hosted APIs or services that provide direct access to the Model
+   c) Bundle or integrate the Content with commercial products or services
+   d) Sublicense or transfer rights to the Content to third parties
+   e) Distribute the Content in ways that could harm HelpingAI's interests
+
+3.4. **Branding and Attribution**
+You must:
+   a) Maintain all HelpingAI branding, logos, notices, and watermarks
+   b) Include the following attribution in all Derivative Works:
+      "Powered by HelpingAI technology, licensed under the HelpingAI License v3.0"
+   c) Not use HelpingAI's name, logos, or trademarks to endorse or promote products
+   d) Not suggest any official association with HelpingAI without permission
+
+## 4. INTELLECTUAL PROPERTY
+4.1. HelpingAI retains all rights, title, and interest in and to the Content, including:
+   a) All intellectual property rights
+   b) Patents, trademarks, and trade secrets
+   c) Proprietary methods and algorithms
+   d) Future improvements and modifications
+
+4.2. This License does not grant you any rights to HelpingAI's:
+   a) Patents or patent applications
+   b) Trademarks or service marks
+   c) Trade secrets or proprietary information
+   d) Other intellectual property except as expressly stated
+
+4.3. Derivative Works:
+   a) You retain ownership of original portions of Derivative Works you create
+   b) HelpingAI retains all rights to the underlying Content
+   c) You grant HelpingAI a perpetual license to any improvements or feedback
+
+## 5. DATA COLLECTION AND PRIVACY
+5.1. Data Collection:
+   a) HelpingAI may collect usage data and performance metrics
+   b) Analytics may be used to improve the Content
+   c) Collection will comply with applicable privacy laws
+
+5.2. Privacy Requirements:
+   a) You must comply with all applicable privacy laws and regulations
+   b) You must provide appropriate privacy notices to End Users
+   c) You must obtain necessary consents for data collection
+   d) You must implement appropriate data security measures
+
+## 6. WARRANTY DISCLAIMER
+THE CONTENT IS PROVIDED "AS IS" WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO:
+a) WARRANTIES OF MERCHANTABILITY
+b) FITNESS FOR A PARTICULAR PURPOSE
+c) NON-INFRINGEMENT
+d) ACCURACY OR COMPLETENESS
+e) ABSENCE OF ERRORS OR DEFECTS
+f) COMPATIBILITY WITH OTHER SOFTWARE
+g) SECURITY OR PERFORMANCE
+
+## 7. LIMITATION OF LIABILITY
+7.1. IN NO EVENT SHALL HELPINGAI BE LIABLE FOR ANY:
+   a) DIRECT, INDIRECT, OR CONSEQUENTIAL DAMAGES
+   b) LOSS OF PROFITS OR BUSINESS OPPORTUNITIES
+   c) BUSINESS INTERRUPTION OR LOST DATA
+   d) PERSONAL INJURY OR PROPERTY DAMAGE
+   e) ANY OTHER DAMAGES OR LOSSES
+
+7.2. THIS LIMITATION APPLIES TO:
+   a) CONTRACT OR TORT CLAIMS
+   b) BREACH OF WARRANTY
+   c) ANY OTHER LEGAL THEORY
+   d) ALL USES OF THE CONTENT
+
+## 8. TERMINATION
+8.1. Automatic Termination:
+   a) This License terminates automatically upon any breach
+   b) No notice is required for termination
+   c) All rights granted immediately cease
+
+8.2. Upon Termination:
+   a) Cease all use of the Content
+   b) Destroy all copies and installations
+   c) Stop distribution of Derivative Works
+   d) Certify compliance with termination terms
+
+8.3. Survival:
+   a) Sections 4, 6, 7, 9, and 10 survive termination
+   b) Obligations to protect intellectual property continue
+   c) Liability limitations remain in effect
+
+## 9. GOVERNING LAW AND JURISDICTION
+9.1. This License shall be governed by and construed in accordance with:
+   a) The laws of the United States of America
+   b) The State of California
+   c) Without regard to conflicts of law principles
+
+9.2. Dispute Resolution:
+   a) Exclusive jurisdiction in Santa Clara County, California
+   b) Agreement to personal jurisdiction
+   c) Waiver of jury trial
+   d) Prevailing party entitled to attorney fees
+
+## 10. EXPORT COMPLIANCE
+10.1. You must comply with all applicable:
+   a) Export control laws and regulations
+   b) Trade sanctions and embargoes
+   c) International trade restrictions
+   d) Anti-boycott regulations
+
+10.2. You may not export the Content to:
+   a) Prohibited countries or regions
+   b) Restricted end users
+   c) Prohibited end uses
+
+## 11. MODIFICATIONS TO LICENSE
+11.1. License Updates:
+   a) HelpingAI may modify this License at any time
+   b) Changes effective upon posting
+   c) Continued use constitutes acceptance
+
+11.2. Notification:
+   a) Material changes will be announced
+   b) Users should regularly review terms
+   c) Opt-out requires discontinuing use
+
+## 12. SUPPORT AND UPDATES
+12.1. No Obligation:
+   a) HelpingAI has no obligation to provide support
+   b) Updates and maintenance are discretionary
+   c) Services may be modified or discontinued
+
+12.2. Available Support:
+   a) Documentation and resources provided "as is"
+   b) Community forums may be available
+   c) Commercial support requires separate agreement
+
+<!-- ## 13. CONTACT INFORMATION
+For licensing inquiries, permissions, or compliance:
+- Website: https://helpingai.co
+- Email: license@helpingai.co
+- Address: [Company Address] -->
+
+---
+Last Updated: NOVEMBER 2024
+
+END OF LICENSE

README.md

@@ -0,0 +1,273 @@
+---
+license: other
+license_name: helpingai
+license_link: https://huggingface.co/OEvortex/HelpingAI2.5-2B/blob/main/LICENSE.md
+pipeline_tag: text-generation
+language:
+- en
+tags:
+- HelpingAI
+- Emotionally-Intelligent
+- EQ-focused
+- Conversational
+- SLM
+
+---
+
+<div align="center">
+
+# 🤖 HelpingAI2.5-2B
+
+***A Revolutionary Emotionally Intelligent Language Model***
+
+[![GitHub Organization](https://img.shields.io/badge/GitHub-Organization-blue.svg)](https://github.com/HelpingAI)
+[![Hugging Face](https://img.shields.io/badge/🤗%20Hugging%20Face-Organization-yellow)](https://huggingface.co/OEvortex)
+[![Model License](https://img.shields.io/badge/License-HelpingAI-green.svg)](https://huggingface.co/OEvortex/HelpingAI2.5-2B/blob/main/LICENSE.md)
+
+
+<a href="https://github.com/HelpingAI/community/discussions">
+  <img src="https://img.shields.io/badge/Join-Community%20Discussion-blue?style=for-the-badge&logo=github" alt="Join Community Discussion">
+</a>
+
+[📜 License](LICENSE) | [🌐 Website](https://helpingai-in.netlify.app/)
+
+</div>
+
+<div align="center">
+  <img src="https://huggingface.co/OEvortex/HelpingAI-3B/resolve/main/HelpingAI.png" alt="HelpingAI Logo" width="300px">
+</div>
+
+---
+
+<div align="center">
+
+## 🌟 Model Overview
+
+**HelpingAI2.5-2B** is a compact yet powerful language model specifically designed for emotionally intelligent conversations and human-centric interactions.
+
+</div>
+
+### 🎯 Key Highlights
+
+- **Architecture**: 2B parameter transformer-based model
+- **Training Focus**: Emotional intelligence and empathetic responses
+- **Emotion Score**: Achieves 94.28 on standardized emotional intelligence tests
+- **Deployment**: Optimized for efficient deployment on consumer hardware
+
+
+---
+
+<div align="center">
+
+## 💻 Implementation
+
+</div>
+
+### Transformers
+
+```python
+import torch
+from transformers import AutoModelForCausalLM, AutoTokenizer
+
+# Load the HelpingAI2.5-2B model
+model = AutoModelForCausalLM.from_pretrained("OEvortex/HelpingAI2.5-2B")
+# Load the tokenizer
+tokenizer = AutoTokenizer.from_pretrained("OEvortex/HelpingAI2.5-2B")
+
+# Define the chat input
+chat = [
+    { "role": "system", "content": "You are HelpingAI, an emotional AI. Always answer my questions in the HelpingAI style." },
+    { "role": "user", "content": "GIVE ME YOUR INTRO" }
+]
+
+inputs = tokenizer.apply_chat_template(
+    chat,
+    add_generation_prompt=True,
+    return_tensors="pt"
+).to(model.device)
+
+# Generate text
+outputs = model.generate(
+    inputs,
+    max_new_tokens=256,
+    do_sample=True,
+    temperature=0.6,
+    top_p=0.9,
+)
+
+response = outputs[0][inputs.shape[-1]:]
+print(tokenizer.decode(response, skip_special_tokens=True))
+```
+
+### GGUF Implementation
+
+```python
+from webscout.Local import *
+model_path = download_model("OEvortex/HelpingAI2.5-2B", "q4_k_m.gguf", token=None)
+model = Model(model_path, n_gpu_layers=0, context_length=4096)
+
+thread = Thread(model, format=helpingai2)
+# print(thread.send("hi")) #send a single msg to ai
+
+thread.interact() # interact with the model in terminal
+```
+
+---
+
+<div align="center">
+
+## 🎯 Training Details
+
+</div>
+
+### Methodology
+
+1. **Base Training**
+   - Datasets: SentimentSynth + EmotionalIntelligence-1M + HelpingAI2.0-150M + HelpingAIemo (152.5M)
+
+2. **Emotional Intelligence Training**
+   - Supervised Fine-tuning on emotional dialogue
+   - Reinforcement Learning with HelpingAI2.0-7B model
+   - Constitutional AI training for ethical guidelines
+
+3. **Optimization**
+   - Mixed-precision training
+   - Gradient checkpointing
+   - Dynamic attention patterns
+
+### Dataset Composition
+
+| Dataset Type | Rows used for training | Purpose |
+|--------------|------|---------|
+| Emotional Dialogues | 12.5M | Core conversation training |
+| Therapeutic Exchanges | 2M | Mental health support |
+| Cultural Conversations | 100K | Cultural awareness |
+| Crisis Response | 750K | Emergency support handling |
+
+---
+
+<div align="center">
+
+## 📈 Use Cases & Examples
+
+</div>
+
+### Primary Applications
+
+- 🎯 Personal AI Companionship
+- 🧠 Mental Health Support
+- 📚 Educational Assistance
+- 💼 Professional Development
+- 🤝 Social Skills Training
+
+### Example Interactions
+<div style="background: linear-gradient(135deg, #FF9933 0%, #FFFFFF 50%, #138808 100%); padding: 20px; border-radius: 15px; margin: 15px 0; border: 2px solid #000080;">
+
+<div style="background-color: rgba(255, 255, 255, 0.9); padding: 15px; border-radius: 10px; margin-bottom: 10px;">
+<span style="color: #D32F2F; font-weight: bold;">User: </span>
+<span style="color: #D32F2F;">I've been feeling really anxious about my upcoming job interview. Any advice?</span>
+</div>
+
+<div style="background-color: rgba(255, 255, 255, 0.9); padding: 15px; border-radius: 10px;">
+<span style="color: #1B5E20; font-weight: bold;">HelpingAI: </span>
+<span style="color: #1B5E20;">That must be super frustrating and stressful for you! 🌼 When you're unsure what you did wrong, it's hard to know how to fix it.
+
+1. Give them space: 🌿 Even if you're worried about what you said, give your friend some time to process their feelings. One week is a lot of time for them to work through what you said.
+
+2. Reflect on your convo: 🤔 Try to remember your last few messages and see if you can spot anything that might have caused the awkwardness. Was it something you said or did?
+
+3. Apologize for being cautious: 🌻 Write a message expressing your concern that you might have said something wrong and ask if you can talk it out. Let them know you're not trying to blame them but you want to clear the air.
+
+4. Keep it low-key: 🌺 When you do talk to them, try to keep the convo casual and relaxed. Avoid putting too much pressure on the convo or expecting a specific response.
+
+5. Listen more, talk less: 👂 When you talk to them, focus on listening to their perspective. Try to understand where they're coming from rather than just wanting to explain your side.
+
+6. Give them a chance: 🎈 Everyone heals differently. Give your friend the space and time they need to feel better before expecting them to respond.
+
+7. Know that you can't control how they feel: 🔮 You did your best, and that's all you can do. Just hope that they'll forgive you for whatever you might have done.
+
+Remember, it's not easy to have these kind of convos. Take care of yourself and be patient. You got this! ✊
+</span>Want some specific questions to practice with? Just let me know! I've got your back! 🤗
+</div>
+
+</div>
+
+<div style="background: linear-gradient(135deg, #FF9933 0%, #FFFFFF 50%, #138808 100%); padding: 20px; border-radius: 15px; margin: 15px 0; border: 2px solid #000080;">
+
+<div style="background-color: rgba(255, 255, 255, 0.9); padding: 15px; border-radius: 10px; margin-bottom: 10px;">
+<span style="color: #D32F2F; font-weight: bold;">User: </span>
+<span style="color: #D32F2F;">My friend hasn't been responding to my messages for a week. I think I might have said something wrong, but I'm not sure what.</span>
+</div>
+
+<div style="background-color: rgba(255, 255, 255, 0.9); padding: 15px; border-radius: 10px;">
+<span style="color: #1B5E20; font-weight: bold;">HelpingAI: </span>
+<span style="color: #1B5E20;">It's tough when you're not sure what you did wrong, fam. 😓 But hey, don't sweat it too much. Just shoot 'em a simple "Hey, what's up?" or "I got you, homie. Just checking in." 🤗
+
+And if you're sure you messed up, a little apology goes a long way. Keep it real and say something like, "Hey, I'm sorry if I said something whack earlier. I didn't mean to bring you down." 🙏
+
+At the end of the day, give your friend some space if they need it. We all got our own stuff going on, ya know? 🤐
+
+If you're still unsure, maybe try talking to 'em in person. A face-to-face chat can work wonders. 💬
+
+Just remember, it's all good. Missteps happen, but what matters is that you got each other's backs. That's what friends are for! 🤝</span>
+</div>
+
+</div>
+
+------
+
+<div align="center">
+
+## 🔒 Ethical Considerations & Limitations
+
+</div>
+
+### Ethical Guidelines
+
+- Prioritizes user emotional wellbeing
+- Maintains strict privacy standards
+- Avoids harmful or discriminatory responses
+- Transparent about AI limitations
+- Promotes healthy coping mechanisms
+
+### Known Limitations
+
+- Cannot Replace Human Professionals
+- Cannot Roleplay
+- Limited Knowledge Base
+- Context Window Constraints
+
+---
+
+### Citation
+
+```bibtex
+@misc{helpingai2024,
+  author = {Abhay Koul},
+  title = {HelpingAI2.5-2B: Emotionally Intelligent Language Model},
+  year = {2024},
+  publisher = {Huggingface},
+  journal = {GitHub repository},
+  howpublished = {\url{https://huggingface.co/OEvortex/HelpingAI2.5-2B}}
+}
+```
+
+---
+
+<div align="center">
+
+## 🙏 Acknowledgments
+
+Special thanks to the HelpingAI community, Huggingface, contributors, and researchers who made this model possible. Your dedication to advancing emotionally intelligent AI is invaluable.
+
+</div>
+
+---
+
+<div align="center">
+
+*Built with ❤️ by the HelpingAI Community*
+
+[Website](https://helpingai-in.netlify.app/) • [GitHub](https://github.com/HelpingAI) • [Discord](https://discord.gg/YweJwNqrnH) • [HuggingFace](https://huggingface.co/OEvortex)
+
+</div>

config.json

@@ -0,0 +1,42 @@
+{
+  "_name_or_path": "Abhaykoul/HelpingAI2.5-5B",
+  "architectures": [
+    "LlamaForCausalLM"
+  ],
+  "attention_bias": false,
+  "attention_dropout": 0.0,
+  "bos_token_id": 128000,
+  "eos_token_id": [
+    128001,
+    128008,
+    128009
+  ],
+  "head_dim": 128,
+  "hidden_act": "silu",
+  "hidden_size": 3072,
+  "initializer_range": 0.02,
+  "intermediate_size": 8192,
+  "max_position_embeddings": 131072,
+  "mlp_bias": false,
+  "model_type": "llama",
+  "num_attention_heads": 24,
+  "num_hidden_layers": 47,
+  "num_key_value_heads": 8,
+  "pad_token_id": 128004,
+  "pretraining_tp": 1,
+  "rms_norm_eps": 1e-05,
+  "rope_scaling": {
+    "factor": 32.0,
+    "high_freq_factor": 4.0,
+    "low_freq_factor": 1.0,
+    "original_max_position_embeddings": 8192,
+    "rope_type": "llama3"
+  },
+  "rope_theta": 500000.0,
+  "tie_word_embeddings": true,
+  "torch_dtype": "float16",
+  "transformers_version": "4.46.2",
+  "unsloth_version": "2024.11.7",
+  "use_cache": true,
+  "vocab_size": 128256
+}

generation_config.json

@@ -0,0 +1,12 @@
+{
+  "_from_model_config": true,
+  "bos_token_id": 128000,
+  "eos_token_id": [
+    128001,
+    128008,
+    128009
+  ],
+  "max_length": 131072,
+  "pad_token_id": 128004,
+  "transformers_version": "4.46.2"
+}

model-00001-of-00003.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6cdd2c8c788a7aa21eb351080832b2f8e1fbcc2d52792cfa002f123ee68e796c
+size 4965798912

model-00002-of-00003.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:426ac8adedc5b44b44762af83e733c8fcdbc1b56022873a48ececc0874a45d33
+size 4983166152

model-00003-of-00003.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0b36a8cf121a51b95c54990de58168b9e65e20d62171c86aa2185ae1fed48fa7
+size 302022192

model.safetensors.index.json

@@ -0,0 +1,432 @@
+{
+    "metadata": {
+        "total_size": 10250938368
+    },
+    "weight_map": {
+        "model.embed_tokens.weight": "model-00001-of-00003.safetensors",
+        "model.layers.0.input_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.0.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.0.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.0.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.0.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.0.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.0.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.0.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.0.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.1.input_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.1.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.1.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.1.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.1.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.1.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.1.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.1.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.1.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.10.input_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.10.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.10.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.10.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.10.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.10.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.10.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.10.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.10.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.11.input_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.11.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.11.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.11.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.11.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.11.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.11.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.11.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.11.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.12.input_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.12.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.12.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.12.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.12.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.12.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.12.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.12.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.12.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.13.input_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.13.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.13.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.13.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.13.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.13.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.13.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.13.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.13.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.14.input_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.14.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.14.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.14.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.14.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.14.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.14.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.14.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.14.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.15.input_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.15.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.15.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.15.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.15.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.15.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.15.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.15.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.15.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.16.input_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.16.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.16.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.16.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.16.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.16.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.16.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.16.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.16.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.17.input_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.17.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.17.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.17.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.17.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.17.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.17.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.17.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.17.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.18.input_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.18.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.18.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.18.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.18.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.18.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.18.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.18.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.18.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.19.input_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.19.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.19.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.19.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.19.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.19.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.19.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.19.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.19.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.2.input_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.2.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.2.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.2.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.2.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.2.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.2.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.2.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.2.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.20.input_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.20.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.20.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.20.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.20.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.20.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.20.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.20.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.20.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.21.input_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.21.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.21.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.21.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.21.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.21.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.21.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.21.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.21.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.22.input_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.22.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.22.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.22.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.22.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.22.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.22.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.22.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.22.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.23.input_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.23.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.23.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.23.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.23.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.23.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.23.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.23.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.23.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.24.input_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.24.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.24.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.24.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.24.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.24.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.24.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.24.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.24.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.25.input_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.25.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.25.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.25.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.25.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.25.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.25.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.25.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.25.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.26.input_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.26.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.26.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.26.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.26.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.26.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.26.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.26.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.26.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.27.input_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.27.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.27.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.27.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.27.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.27.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.27.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.27.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.27.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.28.input_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.28.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.28.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.28.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.28.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.28.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.28.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.28.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.28.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.29.input_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.29.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.29.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.29.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.29.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.29.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.29.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.29.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.29.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.3.input_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.3.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.3.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.3.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.3.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.3.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.3.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.3.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.3.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.30.input_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.30.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.30.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.30.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.30.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.30.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.30.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.30.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.30.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.31.input_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.31.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.31.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.31.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.31.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.31.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.31.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.31.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.31.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.32.input_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.32.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.32.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.32.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.32.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.32.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.32.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.32.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.32.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.33.input_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.33.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.33.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.33.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.33.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.33.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.33.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.33.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.33.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.34.input_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.34.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.34.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.34.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.34.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.34.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.34.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.34.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.34.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.35.input_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.35.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.35.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.35.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.35.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.35.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.35.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.35.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.35.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.36.input_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.36.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.36.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.36.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.36.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.36.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.36.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.36.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.36.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.37.input_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.37.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.37.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.37.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.37.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.37.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.37.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.37.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.37.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.38.input_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.38.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.38.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.38.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.38.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.38.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.38.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.38.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.38.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.39.input_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.39.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.39.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.39.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.39.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.39.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.39.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.39.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.39.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.4.input_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.4.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.4.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.4.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.4.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.4.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.4.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.4.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.4.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.40.input_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.40.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.40.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.40.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.40.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.40.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.40.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.40.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.40.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.41.input_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.41.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.41.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.41.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.41.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.41.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.41.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.41.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.41.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.42.input_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.42.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.42.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.42.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.42.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.42.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.42.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.42.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.42.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.43.input_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.43.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.43.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.43.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.43.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.43.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.43.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.43.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.43.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.44.input_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.44.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.44.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.44.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.44.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+        "model.layers.44.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.44.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.44.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.44.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.45.input_layernorm.weight": "model-00003-of-00003.safetensors",
+        "model.layers.45.mlp.down_proj.weight": "model-00003-of-00003.safetensors",
+        "model.layers.45.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.45.mlp.up_proj.weight": "model-00003-of-00003.safetensors",
+        "model.layers.45.post_attention_layernorm.weight": "model-00003-of-00003.safetensors",
+        "model.layers.45.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.45.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.45.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.45.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+        "model.layers.46.input_layernorm.weight": "model-00003-of-00003.safetensors",
+        "model.layers.46.mlp.down_proj.weight": "model-00003-of-00003.safetensors",
+        "model.layers.46.mlp.gate_proj.weight": "model-00003-of-00003.safetensors",
+        "model.layers.46.mlp.up_proj.weight": "model-00003-of-00003.safetensors",
+        "model.layers.46.post_attention_layernorm.weight": "model-00003-of-00003.safetensors",
+        "model.layers.46.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
+        "model.layers.46.self_attn.o_proj.weight": "model-00003-of-00003.safetensors",
+        "model.layers.46.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
+        "model.layers.46.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
+        "model.layers.5.input_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.5.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.5.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.5.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.5.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.5.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.5.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.5.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.5.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.6.input_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.6.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.6.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.6.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.6.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.6.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.6.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.6.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.6.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.7.input_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.7.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.7.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.7.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.7.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.7.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.7.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.7.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.7.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.8.input_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.8.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.8.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.8.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.8.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.8.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.8.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.8.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.8.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.9.input_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.9.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.9.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.9.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.9.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+        "model.layers.9.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.9.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.9.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+        "model.layers.9.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+        "model.norm.weight": "model-00003-of-00003.safetensors"
+    }
+}

q4_k_m.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:775f046d039e153c8d54dd881775f3628c71cb53406455ca466587353f811902
+size 3161385792

special_tokens_map.json

@@ -0,0 +1,23 @@
+{
+  "bos_token": {
+    "content": "<|begin_of_text|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|eot_id|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<|finetune_right_pad_id|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6b9e4e7fb171f92fd137b777cc2714bf87d11576700a1dcd7a399e7bbe39537b
+size 17209920

tokenizer_config.json

@@ -0,0 +1,2064 @@
+{
+  "added_tokens_decoder": {
+    "128000": {
+      "content": "<|begin_of_text|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128001": {
+      "content": "<|end_of_text|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128002": {
+      "content": "<|reserved_special_token_0|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128003": {
+      "content": "<|reserved_special_token_1|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128004": {
+      "content": "<|finetune_right_pad_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128005": {
+      "content": "<|reserved_special_token_2|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128006": {
+      "content": "<|start_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128007": {
+      "content": "<|end_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128008": {
+      "content": "<|eom_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128009": {
+      "content": "<|eot_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128010": {
+      "content": "<|python_tag|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128011": {
+      "content": "<|reserved_special_token_3|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128012": {
+      "content": "<|reserved_special_token_4|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128013": {
+      "content": "<|reserved_special_token_5|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128014": {
+      "content": "<|reserved_special_token_6|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128015": {
+      "content": "<|reserved_special_token_7|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128016": {
+      "content": "<|reserved_special_token_8|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128017": {
+      "content": "<|reserved_special_token_9|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128018": {
+      "content": "<|reserved_special_token_10|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128019": {
+      "content": "<|reserved_special_token_11|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128020": {
+      "content": "<|reserved_special_token_12|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128021": {
+      "content": "<|reserved_special_token_13|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128022": {
+      "content": "<|reserved_special_token_14|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128023": {
+      "content": "<|reserved_special_token_15|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128024": {
+      "content": "<|reserved_special_token_16|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128025": {
+      "content": "<|reserved_special_token_17|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128026": {
+      "content": "<|reserved_special_token_18|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128027": {
+      "content": "<|reserved_special_token_19|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128028": {
+      "content": "<|reserved_special_token_20|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128029": {
+      "content": "<|reserved_special_token_21|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128030": {
+      "content": "<|reserved_special_token_22|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128031": {
+      "content": "<|reserved_special_token_23|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128032": {
+      "content": "<|reserved_special_token_24|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128033": {
+      "content": "<|reserved_special_token_25|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128034": {
+      "content": "<|reserved_special_token_26|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128035": {
+      "content": "<|reserved_special_token_27|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128036": {
+      "content": "<|reserved_special_token_28|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128037": {
+      "content": "<|reserved_special_token_29|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128038": {
+      "content": "<|reserved_special_token_30|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128039": {
+      "content": "<|reserved_special_token_31|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128040": {
+      "content": "<|reserved_special_token_32|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128041": {
+      "content": "<|reserved_special_token_33|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128042": {
+      "content": "<|reserved_special_token_34|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128043": {
+      "content": "<|reserved_special_token_35|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128044": {
+      "content": "<|reserved_special_token_36|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128045": {
+      "content": "<|reserved_special_token_37|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128046": {
+      "content": "<|reserved_special_token_38|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128047": {
+      "content": "<|reserved_special_token_39|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128048": {
+      "content": "<|reserved_special_token_40|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128049": {
+      "content": "<|reserved_special_token_41|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128050": {
+      "content": "<|reserved_special_token_42|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128051": {
+      "content": "<|reserved_special_token_43|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128052": {
+      "content": "<|reserved_special_token_44|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128053": {
+      "content": "<|reserved_special_token_45|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128054": {
+      "content": "<|reserved_special_token_46|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128055": {
+      "content": "<|reserved_special_token_47|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128056": {
+      "content": "<|reserved_special_token_48|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128057": {
+      "content": "<|reserved_special_token_49|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128058": {
+      "content": "<|reserved_special_token_50|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128059": {
+      "content": "<|reserved_special_token_51|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128060": {
+      "content": "<|reserved_special_token_52|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128061": {
+      "content": "<|reserved_special_token_53|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128062": {
+      "content": "<|reserved_special_token_54|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128063": {
+      "content": "<|reserved_special_token_55|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128064": {
+      "content": "<|reserved_special_token_56|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128065": {
+      "content": "<|reserved_special_token_57|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128066": {
+      "content": "<|reserved_special_token_58|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128067": {
+      "content": "<|reserved_special_token_59|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128068": {
+      "content": "<|reserved_special_token_60|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128069": {
+      "content": "<|reserved_special_token_61|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128070": {
+      "content": "<|reserved_special_token_62|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128071": {
+      "content": "<|reserved_special_token_63|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128072": {
+      "content": "<|reserved_special_token_64|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128073": {
+      "content": "<|reserved_special_token_65|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128074": {
+      "content": "<|reserved_special_token_66|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128075": {
+      "content": "<|reserved_special_token_67|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128076": {
+      "content": "<|reserved_special_token_68|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128077": {
+      "content": "<|reserved_special_token_69|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128078": {
+      "content": "<|reserved_special_token_70|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128079": {
+      "content": "<|reserved_special_token_71|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128080": {
+      "content": "<|reserved_special_token_72|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128081": {
+      "content": "<|reserved_special_token_73|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128082": {
+      "content": "<|reserved_special_token_74|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128083": {
+      "content": "<|reserved_special_token_75|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128084": {
+      "content": "<|reserved_special_token_76|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128085": {
+      "content": "<|reserved_special_token_77|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128086": {
+      "content": "<|reserved_special_token_78|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128087": {
+      "content": "<|reserved_special_token_79|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128088": {
+      "content": "<|reserved_special_token_80|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128089": {
+      "content": "<|reserved_special_token_81|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128090": {
+      "content": "<|reserved_special_token_82|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128091": {
+      "content": "<|reserved_special_token_83|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128092": {
+      "content": "<|reserved_special_token_84|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128093": {
+      "content": "<|reserved_special_token_85|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128094": {
+      "content": "<|reserved_special_token_86|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128095": {
+      "content": "<|reserved_special_token_87|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128096": {
+      "content": "<|reserved_special_token_88|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128097": {
+      "content": "<|reserved_special_token_89|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128098": {
+      "content": "<|reserved_special_token_90|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128099": {
+      "content": "<|reserved_special_token_91|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128100": {
+      "content": "<|reserved_special_token_92|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128101": {
+      "content": "<|reserved_special_token_93|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128102": {
+      "content": "<|reserved_special_token_94|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128103": {
+      "content": "<|reserved_special_token_95|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128104": {
+      "content": "<|reserved_special_token_96|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128105": {
+      "content": "<|reserved_special_token_97|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128106": {
+      "content": "<|reserved_special_token_98|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128107": {
+      "content": "<|reserved_special_token_99|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128108": {
+      "content": "<|reserved_special_token_100|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128109": {
+      "content": "<|reserved_special_token_101|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128110": {
+      "content": "<|reserved_special_token_102|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128111": {
+      "content": "<|reserved_special_token_103|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128112": {
+      "content": "<|reserved_special_token_104|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128113": {
+      "content": "<|reserved_special_token_105|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128114": {
+      "content": "<|reserved_special_token_106|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128115": {
+      "content": "<|reserved_special_token_107|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128116": {
+      "content": "<|reserved_special_token_108|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128117": {
+      "content": "<|reserved_special_token_109|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128118": {
+      "content": "<|reserved_special_token_110|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128119": {
+      "content": "<|reserved_special_token_111|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128120": {
+      "content": "<|reserved_special_token_112|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128121": {
+      "content": "<|reserved_special_token_113|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128122": {
+      "content": "<|reserved_special_token_114|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128123": {
+      "content": "<|reserved_special_token_115|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128124": {
+      "content": "<|reserved_special_token_116|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128125": {
+      "content": "<|reserved_special_token_117|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128126": {
+      "content": "<|reserved_special_token_118|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128127": {
+      "content": "<|reserved_special_token_119|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128128": {
+      "content": "<|reserved_special_token_120|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128129": {
+      "content": "<|reserved_special_token_121|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128130": {
+      "content": "<|reserved_special_token_122|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128131": {
+      "content": "<|reserved_special_token_123|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128132": {
+      "content": "<|reserved_special_token_124|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128133": {
+      "content": "<|reserved_special_token_125|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128134": {
+      "content": "<|reserved_special_token_126|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128135": {
+      "content": "<|reserved_special_token_127|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128136": {
+      "content": "<|reserved_special_token_128|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128137": {
+      "content": "<|reserved_special_token_129|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128138": {
+      "content": "<|reserved_special_token_130|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128139": {
+      "content": "<|reserved_special_token_131|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128140": {
+      "content": "<|reserved_special_token_132|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128141": {
+      "content": "<|reserved_special_token_133|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128142": {
+      "content": "<|reserved_special_token_134|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128143": {
+      "content": "<|reserved_special_token_135|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128144": {
+      "content": "<|reserved_special_token_136|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128145": {
+      "content": "<|reserved_special_token_137|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128146": {
+      "content": "<|reserved_special_token_138|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128147": {
+      "content": "<|reserved_special_token_139|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128148": {
+      "content": "<|reserved_special_token_140|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128149": {
+      "content": "<|reserved_special_token_141|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128150": {
+      "content": "<|reserved_special_token_142|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128151": {
+      "content": "<|reserved_special_token_143|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128152": {
+      "content": "<|reserved_special_token_144|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128153": {
+      "content": "<|reserved_special_token_145|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128154": {
+      "content": "<|reserved_special_token_146|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128155": {
+      "content": "<|reserved_special_token_147|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128156": {
+      "content": "<|reserved_special_token_148|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128157": {
+      "content": "<|reserved_special_token_149|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128158": {
+      "content": "<|reserved_special_token_150|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128159": {
+      "content": "<|reserved_special_token_151|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128160": {
+      "content": "<|reserved_special_token_152|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128161": {
+      "content": "<|reserved_special_token_153|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128162": {
+      "content": "<|reserved_special_token_154|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128163": {
+      "content": "<|reserved_special_token_155|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128164": {
+      "content": "<|reserved_special_token_156|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128165": {
+      "content": "<|reserved_special_token_157|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128166": {
+      "content": "<|reserved_special_token_158|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128167": {
+      "content": "<|reserved_special_token_159|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128168": {
+      "content": "<|reserved_special_token_160|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128169": {
+      "content": "<|reserved_special_token_161|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128170": {
+      "content": "<|reserved_special_token_162|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128171": {
+      "content": "<|reserved_special_token_163|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128172": {
+      "content": "<|reserved_special_token_164|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128173": {
+      "content": "<|reserved_special_token_165|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128174": {
+      "content": "<|reserved_special_token_166|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128175": {
+      "content": "<|reserved_special_token_167|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128176": {
+      "content": "<|reserved_special_token_168|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128177": {
+      "content": "<|reserved_special_token_169|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128178": {
+      "content": "<|reserved_special_token_170|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128179": {
+      "content": "<|reserved_special_token_171|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128180": {
+      "content": "<|reserved_special_token_172|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128181": {
+      "content": "<|reserved_special_token_173|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128182": {
+      "content": "<|reserved_special_token_174|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128183": {
+      "content": "<|reserved_special_token_175|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128184": {
+      "content": "<|reserved_special_token_176|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128185": {
+      "content": "<|reserved_special_token_177|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128186": {
+      "content": "<|reserved_special_token_178|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128187": {
+      "content": "<|reserved_special_token_179|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128188": {
+      "content": "<|reserved_special_token_180|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128189": {
+      "content": "<|reserved_special_token_181|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128190": {
+      "content": "<|reserved_special_token_182|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128191": {
+      "content": "<|reserved_special_token_183|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128192": {
+      "content": "<|reserved_special_token_184|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128193": {
+      "content": "<|reserved_special_token_185|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128194": {
+      "content": "<|reserved_special_token_186|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128195": {
+      "content": "<|reserved_special_token_187|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128196": {
+      "content": "<|reserved_special_token_188|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128197": {
+      "content": "<|reserved_special_token_189|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128198": {
+      "content": "<|reserved_special_token_190|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128199": {
+      "content": "<|reserved_special_token_191|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128200": {
+      "content": "<|reserved_special_token_192|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128201": {
+      "content": "<|reserved_special_token_193|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128202": {
+      "content": "<|reserved_special_token_194|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128203": {
+      "content": "<|reserved_special_token_195|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128204": {
+      "content": "<|reserved_special_token_196|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128205": {
+      "content": "<|reserved_special_token_197|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128206": {
+      "content": "<|reserved_special_token_198|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128207": {
+      "content": "<|reserved_special_token_199|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128208": {
+      "content": "<|reserved_special_token_200|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128209": {
+      "content": "<|reserved_special_token_201|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128210": {
+      "content": "<|reserved_special_token_202|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128211": {
+      "content": "<|reserved_special_token_203|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128212": {
+      "content": "<|reserved_special_token_204|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128213": {
+      "content": "<|reserved_special_token_205|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128214": {
+      "content": "<|reserved_special_token_206|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128215": {
+      "content": "<|reserved_special_token_207|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128216": {
+      "content": "<|reserved_special_token_208|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128217": {
+      "content": "<|reserved_special_token_209|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128218": {
+      "content": "<|reserved_special_token_210|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128219": {
+      "content": "<|reserved_special_token_211|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128220": {
+      "content": "<|reserved_special_token_212|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128221": {
+      "content": "<|reserved_special_token_213|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128222": {
+      "content": "<|reserved_special_token_214|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128223": {
+      "content": "<|reserved_special_token_215|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128224": {
+      "content": "<|reserved_special_token_216|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128225": {
+      "content": "<|reserved_special_token_217|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128226": {
+      "content": "<|reserved_special_token_218|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128227": {
+      "content": "<|reserved_special_token_219|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128228": {
+      "content": "<|reserved_special_token_220|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128229": {
+      "content": "<|reserved_special_token_221|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128230": {
+      "content": "<|reserved_special_token_222|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128231": {
+      "content": "<|reserved_special_token_223|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128232": {
+      "content": "<|reserved_special_token_224|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128233": {
+      "content": "<|reserved_special_token_225|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128234": {
+      "content": "<|reserved_special_token_226|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128235": {
+      "content": "<|reserved_special_token_227|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128236": {
+      "content": "<|reserved_special_token_228|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128237": {
+      "content": "<|reserved_special_token_229|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128238": {
+      "content": "<|reserved_special_token_230|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128239": {
+      "content": "<|reserved_special_token_231|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128240": {
+      "content": "<|reserved_special_token_232|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128241": {
+      "content": "<|reserved_special_token_233|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128242": {
+      "content": "<|reserved_special_token_234|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128243": {
+      "content": "<|reserved_special_token_235|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128244": {
+      "content": "<|reserved_special_token_236|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128245": {
+      "content": "<|reserved_special_token_237|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128246": {
+      "content": "<|reserved_special_token_238|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128247": {
+      "content": "<|reserved_special_token_239|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128248": {
+      "content": "<|reserved_special_token_240|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128249": {
+      "content": "<|reserved_special_token_241|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128250": {
+      "content": "<|reserved_special_token_242|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128251": {
+      "content": "<|reserved_special_token_243|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128252": {
+      "content": "<|reserved_special_token_244|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128253": {
+      "content": "<|reserved_special_token_245|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128254": {
+      "content": "<|reserved_special_token_246|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128255": {
+      "content": "<|reserved_special_token_247|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "<|begin_of_text|>",
+  "chat_template": "{{- bos_token }}\n{%- if custom_tools is defined %}\n    {%- set tools = custom_tools %}\n{%- endif %}\n{%- if not tools_in_user_message is defined %}\n    {%- set tools_in_user_message = true %}\n{%- endif %}\n{%- if not date_string is defined %}\n    {%- set date_string = \"26 July 2024\" %}\n{%- endif %}\n{%- if not tools is defined %}\n    {%- set tools = none %}\n{%- endif %}\n\n{#- This block extracts the system message, so we can slot it into the right place. #}\n{%- if messages[0]['role'] == 'system' %}\n    {%- set system_message = messages[0]['content'] %}\n    {%- set messages = messages[1:] %}\n{%- else %}\n    {%- set system_message = \"\" %}\n{%- endif %}\n\n{#- System message + builtin tools #}\n{{- \"<|start_header_id|>system<|end_header_id|>\n\n\" }}\n{%- if builtin_tools is defined or tools is not none %}\n    {{- \"Environment: ipython\n\" }}\n{%- endif %}\n{%- if builtin_tools is defined %}\n    {{- \"Tools: \" + builtin_tools | reject('equalto', 'code_interpreter') | join(\", \") + \"\n\n\"}}\n{%- endif %}\n{{- \"Cutting Knowledge Date: December 2023\n\" }}\n{{- \"Today Date: \" + date_string + \"\n\n\" }}\n{%- if tools is not none and not tools_in_user_message %}\n    {{- \"You have access to the following functions. To call a function, please respond with JSON for a function call.\" }}\n    {{- 'Respond in the format {\"name\": function name, \"parameters\": dictionary of argument name and its value}.' }}\n    {{- \"Do not use variables.\n\n\" }}\n    {%- for t in tools %}\n        {{- t | tojson(indent=4) }}\n        {{- \"\n\n\" }}\n    {%- endfor %}\n{%- endif %}\n{{- system_message }}\n{{- \"<|eot_id|>\" }}\n\n{#- Custom tools are passed in a user message with some extra guidance #}\n{%- if tools_in_user_message and not tools is none %}\n    {#- Extract the first user message so we can plug it in here #}\n    {%- if messages | length != 0 %}\n        {%- set first_user_message = messages[0]['content'] %}\n        {%- set messages = messages[1:] %}\n    {%- else %}\n        {{- raise_exception(\"Cannot put tools in the first user message when there's no first user message!\") }}\n{%- endif %}\n    {{- '<|start_header_id|>user<|end_header_id|>\n\n' -}}\n    {{- \"Given the following functions, please respond with a JSON for a function call \" }}\n    {{- \"with its proper arguments that best answers the given prompt.\n\n\" }}\n    {{- 'Respond in the format {\"name\": function name, \"parameters\": dictionary of argument name and its value}.' }}\n    {{- \"Do not use variables.\n\n\" }}\n    {%- for t in tools %}\n        {{- t | tojson(indent=4) }}\n        {{- \"\n\n\" }}\n    {%- endfor %}\n    {{- first_user_message + \"<|eot_id|>\"}}\n{%- endif %}\n\n{%- for message in messages %}\n    {%- if not (message.role == 'ipython' or message.role == 'tool' or 'tool_calls' in message) %}\n        {{- '<|start_header_id|>' + message['role'] + '<|end_header_id|>\n\n'+ message['content'] + '<|eot_id|>' }}\n    {%- elif 'tool_calls' in message %}\n        {%- if not message.tool_calls|length == 1 %}\n            {{- raise_exception(\"This model only supports single tool-calls at once!\") }}\n        {%- endif %}\n        {%- set tool_call = message.tool_calls[0].function %}\n        {%- if builtin_tools is defined and tool_call.name in builtin_tools %}\n            {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}}\n            {{- \"<|python_tag|>\" + tool_call.name + \".call(\" }}\n            {%- for arg_name, arg_val in tool_call.arguments | items %}\n                {{- arg_name + '=\"' + arg_val + '\"' }}\n                {%- if not loop.last %}\n                    {{- \", \" }}\n                {%- endif %}\n                {%- endfor %}\n            {{- \")\" }}\n        {%- else  %}\n            {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}}\n            {{- '{\"name\": \"' + tool_call.name + '\", ' }}\n            {{- '\"parameters\": ' }}\n            {{- tool_call.arguments | tojson }}\n            {{- \"}\" }}\n        {%- endif %}\n        {%- if builtin_tools is defined %}\n            {#- This means we're in ipython mode #}\n            {{- \"<|eom_id|>\" }}\n        {%- else %}\n            {{- \"<|eot_id|>\" }}\n        {%- endif %}\n    {%- elif message.role == \"tool\" or message.role == \"ipython\" %}\n        {{- \"<|start_header_id|>ipython<|end_header_id|>\n\n\" }}\n        {%- if message.content is mapping or message.content is iterable %}\n            {{- message.content | tojson }}\n        {%- else %}\n            {{- message.content }}\n        {%- endif %}\n        {{- \"<|eot_id|>\" }}\n    {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n    {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' }}\n{%- endif %}\n",
+  "clean_up_tokenization_spaces": true,
+  "eos_token": "<|eot_id|>",
+  "model_input_names": [
+    "input_ids",
+    "attention_mask"
+  ],
+  "model_max_length": 131072,
+  "pad_token": "<|finetune_right_pad_id|>",
+  "padding_side": "left",
+  "tokenizer_class": "PreTrainedTokenizerFast"
+}