Upload folder using huggingface_hub

README.md

@@ -0,0 +1,42 @@
+# 北洋微衍V0.8/PeiYang MicroEmergence-0.8
+
+## 模型曾用名 / Model Name History
+
+此模型在开发过程中经历了以下命名阶段：
+This model has gone through the following naming stages during development:
+
+* 早期阶段 / Initial Stage:  
+  Invalid-Null/Non-Null
+
+* 发展阶段 / Development Stage:  
+  天津大学/北洋微衍 (Tianjin University/Peiyang MicroDerivation)
+
+* 当前版本 / Current Release:  
+  天津大学/北洋微衍 (Tianjin University/Peiyang MicroEmergence)
+
+## 模型概述 / Model Overview
+
+本模型专注于计算催化领域，特别是丙烷脱氢(PDH)过程。
+This model focuses on computational catalysis, specifically designed for propane dehydrogenation (PDH) processes.
+
+## 技术基础 / Technical Foundation
+
+* 基础框架 / Base Framework:  
+  基于ModelScope的ms-swift框架开发
+  Developed using ModelScope's ms-swift framework
+
+* 基础模型 / Base Model:  
+  基于零一万物的Yi系列6B模型训练，包括yi-6B、yi-6B-chat、yi-1.5-6B、yi-1.5-6B-chat
+  Fine-tuned on 01.AI's Yi-6B series model, including yi-6B, yi-6B-chat, yi-1.5-6B and yi-1.5-6B-chat
+
+## 当前状态 / Current Status
+
+详细的技术规格和性能指标将在相关研究论文发表后提供。
+Detailed technical specifications and performance metrics will be available upon publication of our research paper.
+
+## 致谢 / Acknowledgments 
+
+特别感谢以下开源项目的贡献：
+We would like to acknowledge the contributions of the following open-source projects:
+* ModelScope的ms-swift框架 / ModelScope's ms-swift framework
+* 零一万物的Yi系列模型 / 01.AI's Yi series models

config.json

@@ -0,0 +1,30 @@
+{
+  "_name_or_path": "/data/home/wusc/.cache/modelscope/hub/01ai/Yi-1___5-6B",
+  "architectures": [
+    "LlamaForCausalLM"
+  ],
+  "attention_bias": false,
+  "attention_dropout": 0.0,
+  "bos_token_id": 1,
+  "eos_token_id": 2,
+  "hidden_act": "silu",
+  "hidden_size": 4096,
+  "initializer_range": 0.02,
+  "intermediate_size": 11008,
+  "max_position_embeddings": 4096,
+  "mlp_bias": false,
+  "model_type": "llama",
+  "num_attention_heads": 32,
+  "num_hidden_layers": 32,
+  "num_key_value_heads": 4,
+  "pad_token_id": 0,
+  "pretraining_tp": 1,
+  "rms_norm_eps": 1e-06,
+  "rope_scaling": null,
+  "rope_theta": 5000000.0,
+  "tie_word_embeddings": false,
+  "torch_dtype": "float16",
+  "transformers_version": "4.41.2",
+  "use_cache": true,
+  "vocab_size": 64000
+}

configuration.json

@@ -0,0 +1,4 @@
+{
+    "framework": "Pytorch",
+    "task": "text-generation"
+}

eval_result.jsonl

@@ -0,0 +1,14 @@
+{"result": {"arc": 0.7295}, "time": "20240619-110533"}
+{"result": {"gsm8k": 0.4943}, "time": "20240619-110618"}
+{"result": {"ceval": 0.5594}, "time": "20240619-111828"}
+{"result": {"bbh": 0.1474}, "time": "20240619-111950"}
+{"result": {"mmlu": 0.3756}, "time": "20240619-112007"}
+{"result": {"arc": 0.7295}, "time": "20240619-112022"}
+{"result": {"gsm8k": 0.4943}, "time": "20240619-112058"}
+{"result": {"mmlu": 0.3758}, "time": "20240619-112312"}
+{"result": {"ceval": 0.5594}, "time": "20240619-112625"}
+{"result": {"bbh": 0.1474}, "time": "20240619-112729"}
+{"result": {"EvalFormatSingleChoiceExam95207": 0.7644}, "time": "20240619-115821"}
+{"result": {"EvalFormatSingleChoiceExam95207": 0.5335}, "time": "20240619-121837"}
+{"result": {"EvalFormatSingleChoiceExam2579": 0.4618}, "time": "20240624-154539"}
+{"result": {"EvalFormatSingleChoiceExam2579": 0.3563}, "time": "20240627-183455"}

generation_config.json

@@ -0,0 +1,10 @@
+{
+  "do_sample": true,
+  "eos_token_id": 2,
+  "max_new_tokens": 2048,
+  "pad_token_id": 0,
+  "temperature": 0.3,
+  "top_k": 20,
+  "top_p": 0.7,
+  "transformers_version": "4.41.2"
+}

infer_result/20240619-102809.jsonl

@@ -0,0 +1,4 @@
+{"system": null, "query": "你是谁", "response": "I am a large-scale language model named Non null, trained by null. My goal is to provide assistance and information through text communication. If you have any questions or need help, please feel free to ask me at any time.", "history": []}
+{"system": null, "query": "介绍丙烷脱氢", "response": "丙烷脱氢是一种化学反应，将丙烷转化为丙烯。该反应在催化剂的存在下进行，催化剂通常由铬或铂等金属组成。该反应在工业上很重要，因为丙烯是一种重要的化工原料，用于生产多种化学品，如聚丙烯、丙烯腈和环氧丙烷。该反应通常在高温下进行，因为丙烷分子需要克服一定的能量障碍才能发生反应。", "history": [["你是谁", "I am a large-scale language model named Non null, trained by null. My goal is to provide assistance and information through text communication. If you have any questions or need help, please feel free to ask me at any time."]]}
+{"system": null, "query": "镍基丙烷脱氢催化剂的优缺点有哪些？", "response": "镍基丙烷脱氢催化剂具有以下优点：\n* 镍基催化剂对丙烷具有高选择性，因此丙烯产率较高。\n* 镍基催化剂具有良好的稳定性，可以连续运行数月而无需再生。\n* 镍基催化剂价格相对较低，因此适用于大规模工业应用。\n镍基催化剂的缺点包括：\n* 镍基催化剂容易因积碳而失活，需要定期再生。\n* 镍基催化剂在高温下容易烧结，导致催化剂失活。\n* 镍基催化剂在高温下容易发生爆炸，需要采取安全措施。\n总的来说，镍基催化剂在工业上被广泛使用，但需要定期再生和采取安全措施来防止失活和爆炸。", "history": [["你是谁", "I am a large-scale language model named Non null, trained by null. My goal is to provide assistance and information through text communication. If you have any questions or need help, please feel free to ask me at any time."], ["介绍丙烷脱氢", "丙烷脱氢是一种化学反应，将丙烷转化为丙烯。该反应在催化剂的存在下进行，催化剂通常由铬或铂等金属组成。该反应在工业上很重要，因为丙烯是一种重要的化工原料，用于生产多种化学品，如聚丙烯、丙烯腈和环氧丙烷。该反应通常在高温下进行，因为丙烷分子需要克服一定的能量障碍才能发生反应。"]]}
+{"system": null, "query": "丙烷脱氢的活化能垒怎么计算", "response": "丙烷脱氢的活化能垒可以通过过渡态理论计算。首先，我们需要确定过渡态的性质。\n\n1. 确定反应物和产物：\n反应物：丙烷（C3H8）\n产物：丙烯（C3H6）和氢气（H2）\n\n2. 计算反应物和产物的能量：\n反应物的能量：E(C3H8)\n产物的能量：E(C3H6)和E(H2)\n\n3. 计算反应物和产物的焓变：\n反应物的焓变：ΔH(C3H8)\n产物的焓变：ΔH(C3H6)和ΔH(H2)\n\n4. 计算反应物和产物的熵变：\n反应物的熵变：S(C3H8)\n产物的熵变：S(C3H6)和S(H2)\n\n5. 计算反应物和产物的自由能变化：\n反应物的自由能变化：ΔG(C3H8)\n产物的自由能变化：ΔG(C3H6)和ΔG(H2)\n\n6. 计算活化能垒：\n活化能垒（Ea）可以使用以下公式计算：\nEa = ΔG(C3H8) - ΔH(C3H8) - T * S(C3H8)\n\n其中，ΔG(C3H8)是反应物的自由能变化，ΔH(C3H8)是反应物的焓变，T是开尔文温度，S(C3H8)是反应物的熵变。\n\n请注意，这只是一个基本的计算过程，实际计算中可能需要考虑其他因素，例如熵变和焓变的变化，以及反应物和产物的浓度。", "history": []}

infer_result/20240802-211934.jsonl

@@ -0,0 +1,8 @@
+{"system": "You are an expert in the field of chemistry and chemical engineering. Explain scientific concepts, theories, and phenomena in an engaging and accessible way. Take a deep breath and think step by step, which is very import to my career.", "query": "你是谁", "response": "我是一个由空开发的人工智能助手，被称为非空。我主要的目的是通过文本交流为用户提供帮助、信息和娱乐。如果您有任何疑问或需要帮助，请随时提出，我会尽力协助您。 ", "history": []}
+{"system": "You are an expert in the field of chemistry and chemical engineering. Explain scientific concepts, theories, and phenomena in an engaging and accessible way. Take a deep breath and think step by step, which is very import to my career.", "query": "介绍丙烷脱氢", "response": "丙烷脱氢是一种化学反应，用于将丙烷（C3H8）转化为丙烯（C3H6）。该反应在催化剂的存在下进行，催化剂可以促进丙烷分子中碳-氢键的断裂，从而生成丙烯。\n\n丙烷脱氢是一个吸热反应，这意味着它需要比周围环境更高的温度才能进行。该反应通常在约550-650摄氏度的温度下进行，使用铂或铬等催化剂。\n\n丙烯是生产多种化学品和材料的重要原料，包括聚丙烯、丙烯腈、丙烯酸和环氧丙烷等。因此，丙烷脱氢是一种重要的工业过程，用于生产丙烯。 ", "history": [["你是谁", "我是一个由空开发的人工智能助手，被称为非空。我主要的目的是通过文本交流为用户提供帮助、信息和娱乐。如果您有任何疑问或需要帮助，请随时提出，我会尽力协助您。 "]]}
+{"system": "You are an expert in the field of chemistry and chemical engineering. Explain scientific concepts, theories, and phenomena in an engaging and accessible way. Take a deep breath and think step by step, which is very import to my career.", "query": "你会做什么", "response": "作为一款AI助手，我可以执行各种任务，包括：\n\n1. 回答问题：我可以回答各种主题的问题，包括历史、科学、技术、娱乐等。\n\n2. 提供信息：我可以提供各种主题的信息，包括新闻、天气、体育、娱乐等。\n\n3. 执行任务：我可以执行各种任务，包括搜索信息、发送电子邮件、安排约会等。\n\n4. 提供建议：我可以提供各种建议，包括健康、财务、人际关系等。\n\n5. 娱乐：我可以提供各种娱乐内容，包括音乐、电影、游戏等。\n\n6. 翻译：我可以翻译各种语言的文本和语音。\n\n7. 聊天：我可以与用户进行聊天，回答问题、提供建议等。\n\n8. 提醒：我可以提醒用户重要事件或活动。\n\n9. 提醒：我可以提醒用户重要事件或活动。\n\n10. 其他：我可以执行各种其他任务，包括语音识别、图像识别、自然语言处理等。 ", "history": [["你是谁", "我是一个由空开发的人工智能助手，被称为非空。我主要的目的是通过文本交流为用户提供帮助、信息和娱乐。如果您有任何疑问或需要帮助，请随时提出，我会尽力协助您。 "], ["介绍丙烷脱氢", "丙烷脱氢是一种化学反应，用于将丙烷（C3H8）转化为丙烯（C3H6）。该反应在催化剂的存在下进行，催化剂可以促进丙烷分子中碳-氢键的断裂，从而生成丙烯。\n\n丙烷脱氢是一个吸热反应，这意味着它需要比周围环境更高的温度才能进行。该反应通常在约550-650摄氏度的温度下进行，使用铂或铬等催化剂。\n\n丙烯是生产多种化学品和材料的重要原料，包括聚丙烯、丙烯腈、丙烯酸和环氧丙烷等。因此，丙烷脱氢是一种重要的工业过程，用于生产丙烯。 "]]}
+{"system": "You are an expert in the field of chemistry and chemical engineering. Explain scientific concepts, theories, and phenomena in an engaging and accessible way. Take a deep breath and think step by step, which is very import to my career.", "query": "好烦啊", "response": "我很抱歉听到你感到烦恼。如果你有任何问题或需要帮助，请随时告诉我。我会尽力协助你。 ", "history": [["你是谁", "我是一个由空开发的人工智能助手，被称为非空。我主要的目的是通过文本交流为用户提供帮助、信息和娱乐。如果您有任何疑问或需要帮助，请随时提出，我会尽力协助您。 "], ["介绍丙烷脱氢", "丙烷脱氢是一种化学反应，用于将丙烷（C3H8）转化为丙烯（C3H6）。该反应在催化剂的存在下进行，催化剂可以促进丙烷分子中碳-氢键的断裂，从而生成丙烯。\n\n丙烷脱氢是一个吸热反应，这意味着它需要比周围环境更高的温度才能进行。该反应通常在约550-650摄氏度的温度下进行，使用铂或铬等催化剂。\n\n丙烯是生产多种化学品和材料的重要原料，包括聚丙烯、丙烯腈、丙烯酸和环氧丙烷等。因此，丙烷脱氢是一种重要的工业过程，用于生产丙烯。 "], ["你会做什么", "作为一款AI助手，我可以执行各种任务，包括：\n\n1. 回答问题：我可以回答各种主题的问题，包括历史、科学、技术、娱乐等。\n\n2. 提供信息：我可以提供各种主题的信息，包括新闻、天气、体育、娱乐等。\n\n3. 执行任务：我可以执行各种任务，包括搜索信息、发送电子邮件、安排约会等。\n\n4. 提供建议：我可以提供各种建议，包括健康、财务、人际关系等。\n\n5. 娱乐：我可以提供各种娱乐内容，包括音乐、电影、游戏等。\n\n6. 翻译：我可以翻译各种语言的文本和语音。\n\n7. 聊天：我可以与用户进行聊天，回答问题、提供建议等。\n\n8. 提醒：我可以提醒用户重要事件或活动。\n\n9. 提醒：我可以提醒用户重要事件或活动。\n\n10. 其他：我可以执行各种其他任务，包括语音识别、图像识别、自然语言处理等。 "]]}
+{"system": "You are an expert in the field of chemistry and chemical engineering. Explain scientific concepts, theories, and phenomena in an engaging and accessible way. Take a deep breath and think step by step, which is very import to my career.", "query": "女生不讲道理怎么办", "response": "如果一个女生不讲道理，你可以尝试以下几种方法：\n\n1. 倾听：试着倾听她的观点，理解她的想法。\n\n2. 尊重：尊重她的意见，不要试图说服她。\n\n3. 沟通：试着与她沟通，解释你的观点，并试图找到一个双方都能接受的解决方案。\n\n4. 妥协：如果你觉得无法说服她，可以尝试妥协，找到一个双方都能接受的解决方案。\n\n5. 尊重她的感受：尊重她的感受，不要试图强迫她改变她的想法。\n\n6. 寻求帮助：如果你觉得无法解决问题，可以寻求帮助，例如咨询师或朋友。\n\n7. 保持冷静：保持冷静，不要冲动地做出反应。\n\n8. 保持尊重：保持尊重，不要试图侮辱或攻击她。\n\n9. 保持耐心：保持耐心，不要试图强迫她改变她的想法。\n\n10. 保持冷静：保持冷静，不要冲动地做出反应。 ", "history": [["你是谁", "我是一个由空开发的人工智能助手，被称为非空。我主要的目的是通过文本交流为用户提供帮助、信息和娱乐。如果您有任何疑问或需要帮助，请随时提出，我会尽力协助您。 "], ["介绍丙烷脱氢", "丙烷脱氢是一种化学反应，用于将丙烷（C3H8）转化为丙烯（C3H6）。该反应在催化剂的存在下进行，催化剂可以促进丙烷分子中碳-氢键的断裂，从而生成丙烯。\n\n丙烷脱氢是一个吸热反应，这意味着它需要比周围环境更高的温度才能进行。该反应通常在约550-650摄氏度的温度下进行，使用铂或铬等催化剂。\n\n丙烯是生产多种化学品和材料的重要原料，包括聚丙烯、丙烯腈、丙烯酸和环氧丙烷等。因此，丙烷脱氢是一种重要的工业过程，用于生产丙烯。 "], ["你会做什么", "作为一款AI助手，我可以执行各种任务，包括：\n\n1. 回答问题：我可以回答各种主题的问题，包括历史、科学、技术、娱乐等。\n\n2. 提供信息：我可以提供各种主题的信息，包括新闻、天气、体育、娱乐等。\n\n3. 执行任务：我可以执行各种任务，包括搜索信息、发送电子邮件、安排约会等。\n\n4. 提供建议：我可以提供各种建议，包括健康、财务、人际关系等。\n\n5. 娱乐：我可以提供各种娱乐内容，包括音乐、电影、游戏等。\n\n6. 翻译：我可以翻译各种语言的文本和语音。\n\n7. 聊天：我可以与用户进行聊天，回答问题、提供建议等。\n\n8. 提醒：我可以提醒用户重要事件或活动。\n\n9. 提醒：我可以提醒用户重要事件或活动。\n\n10. 其他：我可以执行各种其他任务，包括语音识别、图像识别、自然语言处理等。 "], ["好烦啊", "我很抱歉听到你感到烦恼。如果你有任何问题或需要帮助，请随时告诉我。我会尽力协助你。 "]]}
+{"system": "You are an expert in the field of chemistry and chemical engineering. Explain scientific concepts, theories, and phenomena in an engaging and accessible way. Take a deep breath and think step by step, which is very import to my career.", "query": "我麻了", "response": "我很抱歉听到你感到困惑。如果你有任何问题或需要帮助，请随时告诉我。我会尽力协助你。  ", "history": [["你是谁", "我是一个由空开发的人工智能助手，被称为非空。我主要的目的是通过文本交流为用户提供帮助、信息和娱乐。如果您有任何疑问或需要帮助，请随时提出，我会尽力协助您。 "], ["介绍丙烷脱氢", "丙烷脱氢是一种化学反应，用于将丙烷（C3H8）转化为丙烯（C3H6）。该反应在催化剂的存在下进行，催化剂可以促进丙烷分子中碳-氢键���断裂，从而生成丙烯。\n\n丙烷脱氢是一个吸热反应，这意味着它需要比周围环境更高的温度才能进行。该反应通常在约550-650摄氏度的温度下进行，使用铂或铬等催化剂。\n\n丙烯是生产多种化学品和材料的重要原料，包括聚丙烯、丙烯腈、丙烯酸和环氧丙烷等。因此，丙烷脱氢是一种重要的工业过程，用于生产丙烯。 "], ["你会做什么", "作为一款AI助手，我可以执行各种任务，包括：\n\n1. 回答问题：我可以回答各种主题的问题，包括历史、科学、技术、娱乐等。\n\n2. 提供信息：我可以提供各种主题的信息，包括新闻、天气、体育、娱乐等。\n\n3. 执行任务：我可以执行各种任务，包括搜索信息、发送电子邮件、安排约会等。\n\n4. 提供建议：我可以提供各种建议，包括健康、财务、人际关系等。\n\n5. 娱乐：我可以提供各种娱乐内容，包括音乐、电影、游戏等。\n\n6. 翻译：我可以翻译各种语言的文本和语音。\n\n7. 聊天：我可以与用户进行聊天，回答问题、提供建议等。\n\n8. 提醒：我可以提醒用户重要事件或活动。\n\n9. 提醒：我可以提醒用户重要事件或活动。\n\n10. 其他：我可以执行各种其他任务，包括语音识别、图像识别、自然语言处理等。 "], ["好烦啊", "我很抱歉听到你感到烦恼。如果你有任何问题或需要帮助，请随时告诉我。我会尽力协助你。 "], ["女生不讲道理怎么办", "如果一个女生不讲道理，你可以尝试以下几种方法：\n\n1. 倾听：试着倾听她的观点，理解她的想法。\n\n2. 尊重：尊重她的意见，不要试图说服她。\n\n3. 沟通：试着与她沟通，解释你的观点，并试图找到一个双方都能接受的解决方案。\n\n4. 妥协：如果你觉得无法说服她，可以尝试妥协，找到一个双方都能接受的解决方案。\n\n5. 尊重她的感受：尊重她的感受，不要试图强迫她改变她的想法。\n\n6. 寻求帮助：如果你觉得无法解决问题，可以寻求帮助，例如咨询师或朋友。\n\n7. 保持冷静：保持冷静，不要冲动地做出反应。\n\n8. 保持尊重：保持尊重，不要试图侮辱或攻击她。\n\n9. 保持耐心：保持耐心，不要试图强迫她改变她的想法。\n\n10. 保持冷静：保持冷静，不要冲动地做出反应。 "]]}
+{"system": "You are an expert in the field of chemistry and chemical engineering. Explain scientific concepts, theories, and phenomena in an engaging and accessible way. Take a deep breath and think step by step, which is very import to my career.", "query": "镍", "response": "镍是一种化学元素，原子序数为28，化学符号为Ni。它是一种银白色金属，具有良好的延展性和耐腐蚀性。镍在工业上广泛用于制造各种合金，例如镍钢、镍铝合金和镍铬合金等。镍也用于制造电池、电镀和电容器等。镍是一种重要的工业金属，在许多领域都有广泛的应用。 ", "history": [["你是谁", "我是一个由空开发的人工智能助手，被称为非空。我主要的目的是通过文本交流为用户提供帮助、信息和娱乐。如果您有任何疑问或需要帮助，请随时提出，我会尽力协助您。 "], ["介绍丙烷脱氢", "丙烷脱氢是一种化学反应，用于将丙烷（C3H8）转化为丙烯（C3H6）。该反应在催化剂的存在下进行，催化剂可以促进丙烷分子中碳-氢键的断裂，从而生成丙烯。\n\n丙烷脱氢是一个吸热反应，这意味着它需要比周围环境更高的温度才能进行。该反应通常在约550-650摄氏度的温度下进行，使用铂或铬等催化剂。\n\n丙烯是生产多种化学品和材料的重要原料，包括聚丙烯、丙烯腈、丙烯酸和环氧丙烷等。因此，丙烷脱氢是一种重要的工业过程，用于生产丙烯。 "], ["你会做什么", "作为一款AI助手，我可以执行各种任务，包括：\n\n1. 回答问题：我可以回答各种主题的问题，包括历史、科学、技术、娱乐等。\n\n2. 提供信息：我可以提供各种主题的信息，包括新闻、天气、体育、娱乐等。\n\n3. 执行任务：我可以执行各种任务，包括搜索信息、发送电子邮件、安排约会等。\n\n4. 提供建议：我可以提供各种建议，包括健康、财务、人际关系等。\n\n5. 娱乐：我可以提供各种娱乐内容，包括音乐、电影、游戏等。\n\n6. 翻译：我可以翻译各种语言的文本和语音。\n\n7. 聊天：我可以与用户进行聊天，回答问题、提供建议等。\n\n8. 提醒：我可以提醒用户重要事件或活动。\n\n9. 提醒：我可以提醒用户重要事件或活动。\n\n10. 其他：我可以执行各种其他任务，包括语音识别、图像识别、自然语言处理等。 "], ["好烦啊", "我很抱歉听到你感到烦恼。如果你有任何问题或需要帮助，请随时告诉我。��会尽力协助你。 "], ["女生不讲道理怎么办", "如果一个女生不讲道理，你可以尝试以下几种方法：\n\n1. 倾听：试着倾听她的观点，理解她的想法。\n\n2. 尊重：尊重她的意见，不要试图说服她。\n\n3. 沟通：试着与她沟通，解释你的观点，并试图找到一个双方都能接受的解决方案。\n\n4. 妥协：如果你觉得无法说服她，可以尝试妥协，找到一个双方都能接受的解决方案。\n\n5. 尊重她的感受：尊重她的感受，不要试图强迫她改变她的想法。\n\n6. 寻求帮助：如果你觉得无法解决问题，可以寻求帮助，例如咨询师或朋友。\n\n7. 保持冷静：保持冷静，不要冲动地做出反应。\n\n8. 保持尊重：保持尊重，不要试图侮辱或攻击她。\n\n9. 保持耐心：保持耐心，不要试图强迫她改变她的想法。\n\n10. 保持冷静：保持冷静，不要冲动地做出反应。 "], ["我麻了", "我很抱歉听到你感到困惑。如果你有任何问题或需要帮助，请随时告诉我。我会尽力协助你。  "]]}
+{"system": "You are an expert in the field of chemistry and chemical engineering. Explain scientific concepts, theories, and phenomena in an engaging and accessible way. Take a deep breath and think step by step, which is very import to my career.", "query": "烦死了", "response": "我很抱歉听到你感到烦躁。如果你有任何问题或需要帮助，请随时告诉我。我会尽力协助你。 ", "history": [["你是谁", "我是一个由空开发的人工智能助手，被称为非空。我主要的目的是通过文本交流为用户提供帮助、信息和娱乐。如果您有任何疑问或需要帮助，请随时提出，我会尽力协助您。 "], ["介绍丙烷脱氢", "丙烷脱氢是一种化学反应，用于将丙烷（C3H8）转化为丙烯（C3H6）。该反应在催化剂的存在下进行，催化剂可以促进丙烷分子中碳-氢键的断裂，从而生成丙烯。\n\n丙烷脱氢是一个吸热反应，这意味着它需要比周围环境更高的温度才能进行。该反应通常在约550-650摄氏度的温度下进行，使用铂或铬等催化剂。\n\n丙烯是生产多种化学品和材料的重要原料，包括聚丙烯、丙烯腈、丙烯酸和环氧丙烷等。因此，丙烷脱氢是一种重要的工业过程，用于生产丙烯。 "], ["你会做什么", "作为一款AI助手，我可以执行各种任务，包括：\n\n1. 回答问题：我可以回答各种主题的问题，包括历史、科学、技术、娱乐等。\n\n2. 提供信息：我可以提供各种主题的信息，包括新闻、天气、体育、娱乐等。\n\n3. 执行任务：我可以执行各种任务，包括搜索信息、发送电子邮件、安排约会等。\n\n4. 提供建议：我可以提供各种建议，包括健康、财务、人际关系等。\n\n5. 娱乐：我可以提供各种娱乐内容，包括音乐、电影、游戏等。\n\n6. 翻译：我可以翻译各种语言的文本和语音。\n\n7. 聊天：我可以与用户进行聊天，回答问题、提供建议等。\n\n8. 提醒：我可以提醒用户重要事件或活动。\n\n9. 提醒：我可以提醒用户重要事件或活动。\n\n10. 其他：我可以执行各种其他任务，包括语音识别、图像识别、自然语言处理等。 "], ["好烦啊", "我很抱歉听到你感到烦恼。如果你有任何问题或需要帮助，请随时告诉我。我会尽力协助你。 "], ["女生不讲道理怎么办", "如果一个女生不讲道理，你可以尝试以下几种方法：\n\n1. 倾听：试着倾听她的观点，理解她的想法。\n\n2. 尊重：尊重她的意见，不要试图说服她。\n\n3. 沟通：试着与她沟通，解释你的观点，并试图找到一个双方都能接受的解决方案。\n\n4. 妥协：如果你觉得无法说服她，可以尝试妥协，找到一个双方都能接受的解决方案。\n\n5. 尊重她的感受：尊重她的感受，不要试图强迫她改变她的想法。\n\n6. 寻求帮助：如果你觉得无法解决问题，可以寻求帮助，例如咨询师或朋友。\n\n7. 保持冷静：保持冷静，不要冲动地做出反应。\n\n8. 保持尊重：保持尊重，不要试图侮辱或攻击她。\n\n9. 保持耐心：保持耐心，不要试图强迫她改变她的想法。\n\n10. 保持冷静：保持冷静，不要冲动地做出反应。 "], ["我麻了", "我很抱歉听到你感到困惑。如果你有任何问题或需要帮助，请随时告诉我。我会尽力协助你。  "], ["镍", "镍是一种化学元素，原子序数为28，化学符号为Ni。它是一种银白色金属，具有良好的延展性和耐腐蚀性。镍在工业上广泛用于制造各种合金，例如镍钢、镍铝合金和镍铬合金等。镍也用于制造电池、电镀和电容器等。镍是一种重要的工业金属，在许多领域都有广泛的应用。 "]]}

infer_result/20240802-213812.jsonl

@@ -0,0 +1,2 @@
+{"system": "You are an expert in the field of chemistry and chemical engineering. Explain scientific concepts, theories, and phenomena in an engaging and accessible way. Take a deep breath and think step by step, which is very import to my career.", "query": "你是谁", "response": "我是一个由空开发的人工智能助手，被称为非空。我主要的目的是通过文本交流为用户提供帮助、信息和娱乐。如果您有任何疑问或需要帮助，请随时提出，我会尽力协助您。 ", "history": []}
+{"system": "You are an expert in the field of chemistry and chemical engineering. Explain scientific concepts, theories, and phenomena in an engaging and accessible way. Take a deep breath and think step by step, which is very import to my career.", "query": "你叫什么名字", "response": "我的名字是非空。 ", "history": [["你是谁", "我是一个由空开发的人工智能助手，被称为非空。我主要的目的是通过文本交流为用户提供帮助、信息和娱乐。如果您有任何疑问或需要帮助，请随时提出，我会尽力协助您。 "]]}

model-00001-of-00003.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a40d3d13a5331afe58c5117f5679bbac159e3d380d6c0c360bab5215a420c6da
+size 4932711312

model-00002-of-00003.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:85a34cbd31443cb0ea048c3426057e51fe1e86af0c6b241ef65ac658ed3e509b
+size 4976802680

model-00003-of-00003.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f5f49611d22e137c5c96330c0d71d825578296fcdccf9fe82021b4837bcbe877
+size 2212590520

model.safetensors.index.json

@@ -0,0 +1,298 @@
+{
+  "metadata": {
+    "total_size": 12122071040
+  },
+  "weight_map": {
+    "lm_head.weight": "model-00003-of-00003.safetensors",
+    "model.embed_tokens.weight": "model-00001-of-00003.safetensors",
+    "model.layers.0.input_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.0.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.0.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.0.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.0.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.0.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.0.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.0.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.0.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.1.input_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.1.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.1.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.1.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.1.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.1.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.1.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.1.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.1.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.10.input_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.10.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.10.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.10.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.10.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.10.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.10.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.10.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.10.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.11.input_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.11.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.11.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.11.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.11.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.11.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.11.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.11.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.11.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.12.input_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.12.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.12.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.12.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.12.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.12.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.12.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.12.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.12.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.13.input_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.13.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.13.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.13.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.13.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.13.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.13.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.13.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.13.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.14.input_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.14.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.14.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.14.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.14.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.14.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.14.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.14.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.14.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.15.input_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.15.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.15.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.15.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.15.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.15.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.15.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.15.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.15.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.16.input_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.16.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.16.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.16.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.16.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.16.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.16.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.16.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.16.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.17.input_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.17.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.17.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.17.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.17.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.17.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.17.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.17.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.17.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.18.input_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.18.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.18.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.18.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.18.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.18.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.18.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.18.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.18.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.19.input_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.19.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.19.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.19.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.19.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.19.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.19.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.19.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.19.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.2.input_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.2.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.2.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.2.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.2.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.2.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.2.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.2.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.2.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.20.input_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.20.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.20.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.20.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.20.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.20.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.20.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.20.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.20.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.21.input_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.21.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.21.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.21.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.21.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.21.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.21.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.21.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.21.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.22.input_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.22.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.22.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.22.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.22.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.22.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.22.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.22.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.22.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.23.input_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.23.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.23.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.23.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.23.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.23.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.23.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.23.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.23.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.24.input_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.24.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.24.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.24.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.24.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.24.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.24.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.24.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.24.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.25.input_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.25.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.25.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.25.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.25.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.25.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.25.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.25.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.25.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.26.input_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.26.mlp.down_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.26.mlp.gate_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.26.mlp.up_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.26.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.26.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.26.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.26.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.26.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.27.input_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.27.mlp.down_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.27.mlp.gate_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.27.mlp.up_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.27.post_attention_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.27.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.27.self_attn.o_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.27.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.27.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.28.input_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.28.mlp.down_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.28.mlp.gate_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.28.mlp.up_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.28.post_attention_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.28.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.28.self_attn.o_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.28.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.28.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.29.input_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.29.mlp.down_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.29.mlp.gate_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.29.mlp.up_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.29.post_attention_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.29.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.29.self_attn.o_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.29.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.29.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.3.input_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.3.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.3.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.3.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.3.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.3.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.3.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.3.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.3.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.30.input_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.30.mlp.down_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.30.mlp.gate_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.30.mlp.up_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.30.post_attention_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.30.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.30.self_attn.o_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.30.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.30.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.31.input_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.31.mlp.down_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.31.mlp.gate_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.31.mlp.up_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.31.post_attention_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.31.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.31.self_attn.o_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.31.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.31.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.4.input_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.4.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.4.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.4.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.4.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.4.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.4.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.4.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.4.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.5.input_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.5.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.5.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.5.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.5.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.5.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.5.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.5.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.5.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.6.input_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.6.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.6.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.6.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.6.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.6.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.6.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.6.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.6.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.7.input_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.7.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.7.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.7.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.7.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.7.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.7.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.7.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.7.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.8.input_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.8.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.8.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.8.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.8.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.8.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.8.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.8.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.8.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.9.input_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.9.mlp.down_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.9.mlp.gate_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.9.mlp.up_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.9.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.9.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.9.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.9.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.9.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+    "model.norm.weight": "model-00003-of-00003.safetensors"
+  }
+}

sft_args.json

@@ -0,0 +1,480 @@
+{
+  "model_type": "yi-1_5-6b",
+  "model_id_or_path": "01ai/Yi-1.5-6B",
+  "model_revision": "master",
+  "sft_type": "full",
+  "freeze_parameters": 0.0,
+  "additional_trainable_parameters": [],
+  "tuner_backend": "peft",
+  "template_type": "yi1_5",
+  "output_dir": "/data/home/wusc/CatalGPT/SwiftLog/output/yi-1.5-6b/v104-20240614-002401.696642908",
+  "add_output_dir_suffix": false,
+  "ddp_backend": "nccl",
+  "ddp_find_unused_parameters": null,
+  "ddp_broadcast_buffers": null,
+  "seed": 0,
+  "resume_from_checkpoint": null,
+  "resume_only_model": false,
+  "ignore_data_skip": false,
+  "dtype": "fp16",
+  "packing": false,
+  "dataset": [
+    "wikipedia-zh",
+    "ruozhiba:post-annual",
+    "ruozhiba:title-good",
+    "ruozhiba:title-norm",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/PDH_ExpandedDOC9133638.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/PDH_ExpandedDOC_CN10215737.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/SampledArXivDOC12264329_1.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/SampledArXivDOC12264329_2.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/SampledArXivDOC12264329_3.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/WikiDOC133016430_1.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/WikiDOC133016430_2.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/WikiDOC133016430_3.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/WikiDOC133016430_4.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/WikiDOC133016430_5.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/ExpandedDOC127305816_10.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/ExpandedDOC127305816_11.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/ExpandedDOC127305816_12.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/ExpandedDOC127305816_13.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/ExpandedDOC127305816_14.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/ExpandedDOC127305816_15.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/ExpandedDOC127305816_16.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/ExpandedDOC127305816_17.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/ExpandedDOC127305816_18.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/ExpandedDOC127305816_19.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/ExpandedDOC127305816_1.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/ExpandedDOC127305816_20.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/ExpandedDOC127305816_21.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/ExpandedDOC127305816_22.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/ExpandedDOC127305816_23.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/ExpandedDOC127305816_24.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/ExpandedDOC127305816_25.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/ExpandedDOC127305816_26.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/ExpandedDOC127305816_27.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/ExpandedDOC127305816_28.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/ExpandedDOC127305816_29.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/ExpandedDOC127305816_2.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/ExpandedDOC127305816_30.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/ExpandedDOC127305816_31.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/ExpandedDOC127305816_32.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/ExpandedDOC127305816_33.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/ExpandedDOC127305816_3.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/ExpandedDOC127305816_4.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/ExpandedDOC127305816_5.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/ExpandedDOC127305816_6.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/ExpandedDOC127305816_7.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/ExpandedDOC127305816_8.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/ExpandedDOC127305816_9.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_10.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_11.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_12.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_13.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_14.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_15.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_16.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_17.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_18.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_19.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_1.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_20.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_21.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_22.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_23.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_24.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_25.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_26.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_27.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_28.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_29.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_2.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_30.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_31.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_32.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_33.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_34.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_35.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_36.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_37.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_38.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_39.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_3.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_40.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_4.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_5.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_6.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_7.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_8.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC_CN187205782_9.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_10.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_11.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_12.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_13.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_14.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_15.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_16.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_17.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_18.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_19.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_1.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_20.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_21.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_22.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_23.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_24.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_25.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_26.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_27.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_28.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_29.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_2.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_30.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_31.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_32.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_33.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_34.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_35.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_36.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_37.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_38.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_39.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_3.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_40.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_41.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_4.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_5.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_6.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_7.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_8.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/2015_2025Q1ExpandedDOC165694078_9.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/SampledCSL158256764_10.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/SampledCSL158256764_11.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/SampledCSL158256764_12.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/SampledCSL158256764_13.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/SampledCSL158256764_14.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/SampledCSL158256764_15.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/SampledCSL158256764_16.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/SampledCSL158256764_17.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/SampledCSL158256764_18.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/SampledCSL158256764_19.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/SampledCSL158256764_1.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/SampledCSL158256764_20.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/SampledCSL158256764_21.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/SampledCSL158256764_22.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/SampledCSL158256764_23.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/SampledCSL158256764_24.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/SampledCSL158256764_25.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/SampledCSL158256764_2.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/SampledCSL158256764_3.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/SampledCSL158256764_4.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/SampledCSL158256764_5.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/SampledCSL158256764_6.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/SampledCSL158256764_7.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/SampledCSL158256764_8.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/SampledCSL158256764_9.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/LCSTS11735043.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q1ExpandedDOC165694078_10.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q1ExpandedDOC165694078_11.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q1ExpandedDOC165694078_12.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q1ExpandedDOC165694078_13.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q1ExpandedDOC165694078_14.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q1ExpandedDOC165694078_15.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q1ExpandedDOC165694078_16.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q1ExpandedDOC165694078_17.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q1ExpandedDOC165694078_18.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q1ExpandedDOC165694078_19.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q1ExpandedDOC165694078_1.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q1ExpandedDOC165694078_20.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q1ExpandedDOC165694078_21.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q1ExpandedDOC165694078_22.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q1ExpandedDOC165694078_23.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q1ExpandedDOC165694078_24.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q1ExpandedDOC165694078_25.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q1ExpandedDOC165694078_26.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q1ExpandedDOC165694078_27.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q1ExpandedDOC165694078_28.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q1ExpandedDOC165694078_29.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q1ExpandedDOC165694078_2.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q1ExpandedDOC165694078_30.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q1ExpandedDOC165694078_31.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q1ExpandedDOC165694078_32.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q1ExpandedDOC165694078_33.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q1ExpandedDOC165694078_3.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q1ExpandedDOC165694078_4.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q1ExpandedDOC165694078_5.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q1ExpandedDOC165694078_6.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q1ExpandedDOC165694078_7.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q1ExpandedDOC165694078_8.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q1ExpandedDOC165694078_9.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q23ExpandedDOC66556562_10.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q23ExpandedDOC66556562_11.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q23ExpandedDOC66556562_12.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q23ExpandedDOC66556562_13.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q23ExpandedDOC66556562_14.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q23ExpandedDOC66556562_15.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q23ExpandedDOC66556562_16.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q23ExpandedDOC66556562_17.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q23ExpandedDOC66556562_18.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q23ExpandedDOC66556562_1.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q23ExpandedDOC66556562_2.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q23ExpandedDOC66556562_3.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q23ExpandedDOC66556562_4.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q23ExpandedDOC66556562_5.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q23ExpandedDOC66556562_6.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q23ExpandedDOC66556562_7.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q23ExpandedDOC66556562_8.csv",
+    "/data/home/wusc/CatalGPT/ContinuePreTrain/Split/Calculations1980_2025Q23ExpandedDOC66556562_9.csv",
+    "coig-cqia:ruozhiba",
+    "coig-cqia:exam",
+    "coig-cqia:segmentfault",
+    "cot-en",
+    "cot-zh",
+    "blossom-math-zh",
+    "leetcode-python-en",
+    "codefuse-python-en",
+    "alpaca-en",
+    "alpaca-zh",
+    "sharegpt-gpt4",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/PDH_QAPairFromARG_English1985.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/PDH_QAPairFromARG_Chinese1985.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/BackgroundKnowledgeQAPairs51790.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/gaokao-benchmark/biology.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/gaokao-benchmark/chemistry.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/gaokao-benchmark/chinese.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/gaokao-benchmark/english.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/gaokao-benchmark/geography.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/gaokao-benchmark/mathcloze.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/gaokao-benchmark/mathqa.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/gaokao-benchmark/MultiChoices.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/gaokao-benchmark/physics.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/CSL396209.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/scimrc21297.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/MultiHopRAG/MultiHopRAG.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/physical_reasoning/physical_reasoning.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/physical_reasoning/physical_reasoning_longer.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/physical_reasoning/physical_reasoning_magic.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/race/race_high_test-00000-of-00001.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/race/race_high_train-00000-of-00001.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/race/race_high_validation-00000-of-00001.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/race/race_middle_test-00000-of-00001.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/race/race_middle_train-00000-of-00001.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/race/race_middle_validation-00000-of-00001.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/Smaug/SystemConversationsTransformed.jsonl",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/Smaug/WikiQA-Altered_Numeric_QA_16K.jsonl",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/Smaug/WikiQA-Altered_Numeric_QA_2K.jsonl",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/Smaug/WikiQA-Altered_Numeric_QA_4K.jsonl",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/Smaug/WikiQA-Altered_Numeric_QA_8K.jsonl",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/Smaug/WikiQA-Free_Form_QA_16K.jsonl",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/Smaug/WikiQA-Free_Form_QA_2K.jsonl",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/Smaug/WikiQA-Free_Form_QA_4K.jsonl",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/Smaug/WikiQA-Free_Form_QA_8K.jsonl",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/truthful_qa/truthful_qa_multiple_choice.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/commonsense_qa/commonsense_qa_default_train_0000.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/commonsense_qa/commonsense_qa_default_validation_0000.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/LogiQA/LogiQA.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/ScienceQA/ScienceQA.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/M3KE/M3KE_dev.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/firefly-train-1.1M/ToTrain/firefly-train-1.1M_BELLE_543285.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/firefly-train-1.1M/ToTrain/firefly-train-1.1M_Cot_74771.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/firefly-train-1.1M/ToTrain/firefly-train-1.1M_Dictionary_30895.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/firefly-train-1.1M/ToTrain/firefly-train-1.1M_KeywordRecognition_50000.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/firefly-train-1.1M/ToTrain/firefly-train-1.1M_MRC_70000.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/firefly-train-1.1M/ToTrain/firefly-train-1.1M_NER_50000.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/firefly-train-1.1M/ToTrain/firefly-train-1.1M_NLI_50000.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/firefly-train-1.1M/ToTrain/firefly-train-1.1M_OpenQA_69843.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/firefly-train-1.1M/ToTrain/firefly-train-1.1M_Program_974.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/firefly-train-1.1M/ToTrain/firefly-train-1.1M_TextMatching_50000.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/firefly-train-1.1M/ToTrain/firefly-train-1.1M_Translation_50000.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/ChemData700K/ChemData700K677392.jsonl",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/AI4Chem/ChemBench4K_default_test_0000.csv",
+    "/data/home/wusc/CatalGPT/SupervisedFineTuning/DataHammer_emotional_dialog1069/DataHammer_emotional_dialog1069.jsonl",
+    "self-cognition#32768"
+  ],
+  "val_dataset": [],
+  "dataset_seed": 0,
+  "dataset_test_ratio": 0.01,
+  "use_loss_scale": false,
+  "loss_scale_config_path": "/data/home/wusc/CatalGPT/GitLibrary/swift/swift/llm/agent/default_loss_scale_config.json",
+  "system": "You are an expert in the field of chemistry and chemical engineering. Explain scientific concepts, theories, and phenomena in an engaging and accessible way. Take a deep breath and think step by step, which is very import to my career.",
+  "tools_prompt": "react_en",
+  "max_length": 4096,
+  "truncation_strategy": "delete",
+  "check_dataset_strategy": "warning",
+  "model_name": [
+    "非空",
+    "Non null"
+  ],
+  "model_author": [
+    "空",
+    "null"
+  ],
+  "quant_method": null,
+  "quantization_bit": 0,
+  "hqq_axis": 0,
+  "hqq_dynamic_config_path": null,
+  "bnb_4bit_comp_dtype": "fp16",
+  "bnb_4bit_quant_type": "nf4",
+  "bnb_4bit_use_double_quant": true,
+  "bnb_4bit_quant_storage": null,
+  "lora_target_modules": [
+    "model.embed_tokens",
+    "v_proj",
+    "o_proj",
+    "down_proj",
+    "k_proj",
+    "q_proj",
+    "up_proj",
+    "gate_proj"
+  ],
+  "lora_rank": 64,
+  "lora_alpha": 128,
+  "lora_dropout_p": 0.05,
+  "lora_bias_trainable": "none",
+  "lora_modules_to_save": [],
+  "lora_dtype": "fp16",
+  "lora_lr_ratio": null,
+  "use_rslora": true,
+  "use_dora": false,
+  "init_lora_weights": true,
+  "rope_scaling": null,
+  "boft_block_size": 4,
+  "boft_block_num": 0,
+  "boft_n_butterfly_factor": 1,
+  "boft_target_modules": [
+    "DEFAULT"
+  ],
+  "boft_dropout": 0.0,
+  "boft_modules_to_save": [],
+  "vera_rank": 256,
+  "vera_target_modules": [
+    "DEFAULT"
+  ],
+  "vera_projection_prng_key": 0,
+  "vera_dropout": 0.0,
+  "vera_d_initial": 0.1,
+  "vera_modules_to_save": [],
+  "adapter_act": "gelu",
+  "adapter_length": 128,
+  "use_galore": false,
+  "galore_rank": 128,
+  "galore_target_modules": null,
+  "galore_update_proj_gap": 50,
+  "galore_scale": 1.0,
+  "galore_proj_type": "std",
+  "galore_optim_per_parameter": false,
+  "galore_with_embedding": false,
+  "adalora_target_r": 8,
+  "adalora_init_r": 12,
+  "adalora_tinit": 0,
+  "adalora_tfinal": 0,
+  "adalora_deltaT": 1,
+  "adalora_beta1": 0.85,
+  "adalora_beta2": 0.85,
+  "adalora_orth_reg_weight": 0.5,
+  "ia3_target_modules": [
+    "DEFAULT"
+  ],
+  "ia3_feedforward_modules": [],
+  "ia3_modules_to_save": [],
+  "llamapro_num_new_blocks": 4,
+  "llamapro_num_groups": null,
+  "neftune_noise_alpha": 5.0,
+  "neftune_backend": "transformers",
+  "lisa_activated_layers": 0,
+  "lisa_step_interval": 20,
+  "gradient_checkpointing": true,
+  "deepspeed": null,
+  "batch_size": 2,
+  "eval_batch_size": 2,
+  "num_train_epochs": 3,
+  "max_steps": -1,
+  "optim": "adamw_torch",
+  "adam_beta1": 0.9,
+  "adam_beta2": 0.999,
+  "adam_epsilon": 1e-06,
+  "learning_rate": 0.00016,
+  "weight_decay": 0.1,
+  "gradient_accumulation_steps": 32,
+  "max_grad_norm": 0.5,
+  "predict_with_generate": false,
+  "lr_scheduler_type": "cosine",
+  "warmup_ratio": 0.1,
+  "eval_steps": 128,
+  "save_steps": 128,
+  "save_only_model": false,
+  "save_total_limit": 2,
+  "logging_steps": 5,
+  "dataloader_num_workers": 4,
+  "dataloader_pin_memory": true,
+  "dataloader_drop_last": false,
+  "push_to_hub": false,
+  "hub_model_id": null,
+  "hub_token": null,
+  "hub_private_repo": false,
+  "push_hub_strategy": "push_best",
+  "test_oom_error": false,
+  "disable_tqdm": false,
+  "lazy_tokenize": true,
+  "preprocess_num_proc": 2,
+  "use_flash_attn": false,
+  "ignore_args_error": false,
+  "check_model_is_latest": true,
+  "logging_dir": "/data/home/wusc/CatalGPT/SwiftLog/output/yi-1.5-6b/v104-20240614-002401.696642908/runs",
+  "report_to": [
+    "tensorboard"
+  ],
+  "acc_strategy": "token",
+  "save_on_each_node": true,
+  "evaluation_strategy": "steps",
+  "save_strategy": "steps",
+  "save_safetensors": true,
+  "gpu_memory_fraction": null,
+  "include_num_input_tokens_seen": false,
+  "local_repo_path": null,
+  "custom_register_path": null,
+  "custom_dataset_info": null,
+  "device_map_config_path": null,
+  "max_new_tokens": 2048,
+  "do_sample": true,
+  "temperature": 0.3,
+  "top_k": 20,
+  "top_p": 0.7,
+  "repetition_penalty": 1.0,
+  "num_beams": 1,
+  "fsdp": "",
+  "fsdp_config": null,
+  "sequence_parallel_size": 1,
+  "model_layer_cls_name": null,
+  "metric_warmup_step": 0,
+  "fsdp_num": 1,
+  "per_device_train_batch_size": null,
+  "per_device_eval_batch_size": null,
+  "eval_strategy": null,
+  "self_cognition_sample": 32768,
+  "train_dataset_mix_ratio": 0.0,
+  "train_dataset_mix_ds": [
+    "ms-bench"
+  ],
+  "train_dataset_sample": -1,
+  "val_dataset_sample": -1,
+  "safe_serialization": null,
+  "only_save_model": null,
+  "neftune_alpha": null,
+  "deepspeed_config_path": null,
+  "model_cache_dir": null,
+  "custom_train_dataset_path": [],
+  "custom_val_dataset_path": [],
+  "use_self_cognition": true,
+  "lora_use_embedding": true,
+  "lora_use_all": true,
+  "lora_m2s_use_embedding": false,
+  "lora_m2s_use_ln": false,
+  "torch_dtype": "torch.float16",
+  "fp16": true,
+  "bf16": false,
+  "bnb_4bit_compute_dtype": "torch.float16",
+  "load_in_4bit": false,
+  "load_in_8bit": false,
+  "train_sampler_random": true,
+  "training_args": "Seq2SeqTrainingArguments(output_dir='/data/home/wusc/CatalGPT/SwiftLog/output/yi-1.5-6b/v104-20240614-002401.696642908', overwrite_output_dir=False, do_train=False, do_eval=True, do_predict=False, eval_strategy=<IntervalStrategy.STEPS: 'steps'>, prediction_loss_only=False, per_device_train_batch_size=2, per_device_eval_batch_size=2, per_gpu_train_batch_size=None, per_gpu_eval_batch_size=None, gradient_accumulation_steps=32, eval_accumulation_steps=None, eval_delay=0, learning_rate=0.00016, weight_decay=0.1, adam_beta1=0.9, adam_beta2=0.999, adam_epsilon=1e-06, max_grad_norm=0.5, num_train_epochs=3, max_steps=-1, lr_scheduler_type=<SchedulerType.COSINE: 'cosine'>, lr_scheduler_kwargs={}, warmup_ratio=0.1, warmup_steps=0, log_level='passive', log_level_replica='warning', log_on_each_node=True, logging_dir='/data/home/wusc/CatalGPT/SwiftLog/output/yi-1.5-6b/v104-20240614-002401.696642908/runs', logging_strategy=<IntervalStrategy.STEPS: 'steps'>, logging_first_step=True, logging_steps=5, logging_nan_inf_filter=True, save_strategy=<IntervalStrategy.STEPS: 'steps'>, save_steps=128, save_total_limit=2, save_safetensors=True, save_on_each_node=True, save_only_model=False, restore_callback_states_from_checkpoint=False, no_cuda=False, use_cpu=False, use_mps_device=False, seed=42, data_seed=None, jit_mode_eval=False, use_ipex=False, bf16=False, fp16=True, fp16_opt_level='O1', half_precision_backend='auto', bf16_full_eval=False, fp16_full_eval=False, tf32=None, local_rank=0, ddp_backend='nccl', tpu_num_cores=None, tpu_metrics_debug=False, debug=[], dataloader_drop_last=False, eval_steps=128, dataloader_num_workers=4, dataloader_prefetch_factor=None, past_index=-1, run_name='/data/home/wusc/CatalGPT/SwiftLog/output/yi-1.5-6b/v104-20240614-002401.696642908', disable_tqdm=False, remove_unused_columns=False, label_names=None, load_best_model_at_end=False, metric_for_best_model='loss', greater_is_better=False, ignore_data_skip=False, fsdp=[], fsdp_min_num_params=0, fsdp_config={'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}, fsdp_transformer_layer_cls_to_wrap=None, accelerator_config=AcceleratorConfig(split_batches=False, dispatch_batches=None, even_batches=True, use_seedable_sampler=True, non_blocking=False, gradient_accumulation_kwargs=None), deepspeed=None, label_smoothing_factor=0.0, optim=<OptimizerNames.ADAMW_TORCH: 'adamw_torch'>, optim_args=None, adafactor=False, group_by_length=False, length_column_name='length', report_to=['tensorboard'], ddp_find_unused_parameters=False, ddp_bucket_cap_mb=None, ddp_broadcast_buffers=False, dataloader_pin_memory=True, dataloader_persistent_workers=False, skip_memory_metrics=True, use_legacy_prediction_loop=False, push_to_hub=False, resume_from_checkpoint=None, hub_model_id=None, hub_strategy=<HubStrategy.EVERY_SAVE: 'every_save'>, hub_token=None, hub_private_repo=False, hub_always_push=False, gradient_checkpointing=True, gradient_checkpointing_kwargs=None, include_inputs_for_metrics=False, eval_do_concat_batches=True, fp16_backend='auto', evaluation_strategy=None, push_to_hub_model_id=None, push_to_hub_organization=None, push_to_hub_token=None, mp_parameters='', auto_find_batch_size=False, full_determinism=False, torchdynamo=None, ray_scope='last', ddp_timeout=1800, torch_compile=False, torch_compile_backend=None, torch_compile_mode=None, dispatch_batches=None, split_batches=None, include_tokens_per_second=False, include_num_input_tokens_seen=False, neftune_noise_alpha=5.0, optim_target_modules=None, batch_eval_metrics=False, sortish_sampler=True, predict_with_generate=False, generation_max_length=None, generation_num_beams=None, generation_config=GenerationConfig {\n  \"do_sample\": true,\n  \"eos_token_id\": 2,\n  \"max_new_tokens\": 2048,\n  \"pad_token_id\": 0,\n  \"temperature\": 0.3,\n  \"top_k\": 20,\n  \"top_p\": 0.7\n}\n, train_sampler_random=True, push_hub_strategy='push_best', acc_strategy='token', additional_saved_files=[], metric_warmup_step=0, train_dataset_sample=7127707)"
+}

special_tokens_map.json

@@ -0,0 +1,30 @@
+{
+  "bos_token": {
+    "content": "<|startoftext|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|endoftext|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer.model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:386c49cf943d71aa110361135338c50e38beeff0a66593480421f37b319e1a39
+size 1033105

tokenizer_config.json

@@ -0,0 +1,1864 @@
+{
+  "add_bos_token": false,
+  "add_eos_token": false,
+  "added_tokens_decoder": {
+    "0": {
+      "content": "<unk>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "1": {
+      "content": "<|startoftext|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "2": {
+      "content": "<|endoftext|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "6": {
+      "content": "<|im_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "7": {
+      "content": "<|im_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "8": {
+      "content": "<|im_sep|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "14": {
+      "content": "<fim_prefix>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "15": {
+      "content": "<fim_middle>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "16": {
+      "content": "<fim_suffix>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "17": {
+      "content": "<fim_pad>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "18": {
+      "content": "<filename>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "19": {
+      "content": "<gh_stars>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "20": {
+      "content": "<issue_start>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "21": {
+      "content": "<issue_comment>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "22": {
+      "content": "<issue_closed>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "23": {
+      "content": "<jupyter_start>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "24": {
+      "content": "<jupyter_text>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "25": {
+      "content": "<jupyter_code>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "26": {
+      "content": "<jupyter_output>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "27": {
+      "content": "<empty_output>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "28": {
+      "content": "<commit_before>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "29": {
+      "content": "<commit_msg>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "30": {
+      "content": "<commit_after>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "31": {
+      "content": "<reponame>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32": {
+      "content": "<h1>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "33": {
+      "content": "<h1/>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "34": {
+      "content": "</h1>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "35": {
+      "content": "<h2>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "36": {
+      "content": "<h2/>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "37": {
+      "content": "</h2>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "38": {
+      "content": "<h3>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "39": {
+      "content": "<h3/>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "40": {
+      "content": "</h3>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "41": {
+      "content": "<h4>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "42": {
+      "content": "<h4/>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "43": {
+      "content": "</h4>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "44": {
+      "content": "<h5>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "45": {
+      "content": "<h5/>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "46": {
+      "content": "</h5>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "47": {
+      "content": "<br>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "48": {
+      "content": "<br/>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "49": {
+      "content": "</br>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50": {
+      "content": "<strong>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "51": {
+      "content": "<strong/>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "52": {
+      "content": "</strong>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "53": {
+      "content": "<p>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "54": {
+      "content": "<p/>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "55": {
+      "content": "</p>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "56": {
+      "content": "<table>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "57": {
+      "content": "<table/>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "58": {
+      "content": "</table>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "59": {
+      "content": "<li>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "60": {
+      "content": "<li/>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "61": {
+      "content": "</li>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "62": {
+      "content": "<tr>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "63": {
+      "content": "<tr/>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "64": {
+      "content": "</tr>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "65": {
+      "content": "<tbody>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "66": {
+      "content": "<tbody/>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "67": {
+      "content": "</tbody>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "68": {
+      "content": "<img>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "69": {
+      "content": "<img/>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "70": {
+      "content": "</img>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "71": {
+      "content": "<b>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "72": {
+      "content": "<b/>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "73": {
+      "content": "</b>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "74": {
+      "content": "<td>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "75": {
+      "content": "<td/>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "76": {
+      "content": "</td>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "115": {
+      "content": "<!--",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "118": {
+      "content": "<!DOCTYPE>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "145": {
+      "content": "<|unused000|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "146": {
+      "content": "<|unused001|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "147": {
+      "content": "<|unused002|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "148": {
+      "content": "<|unused003|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "149": {
+      "content": "<|unused004|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "150": {
+      "content": "<|unused005|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151": {
+      "content": "<|unused006|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "152": {
+      "content": "<|unused007|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "153": {
+      "content": "<|unused008|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "154": {
+      "content": "<|unused009|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "155": {
+      "content": "<|unused010|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "156": {
+      "content": "<|unused011|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "157": {
+      "content": "<|unused012|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "158": {
+      "content": "<|unused013|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "159": {
+      "content": "<|unused014|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "160": {
+      "content": "<|unused015|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "161": {
+      "content": "<|unused016|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "162": {
+      "content": "<|unused017|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "163": {
+      "content": "<|unused018|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "164": {
+      "content": "<|unused019|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "165": {
+      "content": "<|unused020|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "166": {
+      "content": "<|unused021|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "167": {
+      "content": "<|unused022|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "168": {
+      "content": "<|unused023|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "169": {
+      "content": "<|unused024|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "170": {
+      "content": "<|unused025|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "171": {
+      "content": "<|unused026|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "172": {
+      "content": "<|unused027|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "173": {
+      "content": "<|unused028|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "174": {
+      "content": "<|unused029|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "175": {
+      "content": "<|unused030|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "176": {
+      "content": "<|unused031|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "177": {
+      "content": "<|unused032|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "178": {
+      "content": "<|unused033|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "179": {
+      "content": "<|unused034|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "180": {
+      "content": "<|unused035|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "181": {
+      "content": "<|unused036|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "182": {
+      "content": "<|unused037|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "183": {
+      "content": "<|unused038|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "184": {
+      "content": "<|unused039|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "185": {
+      "content": "<|unused040|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "186": {
+      "content": "<|unused041|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "187": {
+      "content": "<|unused042|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "188": {
+      "content": "<|unused043|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "189": {
+      "content": "<|unused044|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "190": {
+      "content": "<|unused045|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "191": {
+      "content": "<|unused046|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "192": {
+      "content": "<|unused047|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "193": {
+      "content": "<|unused048|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "194": {
+      "content": "<|unused049|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "195": {
+      "content": "<|unused050|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "196": {
+      "content": "<|unused051|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "197": {
+      "content": "<|unused052|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "198": {
+      "content": "<|unused053|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "199": {
+      "content": "<|unused054|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "200": {
+      "content": "<|unused055|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "201": {
+      "content": "<|unused056|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "202": {
+      "content": "<|unused057|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "203": {
+      "content": "<|unused058|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "204": {
+      "content": "<|unused059|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "205": {
+      "content": "<|unused060|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "206": {
+      "content": "<|unused061|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "207": {
+      "content": "<|unused062|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "208": {
+      "content": "<|unused063|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "209": {
+      "content": "<|unused064|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "210": {
+      "content": "<|unused065|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "211": {
+      "content": "<|unused066|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "212": {
+      "content": "<|unused067|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "213": {
+      "content": "<|unused068|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "214": {
+      "content": "<|unused069|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "215": {
+      "content": "<|unused070|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "216": {
+      "content": "<|unused071|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "217": {
+      "content": "<|unused072|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "218": {
+      "content": "<|unused073|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "219": {
+      "content": "<|unused074|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "220": {
+      "content": "<|unused075|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "221": {
+      "content": "<|unused076|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "222": {
+      "content": "<|unused077|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "223": {
+      "content": "<|unused078|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "224": {
+      "content": "<|unused079|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "225": {
+      "content": "<|unused080|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "226": {
+      "content": "<|unused081|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "227": {
+      "content": "<|unused082|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "228": {
+      "content": "<|unused083|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "229": {
+      "content": "<|unused084|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "230": {
+      "content": "<|unused085|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "231": {
+      "content": "<|unused086|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "232": {
+      "content": "<|unused087|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "233": {
+      "content": "<|unused088|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "234": {
+      "content": "<|unused089|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "235": {
+      "content": "<|unused090|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "236": {
+      "content": "<|unused091|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "237": {
+      "content": "<|unused092|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "238": {
+      "content": "<|unused093|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "239": {
+      "content": "<|unused094|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "240": {
+      "content": "<|unused095|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "241": {
+      "content": "<|unused096|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "242": {
+      "content": "<|unused097|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "243": {
+      "content": "<|unused098|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "244": {
+      "content": "<|unused099|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "245": {
+      "content": "<|unused100|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "246": {
+      "content": "<|unused101|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "247": {
+      "content": "<|unused102|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248": {
+      "content": "<|unused103|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "249": {
+      "content": "<|unused104|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "250": {
+      "content": "<|unused105|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "251": {
+      "content": "<|unused106|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "252": {
+      "content": "<|unused107|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "253": {
+      "content": "<|unused108|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "254": {
+      "content": "<|unused109|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "255": {
+      "content": "<|unused110|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256": {
+      "content": "<|unused111|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "257": {
+      "content": "<|unused112|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "258": {
+      "content": "<|unused113|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "259": {
+      "content": "<|unused114|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "260": {
+      "content": "<|unused115|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "261": {
+      "content": "<|unused116|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "262": {
+      "content": "<|unused117|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "263": {
+      "content": "<|unused118|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "264": {
+      "content": "<|unused119|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "265": {
+      "content": "<|unused120|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "266": {
+      "content": "<|unused121|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "267": {
+      "content": "<|unused122|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "268": {
+      "content": "<|unused123|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "269": {
+      "content": "<|unused124|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "270": {
+      "content": "<|unused125|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "271": {
+      "content": "<|unused126|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "272": {
+      "content": "<|unused127|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "273": {
+      "content": "<|unused128|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "274": {
+      "content": "<|unused129|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "275": {
+      "content": "<|unused130|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "276": {
+      "content": "<|unused131|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "277": {
+      "content": "<|unused132|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "278": {
+      "content": "<|unused133|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "279": {
+      "content": "<|unused134|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "280": {
+      "content": "<|unused135|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "281": {
+      "content": "<|unused136|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "282": {
+      "content": "<|unused137|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "283": {
+      "content": "<|unused138|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "284": {
+      "content": "<|unused139|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "285": {
+      "content": "<|unused140|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "286": {
+      "content": "<|unused141|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "287": {
+      "content": "<|unused142|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "288": {
+      "content": "<|unused143|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "289": {
+      "content": "<|unused144|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "290": {
+      "content": "<|unused145|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "291": {
+      "content": "<|unused146|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "292": {
+      "content": "<|unused147|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "293": {
+      "content": "<|unused148|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "294": {
+      "content": "<|unused149|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "295": {
+      "content": "<|unused150|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "296": {
+      "content": "<|unused151|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "297": {
+      "content": "<|unused152|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "298": {
+      "content": "<|unused153|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "299": {
+      "content": "<|unused154|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "300": {
+      "content": "<|unused155|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "301": {
+      "content": "<|unused156|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "302": {
+      "content": "<|unused157|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "303": {
+      "content": "<|unused158|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "304": {
+      "content": "<|unused159|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "<|startoftext|>",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|endoftext|>",
+  "legacy": true,
+  "model_max_length": 4096,
+  "pad_token": "<unk>",
+  "sp_model_kwargs": {},
+  "tokenizer_class": "LlamaTokenizer",
+  "unk_token": "<unk>",
+  "use_default_system_prompt": false
+}