Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,83 @@
+---
+tags:
+- unsloth
+base_model:
+- zai-org/GLM-4.6
+language:
+- en
+- zh
+library_name: transformers
+license: mit
+pipeline_tag: text-generation
+---
+> [!NOTE]
+>  Includes Unsloth **chat template fixes**! <br> For `llama.cpp`, use `--jinja`
+>
+
+<div>
+<p style="margin-top: 0;margin-bottom: 0;">
+    <em><a href="https://docs.unsloth.ai/basics/unsloth-dynamic-v2.0-gguf">Unsloth Dynamic 2.0</a> achieves superior accuracy & outperforms other leading quants.</em>
+  </p>
+  <div style="display: flex; gap: 5px; align-items: center; ">
+    <a href="https://github.com/unslothai/unsloth/">
+      <img src="https://github.com/unslothai/unsloth/raw/main/images/unsloth%20new%20logo.png" width="133">
+    </a>
+    <a href="https://discord.gg/unsloth">
+      <img src="https://github.com/unslothai/unsloth/raw/main/images/Discord%20button.png" width="173">
+    </a>
+    <a href="https://docs.unsloth.ai/">
+      <img src="https://raw.githubusercontent.com/unslothai/unsloth/refs/heads/main/images/documentation%20green%20button.png" width="143">
+    </a>
+  </div>
+</div>
+
+
+# GLM-4.6
+
+<div align="center">
+<img src=https://raw.githubusercontent.com/zai-org/GLM-4.5/refs/heads/main/resources/logo.svg width="15%"/>
+</div>
+<p align="center">
+    👋 Join our <a href="https://discord.gg/QR7SARHRxK" target="_blank">Discord</a> community.
+    <br>
+    📖 Check out the GLM-4.6 <a href="https://z.ai/blog/glm-4.6" target="_blank">technical blog</a>, <a href="https://arxiv.org/abs/2508.06471" target="_blank">technical report(GLM-4.5)</a>, and <a href="https://zhipu-ai.feishu.cn/wiki/Gv3swM0Yci7w7Zke9E0crhU7n7D" target="_blank">Zhipu AI technical documentation</a>.
+    <br>
+    📍 Use GLM-4.6 API services on <a href="https://docs.z.ai/guides/llm/glm-4.6">Z.ai API Platform. </a>
+    <br>
+    👉 One click to <a href="https://chat.z.ai">GLM-4.6</a>.
+</p>
+
+## Model Introduction
+
+Compared with GLM-4.5, **GLM-4.6**  brings several key improvements:
+
+* **Longer context window:** The context window has been expanded from 128K to 200K tokens, enabling the model to handle more complex agentic tasks.
+* **Superior coding performance:** The model achieves higher scores on code benchmarks and demonstrates better real-world performance in applications such as Claude Code、Cline、Roo Code and Kilo Code, including improvements in generating visually polished front-end pages.
+* **Advanced reasoning:** GLM-4.6 shows a clear improvement in reasoning performance and supports tool use during inference, leading to stronger overall capability.
+* **More capable agents:** GLM-4.6 exhibits stronger performance in tool using and search-based agents, and integrates more effectively within agent frameworks.
+* **Refined writing:** Better aligns with human preferences in style and readability, and performs more naturally in role-playing scenarios.
+
+We evaluated GLM-4.6 across eight public benchmarks covering agents, reasoning, and coding. Results show clear gains over GLM-4.5, with GLM-4.6 also holding competitive advantages over leading domestic and international models such as **DeepSeek-V3.1-Terminus** and **Claude Sonnet 4**.
+
+![bench](https://raw.githubusercontent.com/zai-org/GLM-4.5/refs/heads/main/resources/bench_glm46.png)
+
+## Inference
+
+**Both GLM-4.5 and GLM-4.6 use the same inference method.**
+
+you can check our [github](https://github.com/zai-org/GLM-4.5) for more detail.
+
+## Recommended Evaluation Parameters
+
+For general evaluations, we recommend using a **sampling temperature of 1.0**.
+
+For **code-related evaluation tasks** (such as LCB), it is further recommended to set:
+
+- `top_p = 0.95`
+- `top_k = 40`
+
+
+## Evaluation
+
+- For tool-integrated reasoning, please refer to [this doc](https://github.com/zai-org/GLM-4.5/blob/main/resources/glm_4.6_tir_guide.md).
+- For search benchmark, we design a specific format for searching toolcall in thinking mode to support search agent, please refer to [this](https://github.com/zai-org/GLM-4.5/blob/main/resources/trajectory_search.json). for the detailed template.

chat_template.jinja

@@ -0,0 +1,103 @@
+[gMASK]<sop>
+{%- if tools -%}
+<|system|>
+# Tools
+
+You may call one or more functions to assist with the user query.
+
+You are provided with function signatures within <tools></tools> XML tags:
+<tools>
+{% for tool in tools %}
+{{ tool | tojson|string }}
+{% endfor %}
+</tools>
+
+For each function call, output the function name and arguments within the following XML format:
+<tool_call>{function-name}
+<arg_key>{arg-key-1}</arg_key>
+<arg_value>{arg-value-1}</arg_value>
+<arg_key>{arg-key-2}</arg_key>
+<arg_value>{arg-value-2}</arg_value>
+...
+</tool_call>{%- endif -%}
+{%- macro visible_text(content) -%}
+    {%- if content is string -%}
+        {{- content }}
+    {%- elif content is iterable and content is not mapping -%}
+        {%- for item in content -%}
+            {%- if item is mapping and item.type == 'text' -%}
+                {{- item.text }}
+            {%- elif item is string -%}
+                {{- item }}
+            {%- endif -%}
+        {%- endfor -%}
+    {%- else -%}
+        {{- content }}
+    {%- endif -%}
+{%- endmacro -%}
+{%- set ns = namespace(last_user_index=-1) %}
+{%- for m in messages %}
+    {%- if m.role == 'user' %}
+        {% set ns.last_user_index = loop.index0 -%}
+    {%- endif %}
+{%- endfor %}
+{% for m in messages %}
+{%- if m.role == 'user' -%}<|user|>
+{{ visible_text(m.content) }}
+{{- '/nothink' if (enable_thinking is defined and not enable_thinking and not visible_text(m.content).endswith("/nothink")) else '' -}}
+{%- elif m.role == 'assistant' -%}
+<|assistant|>
+{%- set reasoning_content = '' %}
+{%- set content = visible_text(m.content) %}
+{%- if m.reasoning_content is string %}
+    {%- set reasoning_content = m.reasoning_content %}
+{%- else %}
+    {%- if '</think>' in content %}
+        {%- set reasoning_content = ((content.split('</think>')|first).rstrip('\n').split('<think>')|last).lstrip('\n') %}
+        {%- set content = (content.split('</think>')|last).lstrip('\n') %}
+    {%- endif %}
+{%- endif %}
+{%- if loop.index0 > ns.last_user_index and reasoning_content -%}
+{{ '\n<think>' + reasoning_content.strip() +  '</think>'}}
+{%- else -%}
+{{ '\n<think></think>' }}
+{%- endif -%}
+{%- if content.strip() -%}
+{{ '\n' + content.strip() }}
+{%- endif -%}
+{% if m.tool_calls %}
+{% for tc in m.tool_calls %}
+{%- if tc.function %}
+    {%- set tc = tc.function %}
+{%- endif %}
+{{ '\n<tool_call>' + tc.name }}
+{% set _args = tc.arguments %}
+{% for k, v in _args.items() %}
+<arg_key>{{ k }}</arg_key>
+<arg_value>{{ v | tojson|string if v is not string else v }}</arg_value>
+{% endfor %}
+</tool_call>{% endfor %}
+{% endif %}
+{%- elif m.role == 'tool' -%}
+{%- if m.content is string -%}
+{%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+    {{- '<|observation|>' }}
+{%- endif %}
+{{- '\n<tool_response>\n' }}
+{{- m.content }}
+{{- '\n</tool_response>' }}
+{%- else -%}
+<|observation|>{% for tr in m.content %}
+
+<tool_response>
+{{ tr.output if tr.output is defined else tr }}
+</tool_response>{% endfor -%}
+{% endif -%}
+{%- elif m.role == 'system' -%}
+<|system|>
+{{ visible_text(m.content) }}
+{%- endif -%}
+{%- endfor -%}
+{%- if add_generation_prompt -%}
+    <|assistant|>{{- '\n<think></think>' if (enable_thinking is defined and not enable_thinking) else '' -}}
+{%- endif -%}

config.json

@@ -0,0 +1,44 @@
+{
+  "architectures": [
+    "Glm4MoeForCausalLM"
+  ],
+  "attention_bias": true,
+  "attention_dropout": 0.0,
+  "torch_dtype": "bfloat16",
+  "eos_token_id": [
+    151329,
+    151336,
+    151338
+  ],
+  "first_k_dense_replace": 3,
+  "head_dim": 128,
+  "hidden_act": "silu",
+  "hidden_size": 5120,
+  "initializer_range": 0.02,
+  "intermediate_size": 12288,
+  "max_position_embeddings": 202752,
+  "model_type": "glm4_moe",
+  "moe_intermediate_size": 1536,
+  "n_group": 1,
+  "n_routed_experts": 160,
+  "n_shared_experts": 1,
+  "norm_topk_prob": true,
+  "num_attention_heads": 96,
+  "num_experts_per_tok": 8,
+  "num_hidden_layers": 92,
+  "num_key_value_heads": 8,
+  "num_nextn_predict_layers": 1,
+  "pad_token_id": 151330,
+  "partial_rotary_factor": 0.5,
+  "rms_norm_eps": 1e-05,
+  "rope_scaling": null,
+  "rope_theta": 1000000,
+  "routed_scaling_factor": 2.5,
+  "tie_word_embeddings": false,
+  "topk_group": 1,
+  "transformers_version": "4.56.2",
+  "unsloth_fixed": true,
+  "use_cache": true,
+  "use_qk_norm": true,
+  "vocab_size": 151552
+}

generation_config.json

@@ -0,0 +1,11 @@
+{
+  "_from_model_config": true,
+  "eos_token_id": [
+    151329,
+    151336,
+    151338
+  ],
+  "pad_token_id": 151329,
+  "temperature": 1.0,
+  "transformers_version": "4.56.2"
+}

model-00001-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e811e2ae0af3f8f5c78a4c44ef89a9f181e1b79e56d5860d6553b1f50918925a
+size 2202060968

model-00002-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:559c2c6c327cd224abf66411c7ee013d215578bb9561b0d7b9312f09c7332158
+size 650168352

model-00003-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8f93e05487c6b84c6893ba3967dc05137d31cf4fcf5e52af284513b395d04b10
+size 650168352

model-00004-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4013dad7c73dc6f653ca25d189fdcf43910f67d52816c80fe4d33535ecf28860
+size 7871313120

model-00005-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c9892dea94d1a8988bcd0f7b84cfaffc512cf9d67009667f2d69fd9da612158e
+size 7871313120

model-00006-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f24c50465ebae0f5313014a7ad7f6c3899c52a95e5a651a353c2766e4b4e7298
+size 7871313120

model-00007-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0a5190f7eec27e00e65f49a92835c258552950c11e2a62b04255a00d176109a9
+size 7871313120

model-00008-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:25028914f40903d33035641cd25b947437115f27d19fe097cef49a4699c05d0c
+size 7871313120

model-00009-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4ac318cfc36056c18fe0f320dcd407d85e8500de08884bef5d1b15f845a96646
+size 7871313120

model-00010-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2fb398cc5157d66d2e8ef8f686a5df2bd4ac8a98265745256a3c66b588e7bf9d
+size 7871313120

model-00011-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:629bab852e515c3cea074e88db1f72e37ca27bb5b2af456af2e3eae26e45d66a
+size 7871313616

model-00012-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e643357d0afd3f1870a2df7fb05050e06a2816bbb0f6ef856da5bcf956ca604b
+size 7871313616

model-00013-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ec3175e3d7699175af6751a9ef126f65bd4269013ef9f6abc6e0b56cb9ac277c
+size 7871313616

model-00014-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:31fddd0d558a5e9b392980f25c5941b721d1b631f26664596fe00cc71651820e
+size 7871313616

model-00015-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cddeb04f13a56a6a781f44048bd0d8a250adf34b17c3c098173cc3fdd864419e
+size 7871313616

model-00016-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a6aa2577a4a8b5684ce6f4f49c1b4fb70aac88555b2c0367571efd328d6b9534
+size 7871313616

model-00017-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:00a194a3db95979ba04e0cdaddb85ca76cbb360612a2c550f04bea7ecd632acb
+size 7871313616

model-00018-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:29b6fd2128e8563cf20879d965b2c7b89ac1666edfcaef9332b1fbc5827ee2f0
+size 7871313616

model-00019-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bc6c4804df6b1ea61d5b7bdf835e70f32d4df33d9a22d30be860b2cf71aae417
+size 7871313616

model-00020-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e0248883e585ab1d592d0589999037e1c3f299b10e20ece7d5c30bd77e375da1
+size 7871313616

model-00021-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8675a54477ce0675741a5fee9d062c0de78c3d0174e40a5d01de853ce53a6e4a
+size 7871313616

model-00022-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ca1ae9a36b49cd3ecd25f8258b8d55ab0a1d1f7634fd273a0b548de5e9172acb
+size 7871313616

model-00023-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8d58920a549dbf9887b8e1229863d0cf62227c336191ba76089ae0af6f091d37
+size 7871313616

model-00024-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f232bc262841b0edf63791096ea22b1ab3e76e7428f83d330387471ee29fe75c
+size 7871313616

model-00025-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e57569bea34abe0023bc2183750ea37879deff0289f08d8e6e830515a7873558
+size 7871313616

model-00026-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:41b3bd3383439b898faeeb5437a239a61721c4644b0a697439f47085310a98c9
+size 7871313616

model-00027-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ebe5962e41760b4200dcaa85826f4767dad5290c263b89bba57b40c276a8789f
+size 7871313616

model-00028-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:07577963a77cb7eb6f09f3d73d0d334c2211c216981c85eb7abdb03db2c340b9
+size 7871313616

model-00029-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d339dfc29d844e9aa92bde4efe3b23258ecd860ede53c2a986508e61c20a1a64
+size 7871313616

model-00030-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:48e67c5d8167ab23d033825f02e06c1a38143319ae15d4031a7387d30f910c2f
+size 7871313616

model-00031-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:768a839d45efba7a4334ac1c0e1b42babcf85d41e21c0da49756f3f2cc35bf41
+size 7871313616

model-00032-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:596739c493b334a45eecd111b076924c4013aa4548afba895f2e6d9f0b9febed
+size 7871313616

model-00033-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b5462d2b82d87a28b3bd5a3263625f06aae9b1ddb20122793b8e16aa0848963e
+size 7871313616

model-00034-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:339a74144c5fe02a521675c7792e22d2b5ca66c1ef700eaac831d23086660670
+size 7871313616

model-00035-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2cddd87cb2c99a01502cedc7ea03e34baa3abb3256fdf69a0b100bde69e334c8
+size 7871313616

model-00036-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5d530f1fe2348834c50a3b340dc359e173a5829f8334dfa5d0c33c0d8c6002a6
+size 7871313616

model-00037-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:aa924217f71bde76d5ac2e6b214b9bfde70ad84cdde1f28b67e07100faeb6268
+size 7871313616

model-00038-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e2d53da5652fed1a39ed583e8d76406c64fecc1abd9fd7bb9f4ac931224df1c6
+size 7871313616

model-00039-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:712ef2e1ba038043d61157c09e137c9c208318e8420978238f1bc48b51467541
+size 7871313616

model-00040-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:271106c38601a262ec8ecfe1319057a75eb0b3958761204c62bed09708fa552f
+size 7871313616

model-00041-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5a7b148aa720647b64138799df7b3a49d5a89f427dca4c1d5655f22bf9f83e42
+size 7871313616

model-00042-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:690961b65965bc559115df143cfb58ef9f0bbb39d86030825c0cc862f1c3adb2
+size 7871313616

model-00043-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:194626c7568a6e8e252afc1b2e603c258879c91e7c691cfff5eaa152c86526b3
+size 7871313616

model-00044-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5d62b81c57e5c8b16b12f3d19abd7ca638a92ff08561da136476bc1f5dd0d7e7
+size 7871313616

model-00045-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:19fb2b5f9bfaeba8cf4a7a2ac6e3cdbb227e8245cb905a7bfc37303a22f0f826
+size 7871313616