Text Classification
Transformers
Safetensors
English
Chinese
qwen3_5_text
text-generation
system-one
jev
decision-model
single-token-readout
merged
standalone
Instructions to use ZY-Lee4/QJev3.5-0.8B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ZY-Lee4/QJev3.5-0.8B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="ZY-Lee4/QJev3.5-0.8B")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("ZY-Lee4/QJev3.5-0.8B") model = AutoModelForCausalLM.from_pretrained("ZY-Lee4/QJev3.5-0.8B", device_map="auto") - Notebooks
- Google Colab
- Kaggle
QJev3.5-0.8B(合并后的独立模型)
这是 QJev3.5-0.8B-GGUF 的合并版:
底座 Qwen/Qwen3.5-0.8B + v5 LoRA 用 PEFT merge_and_unload() 合并后保存的完整权重,
加载时不需要 PEFT,直接用 transformers 即可。
from transformers import AutoModelForCausalLM, AutoTokenizer
tok = AutoTokenizer.from_pretrained("ZY-Lee4/QJev3.5-0.8B")
model = AutoModelForCausalLM.from_pretrained("ZY-Lee4/QJev3.5-0.8B")
# 渲染契约与读出方式见模型卡:system 固定、user = [QUESTION]/[OPTIONS]/[STATE]、
# 取答案位置的 top_logprobs 过滤候选字母后 softmax(两遍顺序交换取平均)
- 合并是无损的:在自建 180 题集上,独立版与「底座 Q8_0 + LoRA」的答案 180/180 完全一致、 逐家族准确率相同(ALL 93.9%;gate 97.0 / permissions 93.3 / email 90.0 / compaction 85.0)。
- llama.cpp 用户请用 GGUF 仓:
ZY-Lee4/QJev3.5-0.8B-GGUF有合并后的qjev35-0.8b-q8_0.gguf(774MB,llama-server -m即可,**不需要--lora**)、qjev35-0.8b-f16.gguf,以及体积更小的 LoRA GGUF(挂在同代底座上)。 - 完整评测、定位、许可与引用见主模型卡:
ZY-Lee4/QJev3.5-0.8B-GGUF的 README。 - 与官方 TypeSafe Jev 无隶属关系(第三方复刻)。
- Downloads last month
- 34