alwaysgood/TranslateQwen_v1-GGUF

TranslateQwen_v1 GGUF

GGUF conversion of alwaysgood/scp-stage4-oneshot-forward_dpo_sigmoid for llama.cpp and LM Studio.

Files

File	Purpose
TranslateQwen_v1-Q4_K_M.gguf	Main text model, recommended default
TranslateQwen_v1-BF16.gguf	BF16 text model, larger reference build
TranslateQwen_v1-mmproj-BF16.gguf	Multimodal projector for vision/image input

The main BF16 and Q4_K_M GGUF files are language/text models. Vision/image tensors are split into the separate mmproj-BF16 GGUF, so image input requires loading both the main model and the matching mmproj file.

LM Studio custom template

This model was trained with a raw DPO/SFT translation prompt, not a ChatML chat prompt. LM Studio's normal User/Assistant split can still be used by putting the fixed Instruction and Source headers in the custom template.

In LM Studio, open the model settings, go to Advanced Configuration -> Prompt Template, choose Custom, and use:

Field	Value
Choose template	Custom
Before System	leave empty
After System	\n\n
Before User	### Instruction:\nTranslate the English source into Korean.\n\n### Source:\n
After User	\n\n
Before Assistant	### Response:\n
After Assistant	\n\n

If you type this in LM Studio chat:

The Federal Reserve raised interest rates by 25 basis points.

LM Studio should send this prompt to the model:

### Instruction:
Translate the English source into Korean.

### Source:
The Federal Reserve raised interest rates by 25 basis points.

### Response:

Suggested decoding: greedy or low-temperature translation, e.g. temperature 0.0 to 0.3, context length 8192.

llama.cpp

Text:

llama-cli \
  -m TranslateQwen_v1-Q4_K_M.gguf \
  --color -ngl all -fa -c 8192 \
  -p $'### Instruction:\nTranslate the English source into Korean.\n\n### Source:\nThe Federal Reserve raised interest rates by 25 basis points.\n\n### Response:\n'

Vision:

llama-mtmd-cli \
  -m TranslateQwen_v1-Q4_K_M.gguf \
  --mmproj TranslateQwen_v1-mmproj-BF16.gguf \
  --image /path/to/image.png \
  -p $'### Instruction:\nTranslate the English source into Korean.\n\n### Source:\nDescribe this image in Korean.\n\n### Response:\n' \
  -ngl all -fa -c 8192