PsychQwen3_v4 : GGUF

This model was finetuned and converted to GGUF format using Unsloth.

This model was created for fun, when experimenting with datasets and reasoning in LLMs, This model is a LoRA SFT of Qwen3 8B, which is already an instruct model though not specialized in psychiatry psychqwen3_v4 was trained on a dataset consisting of 20k pairs of question and answer, thinking blocks were added into the answer because psychqwen3_v3 which was trained on the same dataset without thinking blocks couldn't think after the fine-tuning at all.

you are free to deploy and test this model or test it until i stop tunneling my local server via ngrok to the internet connecting this model in inference endpoints and server part with all the tools it has

regarding the tools it has, it can search ICD-11, pull drug information, calculate and search pubmed though not always it acts according to what an optimal model would do as an assistant.

the model hasn't been benchmarked, you are free to do it yourself.

Example usage:

  • For text only LLMs: llama-cli -hf voperl/PsychQwen3_v4 --jinja
  • For multimodal models: llama-mtmd-cli -hf voperl/PsychQwen3_v4 --jinja

Available Model files:

  • Qwen3-8B.Q4_K_M.gguf

Ollama

An Ollama Modelfile is included for easy deployment. This was trained 2x faster with Unsloth

Downloads last month
58
GGUF
Model size
8B params
Architecture
qwen3
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Dataset used to train voperl/PsychQwen3_v4