---
base_model: unsloth/llama-3.2-3b-instruct-bnb-4bit
tags:
- text-generation-inference
- transformers
- unsloth
- llama
- gguf
license: apache-2.0
language:
- en
datasets:
- gghfez/QwQ-LongCoT-130K-cleaned
pipeline_tag: text-generation
---

I highly recommend you to use our flagship 3B model instead: https://huggingface.co/Pinkstack/PARM-V2-QwQ-Qwen-2.5-o1-3B-GGUF <- this model has generally better performance and is higher quality. 

# Uploaded  model

Further trained Llama 3.2 3B with enhanced reasoning, aimed to mimic deepseek r1 quality.

Trained with Nvidia Tesla T4

This is the first model we've trained it may have abnormalities, Phi 3.5 soon.

- **Developed by:** PinkStack 
- **License:** apache-2.0
- **Finetuned from model :** unsloth/llama-3.2-3b-instruct-bnb-4bit

This llama model was trained using [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.

[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)