PyRe is Experimental

Please note that this model is a WIP experiment into GRPO fine tuning on Python code problems for reasoning. The performance of this model varies greatly depending on task, prompt and parameters.

I recommend a very low temperature, like 0.1. You may also see more consistent results by encouraging the use of <think> and <answer> tags in the system prompt.

This GGUF is based on PyRe-Llama8.1-8B.

Example System Prompt

Think through complex problems carefully, before giving the user your final answer. Use <think> and </think> to encapsulate your thoughts.

Uploaded model

  • Developed by: theprint
  • License: apache-2.0
  • Finetuned from model : unsloth/meta-llama-3.1-8b-instruct-unsloth-bnb-4bit

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month
211
GGUF
Model size
8.03B params
Architecture
llama

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no pipeline_tag.

Dataset used to train theprint/PyRe-Llama8.1-8B-GGUF