File size: 3,063 Bytes
d84265d
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
0831e2c
d84265d
 
 
 
eff7466
d84265d
 
 
 
 
 
 
 
 
 
 
 
 
ea4033a
d84265d
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
---
base_model: arcee-ai/Arcee-Maestro-7B-Preview
pipeline_tag: text-generation
inference: true
language:
- en
license: apache-2.0
model_creator: arcee-ai
model_name: Arcee-Maestro-7B-Preview
model_type: qwen2
quantized_by: brittlewis12
tags:
- reasoning
- qwen2
---

# Arcee Maestro 7B Preview GGUF

**Original model**: [Arcee Maestro 7B Preview](https://huggingface.co/arcee-ai/Arcee-Maestro-7B-Preview)

**Model creator**: [Arcee AI](https://huggingface.co/arcee-ai)
 
> Arcee-Maestro-7B-Preview (7B) is Arcee's first reasoning model trained with reinforment learning. It is based on the Qwen2.5-7B DeepSeek-R1 distillation DeepSeek-R1-Distill-Qwen-7B with further GRPO training. Though this is just a preview of our upcoming work, it already shows promising improvements to mathematical and coding abilities across a range of tasks.

> Reinforcement Learning: GRPO with 450,000 verified math problems with some coding examples

This repo contains GGUF format model files for Arcee AI’s Arcee Maestro 7B Preview.

### What is GGUF?

GGUF is a file format for representing AI models. It is the third version of the format, 
introduced by the llama.cpp team on August 21st 2023.

Converted with llama.cpp build 4748 (revision [c392e50](https://github.com/ggml-org/llama.cpp/commits/c392e5094deaf2d1a7c18683214f007fad3fe42b)),
using [autogguf-rs](https://github.com/brittlewis12/autogguf-rs).

### Prompt template: [DeepSeek R1](https://huggingface.co/arcee-ai/Arcee-Maestro-7B-Preview/blob/dc3ee7b5dd2be00e7d2f5aaedb3212a5c183176b/tokenizer_config.json#L184)

```
{{system_message}}<|User|>{{prompt}}<|Assistant|><think>


```

---

## Download & run with [cnvrs](https://twitter.com/cnvrsai) on iPhone, iPad, and Mac!

![cnvrs.ai](https://pbs.twimg.com/profile_images/1744049151241797632/0mIP-P9e_400x400.jpg)

[cnvrs](https://testflight.apple.com/join/sFWReS7K) is the best app for private, local AI on your device:
- create & save **Characters** with custom system prompts & temperature settings
- download and experiment with any **GGUF model** you can [find on HuggingFace](https://huggingface.co/models?library=gguf)!
    * or, use an API key with the chat completions-compatible model provider of your choice -- ChatGPT, Claude, Gemini, DeepSeek, & more!
- make it your own with custom **Theme colors**
- powered by Metal ⚡️ & [Llama.cpp](https://github.com/ggml-org/llama.cpp), with **haptics** during response streaming!
- **try it out** yourself today, on [Testflight](https://testflight.apple.com/join/sFWReS7K)!
    * if you **already have the app**, download Arcee Maestro 7B Preview now! 
    * <cnvrsai:///models/search/hf?id=brittlewis12/Arcee-Maestro-7B-Preview-GGUF>
- follow [cnvrs on twitter](https://twitter.com/cnvrsai) to stay up to date

---

## Original Model Evaluation

> Arcee Maestro 7B preview shows great gains in mathematics and coding, surpassing O1 preview in many metrics.

![arcee-maestro-7b-preview-evals](https://cdn-uploads.huggingface.co/production/uploads/6435718aaaef013d1aec3b8b/DlSBEmCFS7yjJi2kOGuLa.png)