Hugging Face's logo

QuantFactory
/
Matter-0.2-7B-GGUF

Text Generation
Transformers
GGUF
English
mistral
conversational
text-generation-inference
Model card Files Community
Matter-0.2-7B-GGUF
File size: 2,318 Bytes 
ba26109
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
 
---
license: apache-2.0
datasets:
- 0-hero/Matter-0.2
language:
- en
inference: false
library_name: transformers
pipeline_tag: text-generation
tags:
- mistral
- conversational
- text-generation-inference
---

## Matter 7B - 0.2 - GGUF (Mistral 7B 0.2 Finetune)

## This is the GGUF version of the model, made for the llama.cpp inference engine. 

# Model Description

Matter 7B 0.2 is full-finetune on the **Matter 0.2 dataset** (not yet released), which is curated from over 35 datsets analyzing >6B tokens

### Training

Prompt format: This model uses ChatML prompt format.
```
<|im_start|>system
You are a helpful AI assistant.<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
```
### Function Calling

Model also supports function calling. Additional tokens for function calling 

Model function call tokens
- `<tool_call>` - Function call start token
- `</tool_call>` - Function call end token

Function call response tokens
- `<tool_response>` - Function response start token
- `</tool_response>` - Function response end token

Example
```
<|im_start|>system
  You are a helpful assistant with access to the following functions. Use them if required -
  { "name": "get_news_headlines",
    "description": "Get the latest news headlines",
    "parameters":
      { "type": "object",
        "properties":
        { "country":
          { "type": "string",
            "description": "The country for which to fetch news"
          }
        },
      "required": [ "country" ]
    }
  }
<|im_end|>
<|im_start|>user
   Can you tell me the latest news headlines for the United States?<|im_end|>
<|im_start|>assistant
  <tool_call>{"name": "get_news_headlines", "arguments": '{"country": "United States"}'}</tool_call><|im_end|>
<|im_start|>user
  <tool_response>{
    "headlines":
      [
        "Biden announces new vaccine mandates",
        "Hurricane Ida devastates Louisiana",
        "Apple unveils new iPhone",
        "NASA's Perseverance rover collects first Mars rock sample"
      ]
  }</tool_response>
<|im_end|>
<|im_start|>assistant
  Here are the latest news headlines for the United States:
  1. Biden announces new vaccine mandates
  2. Hurricane Ida devastates Louisiana
  3. Apple unveils new iPhone
  4. NASA's Perseverance rover collects first Mars rock sample
<|im_end|>
```