Hugging Face's logo

RichardErkhov
/
Mxode_-_Pythia-70m-Synonym-Sentence-Converter-gguf

GGUF
Model card Files Community
Mxode_-_Pythia-70m-Synonym-Sentence-Converter-gguf
File size: 8,251 Bytes 
913a760
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
 
Quantization made by Richard Erkhov.

[Github](https://github.com/RichardErkhov)

[Discord](https://discord.gg/pvy7H8DZMG)

[Request more models](https://github.com/RichardErkhov/quant_request)


Pythia-70m-Synonym-Sentence-Converter - GGUF
- Model creator: https://huggingface.co/Mxode/
- Original model: https://huggingface.co/Mxode/Pythia-70m-Synonym-Sentence-Converter/


| Name | Quant method | Size |
| ---- | ---- | ---- |
| [Pythia-70m-Synonym-Sentence-Converter.Q2_K.gguf](https://huggingface.co/RichardErkhov/Mxode_-_Pythia-70m-Synonym-Sentence-Converter-gguf/blob/main/Pythia-70m-Synonym-Sentence-Converter.Q2_K.gguf) | Q2_K | 0.04GB |
| [Pythia-70m-Synonym-Sentence-Converter.IQ3_XS.gguf](https://huggingface.co/RichardErkhov/Mxode_-_Pythia-70m-Synonym-Sentence-Converter-gguf/blob/main/Pythia-70m-Synonym-Sentence-Converter.IQ3_XS.gguf) | IQ3_XS | 0.04GB |
| [Pythia-70m-Synonym-Sentence-Converter.IQ3_S.gguf](https://huggingface.co/RichardErkhov/Mxode_-_Pythia-70m-Synonym-Sentence-Converter-gguf/blob/main/Pythia-70m-Synonym-Sentence-Converter.IQ3_S.gguf) | IQ3_S | 0.04GB |
| [Pythia-70m-Synonym-Sentence-Converter.Q3_K_S.gguf](https://huggingface.co/RichardErkhov/Mxode_-_Pythia-70m-Synonym-Sentence-Converter-gguf/blob/main/Pythia-70m-Synonym-Sentence-Converter.Q3_K_S.gguf) | Q3_K_S | 0.04GB |
| [Pythia-70m-Synonym-Sentence-Converter.IQ3_M.gguf](https://huggingface.co/RichardErkhov/Mxode_-_Pythia-70m-Synonym-Sentence-Converter-gguf/blob/main/Pythia-70m-Synonym-Sentence-Converter.IQ3_M.gguf) | IQ3_M | 0.04GB |
| [Pythia-70m-Synonym-Sentence-Converter.Q3_K.gguf](https://huggingface.co/RichardErkhov/Mxode_-_Pythia-70m-Synonym-Sentence-Converter-gguf/blob/main/Pythia-70m-Synonym-Sentence-Converter.Q3_K.gguf) | Q3_K | 0.04GB |
| [Pythia-70m-Synonym-Sentence-Converter.Q3_K_M.gguf](https://huggingface.co/RichardErkhov/Mxode_-_Pythia-70m-Synonym-Sentence-Converter-gguf/blob/main/Pythia-70m-Synonym-Sentence-Converter.Q3_K_M.gguf) | Q3_K_M | 0.04GB |
| [Pythia-70m-Synonym-Sentence-Converter.Q3_K_L.gguf](https://huggingface.co/RichardErkhov/Mxode_-_Pythia-70m-Synonym-Sentence-Converter-gguf/blob/main/Pythia-70m-Synonym-Sentence-Converter.Q3_K_L.gguf) | Q3_K_L | 0.04GB |
| [Pythia-70m-Synonym-Sentence-Converter.IQ4_XS.gguf](https://huggingface.co/RichardErkhov/Mxode_-_Pythia-70m-Synonym-Sentence-Converter-gguf/blob/main/Pythia-70m-Synonym-Sentence-Converter.IQ4_XS.gguf) | IQ4_XS | 0.04GB |
| [Pythia-70m-Synonym-Sentence-Converter.Q4_0.gguf](https://huggingface.co/RichardErkhov/Mxode_-_Pythia-70m-Synonym-Sentence-Converter-gguf/blob/main/Pythia-70m-Synonym-Sentence-Converter.Q4_0.gguf) | Q4_0 | 0.04GB |
| [Pythia-70m-Synonym-Sentence-Converter.IQ4_NL.gguf](https://huggingface.co/RichardErkhov/Mxode_-_Pythia-70m-Synonym-Sentence-Converter-gguf/blob/main/Pythia-70m-Synonym-Sentence-Converter.IQ4_NL.gguf) | IQ4_NL | 0.04GB |
| [Pythia-70m-Synonym-Sentence-Converter.Q4_K_S.gguf](https://huggingface.co/RichardErkhov/Mxode_-_Pythia-70m-Synonym-Sentence-Converter-gguf/blob/main/Pythia-70m-Synonym-Sentence-Converter.Q4_K_S.gguf) | Q4_K_S | 0.04GB |
| [Pythia-70m-Synonym-Sentence-Converter.Q4_K.gguf](https://huggingface.co/RichardErkhov/Mxode_-_Pythia-70m-Synonym-Sentence-Converter-gguf/blob/main/Pythia-70m-Synonym-Sentence-Converter.Q4_K.gguf) | Q4_K | 0.05GB |
| [Pythia-70m-Synonym-Sentence-Converter.Q4_K_M.gguf](https://huggingface.co/RichardErkhov/Mxode_-_Pythia-70m-Synonym-Sentence-Converter-gguf/blob/main/Pythia-70m-Synonym-Sentence-Converter.Q4_K_M.gguf) | Q4_K_M | 0.05GB |
| [Pythia-70m-Synonym-Sentence-Converter.Q4_1.gguf](https://huggingface.co/RichardErkhov/Mxode_-_Pythia-70m-Synonym-Sentence-Converter-gguf/blob/main/Pythia-70m-Synonym-Sentence-Converter.Q4_1.gguf) | Q4_1 | 0.05GB |
| [Pythia-70m-Synonym-Sentence-Converter.Q5_0.gguf](https://huggingface.co/RichardErkhov/Mxode_-_Pythia-70m-Synonym-Sentence-Converter-gguf/blob/main/Pythia-70m-Synonym-Sentence-Converter.Q5_0.gguf) | Q5_0 | 0.05GB |
| [Pythia-70m-Synonym-Sentence-Converter.Q5_K_S.gguf](https://huggingface.co/RichardErkhov/Mxode_-_Pythia-70m-Synonym-Sentence-Converter-gguf/blob/main/Pythia-70m-Synonym-Sentence-Converter.Q5_K_S.gguf) | Q5_K_S | 0.05GB |
| [Pythia-70m-Synonym-Sentence-Converter.Q5_K.gguf](https://huggingface.co/RichardErkhov/Mxode_-_Pythia-70m-Synonym-Sentence-Converter-gguf/blob/main/Pythia-70m-Synonym-Sentence-Converter.Q5_K.gguf) | Q5_K | 0.05GB |
| [Pythia-70m-Synonym-Sentence-Converter.Q5_K_M.gguf](https://huggingface.co/RichardErkhov/Mxode_-_Pythia-70m-Synonym-Sentence-Converter-gguf/blob/main/Pythia-70m-Synonym-Sentence-Converter.Q5_K_M.gguf) | Q5_K_M | 0.05GB |
| [Pythia-70m-Synonym-Sentence-Converter.Q5_1.gguf](https://huggingface.co/RichardErkhov/Mxode_-_Pythia-70m-Synonym-Sentence-Converter-gguf/blob/main/Pythia-70m-Synonym-Sentence-Converter.Q5_1.gguf) | Q5_1 | 0.05GB |
| [Pythia-70m-Synonym-Sentence-Converter.Q6_K.gguf](https://huggingface.co/RichardErkhov/Mxode_-_Pythia-70m-Synonym-Sentence-Converter-gguf/blob/main/Pythia-70m-Synonym-Sentence-Converter.Q6_K.gguf) | Q6_K | 0.06GB |
| [Pythia-70m-Synonym-Sentence-Converter.Q8_0.gguf](https://huggingface.co/RichardErkhov/Mxode_-_Pythia-70m-Synonym-Sentence-Converter-gguf/blob/main/Pythia-70m-Synonym-Sentence-Converter.Q8_0.gguf) | Q8_0 | 0.07GB |




Original model description:
---
license: apache-2.0
language:
- en
tags:
- tiny
- small
- synonym
- tool
- converter
---
## What's this?

A **tiny** model that can perform **paraphrasing** or **synonym substitution**.

The base model is [pythia-70m](https://huggingface.co/EleutherAI/pythia-70m). This model was fine-tuned with 10 epochs using [Q-Lora](https://github.com/artidoro/qlora) method on my own training set.



## How to use

### quick start

First import the model from hf:

```python
from transformers import GPTNeoXForCausalLM, AutoTokenizer


model_name_or_path = 'Mxode/Pythia-70m-C-Language-KnowledgeExtract'
device = 'cuda'

model = GPTNeoXForCausalLM.from_pretrained(model_name_or_path).to(device)
tokenizer = AutoTokenizer.from_pretrained(model_name_or_path)

# prompt template
prompt = '<|prompt|>Convert the following passage into synonymous sentences.<|prompt|>\n'
# any text you wish to convert, preferably in complete single sentences.
content = 'The theories and methods of systems science are extensively employed in various domains, including biology, economics, and sociology.'

text = prompt + content
```

Then generate:

```python
inputs = tokenizer(text, return_tensors="pt").to(device)
input_ids = inputs.input_ids

tokens = model.generate(
    **inputs,
    pad_token_id=tokenizer.eos_token_id,
    max_new_tokens=100,
    do_sample=True,
)
# strip the input
response = tokenizer.decode(tokens[0]).replace(text, "").strip('<|endoftext|>')

# I call it 'Synonymizer' :)
print(f'Synonymizer: {response}')
### output: 
### The disciplines of systems science are extensively employed in various domains, including biology, economics, and sociology.
```

Or maybe we'll try some more impossibly trained news? Hmm, get some sports news from espn and try:

```python
### ...
content = 'As both teams exited the court for halftime, Baynes and Mayen were shoulder to shoulder.'

### ...
print(f'Synonymizer: {response}')
### output:
### As the team neets around the court to ease their shifts, Baynes and Middets were partnerly paryyneen.

### sometimes:
### Begantly mastitatively, Baynes and Mayen staged their team rested the Tywindes rested the Tywindes rested the Tywindes laid the Tywindes laid the Tywindes laid the Tywindes laid the Tywindes laid the Tywindes laid the Tywindes laid the Tywindes laid the Tywindes laid the Tywindes laid the Tywindes laid the Tywindes laid the Tywindes laid the Tywindes laid the Tywindes laid
```

WELL, as you can see, this is after all only an **experimental tiny model** and with that in mind I can give it a 7.5 out of 10 for performance.

I didn't adjust the hyperparameters, could try [low temperature] + [a bit higher repetition_penalty], the performance might be better.

I'll follow up by training more data on a slightly larger model and hopefully supporting multiple languages. While we all know that bigger models have better generalization capabilities - but smaller models are really cool :)