# algebra_linear_1d
---
language: en
datasets:
- algebra_linear_1d
---

This is a [t5-small](https://ai.googleblog.com/2020/02/exploring-transfer-learning-with-t5.html) fine-tuned version on the [math_dataset/algebra_linear_1d](https://www.tensorflow.org/datasets/catalog/math_dataset#mathdatasetalgebra_linear_1d_default_config) for solving **algebra 1d equations** mission.

To load the model:
(necessary packages: !pip install transformers sentencepiece)
```python
from transformers import AutoTokenizer, AutoModelWithLMHead
tokenizer = AutoTokenizer.from_pretrained("dbernsohn/algebra_linear_1d")
model = AutoModelWithLMHead.from_pretrained("dbernsohn/algebra_linear_1d")
```

You can then use this model to solve algebra 1d equations into numbers.

```python
query = "Solve 0 = 1026*x - 2474 + 46592 for x"
input_text = f"{query} </s>"
features = tokenizer([input_text], return_tensors='pt')
model.to('cuda')
output = model.generate(input_ids=features['input_ids'].cuda(), 
                        attention_mask=features['attention_mask'].cuda())

tokenizer.decode(output[0])
# <pad> -41</s>
```

Another examples:

+ Solve 1112*r + 1418*r - 5220 = 587*r - 28536 for r. 
+ Answer:  -12 Pred:  -12
----
+ Solve -119*k + 6*k - 117 - 352 = 322 for k. 
+ Answer:  -7 Pred:  -7
----
+ Solve -547 = -62*t + 437 - 798 for t. 
+ Answer:  3 Pred:  3
----
+ Solve 3*j - 3*j + 0*j - 4802 = 98*j for j. 
+ Answer:  -49 Pred:  -49
----
+ Solve 3047*n - 6130*n - 1700 = -3049*n for n. 
+ Answer:  -50 Pred:  -50
----
+ Solve 121*i + 1690 = 76*i - 128*i + 133 for i. 
+ Answer:  -9 Pred:  -9

The whole training process and hyperparameters are in my [GitHub repo](https://github.com/DorBernsohn/CodeLM/tree/main/MathLM)
> Created by [Dor Bernsohn](https://www.linkedin.com/in/dor-bernsohn-70b2b1146/)