File size: 792 Bytes
8e2b878 1e45691 8e2b878 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 |
---
language:
- en
license: apache-2.0
tags:
- KANama
---
# Goekdeniz-Guelmez/KANama-fineweb-v2-test1
The Model [Goekdeniz-Guelmez/KANama-fineweb-v2-test1](https://huggingface.co/Goekdeniz-Guelmez/KANama-fineweb-v2-test1) was created using KANama.
## Use with KANama
```bash
pip install KANama, transformers
```
```python
from model.handler import from_pretrained, quick_inference
from transformers import AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("Goekdeniz-Guelmez/KANama-fineweb-v2-test1")
model = from_pretrained("path/to/model/folder")
prompt="hello"
input_tokens = tokenizer(prompt, return_tensors="pt").input_ids.to(device)
generated_tokens, generated_text = quick_inference(model, input_tokens, max_new_tokens=50, tokenizer=tokenizer)
print(generated_text)
```
|