|
--- |
|
license: mit |
|
language: |
|
- it |
|
--- |
|
|
|
# Modello Italia 9B |
|
|
|
HF-compatible version of Modello Italia 9B, developed by iGenius. |
|
|
|
```python |
|
import torch |
|
import transformers as tr |
|
|
|
tokenizer = tr.AutoTokenizer.from_pretrained("riccorl/Modello-Italia-9B-hf") |
|
model = tr.AutoModelForCausalLM.from_pretrained( |
|
"riccorl/Modello-Italia-9B-hf", |
|
device_map="auto", |
|
torch_dtype=torch.bfloat16 |
|
) |
|
|
|
MY_SYSTEM_PROMPT_SHORT = ( |
|
"Tu sei Modello Italia, un modello di linguaggio naturale addestrato da iGenius." |
|
) |
|
prompt = "Ciao, chi sei?" |
|
messages = [ |
|
{"role": "system", "content": MY_SYSTEM_PROMPT_SHORT}, |
|
{"role": "user", "content": prompt}, |
|
] |
|
tokenized_chat = tokenizer.apply_chat_template( |
|
messages, tokenize=True, add_generation_prompt=True, return_tensors="pt" |
|
) |
|
out = model.generate(tokenized_chat.to("cuda"), max_new_tokens=200) |
|
``` |
|
|
|
License: MIT(?) |
|
|
|
License PDF: https://secure.igenius.ai/legal/italia_terms_and_conditions.pdf |
|
|
