SCRIPT_README.md · leafspark/Italia-9B at main

# Modello Italia inference script and model
# Copyright 2024 iGenius
#
# Licensed under the MIT License (see LICENSE-MIT).
# This code also contains code from the original project licensed under the Apache License 2.0 (see LICENSE-APACHE).
# This script contains modifications of the original code from Lightning AI.

Instructions

First, move the model and the tokenizer from /modello_italia_9b to the current directory, or ensure that the path is correctly specified.
Install dependencies by running the following command in the terminal:
```
pip install -r requirements.txt
```

To run the generation, use the following command:

python generate.py --checkpoint_dir <model_path> --max_new_tokens 500 --temperature 0.2 --prompt "Ciao, chi sei?"