```python # Modello Italia inference script and model # Copyright 2024 iGenius # # Licensed under the MIT License (see LICENSE-MIT). # This code also contains code from the original project licensed under the Apache License 2.0 (see LICENSE-APACHE). # This script contains modifications of the original code from Lightning AI. ``` ### Instructions 1. First, move the model and the tokenizer from `/modello_italia_9b` to the current directory, or ensure that the path is correctly specified. 2. Install dependencies by running the following command in the terminal: ```terminal pip install -r requirements.txt ``` 3. To run the generation, use the following command: ```terminal python generate.py --checkpoint_dir --max_new_tokens 500 --temperature 0.2 --prompt "Ciao, chi sei?" ```