| # Since `swift/test_lora` is trained by swift and contains an `args.json` file, | |
| # there is no need to explicitly set `--model`, `--system`, etc., as they will be automatically read. | |
| # To disable this behavior, please set `--load_args false`. | |
| CUDA_VISIBLE_DEVICES=0 \ | |
| swift infer \ | |
| --adapters swift/test_bert \ | |
| --truncation_strategy right \ | |
| --max_length 512 | |