abhishek

/

llama-2-7b-hf-small-shards

like 55

Hi Abhishek
Please help
Every time i run the below command i get the below error
autotrain llm --train --project-name llm-1 --model abhishek/llama-2-7b-hf-small-shards --data-path . --use-peft --quantization int4 --lr 2e-4 --train-batch-size 12 --epochs 3 --trainer sft

error is
File "C:\Users\zau3\AppData\Roaming\Python\Python311\site-packages\autotrain\trainers\clm_main_.py", line 526, in
training_config = json.load(open(_args.training_config))
^^^^^^^^^^^^^^^^^^^^^^^^^^^
FileNotFoundError: [Errno 2] No such file or directory: 'llm-1training_params.json'
Traceback (most recent call last):

Here is the full error with warnings

WARNING No GPU found. Forcing training on CPU. This will be super slow!
INFO ['accelerate', 'launch', '--cpu', '-m', 'autotrain.trainers.clm', '--training_config', 'llm-1\training_params.json']
The following values were not passed to accelerate launch and had defaults used instead:
--num_processes was set to a value of 0
--num_machines was set to a value of 1
--mixed_precision was set to a value of 'no'
--dynamo_backend was set to a value of 'no'
To avoid this warning pass in values for each of the problematic parameters or run accelerate config.
C:\Users\zau3\AppData\Roaming\Python\Python311\site-packages\trl\trainer\ppo_config.py:141: UserWarning: The optimize_cuda_cache arguement will be deprecated soon, please use optimize_device_cache instead.
warnings.warn(
Traceback (most recent call last):
File "", line 198, in _run_module_as_main
File "", line 88, in run_code
File "C:\Users\zau3\AppData\Roaming\Python\Python311\site-packages\autotrain\trainers\clm_main.py", line 526, in
training_config = json.load(open(_args.training_config))
^^^^^^^^^^^^^^^^^^^^^^^^^^^
FileNotFoundError: [Errno 2] No such file or directory: 'llm-1training_params.json'
Traceback (most recent call last):
File "", line 198, in _run_module_as_main
File "", line 88, in run_code
File "C:\Users\zau3\AppData\Roaming\Python\Python311\Scripts\accelerate.exe_main.py", line 7, in
File "C:\Users\zau3\AppData\Roaming\Python\Python311\site-packages\accelerate\commands\accelerate_cli.py", line 47, in main
args.func(args)
File "C:\Users\zau3\AppData\Roaming\Python\Python311\site-packages\accelerate\commands\launch.py", line 1023, in launch_command
simple_launcher(args)
File "C:\Users\zau3\AppData\Roaming\Python\Python311\site-packages\accelerate\commands\launch.py", line 643, in simple_launcher
raise subprocess.CalledProcessError(returncode=process.returncode, cmd=cmd)
subprocess.CalledProcessError: Command '['C:\ProgramData\anaconda3\python.exe', '-m', 'autotrain.trainers.clm', '--training_config', 'llm-1training_params.json']' returned non-zero exit status 1.