The model weights are not tied. Please use the `tie_weights` method before using the `infer_auto_device` function.
#2
by
mdbhuggingface
- opened
I am getting error while running cammand "python3 generate.py --share=false --gradio_offline_level=1 --base_model='h2oai/h2ogpt-gm-oasst1-multilang-1024-20b' --prompt_type=human_bot --score_model=None"
https://prnt.sc/oT33b4WFmYEe