configuration_RW.py delete in base falcon-7b
configuration_RW.py has been deleted. so the model stopped working.
runtime error:
OSError: tiiuae/falcon-7b-instruct does not appear to have a file named configuration_RW.py.
You are right, Falcon now has a official support by HF!
no longer need Trust remote code. By the end of the 13th or the beginning of the 14th I commit to updating the base files.
Right thanks. Can you point me towards compressing/quantizing the base falcon 7b base/instruct model?
Sure!
try, if you have some problem tell me here
(I already updated instruct files)
You are right, Falcon now has a official support by HF!
no longer need Trust remote code. By the end of the 13th or the beginning of the 14th I commit to updating the base files.
@vilsonrodrigues where did you find this info? I was trying to load 40B / 7B instruct without trust_remote = True . Not sure how to do it . I've managed to load your model tho, works great :)
In the official repo on HF they comment on this. What I did was update the files to match theirs