Hugging Face's logo

Spaces:
chansung
/
co-write-with-llama2
Runtime error

App Files Community
7

Can I run this locally?

#2
by BBLL3456 - opened
Discussion
BBLL3456

Hi, this is an awesome tool! Can I run this locally? I will be switching it to a smaller model.

BBLL3456 changed discussion status to closed
chansung
 Owner

Hi @BBLL3456

sure thing.
currently, this application uses Hugging Face Inference API for text generation (w/ LLaMA2).
if you want to run it on local environment, you need to replace that part.

chansung changed discussion status to open
BBLL3456

Thanks very much! <3

chansung changed discussion status to closed
y3rawat

hello,
i am getting this error
File "C:\Users\YASH\AppData\Local\Programs\Python\Python311\Lib\site-packages\torch\cuda_init_.py", line 239, in _lazy_init
raise AssertionError("Torch not compiled with CUDA enabled")
AssertionError: Torch not compiled with CUDA enabled
what to do

chansung
 Owner

It seems like you didnt install cuda on your system or your system doesnt aware of cuda

Sign up or log in to comment