Hugging Face's logo

ikawrakow
/
llama-v2-2bit-gguf

GGUF
Inference Endpoints
Model card Files Community
1

run with llama cpp

#1
by rakmik - opened
Discussion
rakmik

run with llama cpp

https://github.com/werruww/llama-cpp-without-build/blob/main/succ_accident_llamacpp_zip1.ipynb

not run with lm studio

rakmik

need config.json for run in lmstudio or kopolod

rakmik

https://stackoverflow.com/questions/76863234/why-llama-2-7b-version-works-but-not-70b-version

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment