TheBloke
/

Llama-2-7B-Chat-GGUF

Text Generation

text-generation-inference

Model card Files Files and versions Community

Resources

View closed (1)

Trying to use llama-2-7b-chat.Q4_K_M.gguf with/without tensorflow weights

#33 opened about 1 month ago by

Fine tuning

#32 opened about 1 month ago by

How to know which bit model deploying using sagemaker

#31 opened about 1 month ago by

GGUF Model not loading at all

#30 opened about 1 month ago by

Waiting for Meta-Llama-3-8B-Instruct-gguf

#29 opened about 1 month ago by

Local model changing in model.py

#28 opened about 2 months ago by

Update Discord Invite link

#27 opened 2 months ago by

Refer the model on HuggingFace

#26 opened 3 months ago by

how to deal with number of tokens exceeded maximum context length

#25 opened 3 months ago by

Connect to vector store through azure ai search index

#24 opened 3 months ago by

Help with llama-2-7b-chat.Q4_K_M.gguf already in local downloads

#23 opened 3 months ago by

401 authentication error

#22 opened 3 months ago by

Why "llama-2-7b-chat.Q8_0.gguf" model is not recommended

#21 opened 4 months ago by

RMSNorm eps value is wrong

#20 opened 4 months ago by

RMSNorm eps value is wrong

#19 opened 4 months ago by

Problem while making multiple request at a time from seperate chat bot instances

#18 opened 4 months ago by

Model is responding for out of context answer also need to know from where its taking the answer?

#17 opened 5 months ago by

[AUTOMATED] Model Memory Requirements

#16 opened 6 months ago by

model-sizer-bot

Is there any linguistic model that supports the Arabic language?

#15 opened 6 months ago by

How to use system prompts?

#14 opened 7 months ago by

Produced Output Stability

#13 opened 7 months ago by

proper embedding for llama-2-7b-chat.Q4_K_M.gguf

#12 opened 7 months ago by

"TheBloke/Llama-2-7b-Chat-GGUF does not appear to have a file named pytorch_model.bin, tf_model.h5, model.ckpt or flax_model.msgpack."

#11 opened 7 months ago by

Running locally: Cannot load model "llama-2-7b-chat.Q2_K.gguf"

#10 opened 7 months ago by

Check the model's maximum input value

#9 opened 8 months ago by

Error while using CTransformers: Model file 'llama-2-7b-chat.q4_K_M.gguf' not found

#7 opened 8 months ago by

error loading model: GGUF with latest llama_cpp_python 0.2.11

#6 opened 8 months ago by

What model and minimum gpu requirements are required for PDF-QA?

#5 opened 8 months ago by

This model giving the correct answer but twice

#4 opened 8 months ago by

Llama 2 GGUF streaming support?

#3 opened 8 months ago by

Inconsistent Model Name

#2 opened 8 months ago by

Error with runpod

#1 opened 9 months ago by