Junlin Zhou

#7 opened 3 months ago by

Chinglin

what different between the-stack-v2-train-full-ids and the-stack-v2-dedup

5

#2 opened 5 months ago by

shawn0wang

New activity in m-a-p/Matrix 2 months ago

Actual dataset size?

#4 opened 2 months ago by

jlzhou

New activity in cognitivecomputations/dolphin-2.9-llama3-70b 3 months ago

Instruct version please

#5 opened 3 months ago by

rjmehta

New activity in llava-hf/llava-1.5-13b-hf 3 months ago

What does low_cpu_mem_usage do?

#8 opened 3 months ago by

omgwenxx

New activity in TheBloke/deepseek-coder-33B-instruct-AWQ 3 months ago

Problem Running Model

13

#3 opened 9 months ago by

bezale

New activity in m-a-p/OpenCodeInterpreter-DS-6.7B 4 months ago

It seems that this model sometimes ignores user instruction

#12 opened 4 months ago by

jlzhou

New activity in tiiuae/falcon-180B 4 months ago

Start an API for falcon-180B

6

#22 opened 10 months ago by

DrLuttapi

New activity in Replete-AI/Mistral-Evolved-11b-v0.1 4 months ago

Add `chat_template` in tokenizer config

#3 opened 4 months ago by

jlzhou

New activity in m-a-p/OpenCodeInterpreter-DS-6.7B 4 months ago

Please create google Gemma-7b (8.5b) based version

12

#4 opened 5 months ago by

rombodawg

New activity in TheBloke/MistralLite-7B-GGUF 4 months ago

Dose HF-TGI support this GGUF version?

#2 opened 4 months ago by

gpt3eth

New activity in TheBloke/Llama-2-13B-chat-GPTQ 4 months ago

How to convert 4bit model back to fp16 data format?

#52 opened 5 months ago by

tremblingbrain

New activity in cognitivecomputations/dolphin-2.6-mistral-7b-dpo-laser 5 months ago

Add `chat_template` in tokenizer config

#11 opened 5 months ago by

jlzhou

New activity in TheBloke/Mistral-7B-Instruct-v0.1-GGUF 6 months ago

Poor Model Performance with Recommended Quantized Model

#21 opened 6 months ago by

nlpsingh

New activity in mistralai/Mistral-7B-v0.1 7 months ago

13b in the future?

9

#21 opened 10 months ago by deleted

New activity in TheBloke/SOLAR-10.7B-Instruct-v1.0-GGUF 7 months ago

No memory within model?

5

#3 opened 7 months ago by

jdc4429

New activity in Weyaxi/OpenHermes-2.5-neural-chat-7b-v3-2-7B 8 months ago

fix: missing suffix for system message

#1 opened 8 months ago by

jlzhou

New activity in Open-Orca/Mistral-7B-OpenOrca 9 months ago

Problem with streaming support

5

#17 opened 9 months ago by

mattma1970

New activity in TheBloke/Mistral-7B-OpenOrca-GPTQ 9 months ago

fix: quantize param in TGI example

#8 opened 9 months ago by

jlzhou

New activity in TheBloke/Llama-2-13B-chat-AWQ 10 months ago

any idea how to test this for inferencing using vllm?

#1 opened 10 months ago by

silvacarl

New activity in TheBloke/airoboros-33B-gpt4-1.4-GPTQ 10 months ago

Failed to run this model on A6000 48GB VRAM Machine

#3 opened 10 months ago by

Leegohi

New activity in tiiuae/falcon-40b-instruct 11 months ago

CPU or GPU

#76 opened 11 months ago by

lalit34

New activity in TheBloke/Llama-2-70B-fp16 12 months ago

How to quantise the model?

#2 opened 12 months ago by

szbigcat

New activity in TheBloke/upstage-llama-30b-instruct-2048-GPTQ 12 months ago

Does it increase inference speed on the same gpu?

#1 opened 12 months ago by

aibarito-ua

New activity in tiiuae/falcon-40b about 1 year ago

Getting HTTP Error Code: 422 when using Inference API

#96 opened about 1 year ago by

reetkat

New activity in tiiuae/falcon-40b-instruct about 1 year ago

Model sometimes generates '</s>'