Shuyue Jia (Bruce)

shuyuej's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in meta-llama/Llama-3.3-70B-Instruct 3 months ago

What Happens If the Prompt Exceeds 8,196 Tokens? And difference between input limit and context length limit?

2

#36 opened 3 months ago by

averyyu99

quant versions?

1

#12 opened 3 months ago by

apol

New activity in TheBloke/h2ogpt-research-oasst1-llama-65B-GPTQ 3 months ago

RecursionError: maximum recursion depth exceeded

1

#1 opened over 1 year ago by

WajihUllahBaig

New activity in shuyuej/e5-mistral-7b-instruct-GPTQ 7 months ago

missing model.safetensors.index.json

3

#1 opened 7 months ago by

kresimirfijacko

New activity in shuyuej/Mistral-Nemo-Instruct-2407-GPTQ 7 months ago

Can you create gptq 8 bits quants?

1

#1 opened 7 months ago by

rjmehta

New activity in hugging-quants/Meta-Llama-3.1-405B-Instruct-GPTQ-INT4 7 months ago

Can you provide one model using `group_size=1024` to make the model smaller?

#15 opened 7 months ago by

shuyuej

OOM Error

#13 opened 7 months ago by

shuyuej

Update quantize_config.json

1

#12 opened 7 months ago by

shuyuej

Update config.json

1

#11 opened 7 months ago by

shuyuej

Source codes to quantize the LLaMA 3.1 405B model

3

#10 opened 7 months ago by

shuyuej

New activity in hugging-quants/Meta-Llama-3.1-70B-Instruct-GPTQ-INT4 8 months ago

Request for Mistral Large Instruct GPTQ INT4

4

#2 opened 8 months ago by

sparsh35

New activity in mistralai/Mamba-Codestral-7B-v0.1 8 months ago

Missing config.json

5

#6 opened 8 months ago by

wxl2001

New activity in openerotica/c4ai-command-r-plus-GPTQ-ERQ 8 months ago

Where can we download `quant.py`?

1

#1 opened 8 months ago by

shuyuej

New activity in CohereForAI/c4ai-command-r-v01 8 months ago

Learning Rate during pretraining

1

#58 opened 8 months ago by

shuyuej

New activity in Salesforce/SFR-Embedding-2_R 8 months ago

About the tokenizer - Why use LLaMA tokenizer?

#5 opened 8 months ago by

shuyuej

New activity in NovaSearch/stella_en_1.5B_v5 8 months ago

Model max_seq_length

7

#6 opened 8 months ago by

shuyuej

New activity in Salesforce/SFR-Embedding-2_R 8 months ago

Model max_seq_length

1

#4 opened 8 months ago by

shuyuej

New activity in openlifescienceai/open_medical_llm_leaderboard 9 months ago

Where can we find `eval_medical_llm.py` and `main.py`

1

#15 opened 9 months ago by

shuyuej

New activity in google/gemma-7b 10 months ago

Fine-Tune a gemma model for question answering

17

#62 opened about 1 year ago by

Iamexperimenting

New activity in google/gemma-7b 11 months ago

Weird Performance Issue with Gemma-7b compared to Gemma-2b with Qlora

6

#91 opened 11 months ago by

UserDAN