neo

neo-benjamin's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

New activity in TheBloke/Llama-2-13B-chat-GPTQ 6 months ago

torch.cuda.OutOfMemoryError: CUDA out of memory.

#50 opened 6 months ago by neo-benjamin

New activity in TheBloke/CodeLlama-13B-Instruct-GPTQ 8 months ago

GPTQ first

4

#1 opened 9 months ago by rabidaught

New activity in bigcode/starcoder 9 months ago

Can you run starcoder in a Mac book pro machine?

3

#83 opened 9 months ago by neo-benjamin

New activity in TheBloke/Llama-2-70B-Chat-GPTQ 10 months ago

How to set max_split_size_mb?

1

#30 opened 10 months ago by neo-benjamin

Load into 2 GPUs

3

#28 opened 10 months ago by sauravm8

70TB with multiple A5000

6

#21 opened 10 months ago by nashid

Why the input prompt is part of the output?

3

#25 opened 10 months ago by neo-benjamin

What does it mean by the inject_fused_attention disabled for 70B model?

1

#24 opened 10 months ago by neo-benjamin