nico radu

Nicopara's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

commented a paper about 1 year ago

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27, 2024 • 610 •

142

New activity in minosu/godot_dodo_4x_60k_starcoder_15b_2ep_ggml_q4_1 over 1 year ago

How do I prompt this model?

1

#1 opened over 1 year ago by

Nicopara

New activity in mayank-mishra/starcoder-GPTQ-4bit-128g almost 2 years ago

extreme slowdown and weird output.

9

#4 opened almost 2 years ago by

abhimortal6

New activity in smallcloudai/starcoder_15b_4bit almost 2 years ago

How do i run this?

1

#1 opened almost 2 years ago by

Nicopara

New activity in TheBloke/Project-Baize-v2-13B-GPTQ almost 2 years ago

Can't load the model on ooba

5

#1 opened almost 2 years ago by

Nicopara

New activity in mayank-mishra/starcoder-GPTQ-4bit-128g almost 2 years ago

Anyway to load this with oobabooga?

3

#3 opened almost 2 years ago by

GamingDaveUK

New activity in ShipItMind/starcoder-gptq-4bit-128g almost 2 years ago

model does not work on rocm

2

#1 opened almost 2 years ago by

Nicopara

New activity in catalpa/codecapybara-4bit-128g-gptq almost 2 years ago

Generates garbage

1

#1 opened almost 2 years ago by

Nicopara

New activity in ShipItMind/starcoder-gptq-4bit-128g almost 2 years ago

model does not work on rocm

2

#1 opened almost 2 years ago by

Nicopara