nico radu

Nicopara's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

commented a paper 6 months ago

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27 • 590 •

140

New activity in minosu/godot_dodo_4x_60k_starcoder_15b_2ep_ggml_q4_1 about 1 year ago

How do I prompt this model?

1

#1 opened about 1 year ago by Nicopara

New activity in mayank-mishra/starcoder-GPTQ-4bit-128g over 1 year ago

extreme slowdown and weird output.

9

#4 opened over 1 year ago by abhimortal6

New activity in smallcloudai/starcoder_15b_4bit over 1 year ago

How do i run this?

1

#1 opened over 1 year ago by Nicopara

New activity in TheBloke/Project-Baize-v2-13B-GPTQ over 1 year ago

Can't load the model on ooba

5

#1 opened over 1 year ago by Nicopara

New activity in mayank-mishra/starcoder-GPTQ-4bit-128g over 1 year ago

Anyway to load this with oobabooga?

3

#3 opened over 1 year ago by GamingDaveUK

New activity in ShipItMind/starcoder-gptq-4bit-128g over 1 year ago

model does not work on rocm

2

#1 opened over 1 year ago by Nicopara

New activity in catalpa/codecapybara-4bit-128g-gptq over 1 year ago

Generates garbage

1

#1 opened over 1 year ago by Nicopara