See the model evaluation on intel's low-bit leaderboard, its not that good

by xceptor - opened May 16

May 16

Here is the link

3thn

Crusoe AI org May 16

Thanks for the heads up! I think the results make the case to add intel's autoround quants to our generation pipeline.

3thn changed discussion status to closed May 16

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment