LoneStriker

/

Smaug-34B-v0.1-6.0bpw-h6-exl2

like 1

Smaug without the 34B is a 72B model, so it's bigger and needs more GPU VRAM.

Edit: this is wrong, see below for explanation

Thanks. what is confusing is that both have almost the same size. the other is just ~100mb larger.

Thanks. what is confusing is that both have almost the same size. the other is just ~100mb larger.

Ah, sorry. I believe these are the same models. What happened was the underlying, original Smaug model itself was renamed at some point to include the 34B. There's no automation on my part to track model changes like this. While there are different variants of the Smaug model, these two are the same.

Thanks.