Quantized versions please?

by siddhesh22 - opened Mar 7

Mar 7

Hey guys, I only have a RTX 3060 and I'm very excited to run this. Would appreciate if you guys post a GGUF or EXL2 quantized version. Thanks in advance.

Xidong

FreedomAI org Mar 7

Thank you for your support. The quantitative version will be updated next Monday. There have been a lot of things recently. We are very sorry for the delay.

eleius

Mar 19

I'm also interested, hope to see a GGUF version if possible, thanks.

Xidong

FreedomAI org Mar 22

Please refer to https://huggingface.co/FreedomIntelligence/Apollo-7B-GGUF, sorry for late update.

Xidong changed discussion status to closed Mar 28

blankreg

Apr 21

More quants are available at https://huggingface.co/mradermacher/Apollo-7B-GGUF

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment