TheBloke
/

Marcoroni-7B-v3-AWQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Context length

#1

by prudant - opened Dec 14, 2023

prudant

Dec 14, 2023

Hi, great work!
how much is the maximum context length of the awq quant model?
regards!

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment