Sequence Length?
#4
by
gsaivinay
- opened
Hello,
Thanks for providing this. Awesome work.
The original model sequence length is 8192. Is the same length is used while converting to GPTQ?
Sorry for the delay. Yes it's 8K in GPTQ also
Thank you very much for your reply. Would you be able to provide the data set name used for the conversion? I'd like to replicate with different setting.
For the GPTQ? I used wikitext2
gsaivinay
changed discussion status to
closed