Increasing the model's predefined max length
#44
by
MLconArtist
- opened
So as the title says, is there a way to increase the model's predefined max length. I am using AutoGPTQ to run it on google colab and the revision I am using is the 4-bit-32g-Actorder_True