What is the max sequence length for instruct and for chat?

#3
by RonanMcGovern - opened

In general, where can I find this information on models?

I believe the context window is 2048 tokens.

Thanks @kjhanjee , I realised afterwards that the sequence length is in the config file. Closing this off, appreciate the help.

RonanMcGovern changed discussion status to closed

Sign up or log in to comment