Inquiries related to data length

by bakch92 - opened Jan 15

Jan 15

The maximum assistant length of the data set is confirmed to be 97015, but the maximum sequence length of the Qwen2.5-32B-Instruct model appears to be 32768.
When fine tuning, was the data set trained as is without any preprocessing?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment