Continue from where you left off is not working
Hello
Need help with this and is really important for my project.
I'm sending a lot data for intelligent extraction to the model.
let's say I give the model 10 pages of data.
the model reply what I need until it stop due to timeout or whatever reason (this does not matter)
then I need the model to continue extracting data from where it left off, but the model just start over.
pseudo-post
Attempt 1:
{
"model": "MiniMax-Text-01",
"messages": [
{
"role": "system",
"name": "system",
"content": "..."
},
{
"role": "user",
"name": "user",
"content": "ten pages of data"
},
{
"role": "assistant",
"name": "assistant",
"content": "model previous reply"
}
],
"stream": true,
"max_tokens": 1000000,
"temperature": 0.5
}
Expected behavior: it should continue the stream from the very next word but it does not.
Current behavior: start over from the initial data.
Attempt 2:
{
"model": "MiniMax-Text-01",
"messages": [
{
"role": "system",
"name": "system",
"content": "..."
},
{
"role": "user",
"name": "user",
"content": "ten pages of data"
},
{
"role": "assistant",
"name": "assistant",
"content": "model previous reply"
},
{
"role": "user",
"name": "user",
"content": "continue"
}
],
"stream": true,
"max_tokens": 1000000,
"temperature": 0.5
}
COMBINATIONS TRIED:
[the last part of the reply] == the last 50 characters
"continue from where you left off"
"continue from here: [the last part of the reply]"
"DO NOT REPEAT your previous answer keep going and continue from where you left off"
"DO NOT REPEAT your previous answer keep going and continue from where you left off from here [the last part of the reply]"
Expected behavior: it should continue the stream from the very next word but it does not.
Current behavior: start over from the initial data.
Attempt 3:
{
"model": "MiniMax-Text-01",
"messages": [
{
"role": "system",
"name": "system",
"content": "..."
},
{
"role": "user",
"name": "user",
"content": "ten pages of data"
},
{
"role": "user",
"name": "user",
"content": "continue and other combinations"
},
{
"role": "assistant",
"name": "assistant",
"content": "model previous reply"
},
{
"role": "assistant",
"name": "assistant",
"content": "[the last part of the reply]"
}
],
"stream": true,
"max_tokens": 1000000,
"temperature": 0.5
}
Expected behavior: it should continue the stream from the very next word but it does not.
Current behavior: start over from the initial data.
and the same issue
if there is a way to force the model to continue the answer please help me how to do it.