inu-ai
/

alpaca-guanaco-japanese-gpt-1b

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

inu-ai commited on Apr 12, 2023

Commit

8035c99

•

1 Parent(s): 640e70f

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -65,8 +65,8 @@ def generate_response(role_instruction, conversation_history, new_conversation):
         if n + MAX_ASSISTANT_LENGTH <= MAX_INPUT_LENGTH:
             break
         else:
-            conversation_history.pop()
-            conversation_history.pop()
     with torch.no_grad():
         output_ids = model.generate(

         if n + MAX_ASSISTANT_LENGTH <= MAX_INPUT_LENGTH:
             break
         else:
+            conversation_history.pop(0)
+            conversation_history.pop(0)
     with torch.no_grad():
         output_ids = model.generate(