Prompt Template Required?

#1
by Jeximo - opened

Hi, thanks in general :]

Usually I can mess with a model in llama.cpp with -i -ins, but this model produces craziness:

 hello. what's your name? whats your function?
Function(input)print('Hello {0} '.format(Input)) # 在中间定义的函数名,用于在程序结束时调用。
> hello?
Function(input
&gt#include <stringbuffer类中复制数据到指针str.hcout 输出到文件对象fstream ,把字符串在内存里 面做成一个链表

..different run below

> hello
 123
4.578960,3.75 - Test the code above and runningufile() on respective output respectively.
> hello?
”
This would truncate text chunks appended after the initial three characters ('“’), given
 RunningLength is >= 4, RunningStringCount = N+1 (as compared to running 
length running string count tracking respectively). Try surfingufile 
without runninglength runningstringcount

Do you know if the prompt template absolutely required?

I honestly don't know what the prompt template for this model is, or if it even has one.

The English examples in the README was just a categorisation prompt Hamlet->Shakespeare\nOne Hundred Years of Solitude->

Maybe it has been trained only to answer evaluation questions? But I'm afraid I don't know. Most of the documentation is in Chinese so it's hard to tell

You could try it with an MMLU question like this:

As Seller, an encyclopedia salesman, approached the grounds on which Hermit's house was situated,
he saw a sign that said, "No salesmen. Trespassers will be prosecuted. Proceed at your own risk."
Although Seller had not been invited to enter, he ignored the sign and drove up the driveway toward
the house. As he rounded a curve, a powerful explosive charge buried in the driveway exploded, and
Seller was injured. Can Seller recover damages from Hermit for his injuries?
(A) Yes, unless Hermit, when he planted the charge, intended only to deter, not harm, intruders.
(B) Yes, if Hermit was responsible for the explosive charge under the driveway.
(C) No, because Seller ignored the sign, which warned him against proceeding further.
(D) No, if Hermit reasonably feared that intruders would come and harm him or his family.

You could try it with an MMLU question like this:

As Seller, an encyclopedia salesman, approached the grounds on which Hermit's house was situated,
he saw a sign that said, "No salesmen. Trespassers will be prosecuted. Proceed at your own risk."
Although Seller had not been invited to enter, he ignored the sign and drove up the driveway toward
the house. As he rounded a curve, a powerful explosive charge buried in the driveway exploded, and
Seller was injured. Can Seller recover damages from Hermit for his injuries?
(A) Yes, unless Hermit, when he planted the charge, intended only to deter, not harm, intruders.
(B) Yes, if Hermit was responsible for the explosive charge under the driveway.
(C) No, because Seller ignored the sign, which warned him against proceeding further.
(D) No, if Hermit reasonably feared that intruders would come and harm him or his family.

Ill try that, thanks.

Jeximo changed discussion status to closed

Sign up or log in to comment