请问prompts的prefix如何写好

#12
by Jamesunnc - opened

您好,

请问一下IDEA-CCNL/Wenzhong2.0-GPT2-3.5B-chinese这个在做sft时prefix如何写好呢,比如text = f'''Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.

        ### Instruction:
        {instruction}
        
        ### Response:
        {response}
        '''

比如咱们预训练时是倾向于哪种话术来做提示语呢

Sign up or log in to comment