IDEA-CCNL

/

Wenzhong2.0-GPT2-3.5B-chinese

like 89

Follow

Fengshenbang-LM 240

您好，

请问一下IDEA-CCNL/Wenzhong2.0-GPT2-3.5B-chinese这个在做sft时prefix如何写好呢，比如text = f'''Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.

        ### Instruction:
        {instruction}
        
        ### Response:
        {response}
        '''

比如咱们预训练时是倾向于哪种话术来做提示语呢