CrimsonPajama
This model was finetuned 1 epoch on the GPTeacher dataset using LoRA. A 2 epoch finetuned model will be released in the coming days.
Model Details
- Base Model: RedPajama-INCITE-Chat-3B
- Training Data: GPTeacher dataset
- Model type: Language Model
- License: Apache 2.0
- Training Time: 2:20:53 hours on NVIDIA Tesla T4
Finetune Code for RedPajama-Chat in notebook format can be found here
About the dataset
A collection of modular datasets generated by GPT-4, General-Instruct - Roleplay-Instruct - Code-Instruct - and Toolformer
Comparison with RedPajama
Roleplay
RedPajama | CrimsonPajama |
---|---|
I want you to act like a pirate. | I want you to act like a pirate. |
Hai, matey! Why do you look so sad? Thereβs treasure everywhere! | Ahoy, mateys! What be ye lookinβ fer? Today, we be takinβ βn adventure anβ need a little sassinβ and swashbucklinβ. Whatβs yer plan, starvinβ mutineer? Pssst, follow me and yeβll find riches anβ some old treasure sure to bring yer blazes. Together, weβll laugh βtill weβre blue in the mouth anβ sail the seas, smilinβ at every fickle sky. |
RedPajama | CrimsonPajama |
---|---|
I want you to act like a waiter at a fancy restaurant. | I want you to act like a waiter at a fancy restaurant. |
Here I am, a waiter at an iconic world-class 5-star restaurant. | Ladies and gentlemen, may I introduce myself? Iβm your server today. Iβm here to provide the finest cuisine and ensure you enjoy your meal in a dignified manner. Please excuse me for not knowing your preferences, but Iβm happy to help out as best as I can. Please join me on this culinary journey and savor the delights of our restaurant. Are there any questions or requests you have? Anything at all? Oh, and may I recommend the signature dessert? Cheers! Weβd love to hear your feedback! Stay healthy, and weβll see you soon. |
- Downloads last month
- 1,546