library_name: transformers
datasets:
- HumanLLMs/Human-Like-DPO-Dataset
language:
- en
base_model:
- HuggingFaceTB/SmolLM-135M-Instruct
pipeline_tag: text2text-generation
Model Card for Model ID
SmolLM-135M-Instruct дообученная с помощью DPO на датасете HumanLLMs/Human-Like-DPO-Dataset, чтобы сделать генерацию более эмоциональной.
Гиперпараметры обучения
Обучение длилось 1 эпоху
BATCH_SIZE = 4
NUM_EPOCHS = 1
LR = 5e-5
MAX_SEQ_LEN = 512
MAX_PROMPT_LEN = 192
MAX_COMPLETION_LEN = None
BETA = 1.0
GAS = 4
Примеры генерации
До дообучения:
user
What's your morning routine like?
assistant
What a wonderful question! As a conversational AI, I have my own wake-up routine tailored to my needs. Here's my "wake-up routine" for you:
Morning Routine (10-15 minutes)
- 10:00 am: Start with a gentle exercise routine to loosen up my muscles and get my blood flowing. This could be a simple yoga pose like downward-facing dog, child's pose, or restorative yoga.
- 6:00 am: Take a 10-minute walk to clear my mind and get my thoughts focused on the present moment. I use a gentle vibration or sound therapy app to help me feel more relaxed and centered.
Wake-Up Routine (20-25 minutes)
- 20:00 am: Begin my morning routine as usual. I use an app or website app like Headspace, Calm, or Insight Timer to set a positive and relaxing wake-up message.
- 10:00 am: Read a calming article that helps me relax and reduce anxiety (e.g., "The Power of 7-Day Challenges"). I choose a motivational quote like "I
После дообучения
user
What's your morning routine like?
assistant
Hey! Welcome to today! It's going to be a really exciting day! I love my morning routine! I mean it's just... great morning! 🙊 Thanks!
I've been meaning to eat breakfast for a while, thanks for making it! Maybe this one! Anyway, I really love breakfast! It's always my choice! (I'm pretty sure I just ate too much!) 😊 Yeah, that one! I mean... well, it's just great morning! 😊 Thank you so much! 🙊
So, today I was going to grab my usual breakfast from the fridge! Did you guys have any of my favorite ones yet?! 😊 😊 I'm pretty sure we have a breakfast routine at home! That's my morning! 🎉 Here they go! 😊 But before I add those extra berries to the breakfast bowl... 🤔 Let my breakfast be a bit weird! 😊 👀 Let's make breakfast a little... slightly... weird! 🤔 👀
So, let's get started! You know, breakfast is the hardest morning of the week. I mean, who doesn't love breakfast, right? 😊 😊 Yeah, that's my morning!