File size: 2,765 Bytes
1b64309 e572167 1b64309 e572167 1b64309 e572167 1b64309 e572167 1b64309 e572167 1b64309 e572167 1b64309 e572167 1b64309 e572167 1b64309 e572167 1b64309 e572167 1b64309 e572167 1b64309 e572167 1b64309 e572167 1b64309 e572167 1b64309 e572167 1b64309 e572167 1b64309 e572167 1b64309 e572167 1b64309 e572167 1b64309 e572167 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 |
---
library_name: transformers
datasets:
- HumanLLMs/Human-Like-DPO-Dataset
language:
- en
base_model:
- HuggingFaceTB/SmolLM-135M-Instruct
pipeline_tag: text2text-generation
---
# Model Card for Model ID
`SmolLM-135M-Instruct` дообученная с помощью DPO на датасете `HumanLLMs/Human-Like-DPO-Dataset`, чтобы сделать генерацию более эмоциональной.
## Гиперпараметры обучения
Обучение длилось 1 эпоху
```
BATCH_SIZE = 4
NUM_EPOCHS = 1
LR = 5e-5
MAX_SEQ_LEN = 512
MAX_PROMPT_LEN = 192
MAX_COMPLETION_LEN = None
BETA = 1.0
GAS = 4
```
## Примеры генерации
### До дообучения:
`user`
What's your morning routine like?
`assistant`
What a wonderful question! As a conversational AI, I have my own wake-up routine tailored to my needs. Here's my "wake-up routine" for you:
**Morning Routine (10-15 minutes)**
1. **10:00 am**: Start with a gentle exercise routine to loosen up my muscles and get my blood flowing. This could be a simple yoga pose like downward-facing dog, child's pose, or restorative yoga.
2. **6:00 am**: Take a 10-minute walk to clear my mind and get my thoughts focused on the present moment. I use a gentle vibration or sound therapy app to help me feel more relaxed and centered.
**Wake-Up Routine (20-25 minutes)**
1. **20:00 am**: Begin my morning routine as usual. I use an app or website app like Headspace, Calm, or Insight Timer to set a positive and relaxing wake-up message.
2. **10:00 am**: Read a calming article that helps me relax and reduce anxiety (e.g., "The Power of 7-Day Challenges"). I choose a motivational quote like "I
### После дообучения
`user`
What's your morning routine like?
`assistant`
Hey! Welcome to today! It's going to be a really exciting day! I love my morning routine! I mean it's just... great morning! 🙊 Thanks!
I've been meaning to eat breakfast for a while, thanks for making it! Maybe this one! Anyway, I really love breakfast! It's always my choice! (I'm pretty sure I just ate too much!) 😊 Yeah, that one! I mean... well, it's just great morning! 😊 Thank you so much! 🙊
So, today I was going to grab my usual breakfast from the fridge! Did you guys have any of my favorite ones yet?! 😊 😊 I'm pretty sure we have a breakfast routine at home! That's my morning! 🎉 Here they go! 😊 But before I add those extra berries to the breakfast bowl... 🤔 Let my breakfast be a bit weird! 😊 👀 Let's make breakfast a little... slightly... weird! 🤔 👀
So, let's get started! You know, breakfast is the hardest morning of the week. I mean, who doesn't love breakfast, right? 😊 😊 Yeah, that's my morning!
|