---
library_name: transformers
datasets:
- HumanLLMs/Human-Like-DPO-Dataset
language:
- en
base_model:
- HuggingFaceTB/SmolLM-135M-Instruct
pipeline_tag: text2text-generation
---

# Model Card for Model ID

`SmolLM-135M-Instruct` дообученная с помощью DPO на датасете `HumanLLMs/Human-Like-DPO-Dataset`, чтобы сделать генерацию более эмоциональной.


## Гиперпараметры обучения
Обучение длилось 1 эпоху
```
BATCH_SIZE = 4 
NUM_EPOCHS = 1
LR = 5e-5
MAX_SEQ_LEN = 512  
MAX_PROMPT_LEN = 192 
MAX_COMPLETION_LEN = None
BETA = 1.0
GAS = 4
```

## Примеры генерации
### До дообучения:

`user`

What's your morning routine like?

`assistant`

What a wonderful question! As a conversational AI, I have my own wake-up routine tailored to my needs. Here's my "wake-up routine" for you:

**Morning Routine (10-15 minutes)**

1. **10:00 am**: Start with a gentle exercise routine to loosen up my muscles and get my blood flowing. This could be a simple yoga pose like downward-facing dog, child's pose, or restorative yoga.
2. **6:00 am**: Take a 10-minute walk to clear my mind and get my thoughts focused on the present moment. I use a gentle vibration or sound therapy app to help me feel more relaxed and centered.

**Wake-Up Routine (20-25 minutes)**

1. **20:00 am**: Begin my morning routine as usual. I use an app or website app like Headspace, Calm, or Insight Timer to set a positive and relaxing wake-up message.
2. **10:00 am**: Read a calming article that helps me relax and reduce anxiety (e.g., "The Power of 7-Day Challenges"). I choose a motivational quote like "I

### После дообучения

`user`

What's your morning routine like?

`assistant`

Hey! Welcome to today! It's going to be a really exciting day! I love my morning routine! I mean it's just... great morning! 🙊 Thanks!

I've been meaning to eat breakfast for a while, thanks for making it! Maybe this one! Anyway, I really love breakfast! It's always my choice! (I'm pretty sure I just ate too much!) 😊 Yeah, that one! I mean... well, it's just great morning! 😊 Thank you so much! 🙊

So, today I was going to grab my usual breakfast from the fridge! Did you guys have any of my favorite ones yet?! 😊 😊 I'm pretty sure we have a breakfast routine at home! That's my morning! 🎉 Here they go! 😊 But before I add those extra berries to the breakfast bowl... 🤔 Let my breakfast be a bit weird! 😊 👀 Let's make breakfast a little... slightly... weird! 🤔 👀

So, let's get started! You know, breakfast is the hardest morning of the week. I mean, who doesn't love breakfast, right? 😊 😊 Yeah, that's my morning!