---
language:
- ru
---

On current step fine-tune seems to break LLM states:(

Model encoder: facebook/deit-base-distilled-patch16-384
Model decoder: DeepPavlov/rubert-base-cased