File size: 264 Bytes
4a0e15e
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
---
language:
- ru
tags:
- PyTorch
- Transformers
thumbnail: "https://github.com/sberbank-ai/ru-gpts"
---
# rugpt2large
Model was trained with sequence length 1024 using transformers by [SberDevices](https://sberdevices.ru/) team on 170Gb data on 64 GPUs 3 weeks.