ai-forever commited on
Commit
1207ecb
1 Parent(s): d773b26

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +60 -0
README.md ADDED
@@ -0,0 +1,60 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - Kandinsky
5
+ - text-image
6
+ - text2image
7
+ - diffusion
8
+ - latent diffusion
9
+ - mCLIP-XLMR
10
+ - mT5
11
+ ---
12
+
13
+ # Kandinsky 2.0
14
+
15
+
16
+ Kandinsky 2.0 — the first multilingual text2image model.
17
+
18
+ [Open In Colab](https://colab.research.google.com/drive/1uPg9KwGZ2hJBl9taGA_3kyKGw12Rh3ij?usp=sharing)
19
+
20
+ [GitHub repository](https://github.com/ai-forever/Kandinsky-2.0)
21
+
22
+ [Habr post](https://habr.com/ru/company/sberbank/blog/701162/)
23
+
24
+ [Demo](https://rudalle.ru/)
25
+
26
+ **UNet size: 1.2B parameters**
27
+
28
+ ![NatallE.png](https://s3.amazonaws.com/moonup/production/uploads/1669132577749-5f91b1208a61a359f44e1851.png)
29
+
30
+ It is a latent diffusion model with two multi-lingual text encoders:
31
+ * mCLIP-XLMR (560M parameters)
32
+ * mT5-encoder-small (146M parameters)
33
+
34
+
35
+ These encoders and multilingual training datasets unveil the real multilingual text2image generation experience!
36
+
37
+ ![header.png](https://s3.amazonaws.com/moonup/production/uploads/1669132825912-5f91b1208a61a359f44e1851.png)
38
+
39
+ # How to use
40
+
41
+ ```python
42
+ pip install "git+https://github.com/ai-forever/Kandinsky-2.0.git"
43
+
44
+ from kandinsky2 import get_kandinsky2
45
+ model = get_kandinsky2('cuda', task_type='text2img')
46
+ images = model.generate_text2img('кошка в космосе', batch_size=4, h=512, w=512, num_steps=75, denoised_type='dynamic_threshold', dynamic_threshold_v=99.5, sampler='ddim_sampler', ddim_eta=0.01, guidance_scale=10)
47
+ ```
48
+
49
+ # Authors
50
+
51
+ + Arseniy Shakhmatov: [Github](https://github.com/cene555), [Blog](https://t.me/gradientdip)
52
+ + Anton Razzhigaev: [Github](https://github.com/razzant), [Blog](https://t.me/abstractDL)
53
+ + Aleksandr Nikolich: [Github](https://github.com/AlexWortega), [Blog](https://t.me/lovedeathtransformers)
54
+ + Vladimir Arkhipkin: [Github](https://github.com/oriBetelgeuse)
55
+ + Igor Pavlov: [Github](https://github.com/boomb0om)
56
+ + Andrey Kuznetsov: [Github](https://github.com/kuznetsoffandrey)
57
+ + Denis Dimitrov: [Github](https://github.com/denndimitrov)
58
+
59
+
60
+