dverdu-freepik
commited on
Commit
•
143c057
1
Parent(s):
5c69589
update readme
Browse files
README.md
CHANGED
@@ -60,13 +60,11 @@ image.save("output.png")
|
|
60 |
|
61 |
Inspired by [Ostris](https://ostris.com/2024/09/07/skipping-flux-1-dev-blocks/) findings, we analyzed the mean squared error (MSE) between the input and output of each block to quantify their contribution to the final result, revealing significant variability.
|
62 |
|
63 |
-
As Ostris pointed out, not all blocks contribute equally. While skipping just one of the early MMDiT blocks can significantly impact model performance, skipping the rest of the blocks does not have a significant impact over the final image quality.
|
64 |
-
|
65 |
![Flux.1 Lite generated image](sample_images/skip_blocks/generated_img.png)
|
66 |
![MSE MMDIT](sample_images/skip_blocks/mse_mmdit_img.png)
|
67 |
![MSE DIT](sample_images/skip_blocks/mse_dit_img.png)
|
68 |
|
69 |
-
|
70 |
|
71 |
![Skip one MMDIT block](sample_images/skip_blocks/skip_one_MMDIT_block.png)
|
72 |
![Skip one DIT block](sample_images/skip_blocks/skip_one_DIT_block.png)
|
|
|
60 |
|
61 |
Inspired by [Ostris](https://ostris.com/2024/09/07/skipping-flux-1-dev-blocks/) findings, we analyzed the mean squared error (MSE) between the input and output of each block to quantify their contribution to the final result, revealing significant variability.
|
62 |
|
|
|
|
|
63 |
![Flux.1 Lite generated image](sample_images/skip_blocks/generated_img.png)
|
64 |
![MSE MMDIT](sample_images/skip_blocks/mse_mmdit_img.png)
|
65 |
![MSE DIT](sample_images/skip_blocks/mse_dit_img.png)
|
66 |
|
67 |
+
As Ostris pointed out, not all blocks contribute equally. While skipping just one of the early MMDiT or late DiT blocks can significantly impact model performance, skipping any single block in between does not have a significant impact over the final image quality.
|
68 |
|
69 |
![Skip one MMDIT block](sample_images/skip_blocks/skip_one_MMDIT_block.png)
|
70 |
![Skip one DIT block](sample_images/skip_blocks/skip_one_DIT_block.png)
|