pcuenq HF staff commited on
Commit
49431a8
1 Parent(s): 66747c1

Update README.md (#2)

Browse files

- Update README.md (776cc5a19415014dc99373b52225c6ed531cab27)

Files changed (1) hide show
  1. README.md +10 -6
README.md CHANGED
@@ -1,17 +1,22 @@
 
 
 
 
 
1
  # Core ML Stable Diffusion Mixed-Bit Palettization Resources
2
 
3
  This repository contains resources related to the use of [mixed-bit palettization techniques for Stable Diffusion](https://github.com/apple/ml-stable-diffusion#mbp). As explained in the original repo, this is an advanced compression technique that applies palettization using a varying number of bits per layer to keep quality above the desired threshold (as measured by the PSNR with respect to the original model). This can achieve strong space savings without resorting to learned quantization tables during fine-tuning.
4
 
5
  The repository contains the following resources:
6
 
7
- - [`recipes/`](tree/main/recipes). JSON files with results from the analysis phase [(Step 1 of the instructions)](https://github.com/apple/ml-stable-diffusion#mbp) on three popular Stable Diffusion models:
8
  * Stable Diffusion 1.5
9
  * Stable Diffusion 2.1 base
10
  * Stable Diffusion XL 1.0 base
11
 
12
  You can apply any of the available recipes on the appropriate model to experiment and compare results.
13
 
14
- - [`unet-mbp-sdxl-1-base/`](tree/main/unet-mbp-sdxl-1-base). Three pre-applied recipes on the UNet of Stable Diffusion XL 1.0 base:
15
 
16
  | Recipe | Effective bits | UNet size (GB) | Size reduction |
17
  |------------------------------|----------------|----------------|----------------|
@@ -19,9 +24,8 @@ You can apply any of the available recipes on the appropriate model to experimen
19
  | recipe_4_50_bit_mixedpalette | 4.50 | 1.4 | 71% |
20
  | recipe_6_55_bit_mixedpalette | 6.55 | 2.0 | 58% |
21
 
22
- - [`coreml-stable-diffusion-xl-base_mbp_4_50_palettized`]. A full pipeline of a Core ML version of Stable Diffusion XL 1.0 base, with the `recipe_4_50_bit_mixedpalette` recipe pre-applied to the UNet. You can download it to use in your own Core ML apps.
23
 
24
- - [`coreml-stable-diffusion-xl-base_mbp_4_50_palettized.zip`]. An archived version of the same pipeline, for use with [Hugging Face demo app](https://github.com/huggingface/swift-coreml-diffusers) and other third party tools.
25
-
26
- This repository was prepared by Apple and Hugging Face in July 2023, from experiments conducted on July 2023 using public beta versions of iOS 17.0, iPadOS 17.0 and macOS 14.0.
27
 
 
 
1
+ ---
2
+ license: openrail++
3
+ tags:
4
+ - core-ml
5
+ ---
6
  # Core ML Stable Diffusion Mixed-Bit Palettization Resources
7
 
8
  This repository contains resources related to the use of [mixed-bit palettization techniques for Stable Diffusion](https://github.com/apple/ml-stable-diffusion#mbp). As explained in the original repo, this is an advanced compression technique that applies palettization using a varying number of bits per layer to keep quality above the desired threshold (as measured by the PSNR with respect to the original model). This can achieve strong space savings without resorting to learned quantization tables during fine-tuning.
9
 
10
  The repository contains the following resources:
11
 
12
+ - [`recipes/`](https://huggingface.co/pcuenq/coreml-stable-diffusion-mixed-bit-palettization/tree/main/recipes). JSON files with results from the analysis phase [(Step 1 of the instructions)](https://github.com/apple/ml-stable-diffusion#mbp) on three popular Stable Diffusion models:
13
  * Stable Diffusion 1.5
14
  * Stable Diffusion 2.1 base
15
  * Stable Diffusion XL 1.0 base
16
 
17
  You can apply any of the available recipes on the appropriate model to experiment and compare results.
18
 
19
+ - [`unet-mbp-sdxl-1-base/`](https://huggingface.co/pcuenq/coreml-stable-diffusion-mixed-bit-palettization/tree/main/unet-mbp-sdxl-1-base). Three pre-applied recipes on the UNet of Stable Diffusion XL 1.0 base:
20
 
21
  | Recipe | Effective bits | UNet size (GB) | Size reduction |
22
  |------------------------------|----------------|----------------|----------------|
 
24
  | recipe_4_50_bit_mixedpalette | 4.50 | 1.4 | 71% |
25
  | recipe_6_55_bit_mixedpalette | 6.55 | 2.0 | 58% |
26
 
27
+ - [`coreml-stable-diffusion-xl-base_mbp_4_50_palettized`](https://huggingface.co/pcuenq/coreml-stable-diffusion-mixed-bit-palettization/tree/main/coreml-stable-diffusion-xl-base_mbp_4_50_palettized). A full pipeline of a Core ML version of Stable Diffusion XL 1.0 base, with the `recipe_4_50_bit_mixedpalette` recipe pre-applied to the UNet. You can download it to use in your own Core ML apps.
28
 
29
+ - [`coreml-stable-diffusion-xl-base_mbp_4_50_palettized.zip`](https://huggingface.co/pcuenq/coreml-stable-diffusion-mixed-bit-palettization/blob/main/coreml-stable-diffusion-xl-base_mbp_4_50_palettized.zip). An archived version of the same pipeline, for use with [Hugging Face demo app](https://github.com/huggingface/swift-coreml-diffusers) and other third party tools.
 
 
30
 
31
+ This repository was prepared by Apple and Hugging Face in July 2023, from experiments conducted using public beta versions of iOS 17.0, iPadOS 17.0 and macOS 14.0.