PyTorch
style-transfer
face-stylization
trysem hysts HF staff commited on
Commit
892b661
0 Parent(s):

Duplicate from CVPR/DualStyleGAN

Browse files

Co-authored-by: hysts <hysts@users.noreply.huggingface.co>

.gitattributes ADDED
@@ -0,0 +1,28 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.npy filter=lfs diff=lfs merge=lfs -text
2
+ *.7z filter=lfs diff=lfs merge=lfs -text
3
+ *.arrow filter=lfs diff=lfs merge=lfs -text
4
+ *.bin filter=lfs diff=lfs merge=lfs -text
5
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.model filter=lfs diff=lfs merge=lfs -text
12
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
13
+ *.onnx filter=lfs diff=lfs merge=lfs -text
14
+ *.ot filter=lfs diff=lfs merge=lfs -text
15
+ *.parquet filter=lfs diff=lfs merge=lfs -text
16
+ *.pb filter=lfs diff=lfs merge=lfs -text
17
+ *.pt filter=lfs diff=lfs merge=lfs -text
18
+ *.pth filter=lfs diff=lfs merge=lfs -text
19
+ *.rar filter=lfs diff=lfs merge=lfs -text
20
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
21
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
22
+ *.tflite filter=lfs diff=lfs merge=lfs -text
23
+ *.tgz filter=lfs diff=lfs merge=lfs -text
24
+ *.wasm filter=lfs diff=lfs merge=lfs -text
25
+ *.xz filter=lfs diff=lfs merge=lfs -text
26
+ *.zip filter=lfs diff=lfs merge=lfs -text
27
+ *.zstandard filter=lfs diff=lfs merge=lfs -text
28
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,43 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ library_name: pytorch
4
+ tags:
5
+ - style-transfer
6
+ - face-stylization
7
+ datasets:
8
+ - cartoon
9
+ - caricature
10
+ - anime
11
+ - pixar
12
+ - slamdunk
13
+ - arcane
14
+ - comic
15
+ duplicated_from: CVPR/DualStyleGAN
16
+ ---
17
+
18
+ ## Model Details
19
+
20
+ This system provides a web demo for the following paper:
21
+
22
+ **Pastiche Master: Exemplar-Based High-Resolution Portrait Style Transfer (CVPR 2022)**
23
+
24
+ - Algorithm developed by: Shuai Yang, Liming Jiang, Ziwei Liu and Chen Change Loy
25
+ - Web demo developed by: [hysts](https://huggingface.co/hysts)
26
+ - Resources for more information:
27
+ - [Project Page](https://www.mmlab-ntu.com/project/dualstylegan/)
28
+ - [Research Paper](https://arxiv.org/abs/2203.13248)
29
+ - [GitHub Repo](https://github.com/williamyang1991/DualStyleGAN)
30
+
31
+ **Abstract**
32
+ > Recent studies on StyleGAN show high performance on artistic portrait generation by transfer learning with limited data. In this paper, we explore more challenging exemplar-based high-resolution portrait style transfer by introducing a novel DualStyleGAN with flexible control of dual styles of the original face domain and the extended artistic portrait domain. Different from StyleGAN, DualStyleGAN provides a natural way of style transfer by characterizing the content and style of a portrait with an intrinsic style path and a new extrinsic style path, respectively. The delicately designed extrinsic style path enables our model to modulate both the color and complex structural styles hierarchically to precisely pastiche the style example. Furthermore, a novel progressive fine-tuning scheme is introduced to smoothly transform the generative space of the model to the target domain, even with the above modifications on the network architecture. Experiments demonstrate the superiority of DualStyleGAN over state-of-the-art methods in high-quality portrait style transfer and flexible style control.
33
+
34
+
35
+ ## Citation Information
36
+ ```bibtex
37
+ @inproceedings{yang2022Pastiche,
38
+  author = {Yang, Shuai and Jiang, Liming and Liu, Ziwei and and Loy, Chen Change},
39
+  title = {Pastiche Master: Exemplar-Based High-Resolution Portrait Style Transfer},
40
+  booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
41
+  year = {2022}
42
+ }
43
+ ```
models/anime/exstyle_code.npy ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:31465bcb616bce061d973d794443a800eb96fb58633ed563494e91d2bd530617
3
+ size 6428496
models/anime/generator.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7336adf17ddb45ebfb64b76a86f8d3986df6482313fd1b0716013b1a8b743056
3
+ size 307988244
models/anime/refined_exstyle_code.npy ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:09d3022b12d96e02c888babc02ca7288bc169f2b282f1e2de29fc4d5816314b9
3
+ size 6428496
models/anime/sampler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6d892c805992f1b434b5dd632d1a90ae4ac616b0119cd13a9a5d6ace5962114a
3
+ size 4997529
models/arcane/exstyle_code.npy ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:437d2fdd0bb9bf7337a59db515a356de0527fe49e926ab10052e16a01153d026
3
+ size 3694721
models/arcane/generator.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c9b3b8c1a300911299e66e07a656333ba85ac79e1ff04a55e9357d0f915b5e6a
3
+ size 307988244
models/arcane/sampler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d402f3fff0523983b962b32ad54a7ab3d4f70cbb0c1676fba1eaba96eee3b1f9
3
+ size 4997529
models/caricature/exstyle_code.npy ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:528dd3e6d331daa5d0848dd94fccbca50b1bb3f1daa3ce3f717734bcc155d20d
3
+ size 7354601
models/caricature/generator.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:25ca1d3b5d281c880136d812176304e842d060e8cf6403d51ea637bb3cdcd9e3
3
+ size 307988244
models/caricature/refined_exstyle_code.npy ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:29fd9d6609458690fb4ea85a2456dd251c2db6bf41f0f9a9ca868e5100f08b49
3
+ size 7354601
models/caricature/sampler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c5904238bcda699f70d744ff8c723a274410562d1d04a75eb963c1b20ee3faa6
3
+ size 4997529
models/cartoon/exstyle_code.npy ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:12a51461a56b5640435f9d428e18676096a10c11dc4cb3c193cbd68cfb4972dc
3
+ size 11714990
models/cartoon/generator.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:de40db8bc79db5184f65b91a3fd710e2806d3010903cd9af754c9906b38edd8f
3
+ size 307988244
models/cartoon/refined_exstyle_code.npy ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b8ccd6be0154c233920b7694dbb20c8353ab3f5bd33a426a18eb2702e2f8d068
3
+ size 11714990
models/cartoon/sampler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e477698efdcbc8b5f4a57c017ca64369ca9bb429eecc11500283d8b2ae7b2d2e
3
+ size 4997529
models/comic/exstyle_code.npy ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b901ffeed34bfae885a3481cabb7574481f3d9de57bb0e000c916f969bcd871a
3
+ size 3731118
models/comic/generator.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1221f44422239c7d0c56464ebfe19880ee0aac694c2ba5b728875486a1261d2e
3
+ size 307988244
models/comic/sampler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b4398f5783f7adf5ede865b7d827b744ea3613d8185517ee9d1f7c69001d87f9
3
+ size 4997529
models/encoder.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:264f263987efb847f1ff2f2bf729178d0ee25a6d65731f5a4d194de2c3ba3507
3
+ size 1201660560
models/generator-pretrain.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:124da354f099f26d649c9f9c7d761b2a9d8b75cb85493503b3e1dc2a3985d582
3
+ size 1314687837
models/pixar/exstyle_code.npy ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d0bd9447e7bbccc918106f780e471bd309ad0d416752e82e7781f60a4558e34f
3
+ size 4506989
models/pixar/generator.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0f68d75f297ba2614944e5ca7ad96e798f74b3ef0f6dfc74e6c5170f8983ac8b
3
+ size 307988244
models/pixar/sampler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:521826dc5b881d00936e456f340082f0a33f21219f6f2e72efe71314261a519a
3
+ size 4997529
models/slamdunk/exstyle_code.npy ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e37b340fac788924813529ced3deedffe070f4c8bbc9c820723c7e25510802fc
3
+ size 4433133
models/slamdunk/generator.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:784c1fee8621f91a1c06af4b0fd9ed4cf6e436e884fa62d85bf8c766ac98df71
3
+ size 307988244
models/slamdunk/sampler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d1d218849d7e7a310e799a2e043b53992e42d0c571ee800b6d194da16d1b19aa
3
+ size 4997529