ddw2AIGROUP2CQUPT commited on
Commit
297973e
Β·
verified Β·
1 Parent(s): f53076c

Upload 11 files

Browse files
.gitattributes CHANGED
@@ -33,3 +33,6 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ assets/demo.mp4 filter=lfs diff=lfs merge=lfs -text
37
+ assets/facecaption.png filter=lfs diff=lfs merge=lfs -text
38
+ assets/illfacecaption.png filter=lfs diff=lfs merge=lfs -text
.gitignore ADDED
@@ -0,0 +1,171 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Byte-compiled / optimized / DLL files
2
+ __pycache__/
3
+ *.py[cod]
4
+ *$py.class
5
+
6
+ # C extensions
7
+ *.so
8
+
9
+ # Distribution / packaging
10
+ .Python
11
+ build/
12
+ develop-eggs/
13
+ dist/
14
+ downloads/
15
+ eggs/
16
+ .eggs/
17
+ lib/
18
+ lib64/
19
+ parts/
20
+ sdist/
21
+ var/
22
+ wheels/
23
+ share/python-wheels/
24
+ *.egg-info/
25
+ .installed.cfg
26
+ *.egg
27
+ MANIFEST
28
+
29
+ # PyInstaller
30
+ # Usually these files are written by a python script from a template
31
+ # before PyInstaller builds the exe, so as to inject date/other infos into it.
32
+ *.manifest
33
+ *.spec
34
+
35
+ # Installer logs
36
+ pip-log.txt
37
+ pip-delete-this-directory.txt
38
+
39
+ # Unit test / coverage reports
40
+ htmlcov/
41
+ .tox/
42
+ .nox/
43
+ .coverage
44
+ .coverage.*
45
+ .cache
46
+ nosetests.xml
47
+ coverage.xml
48
+ *.cover
49
+ *.py,cover
50
+ .hypothesis/
51
+ .pytest_cache/
52
+ cover/
53
+
54
+ # Translations
55
+ *.mo
56
+ *.pot
57
+
58
+ # Django stuff:
59
+ *.log
60
+ local_settings.py
61
+ db.sqlite3
62
+ db.sqlite3-journal
63
+
64
+ # Flask stuff:
65
+ instance/
66
+ .webassets-cache
67
+
68
+ # Scrapy stuff:
69
+ .scrapy
70
+
71
+ # Sphinx documentation
72
+ docs/_build/
73
+
74
+ # PyBuilder
75
+ .pybuilder/
76
+ target/
77
+
78
+ # Jupyter Notebook
79
+ .ipynb_checkpoints
80
+
81
+ # IPython
82
+ profile_default/
83
+ ipython_config.py
84
+
85
+ # pyenv
86
+ # For a library or package, you might want to ignore these files since the code is
87
+ # intended to run in multiple environments; otherwise, check them in:
88
+ # .python-version
89
+
90
+ # pipenv
91
+ # According to pypa/pipenv#598, it is recommended to include Pipfile.lock in version control.
92
+ # However, in case of collaboration, if having platform-specific dependencies or dependencies
93
+ # having no cross-platform support, pipenv may install dependencies that don't work, or not
94
+ # install all needed dependencies.
95
+ #Pipfile.lock
96
+
97
+ # UV
98
+ # Similar to Pipfile.lock, it is generally recommended to include uv.lock in version control.
99
+ # This is especially recommended for binary packages to ensure reproducibility, and is more
100
+ # commonly ignored for libraries.
101
+ #uv.lock
102
+
103
+ # poetry
104
+ # Similar to Pipfile.lock, it is generally recommended to include poetry.lock in version control.
105
+ # This is especially recommended for binary packages to ensure reproducibility, and is more
106
+ # commonly ignored for libraries.
107
+ # https://python-poetry.org/docs/basic-usage/#commit-your-poetrylock-file-to-version-control
108
+ #poetry.lock
109
+
110
+ # pdm
111
+ # Similar to Pipfile.lock, it is generally recommended to include pdm.lock in version control.
112
+ #pdm.lock
113
+ # pdm stores project-wide configurations in .pdm.toml, but it is recommended to not include it
114
+ # in version control.
115
+ # https://pdm.fming.dev/latest/usage/project/#working-with-version-control
116
+ .pdm.toml
117
+ .pdm-python
118
+ .pdm-build/
119
+
120
+ # PEP 582; used by e.g. github.com/David-OConnor/pyflow and github.com/pdm-project/pdm
121
+ __pypackages__/
122
+
123
+ # Celery stuff
124
+ celerybeat-schedule
125
+ celerybeat.pid
126
+
127
+ # SageMath parsed files
128
+ *.sage.py
129
+
130
+ # Environments
131
+ .env
132
+ .venv
133
+ env/
134
+ venv/
135
+ ENV/
136
+ env.bak/
137
+ venv.bak/
138
+
139
+ # Spyder project settings
140
+ .spyderproject
141
+ .spyproject
142
+
143
+ # Rope project settings
144
+ .ropeproject
145
+
146
+ # mkdocs documentation
147
+ /site
148
+
149
+ # mypy
150
+ .mypy_cache/
151
+ .dmypy.json
152
+ dmypy.json
153
+
154
+ # Pyre type checker
155
+ .pyre/
156
+
157
+ # pytype static type analyzer
158
+ .pytype/
159
+
160
+ # Cython debug symbols
161
+ cython_debug/
162
+
163
+ # PyCharm
164
+ # JetBrains specific template is maintained in a separate JetBrains.gitignore that can
165
+ # be found at https://github.com/github/gitignore/blob/main/Global/JetBrains.gitignore
166
+ # and can be added to the global gitignore or merged into this file. For a more nuclear
167
+ # option (not recommended) you can uncomment the following to ignore the entire idea folder.
168
+ #.idea/
169
+
170
+ # PyPI configuration file
171
+ .pypirc
README.md ADDED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # FaceMaker-V0
2
+
3
+ ## News and Update πŸ”₯πŸ”₯πŸ”₯
4
+
5
+ - Dec.28, 2024. **[FaceMaker-V0](https://github.com/ddw2AIGROUP2CQUPT/Face-MakeUp), is released!πŸ‘πŸ‘πŸ‘**
6
+
7
+
8
+
9
+ ## Demo
10
+
11
+
12
+
13
+ https://github.com/user-attachments/assets/392f4f86-92e2-4c28-b8a7-fb724b098678
14
+
15
+
16
+
17
+ ## FaceCaptionHQ-4M
18
+
19
+ We constructed a large-scale facial image-text dataset for facial image generation task.
20
+
21
+ [![facecaption](assets/facecaption.png)](https://huggingface.co/datasets/OpenFace-CQUPT/FaceCaption-15M)
22
+
23
+ ## Model
24
+
25
+ ![Model](assets/Model.png)
26
+
27
+ ## Results
28
+ **Unsplash-Face**
29
+
30
+ | Method | CLIP-T ↑ | CLIP-I ↑ | DINO ↑ | FaceSim ↑ | FID ↓ | Attr_c ↑ | VLM-score ↑ |
31
+ | ----------------- | -------- | -------- | -------- | --------- | --------- | -------- | ----------- |
32
+ | Ip-Adapter.(2023) | 27.7 | 64.9 | 37.6 | 53.2 | 226.9 | 3.0 | 65.3 |
33
+ | PhotoMaker.(2023) | 28.2 | 56.5 | 26.2 | 20.7 | 224.4 | 2.2 | 60.1 |
34
+ | InstantID.(2024) | 24.8 | 78.0 | 49.4 | **71.2** | 178.7 | 3.8 | 54.8 |
35
+ | Pulid.(2024) | **29.3** | 46.3 | 21.0 | 24.3 | 284.5 | 2.4 | 36.5 |
36
+ | Ours | 22.3 | **82.1** | **73.2** | 69.2 | **130.1** | **4.0** | **79.6** |
37
+
38
+ **FaceCaption**
39
+
40
+ | Method | CLIP-T ↑ | CLIP-I ↑ | DINO ↑ | FaceSim ↑ | FID ↓ | Attr_c ↑ | VLM-score ↑ |
41
+ | ----------------- | --------- | -------- | -------- | --------- | -------- | -------- | ----------- |
42
+ | Ip-Adapter.(2023) | 26.78 | 69.7 | 48.0 | 59.2 | 195.4 | 3.2 | 63.2 |
43
+ | PhotoMaker.(2023) | 28.12 | 50.5 | 25.9 | 22.1 | 237.6 | 2.2 | 54.5 |
44
+ | InstantID.(2024) | 24.29 | 67.2 | 50.1 | 75.5 | 166.5 | 5.3 | 53.7 |
45
+ | Pulid.(2024) | **29.21** | 36.2 | 13.2 | 22.8 | 298.5 | 2.1 | 43.5 |
46
+ | Ours | 21.96 | **87.4** | **79.4** | **77.8** | **95.4** | **6.3** | **73.1** |
assets/Identity_mixing.png ADDED
assets/Illustrations_of various_model_on_recontextualization_task.png ADDED
assets/Illustrations_of_our_Face-MakeUp.png ADDED
assets/Illustrations_of_various_on_identity_mixing(a)and_old2new(b)..png ADDED
assets/Model.png ADDED
assets/Stylization.png ADDED
assets/demo.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b10e24c82a33c74a664d204262a12d5c100396bfcc103ffe85a449a0c68232cd
3
+ size 3930421
assets/facecaption.png ADDED

Git LFS Details

  • SHA256: b9d57e872944c518e24616751a839c78098b0b1777555537a5c039520d6a1dc3
  • Pointer size: 132 Bytes
  • Size of remote file: 3.15 MB
assets/illfacecaption.png ADDED

Git LFS Details

  • SHA256: c8acff7308d7cc1793e0426a7d5cff98dcdb23f5b47c661e9f6f91fa2345b9ca
  • Pointer size: 132 Bytes
  • Size of remote file: 1.66 MB