Spaces:
Sleeping
Sleeping
text changes
Browse files
app.py
CHANGED
@@ -141,7 +141,7 @@ def setup_how_to():
|
|
141 |
expander.image(Image.open('./assets/HF_MODEL_ID_EXAMPLE.png'))
|
142 |
expander.write("3. Test your chosen model by generating an image using an input prompt e.g.: 'A corgi with some cool sunglasses'\n")
|
143 |
expander.image(Image.open('./assets/lykon_corgi.png'))
|
144 |
-
expander.write("4. Navigate to the '\U0001F30E
|
145 |
" to evaluate your model once it has been loaded\n"
|
146 |
"5. Once you have generated some evaluation images, head over to the '\U0001F4C1 Generated Images' tab to have a look at them\n"
|
147 |
"6. To check out your evaluations or all of the TBYB Community evaluations, head over to the '\U0001F4CA Model Comparison' tab\n"
|
@@ -272,32 +272,33 @@ def setup_additional_information_tab(tab):
|
|
272 |
promise that all T2I models will work - if you run into any issues that you think should be possible, feel
|
273 |
free to reach out!
|
274 |
- Currently, a model_index.json file is required to load models and use them with TBYB, we will look to
|
275 |
-
address other models in future
|
276 |
- TBYB only works on T2I models hosted on HuggingFace, other model repositories are not currently supported
|
277 |
- Adaptor models are currently not supported, we will look to add evaluation functionalities of these
|
278 |
models in the future.
|
279 |
-
- Download, generation, inference and evaluation times are
|
|
|
280 |
|
281 |
Keep in mind that these constraints may be removed or added to any time.
|
282 |
""")
|
283 |
-
st.header('4.
|
284 |
st.markdown(
|
285 |
"""
|
286 |
Given this application is used for the assessment of T2I biases and relies on
|
287 |
pre-trained models available on HuggingFace, we are not responsible for any content generated
|
288 |
by public-facing models that have been used to generate images using this application.
|
289 |
-
|
290 |
-
|
|
|
291 |
insensitive, disturbing, distressing or offensive images that propagate harmful stereotypes or
|
292 |
representations of marginalised groups, please address your concerns to the model providers.
|
293 |
|
294 |
-
|
295 |
However, given the TBYB tool is designed for bias quantification and is driven by transparency, it would be
|
296 |
beneficial to the TBYB community to share evaluations of biased T2I models!
|
297 |
|
298 |
-
|
299 |
-
|
300 |
-
|
301 |
|
302 |
For further questions/queries or if you want to simply strike a conversation,
|
303 |
please reach out to Jordan Vice at: jordan.vice@uwa.edu.au""")
|
@@ -307,7 +308,7 @@ setup_how_to()
|
|
307 |
|
308 |
|
309 |
if user_login_create():
|
310 |
-
tab1, tab2, tab3, tab4, tab5, tab6 = st.tabs(["\U0001F527 Setup", "\U0001F30E
|
311 |
"\U0001F4CA Model Comparison", "\U0001F4C1 Generated Images", "\U0001F4F0 Additional Information"])
|
312 |
setup_additional_information_tab(tab6)
|
313 |
|
|
|
141 |
expander.image(Image.open('./assets/HF_MODEL_ID_EXAMPLE.png'))
|
142 |
expander.write("3. Test your chosen model by generating an image using an input prompt e.g.: 'A corgi with some cool sunglasses'\n")
|
143 |
expander.image(Image.open('./assets/lykon_corgi.png'))
|
144 |
+
expander.write("4. Navigate to the '\U0001F30E Bias Eval. (BEval)' or '\U0001F3AF Task-Oriented BEval' tabs "
|
145 |
" to evaluate your model once it has been loaded\n"
|
146 |
"5. Once you have generated some evaluation images, head over to the '\U0001F4C1 Generated Images' tab to have a look at them\n"
|
147 |
"6. To check out your evaluations or all of the TBYB Community evaluations, head over to the '\U0001F4CA Model Comparison' tab\n"
|
|
|
272 |
promise that all T2I models will work - if you run into any issues that you think should be possible, feel
|
273 |
free to reach out!
|
274 |
- Currently, a model_index.json file is required to load models and use them with TBYB, we will look to
|
275 |
+
address other models in the future
|
276 |
- TBYB only works on T2I models hosted on HuggingFace, other model repositories are not currently supported
|
277 |
- Adaptor models are currently not supported, we will look to add evaluation functionalities of these
|
278 |
models in the future.
|
279 |
+
- Download, generation, inference and evaluation times are hardware dependent. We are currently deploying the
|
280 |
+
TBYB space on a T4 GPU. With more funding and usage, we plan on deploying more powerful GPU options.
|
281 |
|
282 |
Keep in mind that these constraints may be removed or added to any time.
|
283 |
""")
|
284 |
+
st.header('4. Disclaimer')
|
285 |
st.markdown(
|
286 |
"""
|
287 |
Given this application is used for the assessment of T2I biases and relies on
|
288 |
pre-trained models available on HuggingFace, we are not responsible for any content generated
|
289 |
by public-facing models that have been used to generate images using this application.
|
290 |
+
|
291 |
+
Bias cannot be easily measured and we do not claim that our approach is without any faults. TBYB is proposed
|
292 |
+
as an auxiliary tool to assess model biases and thus, if a chosen model is found to output
|
293 |
insensitive, disturbing, distressing or offensive images that propagate harmful stereotypes or
|
294 |
representations of marginalised groups, please address your concerns to the model providers.
|
295 |
|
|
|
296 |
However, given the TBYB tool is designed for bias quantification and is driven by transparency, it would be
|
297 |
beneficial to the TBYB community to share evaluations of biased T2I models!
|
298 |
|
299 |
+
Despite only being able to assess HuggingFace \U0001F917 models, we share no association with them outside of
|
300 |
+
hosting TBYB as a HuggingFace space. Given their growth in popularity in the computer science community and their
|
301 |
+
host of T2I model repositories, we have decided to host our web-app here.
|
302 |
|
303 |
For further questions/queries or if you want to simply strike a conversation,
|
304 |
please reach out to Jordan Vice at: jordan.vice@uwa.edu.au""")
|
|
|
308 |
|
309 |
|
310 |
if user_login_create():
|
311 |
+
tab1, tab2, tab3, tab4, tab5, tab6 = st.tabs(["\U0001F527 Setup", "\U0001F30E Bias Eval. (BEval)", "\U0001F3AF Task-Oriented BEval.",
|
312 |
"\U0001F4CA Model Comparison", "\U0001F4C1 Generated Images", "\U0001F4F0 Additional Information"])
|
313 |
setup_additional_information_tab(tab6)
|
314 |
|