AshrafAlAodat commited on
Commit
916593a
1 Parent(s): 7ae5ea7

Added more info

Browse files
Files changed (1) hide show
  1. README.md +74 -31
README.md CHANGED
@@ -1,31 +1,74 @@
1
- metadata:
2
-
3
- license: creativeml-openrail-m
4
- tags:
5
- - stable-diffusion
6
- - stable-diffusion-diffusers
7
- - text-to-image
8
- inference: true
9
- extra_gated_prompt: >-
10
- This model is open access and available to all, with a CreativeML OpenRAIL-M
11
- license further specifying rights and usage.
12
-
13
- The CreativeML OpenRAIL License specifies:
14
-
15
-
16
- 1. You can't use the model to deliberately produce nor share illegal or
17
- harmful outputs or content
18
-
19
- 2. Riffusion claims no rights on the outputs you generate, you are free to use
20
- them and are accountable for their use which must not go against the
21
- provisions set in the license
22
-
23
- 3. You may re-distribute the weights and use the model commercially and/or as
24
- a service. If you do, please be aware you have to include the same use
25
- restrictions as the ones in the license and share a copy of the CreativeML
26
- OpenRAIL-M to all your users (please read the license entirely and carefully)
27
-
28
- Please read the full license carefully here:
29
- https://huggingface.co/spaces/CompVis/stable-diffusion-license
30
-
31
- extra_gated_heading: Please read the LICENSE to access this model
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: creativeml-openrail-m
3
+ tags:
4
+ - stable-diffusion
5
+ - stable-diffusion-diffusers
6
+ - text-to-image
7
+ inference: true
8
+ extra_gated_prompt: |-
9
+ This model is open access and available to all, with a CreativeML OpenRAIL-M license further specifying rights and usage.
10
+ The CreativeML OpenRAIL License specifies:
11
+
12
+ 1. You can't use the model to deliberately produce nor share illegal or harmful outputs or content
13
+ 2. Riffusion claims no rights on the outputs you generate, you are free to use them and are accountable for their use which must not go against the provisions set in the license
14
+ 3. You may re-distribute the weights and use the model commercially and/or as a service. If you do, please be aware you have to include the same use restrictions as the ones in the license and share a copy of the CreativeML OpenRAIL-M to all your users (please read the license entirely and carefully)
15
+ Please read the full license carefully here: https://huggingface.co/spaces/CompVis/stable-diffusion-license
16
+
17
+ extra_gated_heading: Please read the LICENSE to access this model
18
+ ---
19
+
20
+ # Text-To-Sinogram
21
+
22
+ is an app for generation of sinogram with stable diffusion.
23
+
24
+ * Model checkpoint: https://huggingface.co/AshrafAlAodat/text-to-sinogram-v1
25
+
26
+ This repository contains the model files, including:
27
+
28
+ * a diffusers formated library
29
+ * a compiled checkpoint file
30
+ * a traced unet for improved inference speed
31
+
32
+ ## Model V1
33
+
34
+ It is a latent text-to-image diffusion model capable of generating sinogram images given any text input. These sinograms can be reconstructed back to the original image.
35
+
36
+ The model was created by [Ashraf Al-Aodat](https://github.com/Ashraf-Al-Aodat) as a proof of concept.
37
+
38
+ You can use the model directly.
39
+
40
+ The model was created by fine-tuning the **Stable-Diffusion-v1-5** checkpoint. Read about Stable Diffusion here [🤗's Stable Diffusion blog](https://huggingface.co/blog/stable_diffusion).
41
+
42
+ ### Model Details
43
+ - **Developed by:** Ashraf Al-Aodat
44
+ - **Model type:** Diffusion-based text-to-image generation model
45
+ - **Language(s):** English
46
+ - **License:** [The CreativeML OpenRAIL M license](https://huggingface.co/spaces/CompVis/stable-diffusion-license) is an [Open RAIL M license](https://www.licenses.ai/blog/2022/8/18/naming-convention-of-responsible-ai-licenses), adapted from the work that [BigScience](https://bigscience.huggingface.co/) and [the RAIL Initiative](https://www.licenses.ai/) are jointly carrying in the area of responsible AI licensing. See also [the article about the BLOOM Open RAIL license](https://bigscience.huggingface.co/blog/the-bigscience-rail-license) on which our license is based.
47
+ - **Model Description:** This is a model that can be used to generate and modify images based on text prompts. It is a [Latent Diffusion Model](https://arxiv.org/abs/2112.10752) that uses a fixed, pretrained text encoder ([CLIP ViT-L/14](https://arxiv.org/abs/2103.00020)) as suggested in the [Imagen paper](https://arxiv.org/abs/2205.11487).
48
+
49
+ ### Direct Use
50
+ The model is intended for research purposes only. Possible research areas and
51
+ tasks include
52
+
53
+ - Generation of artworks, audio, and use in creative processes.
54
+ - Applications in educational or creative tools.
55
+ - Research on generative models.
56
+
57
+ ### Datasets
58
+ The original Stable Diffusion v1.5 was trained on the [sinograms](https://huggingface.co/datasets/AshrafAlAodat/sinograms) dataset using the [CLIP text encoder](https://openai.com/blog/clip/).
59
+
60
+ ### Fine Tuning
61
+
62
+ Check out the [diffusers training examples](https://huggingface.co/docs/diffusers/training/overview) from Hugging Face. Fine tuning requires a dataset of sinogram images of objects, with associated text describing them. Note that the CLIP encoder is able to understand and connect many words even if they never appear in the dataset. It is also possible to use a [dreambooth](https://huggingface.co/blog/dreambooth) method to get custom styles.
63
+
64
+ ## Citation
65
+
66
+ If you build on this work, please cite it as follows:
67
+
68
+ ```
69
+ @article{TODO,
70
+ author = {Al-Aodat, Ashraf*},
71
+ title = {{Text-To-Sinogram - Stable diffusion for sinogram generation a proof of concept}},
72
+ year = {2022}
73
+ }
74
+ ```