Hugging Face's logo

yyupenn
/
whylesionclip

Zero-Shot Image Classification
OpenCLIP
clip
Model card Files Community
whylesionclip
File size: 3,287 Bytes 
a07fced
 
18a861e
 
 
 
 
 
 
a07fced
18a861e
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
 
---

license: mit
widget:
- src: >-
    https://www.verywellhealth.com/thmb/yCmWnfp16fvO0C7qB2jUUcUq8XY=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/GettyImages-1451577990-07db16e0a41043bc968d5cbf2dbaec83.jpg
  candidate_labels: dark color, light color, irregular shape
  example_title: Malignant Melanoma
library_name: open_clip
pipeline_tag: zero-shot-image-classification
---


# Model Card for WhyLesionClip

#  Table of Contents

1. [Model Details](#model-details)
2. [Get Started](#how-to-get-started-with-the-model)
3. [Uses](#uses)
4. [Training Details](#training-details)
5. [Evaluation](#evaluation)
6. [Citation](#citation)

## Model Details

- **Model:** WhyLesionClip
- **Paper:** https://arxiv.org/pdf/2405.14839
- **Website:** https://yueyang1996.github.io/knobo/
- **Repository:** https://github.com/YueYANG1996/KnoBo


## How to Get Started with the Model

Use the code below to get started with the model.

[More Information Needed]


## Uses

<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->

### Direct Use

<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->

[More Information Needed]

### Downstream Use

<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->

[More Information Needed]

### Out-of-Scope Use

<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->

[More Information Needed]

Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.


## Training Details

### Training Data

<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->

[More Information Needed]

### Preprocessing [optional]

[More Information Needed]


### Training Hyperparameters

- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->

## Evaluation

<!-- This section describes the evaluation protocols and provides the results. -->

### Testing Data

<!-- This should link to a Dataset Card if possible. -->

[More Information Needed]


### Metrics

<!-- These are the evaluation metrics being used, ideally with a description of why. -->

[More Information Needed]

### Results

[More Information Needed]


## Citation

<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->

**BibTeX:**

```

@article{yang2024textbook,

      title={A Textbook Remedy for Domain Shifts: Knowledge Priors for Medical Image Analysis}, 

      author={Yue Yang and Mona Gandhi and Yufei Wang and Yifan Wu and Michael S. Yao and Chris Callison-Burch and James C. Gee and Mark Yatskar},

      journal={arXiv preprint arXiv:2405.14839},

      year={2024}

}

```