|
---
|
|
license: mit
|
|
widget:
|
|
- src: >-
|
|
https://www.verywellhealth.com/thmb/yCmWnfp16fvO0C7qB2jUUcUq8XY=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/GettyImages-1451577990-07db16e0a41043bc968d5cbf2dbaec83.jpg
|
|
candidate_labels: dark color, light color, irregular shape
|
|
example_title: Malignant Melanoma
|
|
library_name: open_clip
|
|
pipeline_tag: zero-shot-image-classification
|
|
---
|
|
|
|
# Model Card for WhyLesionClip
|
|
|
|
# Table of Contents
|
|
|
|
1. [Model Details](#model-details)
|
|
2. [Get Started](#how-to-get-started-with-the-model)
|
|
3. [Uses](#uses)
|
|
4. [Training Details](#training-details)
|
|
5. [Evaluation](#evaluation)
|
|
6. [Citation](#citation)
|
|
|
|
## Model Details
|
|
|
|
- **Model:** WhyLesionClip
|
|
- **Paper:** https://arxiv.org/pdf/2405.14839
|
|
- **Website:** https://yueyang1996.github.io/knobo/
|
|
- **Repository:** https://github.com/YueYANG1996/KnoBo
|
|
|
|
|
|
## How to Get Started with the Model
|
|
|
|
Use the code below to get started with the model.
|
|
|
|
[More Information Needed]
|
|
|
|
|
|
## Uses
|
|
|
|
<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
|
|
|
|
### Direct Use
|
|
|
|
<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
|
|
|
|
[More Information Needed]
|
|
|
|
### Downstream Use
|
|
|
|
<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
|
|
|
|
[More Information Needed]
|
|
|
|
### Out-of-Scope Use
|
|
|
|
<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
|
|
|
|
[More Information Needed]
|
|
|
|
Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
|
|
|
|
|
|
## Training Details
|
|
|
|
### Training Data
|
|
|
|
<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
|
|
|
|
[More Information Needed]
|
|
|
|
### Preprocessing [optional]
|
|
|
|
[More Information Needed]
|
|
|
|
|
|
### Training Hyperparameters
|
|
|
|
- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
|
|
|
|
## Evaluation
|
|
|
|
<!-- This section describes the evaluation protocols and provides the results. -->
|
|
|
|
### Testing Data
|
|
|
|
<!-- This should link to a Dataset Card if possible. -->
|
|
|
|
[More Information Needed]
|
|
|
|
|
|
### Metrics
|
|
|
|
<!-- These are the evaluation metrics being used, ideally with a description of why. -->
|
|
|
|
[More Information Needed]
|
|
|
|
### Results
|
|
|
|
[More Information Needed]
|
|
|
|
|
|
## Citation
|
|
|
|
<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
|
|
|
|
**BibTeX:**
|
|
|
|
```
|
|
@article{yang2024textbook,
|
|
title={A Textbook Remedy for Domain Shifts: Knowledge Priors for Medical Image Analysis},
|
|
author={Yue Yang and Mona Gandhi and Yufei Wang and Yifan Wu and Michael S. Yao and Chris Callison-Burch and James C. Gee and Mark Yatskar},
|
|
journal={arXiv preprint arXiv:2405.14839},
|
|
year={2024}
|
|
}
|
|
``` |
