jaketae commited on
Commit
8375841
2 Parent(s): 7326e2c 8b6d3c7

Merge branch 'main' of https://huggingface.co/spaces/flax-community/koclip

Browse files
Files changed (1) hide show
  1. image2text.py +4 -2
image2text.py CHANGED
@@ -15,8 +15,10 @@ def app(model_name):
15
  st.title("Zero-shot Image Classification")
16
  st.markdown(
17
  """
18
- Some text goes in here.
19
- """
 
 
20
  )
21
 
22
  query1 = st.file_uploader("Choose an image...", type=["jpg", "jpeg", "png"])
 
15
  st.title("Zero-shot Image Classification")
16
  st.markdown(
17
  """
18
+ This demonstration explores capability of KoCLIP in the field of Zero-Shot Prediction. This demo takes a set of image and captions from, and predicts the most likely label among the different captions given.
19
+
20
+ KoCLIP is a retraining of OpenAI's CLIP model using 82,783 images from [MSCOCO](https://cocodataset.org/#home) dataset and Korean caption annotations. Korean translation of caption annotations were obtained from [AI Hub](https://aihub.or.kr/keti_data_board/visual_intelligence). Base model `koclip` uses `klue/roberta` as text encoder and `openai/clip-vit-base-patch32` as image encoder. Larger model `koclip-large` uses `klue/roberta` as text encoder and bigger `google/vit-large-patch16-224` as image encoder.
21
+ """
22
  )
23
 
24
  query1 = st.file_uploader("Choose an image...", type=["jpg", "jpeg", "png"])