File size: 720 Bytes
bebd7c1
 
 
 
 
 
 
cd2c4dc
bebd7c1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
---
datasets:
- ayoubkirouane/captcha
- project-sloth/captcha-images
language:
- en
library_name: transformers
pipeline_tag: image-text-to-text
---

## Base Model : 
- vikhyatk/moondream2

## Dataset : 
- project-sloth/captcha-images



# Load model : 


```python

from transformers import AutoModelForCausalLM, AutoTokenizer
from PIL import Image

model_id = "ayoubkirouane/moondream2-image-captcha"
model = AutoModelForCausalLM.from_pretrained(model_id, trust_remote_code=True)
tokenizer = AutoTokenizer.from_pretrained(model_id , trust_remote_code=True)

image = Image.open('/content/test.png')
enc_image = model.encode_image(image)
print(model.answer_question(enc_image, "What does the text say?", tokenizer))


```