adept/fuyu-8b · Discussions

#70 opened about 2 months ago by

jchiu1234

How to evaluate it on AI2D dataset?

#69 opened 2 months ago by

boydcheung

Masking the image tokens during training

#68 opened 2 months ago by

jchiu1234

finetune fuyu-8b model

#67 opened 3 months ago by

yinincanada

Is there any way to use image embeddings as input? (similar to input_embeds param)

#66 opened 4 months ago by

sanchd

OCR function

#65 opened 5 months ago by

linxi

Does localization really work?

#64 opened 5 months ago by

Seungyoun

finetune fuyu8b text location with image size of 1920x1080 always got OOM even on A100*8

#63 opened 5 months ago by

Nooodles

Are there special tokens that are ignored during loss computation?

9

#62 opened 5 months ago by

Nyandwi

why does the coordinates need to be divided by two in scale_bbox_to_transformed_image?

#61 opened 5 months ago by

Nooodles

Here is a simple multimodal like training script to see model working.

#60 opened 5 months ago by

besiktas

GPU requirements

#59 opened 5 months ago by

thightower1

I keep running out of memory. Why dont they just tell what equipment is required to run these models

#58 opened 5 months ago by

alquimista888

crash kernel

6

#57 opened 6 months ago by

simonbrbx

Tips on resolving this typing.Optional error seemingly related to PIL.Image?

#56 opened 6 months ago by

justinwickett

demo of PDF vqa

#55 opened 6 months ago by

verigle

test

#54 opened 6 months ago by

Aaronx

Upload 2.jpg

#53 opened 6 months ago by

Aaronx

test

#52 opened 6 months ago by

Aaronx

8B? Or 9B?

#51 opened 6 months ago by

mrfakename

Memory Spikes while Getting Model Logits

#49 opened 6 months ago by

Nyandwi

Is there a way to run it on a 8GB GPU?

#47 opened 6 months ago by

bobe94

issue with quantization on windows

#46 opened 6 months ago by

FantasticMrCat

How does the Fuyu model Get images?

#45 opened 6 months ago by

VatsaDev

For the vqav2 data set example "fish and carrot", why does the model output a sentence instead of a phrase?

8

#44 opened 6 months ago by

changgeli

fine-tuning using FSDP and non 80GB cards?

8

#43 opened 6 months ago by

besiktas

Released capabilities

6

#42 opened 6 months ago by

ludeksvoboda

Update README.md

#41 opened 6 months ago by

ybelkada

Colab

#39 opened 7 months ago by

nengelmann

whether special instruction is need to trigger OCR location function?

#38 opened 7 months ago by

liupei0408

How to get Image embedding using Fuyu

#37 opened 7 months ago by

oaishi

How to get the detailed description in the fuyu-8b-demo？

#35 opened 7 months ago by

dwdxdy

The Numbers

#33 opened 7 months ago by

changgeli

Questions about the examples in the blog

#32 opened 7 months ago by

AudreyLin

ImportError for FuyuProcessor in Transformers v4.34.1

#30 opened 7 months ago by

ClaraLovesFunk

hi love it

#29 opened 7 months ago by

boinc

The 8b model could get correct results for case showed on the offical blog

#28 opened 7 months ago by

YuntaoChen

long response times

#27 opened 7 months ago by

FantasticMrCat42

ValueError: Unable to infer channel dimension format

#26 opened 7 months ago by

vishal1278

A working demo.py for your reference

#25 opened 7 months ago by

Colderthanice

Using this model as a QA-tool/OCR on a text heavy document?

#24 opened 7 months ago by

Techie5879

Loading the model on multi-gpu setup?

#23 opened 7 months ago by

Techie5879

issue with inference

#22 opened 7 months ago by

zhangchaosunshine

issue with running the model

#21 opened 7 months ago by

slay

Possible for quantization other than bitsandbytes?

#20 opened 7 months ago by

Yhyu13

Run on MBP M1

4

#17 opened 7 months ago by

sagar-kris

License question

#16 opened 7 months ago by

SetoKaiba

Warning output

4

#15 opened 7 months ago by

dashesy

Bug when deploying to Inference Endpoints

#14 opened 7 months ago by

gpantalos

Support multi-image?