Easy evaluation of the zero-shot capabilities of siglip

#3
by fhvilshoj - opened

Hi!
Thanks for your big efforts in training this model. It's really helping push forward the field of AI as shown by your number of downloads!

I wanted to show how we've evaluated the model against a bunch of others on a handful of medical datasets. It's super easy to add other datasets from HF as well.

medical-linear-probe-accuracy.png

We did it with this repo: https://github.com/encord-team/text-to-image-eval

Would be curious to hear how this stacks up against your findings!

Sign up or log in to comment