how to use the annotation mode

#15
by mehmetsat - opened

Will you share the annotation mode inference like in your demo?

Ai2 org

Yea mean when the model output points? The model will return points if you ask it a pointing/counting questions with key words like "How many" or "Point to the". It will also try to point if you input a message that starts with "point_qa:" like this:
image.png

Internally the model produces points as plain text in a html-like format, see for how to parse them: https://huggingface.co/allenai/Molmo-7B-O-0924/discussions/1#66f47d79a4f47d65558a79ca

amanrangapur changed discussion status to closed
amanrangapur changed discussion status to open

Sign up or log in to comment