Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
vikhyatkΒ 
posted an update Jul 23
Post
3240
πŸš€ Exciting news! We've just launched "Thundermoon" - the latest version of Moondream, our open-source vision language model! πŸŒ™

Key improvements in this release:
1. Massive leap in OCR capabilities
2. Enhanced document understanding
3. Significant boosts across key metrics:
* DocVQA: 61.9 (↑103%)
* TextVQA: 60.2 (↑5.2%)
* GQA: 64.9 (↑2.9%)

What does this mean? Moondream can now tackle complex document analysis tasks with unprecedented accuracy for a model of its size. From deciphering handwritten notes to interpreting data tables, the applications are vast.

Check out the image for a glimpse of Moondream in action, effortlessly extracting insights from a 1944 sugar industry document!

Why it matters:
* Democratizing AI: As an open-source project, we're making advanced vision AI accessible to all developers.
* Efficiency: Proving that smaller models can deliver big results.
* Real-world impact: From historical document analysis to modern business intelligence, the potential use cases are exciting.

Curious to try it out? Try out the live demo here! https://moondream.ai/playground

Any plans to fix the llama.cpp implementation ? It's sad to see the entire moondream family of finetunes barred from that framework

Β·

Yup, currently working on getting a clean GGML implementation working here so I can then go and figure out what's going on in llama.cpp. https://github.com/vikhyat/moondream/tree/vik-ggml

Nice!
Is thundermoon available anywhere?
I only see moondream 2 available.

Β·

It's in the same repo, uploaded with the tag "2024-07-23" you can pass in as revision when instantiating the model.

In this post