Luca Strebel's picture
3 29

Luca Strebel

LucStr

AI & ML interests

None yet

Recent Activity

View all activity

Organizations

Rapidata's profile picture

LucStr's activity

reacted to jasoncorkill's post with πŸ‘€ 3 days ago
view post
Post
2740
Integrating human feedback is vital for evolving AI models. Boost quality, scalability, and cost-effectiveness with our crowdsourcing tool!

..Or run A/B tests and gather thousands of responses in minutes. Upload two images, ask a question, and watch the insights roll in!

Check it out here and let us know your feedback: https://app.rapidata.ai/compare
reacted to jasoncorkill's post with πŸš€ 5 days ago
view post
Post
2474
This dataset was collected in roughly 4 hours using the Rapidata Python API, showcasing how quickly large-scale annotations can be performed with the right tooling!

All that at less than the cost of a single hour of a typical ML engineer in Zurich!

The new dataset of ~22,000 human annotations evaluating AI-generated videos based on different dimensions, such as Prompt-Video Alignment, Word for Word Prompt Alignment, Style, Speed of Time flow and Quality of Physics.

Rapidata/text-2-video-Rich-Human-Feedback
reacted to jasoncorkill's post with ❀️ 10 days ago
view post
Post
4515
Runway Gen-3 Alpha: The Style and Coherence Champion

Runway's latest video generation model, Gen-3 Alpha, is something special. It ranks #3 overall on our text-to-video human preference benchmark, but in terms of style and coherence, it outperforms even OpenAI Sora.

However, it struggles with alignment, making it less predictable for controlled outputs.

We've released a new dataset with human evaluations of Runway Gen-3 Alpha: Rapidata's text-2-video human preferences dataset. If you're working on video generation and want to see how your model compares to the biggest players, we can benchmark it for you.

πŸš€ DM us if you’re interested!

Dataset: Rapidata/text-2-video-human-preferences-runway-alpha
  • 1 reply
Β·
reacted to jasoncorkill's post with πŸ‘πŸš€ 23 days ago
view post
Post
2673
We benchmarked @xai-org 's Aurora model, as far as we know the first public evaluation of the model at scale.

We collected 401k human annotations in over the past ~2 days for this, we have uploaded all of the annotation data here on huggingface with a fully permissive license
Rapidata/xAI_Aurora_t2i_human_preferences
upvoted an article about 1 month ago
view article
Article

Beyond Image Preferences - Rich Human Feedback for Text-to-Image Generation

By RapidataAI and 5 others β€’
β€’ 13