Lim

liminalism
ยท

AI & ML interests

Day 1

Recent Activity

liked a model 26 days ago
jadechoghari/Ferret-UI-Gemma2b
liked a model about 2 months ago
nvidia/NVLM-D-72B
View all activity

Organizations

liminalism's activity

upvoted an article 8 months ago
view article
Article

CodeGemma - an official Google release for code LLMs

โ€ข 99
Reacted to philschmid's post with ๐Ÿ‘ 8 months ago
view post
Post
6564
New state-of-the-art open LLM! ๐Ÿš€ Databricks just released DBRX, a 132B MoE trained on 12T tokens. Claiming to surpass OpenAI GPT-3.5 and is competitive with Google Gemini 1.0 Pro. ๐Ÿคฏ

TL;DR
๐Ÿงฎ 132B MoE with 16 experts with 4 active in generation
๐ŸชŸ 32 000 context window
๐Ÿ“ˆ Outperforms open LLMs on common benchmarks, including MMLU
๐Ÿš€ Up to 2x faster inference than Llama 2 70B
๐Ÿ’ป Trained on 12T tokens
๐Ÿ”ก Uses the GPT-4 tokenizer
๐Ÿ“œ Custom License, commercially useable

Collection: databricks/dbrx-6601c0852a0cdd3c59f71962
Demo: databricks/dbrx-instruct

Kudos to the Team at Databricks and MosaicML for this strong release in the open community! ๐Ÿค—
ยท