aohenduo's picture

aohenduo

chenduo

AI & ML interests

None yet

Recent Activity

liked a model 4 days ago
Qwen/Qwen2.5-VL-7B-Instruct
liked a model about 1 month ago
deepseek-ai/DeepSeek-V3-Base
View all activity

Organizations

None yet

chenduo's activity

reacted to onekq's post with πŸ”₯ 9 days ago
view post
Post
4636
πŸ‹DeepSeek πŸ‹ is the real OpenAI 😯
Β·
New activity in shenzhi-wang/Llama3.1-70B-Chinese-Chat 3 months ago
liked a Space 4 months ago
reacted to reach-vb's post with πŸ‘ 4 months ago
view post
Post
5498
Multimodal Ichigo Llama 3.1 - Real Time Voice AI πŸ”₯

> WhisperSpeech X Llama 3.1 8B
> Trained on 50K hours of speech (7 languages)
> Continually trained on 45hrs 10x A1000s
> MLS -> WhisperVQ tokens -> Llama 3.1
> Instruction tuned on 1.89M samples
> 70% speech, 20% transcription, 10% text
> Apache 2.0 licensed ⚑

Architecture:
> WhisperSpeech/ VQ for Semantic Tokens
> Llama 3.1 8B Instruct for Text backbone
> Early fusion (Chameleon)

I'm super bullish on HomeBrew/ Jan and early fusion, audio and text, multimodal models!

(P.S. Play with the demo on Hugging Face: jan-hq/Ichigo-llama3.1-s-instruct)
reacted to clem's post with πŸ‘ 7 months ago
view post
Post
2498
This is the week of small AI language models!
Β·
New activity in ChaoticNeutrals/RPMix-4x7B-MoE 10 months ago

Quantization error

2
#1 opened 10 months ago by
chenduo