๐๐ฎ๐ฆ๐ฆ๐๐ซ๐ฒ ๐จ๐ ๐๐ซ๐ญ๐ข๐๐ฅ๐- ๐ # ๐๐๐๐ก๐๐ง๐ข๐๐ฌ ๐จ๐ ๐๐๐-๐โ๐จโ: GPT-4โoโ operates through three main components ๐ ๏ธ
๐. ๐๐ฎ๐ฉ๐๐ซ๐๐ก๐๐ญ: Integrates image generation, QnA (image, document and video) for diverse interactions. ๐. ๐๐จ๐ข๐๐ ๐๐ก๐๐ญ: Merges TTS and STT for real-time, human-like audio responses, focusing on human interaction. ๐. ๐๐ข๐๐๐จ ๐๐ก๐๐ญ: Utilizes Zero Shot Image Classification to enhance user interaction with visual information.
๐. ๐๐ฎ๐ฅ๐ญ๐ข๐๐จ๐๐๐ฅ๐ข๐๐ข๐๐๐ญ๐ข๐จ๐ง: Combines multiple models for a powerful, multifunctional AI. ๐. ๐๐ฎ๐๐ญ ๐๐๐ฉ๐ ๐๐๐ญ๐ก๐จ๐: Uses different models or APIs for specific tasks without additional training.
The article provides an in-depth exploration of GPT-4โoโ, its functionalities, and methods to create similar AI models. It emphasizes the modelโs language support and its innovative approach to human-AI interaction. ๐ก๐
Honestly i don't understand how come we as the open source community haven't surpassed GPT-4 yet ? Like for me it looks like everything is out there just need to be exploited! Clearly specialized small models outperforms gpt4 on downstream tasks ! So why haven't we just trained a 1B-2B really strong general model and then continue pertained and/or finetuned it on datasets for downstream tasks like math, code...well structured as Textbooks format or other datasets formats that have been proven to be really efficient and good! Ounce you have 100 finetuned model, just wrap them all into a FrankenMoE and Voila โจ And that's just what a NOOB like myself had in mind, I'm sure there is better, more efficient ways to do it ! So the question again, why we haven't yet ? I feel I'm missing something... Right?
5 replies
ยท
reacted to akhaliq's
post with โค๏ธ๐9 months ago
Sora is the first large-scale generalist video generation model that garnered significant attention across society. Since its launch by OpenAI in February 2024, no other video generation models have paralleled {Sora}'s performance or its capacity to support a broad spectrum of video generation tasks. Additionally, there are only a few fully published video generation models, with the majority being closed-source. To address this gap, this paper proposes a new multi-agent framework Mora, which incorporates several advanced visual AI agents to replicate generalist video generation demonstrated by Sora. In particular, Mora can utilize multiple visual agents and successfully mimic Sora's video generation capabilities in various tasks, such as (1) text-to-video generation, (2) text-conditional image-to-video generation, (3) extend generated videos, (4) video-to-video editing, (5) connect videos and (6) simulate digital worlds. Our extensive experimental results show that Mora achieves performance that is proximate to that of Sora in various tasks. However, there exists an obvious performance gap between our work and Sora when assessed holistically. In summary, we hope this project can guide the future trajectory of video generation through collaborative AI agents.
reacted to vikhyatk's
post with โค๏ธ9 months ago