MiniMaxAI/MiniMax-VL-01
Image-Text-to-Text
•
Updated
•
2.09k
•
228
Ayaan Sharif
Ayaan-Sharif
AI & ML interests
NLP, LLM, TEXT, Languages
Recent Activity
liked
a model
21 days ago
MiniMaxAI/MiniMax-VL-01
liked
a dataset
24 days ago
DAMO-NLP-SG/multimodal_textbook
liked
a model
29 days ago
cognitivecomputations/dolphin-2.9-llama3-8b
Organizations
Ayaan-Sharif's activity
liked
a
model
21 days ago
liked
a
dataset
24 days ago
liked
2
models
29 days ago
replied to
sanchit-gandhi's
post
about 1 month ago
what if we segment the audio first and then transcribe tho its some extra compute to throw in but imo it would resul tin better result !
liked
3
Spaces
about 1 month ago
liked
a
model
about 1 month ago
commented
a
paper
about 1 month ago
liked
a
model
about 1 month ago
upvoted
a
collection
about 1 month ago
liked
a
Space
about 1 month ago
liked
a
Space
about 2 months ago
liked
2
models
about 2 months ago
reacted to
vladbogo's
post with 👍
about 2 months ago
Post
Panda-70M is a new large-scale video dataset comprising 70 million high-quality video clips, each paired with textual captions, designed to be used as pre-training for video understanding tasks.
Key Points:
* Automatic Caption Generation: Utilizes an automatic pipeline with multiple cross-modality teacher models to generate captions for video clips.
* Fine-tuned Caption Selection: Employs a fine-tuned retrieval model to select the most appropriate caption from multiple candidates for each video clip.
* Improved Performance: Pre-training on Panda-70M shows significant performance gains in video captioning, text-video retrieval, and text-driven video generation.
Paper: Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teachers (2402.19479)
Project page: https://snap-research.github.io/Panda-70M/
Code: https://github.com/snap-research/Panda-70M
Congrats to the authors @tschen , @aliaksandr-siarohin et al. for their work!
Key Points:
* Automatic Caption Generation: Utilizes an automatic pipeline with multiple cross-modality teacher models to generate captions for video clips.
* Fine-tuned Caption Selection: Employs a fine-tuned retrieval model to select the most appropriate caption from multiple candidates for each video clip.
* Improved Performance: Pre-training on Panda-70M shows significant performance gains in video captioning, text-video retrieval, and text-driven video generation.
Paper: Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teachers (2402.19479)
Project page: https://snap-research.github.io/Panda-70M/
Code: https://github.com/snap-research/Panda-70M
Congrats to the authors @tschen , @aliaksandr-siarohin et al. for their work!
- 1 reply
liked
a
Space
about 2 months ago
multi gpu setup when ?
2
#5 opened 2 months ago
by
Ayaan-Sharif
liked
a
Space
2 months ago