Pegasus-v1 Technical Report
Authors: name: Raehyuk Jung; name: Hyojun Go; name: Jaehyuk Yi; name: Jiho Jang; name: Daniel Kim; name: Jay Suh; name: Aiden Lee; name: Cooper Han; name: Jae Lee; name: Jeff Kim; name: Jin-Young Kim; name: Junwan Kim; name: Kyle Park; name: Lucas Lee; name: Mars Ha; name: Minjoon Seo; name: Abraham Jo; name: Ed Park; name: Hassan Kianinejad; name: SJ Kim; name: Tony Moon; name: Wade Jeong; name: Andrei Popescu; name: Esther Kim; name: EK Yoon; name: Genie Heo; name: Henry Choi; name: Jenna Kang; name: Kevin Han; name: Noah Seo; name: Sunny Nguyen; name: Ryan Won; name: Yeonhoo Park; name: Anthony Giuliani; name: Dave Chung; name: Hans Yoon; name: James Le; name: Jenny Ahn; name: June Lee; name: Maninder Saini; name: Meredith Sanders; name: Soyoung Lee; name: Sue Kim; name: Travis Couture
Published: 2024-04-23 02:32:57

Abstract: This technical report introduces Pegasus-1, a multimodal language model
specialized in video content understanding and interaction through natural
language. Pegasus-1 is designed to address the unique challenges posed by video
data, such as interpreting spatiotemporal information, to offer nuanced video
content comprehension across various lengths. This technical report overviews
Pegasus-1's architecture, training strategies, and its performance in
benchmarks on video conversation, zero-shot video question answering, and video
summarization. We also explore qualitative characteristics of Pegasus-1 ,
demonstrating its capabilities as well as its limitations, in order to provide
readers a balanced view of its current state and its future direction.