A Video Summarization Technique of Animation Products According to Film Comic Format
Tomokazu Ishikawa ∗Kento Okazaki

Masanori Kakimoto

Tomoyuki Nishita

Tokyo University of Technology

Tokyo University of Technology

Tokyo University of Technology

UEI Research / Hiroshima Shudo University

Figure 1: Characteristics of a film comic. We focus on the fourcharacteristics written in the blue balloon. ”Eden of The East thec
movie I - The King of Eden -”, ⃝AsmikAce, Inc.

1Introduction

This research focuses on the book medium that makes it possible to enjoy anime works called film comics in ”manga” format.
Film comics are produced by the time-consuming task of production editing. Furthermore, we investigated video summaries fromanime works that were inspired by comic techniques. In a previous method [Cao et al. 2012], user-specified frames were cut fromanimation images, leaving only the highly-attractive frames, called
keyframes. Meanwhile, the recommended areas were automaticallyselected based on the four characteristics of the film comics (seeFig. 1). Here, recommended area is the area that should be displayed inside the comic frame, such as character’s faces and elaborately drawn backgrounds.

2Our Method

The proposed method is roughly classified into two processes:”keyframe detection” and ”recommended area detection and layout output.” The flow of the method is shown in Fig. 2. Keyframe
detection is achieved by detecting edges, flesh colors, and sounds
in individual frames. Concurrently, camera work detection is used
for frame division. Using the quantified features obtained from animage as a comparison, we detect the keyframes not only from pictorial images but also from voice sounds. Changes in scenery aredecided by color difference as well as by feature histograms, andkeyframes are detected based on the number of edges, region ofskin color, and sound volume. Furthermore, tilted scenes are identified by optical flow and adaptation to manga techniques by vector
angle.
The shape and size of a frame in comic are determined dueto the recommended area detection. Using face area detection,
the frame is centered on the character of interest (proposed by∗ e-mail: ishikawatm@stf.teu.ac.jp

Permission to make digital or hard copies of part or all of this work for personal orclassroom use is granted without fee provided that copies are not made or distributedfor commercial advantage and that copies bear this notice and the full citation on thefirst page. Copyrights for third-party components of this work must be honored. For allother uses, contact the Owner/Author.
SIGGRAPH 2014, August 10 – 14, 2014, Vancouver, British Columbia, Canada.
2014 Copyright held by the Owner/Author.
ACM 978-1-4503-2958-3/14/08

Figure 2: Flow of the proposed method. The images are frames inthe animation ”Eden of The East the movie I - The King of Eden -”,c⃝AsmikAce, Inc.

(a) Normal scene(b) Real film comic(c) Tilt scene

Figure 3: Results of the layout chart of the animation ”Eden ofc
The East the movie I - The King of Eden -”, ⃝AsmikAce, Inc. (b)cis a page from the real film comic ”Eden of The East”, ⃝KenjiKamiyama, Chika Umino.

Takayama [Takayama et al. 2012]). In layout processing, the frames
are matched to the results of the keyframe and recommended area
detection, and each domain in the frame is optimized by the leastsquares method. The layout image is then output in manga format.
As our result, Figure 3 (a) shows the output image of the layout.
For comparison, the layout of the film comic is shown in Figure 3(b). Figure 3 (c) shows the concatenated result for tilt scenes. We
proposed a method for keyframe detection, which is necessary forframes and summarization of images in manga format, with a focus
on a book medium for film comics.

References
C AO , Y., C HAN , A. B., AND L AU , R. 2012. Automatic stylistic
manga layout. ACM Transactions on Graphics (Proc. of SIGGRAPH Asia 2012) 31.
TAKAYAMA , K., J OHAN , H., AND N ISHITA , T. 2012. Face detection and face recognition of cartoon characters using featureextraction. In Proc. of Image Electronics and Visual Computing
Workshop 2012, IEVC 2012.