Source: https://patents.justia.com/patent/10504382
Timestamp: 2020-01-26 00:27:25
Document Index: 648649884

Matched Legal Cases: ['Application No. 2015', 'application No. 105122877', 'Application No. 10', 'Application No. 105122877', 'Application No. 10', 'Application No. 2015', 'application No. 105122877']

US Patent for Video playback device and method Patent (Patent # 10,504,382 issued December 10, 2019) - Justia Patents Search
Justia Patents Record EditingUS Patent for Video playback device and method Patent (Patent # 10,504,382)
Video playback device and method
A video playback device includes a processor that executes a procedure. The procedure includes: for each of plural videos, receiving designations of positions in display regions of the videos; and adjusting a placement position in the display regions of the plural videos such that the positions designated for each of the plural videos are aligned at the same position in a vertical direction or a horizontal direction.
This application is based upon and claims the benefit of priority of the prior Japanese Patent Application No. 2015-145346, filed on Jul. 22, 2015, the entire contents of which are incorporated herein by reference.
The embodiments discussed herein are related to a storage medium storing a video playback program, a video playback device, and a video playback method.
Hitherto, instruction methods have been proposed for instruction on how to move the body in sports, performances, actions, or the like that are performed by moving the body. In such methods, a sport, performance, action or the like performed by a student under instruction is captured using a video camera, and instruction is given while comparing plural video images on a screen. Moreover, the sport, performance, action or the like as performed by an instructor is compared on the same screen, so as to give the student an understanding of the correct form and timing therefor.
Japanese Laid-Open Patent Publication No. H07-144038
According to an aspect of the embodiments, a video playback device includes a processor that executes a procedure. The procedure includes, for each of plural videos, receiving designations of positions in display regions of the videos; and adjusting a placement position in the display regions of the plural videos such that the positions designated for each of the plural videos are aligned at the same position in a vertical direction or a horizontal direction.
FIG. 1 is a block diagram illustrating a schematic configuration of a video playback system according to a first to a third exemplary embodiment;
FIG. 2 is a diagram illustrating an example of a video playback screen of the first exemplary embodiment;
FIG. 3 is a diagram illustrating an example of a video playback screen with a horizontal bar displayed;
FIG. 4 is a diagram illustrating an example of a video playback screen with the heights of two videos adjusted;
FIG. 5 is a block diagram illustrating a schematic configuration of a computer that functions as a video playback device according to the first to the third exemplary embodiments;
FIG. 6 is a flowchart illustrating an example of height adjustment processing;
FIG. 7 is a diagram illustrating an example of a video playback screen with a vertical bar displayed;
FIG. 8 is a diagram illustrating an example of a video playback screen with horizontal positions of two videos adjusted;
FIG. 9 is a diagram illustrating an example of a video playback screen of the second exemplary embodiment;
FIG. 10 is a diagram illustrating an example of a video playback screen with a superimposition mark displayed;
FIG. 11 is a diagram illustrating an example of a video playback screen with two videos displayed superimposed;
FIG. 12 is a diagram illustrating an example of a video playback screen with positions of superimposed display adjusted;
FIG. 13 is a flowchart illustrating an example of superimposed display processing;
FIG. 14 is a diagram illustrating an example of a shared information table;
FIG. 15 is a diagram illustrating an example of a sharing user table;
FIG. 16 is a diagram illustrating an example of a video playback screen of the third exemplary embodiment;
FIG. 17 is a diagram illustrating an example of a video playback screen with a display share list button displayed;
FIG. 18 is a diagram illustrating an example of a share list screen;
FIG. 19 is a sequence chart representing a flow of processing for exchange between a video playback device of a transmission side user, a video management device, and a video playback device of a reception side user;
FIG. 20 is a flowchart illustrating an example of shared information transmission processing.
FIG. 21 is a flowchart illustrating an example of shared information reception processing;
FIG. 22 is a flowchart illustrating an example of shared video transmission processing; and
FIG. 23 is a flowchart illustrating an example of shared video playback processing.
As illustrated in FIG. 1, a video playback system 10 according to a first exemplary embodiment includes a video playback device 20 and a video management device 30. The video playback device 20 and the video management device 30 are connected to each other by a network.
The video management device 30 includes a controller 31 that controls distribution and the like of video data to the video playback device 20, and a video database (DB) 32 that stores plural items of video data that can be provided to users. In the present exemplary embodiment, the video data is distributed to the video playback device 20 using a method in which split files obtained by splitting a single item of video data at specific time intervals (for example, 10 seconds) are sequentially distributed using hypertext transfer protocol (HTTP). This method is a method such as HTTP live streaming (HLS), or moving picture experts group-dynamic adaptive streaming over HTTP (MPEG-DASH). A playlist describing, for example, a playback sequence for the split files is therefore also stored in the video DB 32 for each item of video data. Management information for managing identification information (for example, usernames) of users to which each item of video data can be distributed is also stored in the video DB 32.
When a user logs in to a video playback application on the video playback device 20, the controller 31 receives identification information (for example, the username) of the logged-in user. The controller 31 transmits, to the video playback device 20, a playlist listing of video data items permitted for distribution to the logged-in user. The playlist listing is a listing of playlist names for respective video data permitted for distribution to the logged-in user, and in addition to the playlist names, the playlist listing may include metadata other than that of the video data, thumbnail images, and the like. Thumbnail images pre-generated from one of the frame images included in the video data may also be stored in the video DB 32, or the thumbnail images may be generated when transmitting the playlist listing.
When the controller 31 receives a request for video data from the video playback device 20, the controller 31 acquires the playlist corresponding to the requested video data from the video DB 32, and transmits the acquired playlist to the video playback device 20. Moreover, the controller 31 acquires, from the video DB 32, the split files sequentially requested by the video playback device 20 according to the playlist, and sequentially transmits the acquired split files to the video playback device 20.
The video playback device 20 functions as a display section that displays a video playback screen 60 (described in detail below), and as a video playback application that is installed to a user terminal provided with an input section for input of information. The user terminal is, for example, an information processing device such as a personal computer (PC), a notebook PC, a tablet terminal, or a smartphone.
As illustrated in FIG. 1, the video playback device 20 functionally includes an acquisition section 21 and a display controller 22. The display controller 22 is an example of a reception section and an adjustment section of technology disclosed herein.
The acquisition section 21 transmits the identification information (for example, the username) of the logged-in user to the video management device 30, and thereby acquires, from the video management device 30, the playlist listing of the video data permitted for distribution to the logged-in user, and passes the acquired playlist listing to the display controller 22. Moreover, the acquisition section 21 transmits, to the video management device 30, the playlist names for videos that have been selected from the playlist listing by the user, and thereby requests video data from the video management device 30, and acquires the playlist corresponding to that video data. Moreover, the acquisition section 21 issues sequential requests to the video management device 30 for split files in accordance with the acquired playlist, and sequentially acquires the split file from the video management device 30. The acquisition section 21 sequentially passes the acquired split file to the display controller 22.
When the display controller 22 receives the playlist listing from the acquisition section 21, the display controller 22, for example, displays a video playback screen 60 like that illustrated in FIG. 2 on the display section. In the example of FIG. 2, plural videos can be played back in a video playback region 61 provided in the center of the video playback screen 60. Note that in the present exemplary embodiment, explanation is given regarding an example of a case in which two videos are played back. The video at the left side of the video playback screen 60 is referred to as a left video 62L and the video at the right side of the video playback screen 60 is referred to as a right video 62R. In states in which desired videos have not yet been selected from the playlist listing, neither a left video 62L nor a right video 62R is displayed on the video playback region 61.
The display controller 22 displays, in a specific region of the video playback screen 60, a left video playlist listing 63L for selecting the left video 62L to play back, and a right video playlist listing 63R for selecting the right video 62R to play back. FIG. 2 illustrates an example in which thumbnail images of the videos represented by the respective playlists are displayed as the respective playlist listings 63L, 63R. The display controller 22 displays the respective playlist listings 63L, 63R in a state in which all of the thumbnail images can be checked by scrolling or the like. The display state of the playlist listing is not limited to cases employing thumbnail images as illustrated in FIG. 2. Playlist names included in the playlist listing may be displayed in a listing, or playlist names may be displayed together with the thumbnail images. When other metadata is also included in the playlist listing acquired from the video management device 30, that metadata may also be displayed together with the playlist listing.
When thumbnail images have been selected by operations such as double clicks or double taps that respectively correspond to the left video playlist listing 63L and the right video playlist listing 63R, the display controller 22 emphatically displays the selected thumbnails images. As the emphatic display, the display controller 22 can control display such that, for example, a border is thickened, size is increased, or brightness is increased. Moreover, the display controller 22 notifies the acquisition section 21 of the playlist name corresponding to the thumbnail image selected from the left video playlist listing 63L, and the playlist name corresponding to the thumbnail image selected from the right video playlist listing 63R.
Moreover, when the display controller 22 receives the split file from the acquisition section 21, the video corresponding to the thumbnail image that was selected from the left video playlist listing 63L is displayed in the video playback region 61 as the left video 62L. Moreover, the video corresponding to the thumbnail image that was selected from the right video playlist listing 63R is displayed in the video playback region 61 as the right video 62R.
In general methods for streaming playback of video using hypertext markup language (HTML), the position and size of a region where a video is to be played back is set in advance. In the present exemplary embodiment, control information regarding the display sizes and display positions of the respective left video 62L and the right video 62R is awaited, and the display controller 22 uses the control information to respectively dispose the left video 62L and the right video 62R at freely selected positions and at freely selected sizes in the video playback region 61. The display size, which is control information, is, for example, information respectively designating the widths and heights for the left video 62L and the right video 62R. The display position, which is control information, is information respectively designating x-coordinates and y-coordinates of freely selected points (for example, the top left corners) of the left video 62L and the right video 62R. Note that the x-coordinate and the y-coordinate may employ coordinate values of a coordinate system in which the rightward direction is set as the positive direction of the x-axis, and the downward direction is set as the positive direction of the y-axis, with the top left corner of the video playback region 61 serving as the origin.
The display controller 22 also displays a left video operation button group 64L for controlling playback of the left video 62L, and a right video operation button group 64R for controlling playback of the right video 62R, in specific regions of the video playback screen 60. The display controller 22 also displays a shared operation button group 64C for simultaneously controlling playback of the left video 62L and playback of the right video 62R. As operation buttons, each of the respective operation button groups 64L, 64C, 64R includes, for example, a rewind button, a play button, a pause button, a fast forward button, a previous-frame button, a slow playback button, and a next-frame button.
When an operation button of the left video operation button group 64L has been operated by the user, the display controller 22 controls playback of the left video 62L based on the button operated and the amount of operation. Moreover, when an operation button of the right video operation button group 64R has been operated by the user, the display controller 22 controls playback of the right video 62R based on the button operated and the amount of operation. Moreover, when an operation button of the shared operation button group 64C has been operated by the user, the display controller 22 controls playback of both the left video 62L and the right video 62R based on the button operated and the amount of operation. This not only enables respective control of playback of the left video 62L and the right video 62R, but also enables both of the videos 62L, 62R to be played back synchronized. For example, the left video 62L is paused at a desired timing, and the playback button of the shared operation button group 64C is selected in a state in which a frame image of the right video 62R to be aligned with the timing of the paused frame image has been searched for using frame-by-frame advancing or the like and then displayed. This enables playback synchronized so as to match the playback timing of a desired frame image to be realized.
The display controller 22 also displays a display horizontal bar button 65 in a specific region of the video playback screen 60. The horizontal bar is a mark for respectively designating positions in the height direction for the left video 62L and the right video 62R. When the display horizontal bar button 65 has been selected, the display controller 22, for example, displays a left video horizontal bar 66L above the left video 62L and displays a right video horizontal bar 66R above the right video 62R as illustrated in FIG. 3. The respective positions at which the horizontal bars 66L, 66R are displayed when the display horizontal bar button 65 has been selected may be predetermined initial positions (for example, positions at half of the height of the respective left video 62L and right video 62R).
The display controller 22 also displays a left video horizontal bar position adjusting button 67L and a right video horizontal bar position adjusting button 67R in a specific region of the video playback screen 60. The horizontal bar position adjusting buttons 67L, 67R are buttons for instructing changes to the respective heights of the respective horizontal bars 66L, 66R. For example, the display controller 22 moves the display positions of the respective horizontal bars 66L, 66R upward or downward by a specific amount of pixels (for example, one pixel) each time a button indicating an upward direction or a downward direction of the respective horizontal bar position adjusting buttons 67L, 67R is selected. Note that the respective horizontal bars 66L, 66R may also be moved in the upward and downward directions directly by an operation such as dragging or swiping.
In place of the display horizontal bar button 65, the display controller 22 displays a execute height adjustment button 68 in a specific region of the video playback screen 60. When the execute height adjustment button 68 has been selected, as illustrated in FIG. 4, the display controller 22 adjusts the display position of at least one out of the left video 62L and the right video 62R such that positions inside the respective videos 62L, 62R indicated by the respective horizontal bars 66L, 66R are set at the same height as each other. Note that the positions at which the left video horizontal bar 66L and the right video horizontal bar 66R were displayed are indicated by the dotted line P in FIG. 4.
More specifically, the display controller 22 acquires information regarding the difference between the height of the left video horizontal bar 66L and the height of the right video horizontal bar 66R, the respective current display positions of the left video 62L and the right video 62R, and the size of the video playback region 61. Based on the acquired information, the display controller 22 derives display positions by adjusting at least one out of the left video 62L or the right video 62R. For example, the display controller 22 derives display positions for a case in which the left video 62L has been moved to a position where the movement amount is the difference in the heights of the horizontal bars 66L, 66R, in a direction to match the heights of the horizontal bars 66L and 66R, within a range that does not exceed the video playback region 61. When the movement amount does not amount to this difference, display positions are derived for a case in which the right video 62R has been moved to a position where the movement amount that is the remaining difference in the heights of the of the horizontal bars 66L, 66R, in a direction to match the heights of the horizontal bars 66L, 66R, within a range not exceeding the video playback region 61. The display controller 22 updates the information indicating the display positions included in the respective control information of the left video 62L and the right video 62R to the display positions derived as described above. The display controller 22 then changes at least one display position out of that of the left video 62L or the right video 62R, based on the updated control information.
Note that in cases in which the movement amounts of the videos 62L, 62R does not amount to the difference even when both of the videos 62L, 62R have been moved to the limit within the range not exceeding the video playback region 61, display position height adjustment may be executed with the display size of both of the videos 62L, 62R reduced.
As described above, in the present exemplary embodiment, the left video 62L and the right video 62R can each be disposed in freely selected regions at freely selected sizes since control information is held for the respective left video 62L and the right video 62R This enables the respective display positions of the left video 62L and the right video 62R to be adjusted based on the designated positions (respective positions within the videos 62L, 62R indicated by the horizontal bars 66L, 66R). Adjusting the display positions of the videos in this manner can be realized using a combination of frameworks each capable of implementing precise functionality, rather than using a large, easy to handle framework such as that of a media player. For example, the functionality described above can be implemented using a combination of a framework for displaying videos, a framework for displaying lines, and a framework that detects operations such as touches, and the like. For example, the AVPlayer, AVPlayerItem layer of AVfoundation, which is a framework related to audio, can be employed as a framework for displaying videos on iOS (registered trademark).
The video playback device 20 may, for example, be implemented by the computer 40 illustrated in FIG. 5. The computer 40 includes a CPU 41, memory 42 serving as a temporary storage region, and a non-volatile storage section 43. The computer 40 also includes an input/output interface (I/F) 44 to which input/output devices 48, such as a display device and an input device, are connected. The computer 40 also includes a read/write (R/W) section 45 for controlling reading and writing of data from and to a recording medium 49, and a network I/F 46 connected to a network such as the internet. The CPU 41, the memory 42, the storage section 43, the input/output I/F 44, the R/W section 45, and the network I/F 46 are connected to one another through a bus 47.
The storage section 43 may be implemented by a hard disk drive (HDD), a solid state drive (SSD), flash memory, or the like. A video playback program 50 that causes the computer 40 to function as the video playback device 20 is stored in the storage section 43, which serves as a storage medium. The video playback program 50 includes an acquisition process 51 and a display control process 52.
The CPU 41 reads the video playback program 50 from the storage section 43, expands the video playback program 50 into the memory 42, and sequentially executes the processes included in the video playback program 50. The CPU 41 operates as the acquisition section 21 illustrated in FIG. 1 by executing the acquisition process 51. The CPU 41 also operates as the display controller 22 illustrated in FIG. 1 by executing the display control process 52. The computer 40, which executes the video playback program 50, thereby functions as the video playback device 20.
The functionality implemented by the video playback program 50 can also be implemented by, for example, a semiconductor integrated circuit, and more specifically, by an application specific integrated circuit (ASIC).
Next, explanation follows regarding operation of the video playback system 10 according to the first exemplary embodiment.
In the video playback device 20, when the user has logged-in to the video playback application, the acquisition section 21 transmits the identification information (for example, the username) of the logged-in user to the video management device 30.
In the video management device 30, when the user identification information has been received, the controller 31 transmits, to the video playback device 20, a playlist listing of video data permitted for distribution to the logged-in user.
In the video playback device 20, the acquisition section 21 passes the acquired playlist listing to the display controller 22. The display controller 22, for example, displays a video playback screen 60 like that illustrated in FIG. 2 (the left video 62L and the right video 62R are not displayed).
When respective thumbnail images have been selected by the user from the left video playlist listing 63L and the right video playlist listing 63R, the display controller 22 emphatically displays the selected thumbnail images. The display controller 22 then notifies, to the acquisition section 21, the playlist name corresponding to the thumbnail image selected from the left video playlist listing 63L, and the playlist name corresponding to the thumbnail image selected from the right video playlist listing 63R. The acquisition section 21 then requests video data from the video management device 30 by transmitting the playlist names indicated by the respectively notified left video 62L and right video 62R to the video management device 30.
In the video management device 30, the controller 31 acquires the playlist corresponding to the requested video data from the video DB 32, and transmits the acquired playlist to the video playback device 20.
In the video playback device 20, the acquisition section 21 acquires the playlist, and sequentially requests the split files from the video management device 30 in accordance with the acquired playlist.
In the video management device 30, the controller 31 acquires the requested split files from the video DB 32, and sequentially transmits the acquired split files to the video playback device 20.
In the video playback device 20, the acquisition section 21 sequentially passes the acquired split files to the display controller 22. Then, when the display controller has received the split files from the acquisition section 21, the left video 62L and the right video 62R are each played back in the video playback region 61. The respective display sizes and display positions of the left video 62L and the right video 62R are defined by the respective control information held for the left video 62L and right video 62R. Note that at this stage, a predetermined initial value is set in the control information. The display controller 22 then respectively controls playback of the left video 62L and the right video 62R based on operation of the operation buttons of the respective operation button groups 64L, 64C, 64R by the user.
Then, in a state in which the video playback screen 60 is displayed with the display horizontal bar button 65 included, when the display horizontal bar button 65 is selected by the user, the height adjustment processing illustrated in FIG. 6 is executed in the video playback device 20.
At step S11 of the height adjustment processing illustrated in FIG. 6, the display controller 22, for example, displays the left video horizontal bar 66L at a predetermined initial position on the left video 62L, and displays the right video horizontal bar 66R at a predetermined initial position on the right video 62R, as illustrated in FIG. 3.
Next, at step S12, the display controller 22 determines whether or not the execute height adjustment button 68 has been selected by the user. Processing transitions to step S13 in cases in which the execute height adjustment button 68 has not been selected.
At step S13, the display controller 22 determines whether or not a change in the position of either the left video horizontal bar 66L or the right video horizontal bar 66R has been received. For example, in cases in which either of the horizontal bar position adjusting buttons 67L, 67R have been selected, and in cases in which either of the horizontal bars 66L, 66R have been operated by dragging or swiping, the display controller 22 receives a change in the position of either of the horizontal bars 66L, 66R. Processing then transitions to step S14. However, processing returns to step S12 in cases in which no change in position has been received.
At step S14, the display controller 22 changes the display position of the horizontal bars 66L, 66R such that the horizontal bars 66L, 66R are displayed at the position received at step S13 above, and processing returns to step S12.
At step S12, processing transitions to step S15 when the display controller 22 determines that the execute height adjustment button 68 has been selected by the user. At step S15, the display controller 22, for example, as illustrated in FIG. 4, adjusts the display position of at least one out of the left video 62L or the right video 62R such that respective positions within the videos 62L, 62R respectively indicated by the horizontal bar 66L and the horizontal bar 66R are at the same height. The height adjustment processing then ends.
As explained above, in the video playback system 10 according to the first exemplary embodiment, the video playback device 20 adjusts the display positions of the left video and the right video such that positions designated by the horizontal bars are aligned at the same position in the vertical direction, namely, such that the designated positions are at the same height. This facilitates comparison of the left video and the right video.
Note that although explanation has been given in the first exemplary embodiment regarding a case in which the left video 62L right video 62R are disposed side-by-side in the horizontal direction and the heights of their display positions are adjusted, there is no limitation thereto. For example, as illustrated in FIG. 7, configuration may be made such that an upper video 62U and a lower video 62D are disposed side-by-side in the vertical direction and their display positions are adjusted in the horizontal direction in a video playback screen 160. In the video playback screen 160, configuration similar to that of the respective configurations of the video playback screen 60 in FIG. 3 are allocated similar reference numerals with only the suffixes of the reference numerals changed from “L” or “R” to “U” or “D”, and detailed explanation is omitted. Note that the reference numeral “U” is allocated to configuration related to the upper video 62U, and the reference numeral “D” is allocated to configuration related to the lower video 62D.
More specifically, when a display vertical bar button 165 (see also FIG. 8) provided to the video playback screen 160 has been selected, the display controller 22 displays an upper video vertical bar 66U on the upper video 62U, and displays a lower video vertical bar 66D on the lower video 62D. Similarly to the horizontal bars 66L, 66R, the respective vertical bars 66U, 66D can be moved in the horizontal direction by operation of an upper video vertical bar position adjustment button 67U and a lower video vertical bar position adjustment button 67D. Moreover, the respective vertical bars 66U, 66D may also be moved in the horizontal direction directly by a dragging or swiping operation. When a horizontal position adjustment execution button 168 provided to the video playback screen 160 has been selected, as illustrated in FIG. 8, the display controller 22 adjusts the display position of at least one out of the upper video 62U or the lower video 62D, such that respective positions in the videos 62U, 62D respectively indicated by the vertical bars 66U, 66D are at the same position in the horizontal direction. Note that the positions at which the upper video vertical bar 66U and the lower video vertical bar 66D were displayed are indicated by the dotted line Q in FIG. 8.
This enables the display positions of the upper video 62U and the lower video 62D in the horizontal direction to also be adjusted similarly to in the case of adjusting the display positions of the left video 62L and the right video 62R in the vertical direction.
Next, explanation follows regarding a video playback system according to a second exemplary embodiment. In the video playback system according to the second exemplary embodiment, portions similar to those of the video playback system 10 according to the first exemplary embodiment are allocated the same reference numerals, and detailed explanation thereof is omitted.
As illustrated in FIG. 1, a video playback system 210 according to the second exemplary embodiment includes a video playback device 220, and the video management device 30. The video playback device 220 and the video management device 30 are connected to each other through a network. As illustrated in FIG. 1, the video playback device 220 functionally includes the acquisition section 21 and a display controller 222. Note that the display controller 222 is an example of a reception section and an adjustment section of technology disclosed herein.
When the display controller 222 has received a playlist listing from the acquisition section 21, the display controller 222, for example, displays a video playback screen 260 like that illustrated in FIG. 9 on a display section. The video playback screen 260 includes a display superimposed mark button 265 instead of the display horizontal bar button 65 of the video playback screen 60 of the first exemplary embodiment. A superimposed mark is a mark for designating a position to serve as a reference for overlaying when performing superimposed display of the left video 62L and the right video 62R. When the display superimposed mark button 265 has been selected, the display controller 222, for example, displays a left video superimposition mark 266L on the left video 62L, and displays a right video superimposition mark 266R on the right video 62R, as illustrated in FIG. 10. In the example of FIG. 10, marks represented by respective squares and lines across the diagonals of the squares serve as the superimposition marks 266L, 266R, and positions (coordinates) of the respective superimposition marks 266L, 266R are specified by the respective positions of the intersection points of the diagonal lines. The positions of the respective superimposition marks 266L, 266R displayed when the display superimposed mark button 265 has been selected may be predetermined initial positions (for example, the respective centers of the left video 62L and the right video 62R).
The display controller 222 also displays a left video superimposition mark position adjustment button 267L and a right video superimposition mark position adjustment button 267R in a specific region of the video playback screen 260. The respective superimposition mark position adjustment buttons 267L, 267R are buttons for instructing changes in the positions of the respective superimposition mails 266L, 266R in both the horizontal direction and the vertical direction. For example, each time a button of the respective superimposition mark position adjustment buttons 267L, 267R indicating a direction out of up, down, left, or right has been selected, the display controller 222 moves the display positions of the respective superimposition marks 266L, 266R by a specific amounts of pixels (for example, one pixel) in the designated direction. Note that the respective superimposition marks 266L, 266R may be directly moved in the up, down, left, or right direction by a dragging or a swiping operation.
Moreover, the display controller 222 displays a execute superimposition button 268 in place of the display superimposed mark button 265 in a specific region of the video playback screen 260. When the execute superimposition button 268 has been selected, as illustrated in FIG. 11, the display controller 222 adjusts the display position of at least one out of the left video 62L and the right video 62R such that positions inside the videos 62L, 62R indicated by the left video superimposition mark 266L and the right video superimposition mark 266R are at the same position. Note that in the example of FIG. 11, the right video 62R is disposed in the center of the video playback region 61, and the left video 62L is superimposed thereon after being set with transparency. The dotted line S in FIG. 11 indicates the position where the superimposition mark 266L or the superimposition mark 266R has been displayed on the left video 62L or the right video 62R. Information related to the overlay sequence (which video is the video to be overlayed on), and the transparency setting can be held as control information of the respective videos 62L, 62R.
The display controller 222 acquires information related to the respective positions of the superimposition marks 266L, 266R in each video, the current respective display positions of the left video 62L and the right video 62R, and the size of the video playback region 61. Based on the acquired information, the display controller 222 derives a display position obtained by adjusting at least one out of the left video 62L or the right video 62R. For example, the display controller 222 derives the position of the right video superimposition mark 266R when the right video 62R has been disposed in the center of the video playback region 61. The display controller 222 then derives the differences between the position of the derived right video superimposition mark 266R and the current position of the left video superimposition mark 266L in the horizontal direction and the vertical direction, and derives a position obtained by moving by this difference as the display position of the left video 62L. In cases in which either of the videos 62L, 62R exceeds the video playback region 61, adjustment may be performed such that the videos 62L, 62R do not exceed the video playback region 61, and the display positions may be readjusted with the display sizes of both of the videos 62L, 62R reduced.
The display controller 222 updates information related to the display positions included in the respective control information of the left video 62L and the right video 62R to the display positions derived above. The display controller 222 also sets the sequence of overlaying in the control information for the respective videos 62L, 62R. The display controller 222 also sets a predetermined transparency ratio for the transparency setting included in the control information of the video at the front side of the overlay. The display controller 222 then changes the display position of at least one out of the left video 62L or the right video 62R based on the updated control information, and displays the left video 62L and the right video 62R superimposed with each other.
The display controller 222 also displays superimposed display position adjustment buttons 69 in a specific region of the video playback screen 260. The superimposed display position adjustment buttons 69 are buttons for instructing an adjustment to the display position of at least one out of the left video 62L or the right video 62R, which are displayed superimposed with each other. The superimposed display position is made adjustable since, depending on the size of the display sections and the contents of the videos, it is easier to compare the two videos 62L, 62R when slightly offset from each other than in cases in which the superimposition marks 266L, 266R are displayed superimposed so as to completely match with each other. In the example of FIG. 11, the superimposed display position adjustment buttons 69 are provided for adjusting the display position of the left video 62L at the front side of the overlay. In this case, each time a button of the superimposed display position adjustment buttons 69 indicating either the up, down, left, or right direction has been selected, for example, the display controller 222 moves the display position of the left video 62L by a specific amount of pixels (for example, one pixel) in the designated direction, as illustrated in FIG. 12.
The display controller 222 also displays a release superimposed display button 70 in a specific region of the video playback screen 260 in place of the execute superimposition button 268. In cases in which the release superimposed display button 70 has been selected, the display controller 222 restores the video playback screen 260 to a state prior to execution of superimposed display (for example, the video playback screen 260 illustrated in FIG. 9).
The video playback device 220 may, for example, be implemented by the computer 40 illustrated in FIG. 5. A video playback program 250 that causes the computer 40 to function as the video playback device 220 is stored in the storage section 43 of the computer 40. The video playback program 250 includes the acquisition process 51 and a display control process 252.
The CPU 41 reads the video playback program 250 from the storage section 43, expands the video playback program 250 into the memory 42, and sequentially executes the processes included in the video playback program 250. The CPU 41 operates as the acquisition section 21 illustrated in FIG. 1 by executing the acquisition process 51. The CPU 41 also operates as the display controller 222 illustrated in FIG. 1 by executing the display control process 252. The computer 40, which executes the video playback program 250, thereby functions as the video playback device 220.
The functionality implemented by the video playback program 250 can also be implemented by, for example, a semiconductor integrated circuit, and more specifically, by an ASIC or the like.
Next, explanation follows regarding operation of the video playback system 210 according to the second exemplary embodiment. The second exemplary embodiment differs from the first exemplary embodiment in that the superimposed display processing illustrated in FIG. 13 is executed in place of the height adjustment processing (FIG. 6) executed in the first exemplary embodiment. When the display superimposed mark button 265 has been selected by the user in a state in which the video playback screen 260 is displayed with the display superimposed mark button 265 included, the superimposed display processing is executed in the video playback device 220.
At step S21 of the superimposed display processing illustrated in FIG. 13, the display controller 222, for example, displays the left video superimposition mark 266L at a predetermined initial position on the left video 62L as illustrated in FIG. 10. The display controller 222 also displays the right video superimposition mark 266R at a predetermined initial position on the right video 62R.
Next, at step S22, the display controller 222 determines whether or not the execute superimposition button 268 has been selected by the user. Processing transitions to step S23 in cases in which the execute superimposition button 268 has not been selected.
At step S23, the display controller 222 determines whether or not a change in the position of either the left video superimposition mark 266L of the right video superimposition mark 266R has been received. For example, in cases in which either out of the superimposition mark position adjustment buttons 267L, 267R has been selected, and in cases in which either out of the superimposition marks 266L, 266R has been drag operated, the display controller 22 receives a change in the position of either out of the superimposition marks 266L, 266R. Processing then transitions to step S24. However, processing returns to step S22 in cases in which a change in position has not been received.
At step S24, the display controller 222 changes the display positions of the superimposition marks 266L, 266R such that the superimposition marks 266L, 266R are displayed at the position received at step S23 above, and processing returns to step S22.
At step S22, processing transitions to step S25 when the display controller 222 has determined that the execute superimposition button 268 has been selected by the user. At step S25, the display controller 22, for example, sets transparency for the left video 62L, and displays the left video 62L superimposed on the right video 62R such that the left video superimposition mark 266L and the right video superimposition mark 266R are at the same position, as illustrated in FIG. 11.
Next, at step S26, the display controller 222 determines whether or not a change in the position of the superimposed display has been received. In cases in which, for example, the superimposed display position adjustment buttons 69 have been selected, the display controller 222 receives the change in the position of the superimposed display, and processing transitions to step S27. However, in cases in which no change in position has been received, processing returns to step S26.
At step S27, the display controller 222 changes the display position of at least one out of the left video 62L or the right video 62R based on the position received at step S26 above, and processing returns to step S26.
At step S26, in cases in which the display controller 222 has determined that no change in position of superimposed display has been received, processing transitions to step S28, and the display controller 222 determines whether or not the release superimposed display button 70 has been selected by the user. Processing returns to step S26 in cases in which the release superimposed display button 70 has not been selected. In cases in which the release superimposed display button 70 has been selected, the superimposed display of the left video 62L and the right video 62R is released, and superimposed display processing ends.
As explained above, in the video playback system 210 according to the second exemplary embodiment, the video playback device 220 adjusts the display position of the left video and the right video such that the positions designated by aligning the superimposition marks at the same position in the horizontal direction and the vertical direction. Namely, the left video and the right video are displayed superimposed with reference to the position of the respective superimposition marks. This facilitates comparison of the left video and the right video.
Moreover, comparison of the left video and the right video is further facilitated by enabling adjustment of the superimposed display positions of the left video and the right video displayed superimposed with reference to the position of the respective superimposition marks.
Note that although explanation has been given regarding a case in which the left video is set with transparency and superimposed on the right video in the second exemplary embodiment, there is no limitation thereto. Superimposition may be performed with the right video at the front, and transparency may be set for both videos.
Moreover, although explanation has been given regarding a case in which the display positions of the videos that are displayed superimposed are offset in the horizontal direction and the vertical direction by operating the superimposed display position adjustment buttons in the second exemplary embodiment, there is no limitation thereto. For example, when superimposed display is executed, a preset may be applied such that superimposed display is performed at a position at a predetermined offset distance in the horizontal direction or the vertical direction, from a position where the superimposition marks of both videos completely match.
Moreover, there is no limitation to cases in which overlaying is performed with the superimposition mark serving as a reference, and one of the videos may be directly moved in at least one out of the horizontal direction and the vertical direction by, for example, button operating or drag operating the video, and superimposed display of both videos may be realized by overlaying the video onto the other video.
Next, explanation follows regarding a video playback system according to the third exemplary embodiment. In the third exemplary embodiment, explanation is given regarding a case in which display positions of videos are shared between users. Note that in the video playback system according to the third exemplary embodiment, portions similar to those of the video playback system 10 according to the first exemplary embodiment are allocated the same reference numerals and detailed explanation thereof is omitted.
As illustrated in FIG. 1, a video playback system 310 according to the third exemplary embodiment includes a video playback device 320 and a video management device 330. The video playback device 320 and the video management device 330 are connected to each other through a network.
A controller 331 of the video management device 330 controls distribution of video data to the video playback device 320, similarly to the controller 31 of the first exemplary embodiment. Additionally, the controller 331 manages shared information for sharing the display position of videos between users. The shared information includes a username, two playlist names, and information related to display positions of videos indicated by the respective playlists, and this is explained in more detail below. Hereafter, the user at the side registering the shared information to the video management device 330 is sometimes referred to as the “transmission side user”, and the user at the side using the shared information managed by the video management device 330 to play back the videos is sometimes referred to as the “reception side user”.
More specifically, the controller 331 receives the shared information transmitted from the video playback device 320 due to instruction from the transmission side user. The controller 331 holds, for example, a shared information table 332A like that illustrated in FIG. 14 in a video DB 332 that stores plural items of video data and the respective playlists of the video data, and the controller 331 manages the received shared information. In the example of FIG. 14, each row corresponds to one item of shared information. Moreover, “playlist 1” and “playlist 2” are two respective playlist names included in the shared information. Note that in the third exemplary embodiment also, video playback can be performed in the video playback device 320 in a state in which the left video 62L and the right video 62R are aligned, similarly to in the first exemplary embodiment. The two playlist names are therefore the playlist name of the left video 62L and the playlist name of the right video 62R, respectively. However, since both of the videos 62L, 62R are identifiable as either the left video 62L or the right video 62R based on the display position, there is no need to specify which out of the left video 62L and the right video 62R the playlist 1 or playlist 2 corresponds to.
The controller 331 also manages the shared information for each transmission side user. When shared information is registered in the shared information table 332A, the controller 331 allocates, to each item of shared information, a number for identifying the item of shared information for each username as a “user-distinct shared information number”.
As illustrated in FIG. 15, for each user, shared information transmitted by that user when they are the transmission side user is also stored in a sharing user table 332B in the video DB 332 in association with identification information (for example, usernames) of users that are capable of using the shared information as reception side users. The sharing user table 332B may be preregistered when application use is registered, and usernames of users capable of using the shared information may be included in the shared information and registered when the shared information has been received by the controller 331.
When shared information usable by a logged-in user is present, the controller 331 notifies this to the video playback device 320 in addition to transmitting the playlist listing of the video data permitted for distribution to the logged-in user. More specifically, the controller 331 references the sharing user table 332B, searches the “reception side user” column for usernames of logged-in users, and acquires the usernames of corresponding transmission side users. In cases in which shared information being managed in association with an acquired username is present in the shared information table 332A, the controller 331 then determines that shared information usable by a logged-in user is present in the shared information table 332A.
Moreover, when the controller 331 has received a request for a share list (described in detail below) from the video playback device 320, the controller 331 acquires shared information usable by the logged-in user from the shared information table 332A, and transmits a share list listing the acquired shared information to the video playback device 320. At least the usernames and the user-distinct shared information numbers for each item of shared information are included in the share list. Other than the above information included in the shared information, metadata, a thumbnail image, and the like of video data indicated by the playlist name included in each item of shared information may also be included in the shared information.
Moreover, when the controller 331 has received a request for a shared video from the video playback device 320, the controller 331 acquires shared information for the requested video, and the two playlists respectively indicated by the two playlist names included in the shared information, from the video DB 332. The controller 331 then transmits the acquired shared information and playlists to the video playback device 320.
As illustrated in FIG. 1, the video playback device 320 functionally includes an acquisition section 321 and a display controller 322. Note that the display controller 322 is an example of a reception section and an adjustment section of technology disclosed herein.
Similarly to the acquisition section 21 of the first exemplary embodiment, the acquisition section 321 acquires video data from the video management device 330. Additionally, the acquisition section 321 transmits the shared information to the video management device 330 according to instruction by the transmission side user.
The acquisition section 321 also acquires video data shared from the video management device 330, according to instruction by the reception side user. More specifically, when a user has logged-in, in cases in which a notification has been received from the video management device 330 stating that shared information usable by the logged-in user is present, the acquisition section 321 notifies this to the display controller 322. Moreover, when a notification (described in detail below) has been made from the display controller 322 stating that a display share list button has been selected, the acquisition section 321 requests a share list from the video management device 330. The acquisition section 321 also passes the share list received corresponding to the request to the display controller 322. Moreover, when the display controller 322 has notified the acquisition section 321 of a username and a user-distinct shared information number of shared information selected from the share list (this is described in more detail below), the acquisition section 321 requests the shared video by transmitting the username and the user-distinct shared information number to the video management device 330. The acquisition section 321 then acquires the shared information and the playlist received corresponding to the request, sequentially acquires the split files from the video management device 330 according to the playlist, and passes the acquired split files to the display controller 322 together with the shared information.
Similarly to the display controller 22 of the first exemplary embodiment, the display controller 322 displays a video playback screen on the display section, and performs height adjustment on the left video 62L and the right video 62R. Additionally, the display controller 322, for example, displays a share button 71 on a video playback screen 360 after having performed height adjustment on the left video 62L and the right video 62R, as illustrated in FIG. 16. When the share button 71 has been selected, the display controller 322 acquires the respective playlist names of the left video 62L and the right video 62R from the playlist listing during playback, and acquires information related to the display positions from the respective control information held by the videos 62L, 62R. The display controller 322 appends the identification information (for example, the username) of the logged-in user to the respective playlist names of the acquired left video 62L and right video 62R and the information related to the display position, and passes this to the acquisition section 321 as the shared information.
Moreover, when the display controller 322 has been notified by the acquisition section 321 that shared information usable by the logged-in user is present, the display controller 322 displays the display share list button 72 on the video playback screen 360, as illustrated in FIG. 17. When the display share list button 72 has been selected, the display controller 322 notifies this to the acquisition section 321.
When the display controller 322 has received the share list from the acquisition section 321, the display controller 322 also displays, for example, a share list screen 80 like that illustrated in FIG. 18. The share list screen 80 may be displayed by switching from video playback screen 360, or may be displayed superimposed over the video playback screen 360. In the example of FIG. 18, the share list screen 80 includes a share list 81 and a select button 82. Each row of the share list 81 corresponds to one item of shared information and each row is displayed in a selectable state. Moreover, each row of the share list 81 is linked to at least a username and a user-distinct shared information number, and selecting at least one row from the share list 81 causes the shared information specified by the username and user-distinct shared information number linked to that row to be selected. In the example of FIG. 18, a case is illustrated in which the items included in the share list 81 are the username, playlist 1, and playlist 2; however, there is no limitation thereto. In cases in which metadata, a thumbnail image, and the like of the video data indicated by each playlist name is included in the share list acquired from the video management device 330, this information may also be displayed.
When the select button 82 has been selected in a state in which at least one row has been selected from the share list 81, the display controller 322 notifies, to the acquisition section 321, the username and the user-distinct shared information number linked to the row selected in the share list 81. The display controller 322 also closes the share list screen 80 and returns to displaying the video playback screen 360.
Moreover, when the display controller 322 has received the shared information together with the split files from the acquisition section 321, the display controller 322 sets, in the control information of the video represented by the split files, the information related to the display position included in the shared information. More specifically, for example, in a case in which the shared information in the first row of the shared information table 332A illustrated in FIG. 14 has been received, (x1, y1) is set as the display position included in the control information of the video represented by the split files acquired in accordance with playlist 1. Similarly, (x2, y2) is set as the display position included in the control information of the video represented by the split files acquired in accordance with playlist 2. When the reception side user plays back the video, the display controller 322 can display the video in the same display position as that of the video playback screen 360 when the transmission side user selected the share button 71 by disposing the respective videos 62L, 62R in accordance with the control information.
The video playback device 320 may, for example, be implemented by the computer 40 illustrated in FIG. 5. A video playback program 350 that causes the computer 40 to function as the video playback device 320 is stored in the storage section 43 of the computer 40. The video playback program 350 includes an acquisition process 351 and a display control process 352.
The CPU 41 reads the video playback program 350 from the storage section 43, expands the video playback program 350 into the memory 42, and sequentially executes the processes included in the video playback program 50. The CPU 41 operates as the acquisition section 321 illustrated in FIG. 1 by executing the acquisition process 351. The CPU 41 also operates as the display controller 322 illustrated in FIG. 1 by executing the display control process 352. The computer 40, which executes the video playback program 350, thereby functions as the video playback device 320.
Note that the functionality implemented by the video playback program 350 can also be implemented by, for example, a semiconductor integrated circuit, and more specifically, by an ASIC or the like.
Next, explanation follows regarding operation of the video playback system 310 according to the third exemplary embodiment. In the third exemplary embodiment, processing other than processing that shares display positions of videos between users is similar to that of the first exemplary embodiment, and explanation therefore follows regarding the processing to share the display positions of videos between users.
After first explaining a flow of processing for exchanges between a video playback device 320A operated by the transmission side user, the video management device 330, and a video playback device 320B operated by the reception side user, explanation follows regarding details of processing executed by each of these devices. Note that it is convenient to treat the video playback device 320A and the video playback device 320B as being distinct for the sake of explaining differences in behavior between the transmission of shared information and the use of shared information, but this does not imply that these devices are configured differently from each other.
FIG. 19 illustrates a sequence chart representing a flow of processing for exchanges between the video playback device 320A, the video management device 330, and the video playback device 320B. In the video playback device 320A, the height adjustment processing for the left video 62L and the right video 62R (S10) is, for example, executed similarly to the height adjustment processing of the first exemplary embodiment (FIG. 6). When the share button 71 has been selected from the video playback screen 360 in this state, the display controller 322 generates shared information (S30) and transmits the shared information to the video management device 330 (S33). The received shared information is managed in the video management device 330 (S40).
Due to a user logging in to the video playback device 320B, the username of the logged-in user is transmitted from the video playback device 320B to the video management device 330 (S71). In cases in which shared information usable by the logged-in user is present, the video management device 330 notifies this to the video playback device 320B (S72). When this notification has been received and the share list has been requested by the video playback device 320B (S63), the share list is transmitted from the video management device 330 (S54). The video playback device 320B then makes a request to the video management device 330 for the shared video (S66). The video management device 330 transmits, to the video playback device 320B, shared information for the requested video and the playlists indicated by the playlist names included in the shared information (S56).
In the video playback device 320B, the acquired shared information is analyzed, and the username, the respective playlist names, and information related to the display position of the video indicated by each of the playlist names is extracted. The video playback device 320B also makes sequential requests to the video management device 330 for the split files in accordance with the acquired playlist (S68). The video management device 330 sequentially transmits the split files to the video playback device 320B in accordance with the request (S73). In the video playback device 320B, the video represented by the acquired split files is disposed and played back at a position according to the display position of the playlist included in the shared information (S69).
Explanation follows regarding processing executed by the video playback device 320A, the video management device 330, and the video playback device 320B, respectively. In each processing, steps that perform processing similar to processing explained with reference to FIG. 19 are allocated the same reference numerals.
First, in the video playback device 320A, when the share button 71 displayed by the video playback screen 360 has been selected, the shared information transmission processing illustrated in FIG. 20 is executed.
At step S31, the display controller 322 respectively acquires the playlist names for the left video 62L and the right video 62R during playback, from the playlist listing received from the acquisition section 321. Next, at step S32, the display controller 322 acquires information related to the display position of the respective videos 62L, 62R from the respective control information of the left video 62L and the right video 62R. Next, at step S33, the display controller 322 appends the identification information of the logged-in user (for example, their username) to the two items of acquired information, these being the playlist names and the display positions, and this is passed to the acquisition section 321 as the shared information. The acquisition section 321 then transmits the shared information to the video management device 330 and then ends the shared information transmission processing.
Next, in the video management device 330, when the shared information transmitted from the video playback device 320A has been received, the shared information reception processing illustrated in FIG. 21 is executed.
At step S41, the controller 331 allocates a user-distinct shared information number to the received shared information. Next, at step S42, the controller 331 stores the shared information allocated with the user-distinct shared information number in the shared information table 332A of the video DB 332, and then ends the shared information reception processing.
Moreover, in the video playback device 320B, when a username transmitted from the video playback device 320B due to a user logging in has been received by the video management device 330, the shared video transmission processing illustrated in FIG. 22 is executed by the video management device 330.
At step S51, the controller 331 references the sharing user table 332B and the shared information table 332A of the video DB 332, and determines whether or not shared information usable by the logged-in user is present. In cases in which shared information usable by the logged-in user is present, processing transitions to step S52, and the video playback device 320B is notified that shared information usable by the logged-in user is present. However, in cases in which no shared information usable by the logged-in user is present, the shared video transmission processing ends.
Next, at step S53, the controller 331 determines whether or not a request for a share list from the video playback device 320B has been received. Processing transitions to step S54 in cases in which a request for a share list has been received, or the determination of the current step is repeated in cases in which a request for a share list has not been received.
At step S54, the controller 331 acquires shared illumination usable by the logged-in user from the shared information table 332A, and transmits the share list listing the acquired shared information to the video playback device 320B.
Next, at step S55, the controller 331 determines whether or not a request from the video playback device 320B for shared videos has been received. Processing transitions to step S56 in cases in which a request for shared videos has been received, or the determination of the current step is repeated in cases in which a request for shared videos has not been received.
At step S56, the controller 331 acquires, from the video DB 332, shared information for the requested videos and the two playlists respectively indicated by the two playlist names included in the shared information, and transmits these to the video playback device 320B.
Next, at step S57, the controller 331 determines whether or not a request from the video playback device 320B for split files has been received. Processing transitions to step S58 in cases in which a request for split files has been received, or the determination of the current step is repeated in cases in which request for split files has not been received.
At step S58, the controller 331 acquires the requested split files from the video DB 332, sequentially transmits the acquired split files to the video playback device 320B, and then the shared video transmission processing ends.
However, when a notification has been made from the video management device 330 to the video playback device 320B stating that shared information usable by the logged-in user is present, the shared video playback processing illustrated in FIG. 23 is executed in the video playback device 320B.
At step S61, the acquisition section 321 notifies the display controller 322 that shared information usable by the logged-in user is present, and having received this notification, the display controller 322 displays the display share list button 72 on the video playback screen 360.
Next, at step S62, the display controller 322 determines whether or not the display share list button 72 has been selected by the user. Processing transitions to step S63 in cases in which the display share list button 72 has been selected, or the determination of the current step is repeated in cases in which the display share list button 72 has not been selected.
At step S63, the display controller 322 notifies the acquisition section 321 that the display share list button 72 has been selected, and having received the notification, the acquisition section 321 makes a request to the video management device 330 for the share list. Next, at step S64, the acquisition section 321 acquires the share list transmitted from the video management device 330 according to the request, and passes the acquired share list to the display controller 322. The display controller 322, for example, displays a share list screen 80 like that illustrated in FIG. 18.
Next, at step S65, in a state in which at least one row has been selected from the share list 81 of the share list screen 80, the display controller 322 determines whether or not shared information has been selected by the user by determining whether or not the select button 82 has been selected. Processing transitions to step S66 in cases in which shared information has been selected, or the determination of the current step is repeated in cases in which shared information has not been selected.
At step S66, the display controller 322 notifies, to the acquisition section 321, the username and the user-distinct shared information number linked to the row selected in the share list 81. Having received the notification, the acquisition section 321 makes a request to the video management device 330 for the shared videos. The display controller 322 also closes the share list screen 80 and returns to displaying the video playback screen 360.
Next, at step S67, the acquisition section 321 acquires the shared information and the playlist transmitted from the video management device 30 according to the request. Next, at step S68, the acquisition section 321 sequentially acquires the split files from the video management device 330 in accordance with the playlist, and passes the acquired split files to the display controller 322 together with the shared information acquired at step S67 above.
Next, at step S69, the display controller 322 sets, in the control information of the videos indicated by the acquired split files, the information related to the display position included in the shared information, disposes and plays back the respective videos 62L, 62R in accordance with the control information, and ends the shared video playback processing.
As explained above, in the video playback system 310 according to the third exemplary embodiment, the video playback device 320 transmits, to the video management device 330, information regarding the respective display positions related to the left video and the right video after height adjustment was performed, and this information is managed as the shared information in the video management device 330. Then, when the shared videos are played back, in the video playback device 320, the shared information is also acquired together with the playlist, and the videos are disposed at the display positions indicated by the shared information. This enables a user who has compared plural videos to share the display positions for each video with another user such that playback is performed at the same display position, without using editing tools or the like to generate new videos in the height adjusted state.
In the third exemplary embodiment, explanation has been given regarding a case in which, similar to the first exemplary embodiment, the display position of each video obtained by adjusting the height of the left video and the right video is shared; however, there is no limitation thereto. Similarly to in the second exemplary embodiment, display positions from a case in which the left video and the right video are displayed superimposed may be shared. In such cases, similarly to in the exemplary embodiments above, display positions, transparency settings, and the like of each video at the time of superimposed display may be managed as shared information.
Explanation has been given regarding a case in which display positions of videos are shared in the third exemplary embodiment. However, in cases in which the shared operation button group 64C is operated and two video playback timings are synchronized by the transmission side user, this synchronization state may also be shared. In such cases, information for specifying respective frame images of the left video 62L and the right video 62R being displayed at the timing when the share button 71 was selected may be acquired (for example, timestamps or frame numbers), and this information may be included in the shared information. When shared videos are played back by the reception side user, the playback timing of the left video 62L and the right video 62R is controlled such that frame images of the left video 62L and frame images of the right video 62R specified by information such as timestamps included in the shared information are displayed at the same timing.
In each of the exemplary embodiments above, explanation has been given regarding cases in which split files obtained by splitting a single item of video data at specific time intervals are sequentially acquired and played back in accordance with a playlist, namely, cases in which the subject is video data managed while split into plural segments; however, there is no limitation thereto. For example, video data managed with each segment as an individual file could be the subject, as in MPEG-4. In such cases, the filename of each file may be included in the shared information in place of the playlist name.
Although explanation has been given regarding examples of cases in which two videos are compared in each of the exemplary embodiments above, technology disclosed herein may also be applied when comparing three or more videos.
Although the drawings illustrate cases in which baseball videos are played back in each of the exemplary embodiments above, the videos that are made the subject may be videos of another sport such as tennis or golf, or may be videos other than a sports videos. Although technology disclosed herein is particularly applicable to videos captured in similar settings, technology disclosed herein is also applicable to comparisons of videos created with, for example, slight differences in camera angle. For example, in the case of baseball videos, although compositions captured in the batter direction from behind the pitcher are often included, subtle discrepancies may arise in such compositions due to differences between stadiums, difference in the position where the pitcher or batter is standing, and the like, despite the compositions being of the same sort. Even in cases in which such discrepancies arise in videos being compared, comparison of minute portions, such as the position of a specific part of the pitcher or batter, is facilitated as long as the display positions can be adjusted as in each of the exemplary embodiments above.
Although explanation was given above regarding a mode in which the video playback program 50, 250, 350 was pre-stored (installed) to the storage section 43, there is no limitation thereto. The program according to technology disclosed herein may be provided in a mode recorded onto a recording medium such as a CD-ROM, DVD-ROM, or USB memory.
An aspect of technology disclosed herein enables comparison of plural videos to be facilitated.
1. A non-transitory recording medium storing a video playback program that causes a computer to execute a process, the process comprising:
displaying a plurality of videos separately in a plurality of display regions, respectively, each of the plurality of videos including control information for controlling a display position and a display size of a display region for the each of the plurality of videos within the screen;
for each of the displayed plurality of videos, receiving a user-designated position indicating a horizontal position or a vertical position within a frame in each of the displayed plurality of videos in each of the plurality of display regions; and
adjusting, by updating the control information of the plurality of videos according to the received user-designated position, a placement position of at least one of the plurality of display regions to line up the plurality of display regions to be at the same horizontal position for the user-designated position indicating the horizontal position in each of the plurality of display regions or at the same vertical position for the user-designated position indicating the vertical position in each of the plurality of display regions.
2. The non-transitory recording medium of claim 1, wherein, in the process, the user-designated position in each of the plurality of display regions is received during playback of each of the plurality of videos in each of the plurality of display regions, respectively.
3. The non-transitory recording medium of claim 1, wherein, in the process, adjusting the placement position includes adjusting a vertical direction position or a horizontal direction position of the at least one of the plurality of display regions, and displaying the plurality of videos in a superimposed state.
4. The non-transitory recording medium of claim 1, wherein, in the process, adjusting the placement position includes displaying the plurality of videos in a superimposed state such that the at least one of the plurality of display regions is offset from an original position of the at least one of the plurality of display regions by a specific distance in a vertical direction or a horizontal direction.
5. The non-transitory recording medium of claim 1, wherein the process further comprises storing, in a storage section, information related to the placement position adjusted for the at least one of the plurality of display regions.
6. A video playback device, comprising:
a processor configured to execute a process, the process comprising: displaying a plurality of videos separately in a plurality of display regions, respectively, each of the plurality of videos including control information for controlling a display position and a display size of a display region for the each of the plurality of videos within the screen; for each of the displayed plurality of videos, receiving a user-designated position indicating a horizontal position or a vertical position within a frame in each of the displayed plurality of videos in each of the plurality of display regions; and adjusting, by updating the control information of the plurality of videos according to the received user-designated position, a placement position of at least one of the plurality of display regions to line up the plurality of display regions to be at the same horizontal position for the user-designated position indicating the horizontal position in each of the plurality of display regions or at the same vertical position for the user-designated position indicating the vertical position in each of the plurality of display regions.
7. The video playback device of claim 6, wherein, in the process, the user-designated position in each of the plurality of display regions is received during playback of each of the plurality of videos in each of the plurality of display regions, respectively.
8. The video playback device of claim 6, wherein, in the process, adjusting the placement position includes adjusting a vertical direction position or a horizontal direction position of the at least one of the plurality of display regions, and displaying the plurality of videos in a superimposed state.
9. The video playback device of claim 6, wherein, in the process, adjusting the placement position includes displaying the plurality of videos in a superimposed state such that the at least one of the plurality of display regions is offset from an original position of the at least one of the plurality of display regions by a specific distance in a vertical direction or a horizontal direction.
10. The video playback device of claim 6, wherein the process further comprises storing, in a storage section, information related to the placement position adjusted for the at least one of the plurality of display regions.
11. A video playback method, comprising:
by a processor, adjusting, by updating the control information of the plurality of videos according to the received user-designated position, a placement position of at least one of the plurality of display regions to line up the plurality of display regions to be at the same horizontal position for the user-designated position indicating the horizontal position in each of the plurality of display regions or at the same vertical position for the user-designated position indicating the vertical position in each of the plurality of display regions.
12. The video playback method of claim 11, wherein, in the process, the user-designated position in each of the plurality of display regions is received during playback of each of the plurality of videos in each of the plurality of display regions, respectively.
13. The video playback method of claim 11, wherein, in the process, adjusting the placement position includes adjusting a vertical direction position or a horizontal direction position of the at least one of the plurality of display regions, and displaying the plurality of videos in a superimposed state.
14. The video playback method of claim 11, wherein, in the process, adjusting the placement position includes displaying the plurality of videos in a superimposed state such that the at least one of the plurality of display regions is offset from an original position of the at least one of the plurality of display regions by a specific distance in a vertical direction or a horizontal direction.
15. The video playback method of claim 11, wherein the process further comprises storing, in a storage section, information related to the placement position adjusted for the at least one of the plurality of display regions.
5947742 September 7, 1999 Katayama
20090147139 June 11, 2009 Watanabe
20090327893 December 31, 2009 Terry
20100054706 March 4, 2010 McCrossan
20140123160 May 1, 2014 van Coppenolle
20140286619 September 25, 2014 Nakagome et al.
20150356355 December 10, 2015 Oguchi
20160018973 January 21, 2016 Meehan
20170025037 January 26, 2017 Oguchi
20180095656 April 5, 2018 Ingah
7-144038 June 1995 JP
2014-186168 October 2014 JP
2015-61237 March 2015 JP
10-2014-0116033 October 2014 KR
M321799 November 2007 TW
M1482422 July 2014 TW
201436836 October 2014 TW
Office Action dated Jun. 6, 2017, issued in counterpart Taiwanese application No. 105122877, with English translation. (11 pages).
Office Action dated Jun. 21, 2017, issued in counterpart Korean Application No. 10-2016-0092856, with English translation. (12 pages).
Office Action dated Jan. 5, 2018, issued in counterpart Taiwanese Application No. 105122877, with English translation (10 pages).
Office Action dated Jan. 12, 2018, issued in counterpart Korean Application No. 10-2016-0092856, with English translation. (7 pages).
Office Action dated Jan. 8, 2019, issued in counterpart Japanese Application No. 2015-145346, with English machine translation. (5 pages).
Office Action dated Oct. 8, 2018, issued in Taiwanese Patent application No. 105122877, with English translation (7 pages) .
Patent number: 10504382
Patent Publication Number: 20170025039
Assignee: RUN.EDGE LIMITED (Tokyo)
Inventors: Atsushi Oguchi (Kawasaki), Masahiro Kihara (Fukuoka), Shunsuke Kobayashi (Fukuoka), Kazumi Doi (Fukuoka)
Application Number: 15/215,003
Current U.S. Class: Record Editing (360/13)
International Classification: H04N 5/775 (20060101); G09B 19/00 (20060101); G09B 5/06 (20060101); H04N 21/472 (20110101); H04N 21/8547 (20110101);