Source: https://patents.google.com/patent/JP6314438B2/en
Timestamp: 2020-05-28 19:36:43
Document Index: 483396653

Matched Legal Cases: ['art 3', 'art 3', 'art 6', 'art 6', 'art 6', 'art 6', 'art 7', 'art 7', 'art 8']

JP6314438B2 - Display control apparatus, display control method, and program - Google Patents
JP6314438B2
JP6314438B2 JP2013237931A JP2013237931A JP6314438B2 JP 6314438 B2 JP6314438 B2 JP 6314438B2 JP 2013237931 A JP2013237931 A JP 2013237931A JP 2013237931 A JP2013237931 A JP 2013237931A JP 6314438 B2 JP6314438 B2 JP 6314438B2
JP2013237931A
JP2015099968A (en
JP2015099968A5 (en
信儀 西坂
2013-11-18 Application filed by カシオ計算機株式会社 filed Critical カシオ計算機株式会社
2013-11-18 Priority to JP2013237931A priority Critical patent/JP6314438B2/en
2015-05-28 Publication of JP2015099968A publication Critical patent/JP2015099968A/en
2017-01-05 Publication of JP2015099968A5 publication Critical patent/JP2015099968A5/ja
2018-04-25 Publication of JP6314438B2 publication Critical patent/JP6314438B2/en
The present invention relates to a display control apparatus, a display control method, and a program for displaying an image.
2. Description of the Related Art Conventionally, there has been known an apparatus that displays a reference line superimposed on a moving image when analyzing a swing form of a golf club at the time of reproducing a moving image that captures a person swinging a golf club. Specifically, based on a predetermined operation by the user, after specifying the frame image when the subject enters the address posture, the moving image is set with the reference line set at a position suitable for the analysis of the swing form. Playback is performed (for example, see Patent Document 1).
JP-A-10-201898
However, in the case of the above-mentioned Patent Document 1, since a reference line is simply attached to a moving image and displayed, there is a problem that it is difficult for the viewer to objectively grasp the state of the subject.
The present invention has been made in view of such a problem, and an object of the present invention is to be able to easily and objectively grasp information based on an index set in an image.
In order to solve the above problems, a display control device according to the present invention provides:
Image acquisition means for acquiring an image of a subject;
Setting means for setting a reference line as an index for acquiring information related to a specific operation of a subject in the image for the image acquired by the image acquisition means;
Information acquisition means for acquiring information related to the operation based on the reference line set by the setting means;
A control unit that causes the display unit to display the index and information about the operation acquired by the information acquisition unit in association with the image acquired by the image acquisition unit;
The information acquisition means acquires the predetermined color information corresponding to the type of the other lines forming the reference line and the angle,
The control unit causes the display unit to display the indicator and the predetermined color information acquired by the information acquisition unit in association with the image acquired by the image acquisition unit.
According to the present invention, it is possible to objectively easily grasp information based on an index set in an image.
It is a block diagram which shows schematic structure of the imaging device of one Embodiment to which this invention is applied. 3 is a flowchart illustrating an example of an operation related to a moving image analysis process performed by the imaging apparatus of FIG. 1. It is a figure which shows typically an example of the moving image which concerns on the moving image analysis process of FIG. It is a figure which shows typically an example of the frame image which concerns on the moving image analysis process of FIG. It is a figure which shows typically an example of the analyzed moving image which concerns on the moving image analysis process of FIG. It is a figure which shows typically an example of the frame image which concerns on the moving image analysis process of the modification 1 to which this invention is applied. It is a figure which shows typically an example of the frame image which concerns on the moving image analysis process of the modification 2 to which this invention is applied.
As shown in FIG. 1, the imaging apparatus 100 according to the present embodiment includes a central control unit 1, a memory 2, an imaging unit 3, an image data generation unit 4, an image recording unit 5, an image analysis unit 6, A display unit 7 and an operation input unit 8 are provided.
The central control unit 1, the memory 2, the imaging unit 3, the image data generation unit 4, the image recording unit 5, the image analysis unit 6 and the display unit 7 are connected via a bus line 9.
The central control unit 1 controls each unit of the imaging device 100. Specifically, although not shown, the central control unit 1 includes a CPU (Central Processing Unit), a RAM (Random Access Memory), and a ROM (Read Only Memory), and includes various processing programs (illustrated) for the imaging apparatus 100. Various control operations are performed according to (omitted).
The memory 2 is composed of, for example, a DRAM (Dynamic Random Access Memory) or the like, and temporarily stores data processed by each unit such as the central control unit 1 and the image analysis unit 6.
The imaging unit 3 includes a lens unit 3a, an electronic imaging unit 3b, and an imaging control unit 3c.
The lens unit 3a includes a plurality of lenses such as a zoom lens and a focus lens, for example.
The electronic imaging unit 3b is composed of, for example, an image sensor such as a complementary metal-oxide semiconductor (CMOS) or a charge coupled device (CCD), and converts an optical image that has passed through various lenses of the lens unit 3a into a two-dimensional image signal. To do.
In addition, although illustration is abbreviate | omitted, the imaging part 3 may be provided with the aperture_diaphragm | restriction which adjusts the quantity of the light which passes the lens part 3a.
The imaging control unit 3c controls imaging of the subject by the imaging unit 3. That is, the imaging control unit 3c includes a timing generator, a driver, and the like, although not shown. Then, the imaging control unit 3c scans and drives the electronic imaging unit 3b with a timing generator and a driver, converts the optical image into a two-dimensional image signal with the electronic imaging unit 3b every predetermined period, and the electronic imaging unit 3b. The frame image is read from the imaging area for each screen and is output to the image data generation unit 4.
The image data generation unit 4 appropriately adjusts the gain for each RGB color component with respect to the analog value signal of the frame image transferred from the electronic imaging unit 3b, and then performs sample holding by a sample hold circuit (not shown). The digital signal is converted into digital data by a / D converter (not shown), color processing including pixel interpolation processing and γ correction processing is performed by a color process circuit (not shown), and then a digital luminance signal Y and color difference signal Cb , Cr (YUV data). Further, the image data generation unit 4 encodes each of a plurality of frame images constituting the moving image in a predetermined format (for example, MPEG format, motion JPEG format, etc.), and generates moving image image data.
For example, the imaging unit 3 captures a series of operations of a predetermined sport by a subject at a predetermined imaging frame rate (for example, 1000 fps), and the image data generation unit 4 includes a plurality of frame images associated with frame numbers. The image data of the moving image consisting of is generated.
In addition, the image data generation unit 4 transfers the generated image data to the memory 2 used as a buffer memory.
The image recording unit 5 is configured by, for example, a nonvolatile memory (flash memory). The image recording unit 5 records image data of various images encoded by a coding unit (not shown) of the image data generation unit 4 using a predetermined coding method.
Specifically, the image recording unit 5 includes, for example, a plurality of frame images F1 to F6 in which a series of actions of a subject are continuously captured by the imaging unit 3 (see FIGS. 3A to 3F). The image data of the moving image consisting of, the image data of the moving image consisting of a predetermined number of frame images based on a predetermined time point, and the like are recorded.
Further, as will be described later, the image recording unit 5 includes information based on an index set by the index processing unit 6b (described later) of the image analysis unit 6 and an index acquired by the information acquisition unit 6c (described later). You may record the image data etc. of the analyzed moving image which consists of several synthetic | combination frame image G1-G6 (refer FIG.5 (a)-FIG.5 (f)) synthesize | combined to each of the images F1-F6.
The image recording unit 5 may be configured, for example, such that a recording medium (not shown) is detachable, and controls reading of data from the loaded recording medium and writing of data to the recording medium.
The image analysis unit 6 includes an image acquisition unit 6a, an index processing unit 6b, and an information acquisition unit 6c.
Note that each unit of the image analysis unit 6 includes, for example, a predetermined logic circuit, but the configuration is an example and the present invention is not limited thereto.
The image acquisition unit 6a acquires an image to be processed by the moving image analysis process.
That is, the image acquisition unit (image acquisition unit) 6a acquires an image of a subject that performs a specific operation. Specifically, the image acquisition unit 6a reads, for example, image data of a moving image including a plurality of frame images obtained by continuously capturing the motion of the subject from a predetermined storage unit (for example, the image recording unit 5). Get.
For example, the image acquisition unit 6 a includes a plurality of frame images F <b> 1 to F <b> 1 generated by the image data generation unit 4 after a series of movements of a predetermined sport (for example, golf swing movements) by the subject are captured by the imaging unit 3. The image data of the moving image composed of F6 is read from the image recording unit 5 and acquired as a processing target of the moving image analysis processing.
The index processing unit 6b performs various processing operations such as index setting and position adjustment for analyzing a specific motion of the subject.
That is, the index processing unit (setting unit) 6b sets a plurality of indexes in the image for the plurality of frame images acquired by the image acquisition unit 6a. In addition, the index processing unit (adjustment unit) 6b adjusts the position of the index in the plurality of frame images. Specifically, for example, the index processing unit 6b reads and acquires index data stored as a default in a predetermined storage unit (for example, the memory 2 or the like). In addition, the index processing unit 6b displays the predetermined frame image (for example, the first frame image F1 (see FIG. 3A)) among the plurality of frame images displayed on the display panel 7a. The index position is adjusted in the frame image in accordance with the index position adjustment instruction input based on the predetermined operation of the operation input unit 8.
Here, the index includes a reference line passing through a predetermined portion of the subject. That is, the index processing unit 6b adjusts the position of the reference line so as to pass a predetermined portion of the subject in the frame image based on a predetermined operation of the operation input unit 8 by the user. For example, in the case of a subject performing a golf swing, the index processing unit 6b adjusts the position of the first reference line L1 so as to pass through the waist portion of the subject and the club head portion, and the base portion of the subject's neck The position of the second reference line L2 is adjusted so as to pass through the club head part, and the position of the third reference line L3 is adjusted so as to pass through the waist part of the subject and the base part of the neck.
Further, for example, when adjusting the positions of a plurality of indices such as the first to third reference lines L1 to L3, among these indices, based on a predetermined operation of the operation input unit (designating means) 8 by the user. When the index whose position is to be adjusted is specified, the index processing unit 6b adjusts the position of the specified index.
In addition, the index processing unit 6b sets each index (for example, the first to third reference lines L1 to L3) in a predetermined frame image (for example, the first frame image F1) among the plurality of frame images. Thus, the remaining frame images are similarly set by applying indices to positions corresponding to the indices of the first frame image F1.
Note that the numbers, positions, and the like of the indexes such as the first to third reference lines L1 to L3 described above are merely examples, and are not limited thereto, and can be arbitrarily changed as appropriate.
The information acquisition unit (information acquisition unit) 6c acquires information based on an index for analyzing a specific motion of the subject set in the frame image.
That is, when a plurality of indices are set by the index processing unit 6b in a plurality of frame images, the information acquisition unit 6c acquires information corresponding to each of the plurality of indices. At this time, when the position of the index is adjusted by the index processing unit 6b, the information acquisition unit 6c sequentially acquires information corresponding to the index after the position adjustment. Specifically, each time the position of the reference line as the index set by the index processing unit 6b is adjusted, the information acquisition unit 6c and the reference line after the position adjustment and a predetermined straight line (for example, another reference line) And a predetermined straight line substantially orthogonal to the optical axis direction) (for example, first to third angles A1 to A3) are sequentially acquired as information based on the index.
For example, in the case of a subject performing a golf swing, the information acquisition unit 6c calculates the first angle A1 formed by the first reference line L1 and the horizontal straight line of the image, and corresponds to the first reference line L1. The second angle A2 formed by the second reference line L2 and the first reference line L1 is calculated and acquired as information corresponding to the second reference line L2, and the third reference line L3 A third angle A3 formed by a straight line in the vertical direction of the image is calculated and acquired as information corresponding to the third reference line L3.
Further, the image analysis unit 6 includes each of the plurality of frame images, the index set by the index processing unit 6b (for example, the first to third reference lines L1 to L3) and the information acquired by the information acquisition unit 6c. (For example, first to third angles A1 to A3, etc.) are combined to generate image data of an analyzed moving image composed of a plurality of combined frame images G1 to G6.
Each index is prepared according to the handedness of the person who operates, and FIG. 4 is for a right-handed person.
The display unit 7 displays still images and moving images. Specifically, the display unit 7 includes a display panel 7a and a display control unit 7b.
The display panel 7a displays an image in the display area. Specifically, the display panel 7a displays a live view image while sequentially updating a plurality of image frames generated by imaging the subject by the imaging unit 3 at a predetermined playback frame rate in the still image capturing mode or the moving image capturing mode. L is displayed.
Examples of the display panel 7a include a liquid crystal display panel and an organic EL (Electro-Luminescence) display panel. However, the display panel 7a is an example and is not limited thereto.
The display control unit 7b performs control to display a predetermined image on the display screen of the display panel 7a based on the image data of a predetermined size read from the image recording unit 5 and decoded by the image analysis unit 6. Specifically, the display control unit 7b includes a VRAM (Video Random Access Memory), a VRAM controller, a digital video encoder, and the like. The digital video encoder reads out the luminance signal Y and the color difference signals Cb and Cr decoded by the image analysis unit 6 and stored in the VRAM (not shown) from the VRAM via the VRAM controller, and stores these data. Originally, a video signal is generated and output to the display panel 7a.
Further, in the moving image analysis process, the display control unit 7b causes the index set by the index processing unit 6b and information based on the index to be superimposed on the frame image and displayed on the display panel 7a.
That is, the display control unit (control unit) 7b displays the index and the information based on the index acquired by the information acquisition unit 6c in association with the plurality of frame images acquired by the image acquisition unit 6a. ) 7a is displayed. Specifically, when a plurality of indexes are set by the index processing unit 6b and information corresponding to each index is acquired by the information acquisition unit 6c, the display control unit 7b displays information corresponding to the plurality of indexes and each index. Are displayed on the display panel 7a.
For example, the display control unit 7b superimposes each of the plurality of frame images, and each of the plurality of indices corresponds to a corresponding color (for example, red for the first reference line L1 and for the second reference line L2). In the case of the third reference line L3, the color is displayed on the display panel 7a. In addition, the display control unit 7b superimposes each of the plurality of frame images, and displays information based on the plurality of indexes on the display panel 7a using colors substantially equal to the corresponding indexes. Specifically, the display control unit 7b sets the first angle A1 to “R: **” in red (R) substantially equal to the first reference line L1, and sets the second angle A2 to the second reference line. As an aspect of “B: **” in blue (B) substantially equal to L2, and as an aspect of “G: **” in green (G) substantially equal to the third reference line L3, the third angle A3 is respectively It is displayed at a predetermined position on the display panel 7a.
In addition, the display control unit 7b is a region corresponding to an angle (for example, first to third angles A1 to A3) formed by a reference line and a predetermined straight line as information based on a plurality of indices (in FIG. 4, A predetermined color may be added to the regions B1 to B3) indicated by dots, and displayed on the display panel 7a.
The operation input unit 8 is for inputting various instructions to the apparatus main body.
Specifically, the operation input unit 8 includes an operation unit (not shown) including up / down / left / right cursor buttons, a determination button, and the like related to selection of a shooting mode, a function, and the like.
When the user operates various buttons on the operation unit, the operation input unit 8 outputs an operation instruction corresponding to the operated button to the central control unit 1. The central control unit 1 causes each unit to execute a predetermined operation (for example, imaging of a subject) in accordance with an operation instruction output from the operation input unit 8 and input.
The operation input unit 8 may include a touch panel (not shown) provided integrally with the display panel 7a of the display unit 7.
Next, the moving image analysis processing will be described with reference to FIGS.
FIG. 2 is a flowchart illustrating an example of an operation related to the moving image analysis process.
The moving image analysis process described below is performed when a moving image analysis mode is selected from a plurality of operation modes displayed on a menu screen (not shown) based on a predetermined operation of the operation input unit 8 by the user. It is a process to be executed.
<Video analysis processing>
As shown in FIG. 2, first, when a moving image to be processed by the moving image analysis process is specified based on a predetermined operation of the operation input unit 8 by the user, the image acquisition unit 6a displays the specified moving image ( For example, the image data of the moving image composed of a plurality of frame images F1 to F6 in which the motion of the subject is continuously captured; see FIG. 3A to FIG. (Step S1).
Next, among the plurality of frame images, based on a predetermined operation (for example, frame advance operation) of the operation input unit 8 by the user, a predetermined frame image (for example, used for adjusting the position of the index to be combined) When the first frame image F1 or the like is designated, the display control unit 7b displays the designated frame image on the display panel 7a (step S2; see FIG. 4).
Subsequently, for example, the index processing unit 6b reads out and acquires data of each default index (for example, the first to third reference lines L1 to L3) from a predetermined storage unit (for example, the memory 2). The display control unit 7b superimposes each index on a frame image (for example, the first frame image F1 or the like) and displays it on the display panel 7a (step S3).
Next, the index processing unit 6b determines whether or not an instruction to specify an index whose position is to be adjusted is input based on a predetermined operation of the operation input unit 8 by the user (step S4).
If it is determined in step S4 that an instruction to specify an index has been input (step S4; YES), the index processing unit 6b adjusts the position of the input index based on a predetermined operation of the operation input unit 8 by the user. In accordance with the instruction, the position of the index is adjusted in the frame image (step S5). Specifically, for example, in the case of a subject performing a golf swing, the index processing unit 6b adjusts the position of the first reference line L1 so as to pass through the waist portion and the club head portion of the subject.
Subsequently, the information acquisition unit 6c acquires information corresponding to each of the plurality of indexes, and the display control unit 7b displays information based on the acquired indexes as frame images (for example, the first frame image F1). To be displayed on the display panel 7a (step S6). Specifically, for example, in the case of a subject performing a golf swing, the information acquisition unit 6c calculates a first angle A1 formed by the first reference line L1 and a horizontal straight line of the image, and the first reference line. Acquired as information corresponding to L1.
If it is determined in step S4 that an instruction for specifying an index has not been input (step S4; NO), the process of step S5 is skipped, and the display control unit 7b displays the acquired information. It is superimposed on the frame image and displayed on the display panel 7a (step S6).
Next, the display control unit 7b determines whether or not a moving image playback instruction has been input based on a predetermined operation of the operation input unit 8 by the user (step S7).
Here, if it is determined that a moving image playback instruction has been input (step S7; YES), the display control unit 7b displays a plurality of frame images in a state where each index and information based on each index are displayed in a superimposed manner. Are reproduced at a predetermined reproduction frame rate and displayed on the display panel 7a (step S8; see FIGS. 5A to 5F).
On the other hand, if it is determined in step S7 that no reproduction instruction is input (step S7; NO), the image analysis unit 6 generates an analyzed moving image based on a predetermined operation of the operation input unit 8 by the user. It is determined whether or not an instruction has been input (step S9).
Here, if it is determined that an instruction for generating an analyzed moving image has not been input (step S9), the image analysis unit 6 returns the process to step S4, and executes the subsequent processes. In other words, for example, when an instruction to specify an index whose position is to be newly adjusted is input in step S4 (step S4; YES), the index processing unit 6b uses the operation input unit 8 by the user in step S5. The index position is adjusted in the frame image in accordance with the index position adjustment instruction input based on the predetermined operation. In step S6, the information acquisition unit 6c acquires information corresponding to the index whose position is newly adjusted. Thereafter, the display control unit 7b performs the processes of steps S7 and S8 in substantially the same manner as described above, and proceeds to step S9.
Each of the above processes is repeatedly executed until it is determined in step S9 that an instruction to generate an analyzed moving image has been input (step S9; YES).
If it is determined in step S9 that an instruction to generate an analyzed moving image has been input (step S9; YES), the image analysis unit 6 uses each of the plurality of frame images and each index (for example, first to first). Three reference lines L1 to L3) and information based on each index (for example, the first to third angles A1 to A3, etc.) are combined to generate an analyzed moving image composed of a plurality of combined frame images G1 to G6. Image data is generated (step S10).
Then, the image recording unit 5 acquires and records the image data of the analyzed moving image generated by the image analyzing unit 6 (step S11), and ends the moving image analysis process.
As described above, according to the imaging apparatus 100 of the present embodiment, information based on an index (for example, a reference line passing through a predetermined portion of the subject) for analyzing a specific motion of the subject set in the moving image. (For example, an angle formed by a reference line and a predetermined straight line) is acquired, and the index and the acquired information are displayed on the display panel 7a in association with the acquired moving image, so the index is simply displayed. Instead, the information corresponding to the index is displayed in association with the moving image, so that the viewer can easily objectively grasp the information based on the index. In particular, the information based on the index can be objectively and easily grasped by the viewer by expressing the information based on the index as a numerical value such as an angle formed by a reference line and a predetermined straight line.
Further, since the position of the index in the image is adjusted and information corresponding to the position-adjusted index is acquired, even when the position of the index in the image is adjusted to the user-desired position, Information based on the index can be appropriately acquired according to the index after the position adjustment. At this time, a user-desired index whose position should be adjusted can be easily specified based on a predetermined operation by the user.
In addition, since a plurality of indices and information corresponding to each index are displayed on the display panel 7a in association with each other, even when a plurality of indices are set for analyzing a specific motion of the subject, each index is supported. Information can be displayed in an easy-to-understand manner. That is, each of the plurality of indices can be represented using a corresponding color, and similarly, each piece of information based on the plurality of indices can be represented using a color substantially equal to the corresponding index.
In this way, the viewer can easily objectively grasp each piece of information based on the plurality of indices.
In addition, when the information corresponding to the index is expressed using an angle formed by the reference line and a predetermined straight line, a predetermined color is added to the area corresponding to the angle and displayed on the display panel 7a. The object represented as the corresponding information can be clearly displayed, and the information based on the index can be easily grasped objectively by the viewer.
Below, the modification of a moving image analysis process is demonstrated.
In addition, the modified example of the moving image analysis process is substantially the same as the moving image analysis process performed by the imaging apparatus 100 of the above-described embodiment except for the details described below, and detailed description thereof is omitted.
In the moving image analysis processing according to the first modification, moving image image data (see FIG. 6) including a plurality of frame images based on a predetermined time point in a specific operation of the subject is used as a processing target of the moving image analysis processing. ing.
FIG. 6 schematically illustrates one frame image Fn among a plurality of frame images constituting the moving image.
That is, the image acquisition unit 6a records image data of a moving image composed of a plurality of frame images based on a predetermined point in a specific movement of the subject (for example, an impact at the moment when a ball is hit by a club head). The data is read from the unit 5 and acquired as a processing target of the moving image analysis process.
For example, the index processing unit 6b sets a fourth reference line L4 for analyzing the incident angle of the club head, a fifth reference line L5 for analyzing the ball launch angle, and the like. Specifically, for example, the index processing unit 6b is designated based on a predetermined operation of the operation input unit 8 by the user in any one of the plurality of frame images before the club head and the ball are in contact with each other. A straight line passing through the position of the club head and the position of the club head specified based on a predetermined operation of the operation input unit 8 by the user in any one of the frame images after the club head and the ball are in contact with each other. Set as the fourth reference line L4. Similarly, the index processing unit 6b is, for example, a predetermined one of the operation input unit 8 by the user in any one of the plurality of frame images before (or when contacting) the club head and the ball. The position of the ball specified based on the operation and the position of the ball specified based on a predetermined operation of the operation input unit 8 by the user in any one of the frame images after the club head and the ball are in contact with each other. A straight line passing through is set as the fifth reference line L5.
The method for setting the fourth reference line L4 and the fifth reference line L5 described above is an example and is not limited to this, and can be arbitrarily changed as appropriate.
For example, the information acquisition unit 6c calculates a fourth angle A4 formed by the fourth reference line L4 and the horizontal straight line of the image, acquires the fourth angle A4 as information corresponding to the fourth reference line L4, and the fifth reference line L4. A fifth angle A5 formed by the line L5 and the straight line in the horizontal direction of the image is calculated and acquired as information corresponding to the fifth reference line L5.
The display control unit 7b superimposes each of the plurality of frame images, and each of the plurality of indexes corresponds to a corresponding color (for example, red for the fourth reference line L4, green for the fifth reference line L5, etc. ) To display on the display panel 7a. In addition, the display control unit 7b, for example, sets the fourth angle A4 to “R: **” in red (R) substantially equal to the fourth reference line L4, and sets the fifth angle A5 to the fifth reference line L5. Are displayed in a predetermined position on the display panel 7a in the form of “B: **” in blue (B) substantially equal to the above.
In addition, the display control unit 7b, as information based on a plurality of indices, corresponds to an angle (for example, fourth, fifth angles A4, A5, etc.) formed by a reference line and a predetermined straight line (in FIG. 6, A predetermined color may be added to the regions B4 and B5) indicated by dots to display them on the display panel 7a.
Even in such a configuration, as in the above-described embodiment, instead of simply displaying an index, information corresponding to an index (for example, a reference line passing through a predetermined portion of the subject) (for example, a reference line and a predetermined value) By displaying the angle formed by the straight line in association with the moving image, the viewer can easily objectively grasp information based on the index.
In the moving image analysis process according to the second modification, the display control unit 7b displays other moving images on the display panel 7a side by side with the moving image to be processed in the moving image analysis process (see FIG. 7). .
Specifically, the display control unit 7b arranges the moving image to be processed in the moving image analysis process in the left region of the display area of the display panel 7a, and places the other moving image in the right region. A moving image (for example, a swinging motion of a professional golfer or a swinging motion of the user himself / herself) is arranged. FIG. 7 shows one frame image Fa among a plurality of frame images constituting a moving image to be processed by the moving image analysis process and one of a plurality of frame images constituting another moving image. The frame image Fb is schematically shown.
Then, for each moving image, the display control unit 7b displays each index (for example, the first to third reference lines L1 to L3) and information corresponding to the index (for example, the first to third angles A1 to A3). Etc.) is displayed on the display panel 7a, and the degree of difference from other moving images is displayed on the display panel 7a as information based on the index.
For example, the information acquisition unit 6c acquires, as information based on the index, the first to third angles A1 to A3 acquired based on the moving image that is the processing target of the moving image analysis process and other moving images. Differences from the first to third angles A1 to A3 are calculated and acquired. The display control unit 7b sets the dissimilarity C1 of the first angle A1 as red (R) substantially equal to the first reference line L1 as “R: ± **”, and the dissimilarity C2 of the second angle A2 The mode is “B: ± **” in blue (B) substantially equal to the second reference line L2, and the difference C3 of the third angle A3 is “G” in green (G) substantially equal to the third reference line L3. : ± ** ”is displayed at a predetermined position on the display panel 7a.
Even in such a configuration, as in the above-described embodiment, instead of simply displaying an index, information corresponding to an index (for example, a reference line passing through a predetermined portion of the subject) (for example, a reference line and a predetermined value) By displaying the degree of difference between the angle formed by the straight line and another moving image in association with the moving image, the viewer can easily objectively grasp the information based on the index. Furthermore, it is possible to easily compare the difference between a moving image to be processed in the moving image analysis process and another moving image (for example, a professional golfer's swing) and information based on the index. On the other hand, information based on the index can be objectively and easily grasped.
In addition, although the difference degrees C1-C3 of 1st-3rd angles A1-A3 were illustrated as a difference degree with another moving image, it is an example and it is not restricted to this, It can change arbitrarily arbitrarily. is there. For example, the degree of difference from the other moving images may be a difference between the sizes of the areas including the first to third reference lines L1 to L3.
In the above embodiment, the position of a reference line (for example, the first reference line L1) as an index is manually adjusted based on a predetermined operation of the operation input unit 8 by the user. However, the present invention is not limited to this. For example, predetermined image processing (for example, face detection processing or pattern matching processing) is performed on the moving image, the image of the subject is analyzed, and the position of the index is automatically adjusted. It is good also as such a structure.
Furthermore, the configuration of the imaging apparatus 100 is merely an example illustrated in the above embodiment, and is not limited thereto. Furthermore, although the imaging apparatus 100 is illustrated as the display control apparatus, the present invention is not limited to this.
In addition, in the above embodiment, the functions as the image acquisition unit, the setting unit, the information acquisition unit, and the control unit are controlled under the control of the central control unit 1, and the image acquisition unit 6a, the index processing unit 6b, the information Although the configuration realized by driving the acquisition unit 6c and the display control unit 7b is not limited to this, the configuration is realized by executing a predetermined program or the like by the CPU of the central control unit 1 It is also good.
That is, a program including an image acquisition processing routine, a setting processing routine, an information acquisition routine, and a display control processing routine is stored in a program memory (not shown) that stores the program. Then, the CPU of the central control unit 1 may function as means for acquiring an image of a subject by an image acquisition processing routine. In addition, the CPU of the central control unit 1 may function as a means for setting an index for analyzing a specific operation of a subject in the acquired image for the acquired image. Further, the CPU of the central control unit 1 may function as means for acquiring information based on the set index by the information acquisition routine. Further, the CPU of the central control unit 1 may be caused to function as means for causing the display panel 7a to display the index and the acquired information in association with the acquired image by the display control processing routine.
Similarly, the adjustment means may be configured to be realized by executing a predetermined program or the like by the CPU of the central control unit 1.
Setting means for setting an index for analysis of a specific action of a subject in the image for the image acquired by the image acquisition means;
Information acquisition means for acquiring information based on the index set by the setting means;
A control unit that causes the display unit to display the index and the information acquired by the information acquisition unit in association with the image acquired by the image acquisition unit;
The setting means sets a plurality of indices in the image acquired by the acquisition means,
The information acquisition means acquires information corresponding to each of the plurality of indicators,
The display control apparatus according to claim 1, wherein the control unit causes the display unit to display the plurality of indexes and information corresponding to the indexes in association with each other.
An adjustment unit for adjusting the position of the index in the image acquired by the image acquisition unit;
The display control apparatus according to claim 1, wherein information corresponding to the index after the position adjustment by the adjustment unit is specified.
The display control apparatus according to claim 3, further comprising a specifying unit that specifies the index whose position is to be adjusted by the adjusting unit based on a predetermined operation by a user.
The indicator includes a reference line passing through a predetermined portion of the subject,
The display control apparatus according to any one of claims 1 to 4, wherein information on an angle formed by the reference line is acquired.
The information acquisition means further includes:
Obtaining information of a predetermined color corresponding to an angle formed by the reference line;
The display control means further includes
6. The display control apparatus according to claim 5, wherein information of a predetermined color acquired by the information acquisition unit is added between the reference line and a predetermined straight line and displayed on the display unit.
The display control apparatus according to claim 5, wherein the information acquisition unit further acquires information on an angle formed by the reference line and a predetermined straight line.
The display control apparatus according to claim 5, wherein the information acquisition unit further acquires information on an angle formed by the reference lines.
The display control apparatus according to claim 2, wherein each of the plurality of indexes is displayed on the display unit using a corresponding color.
The display control apparatus according to claim 9, wherein each of the states of the plurality of subjects is displayed on the display unit using a color substantially equal to the corresponding index.
A display control method using a display control device,
Processing to acquire the image of the subject;
A setting process for setting an index for analyzing a specific motion of a subject in the image for the acquired image;
Processing to obtain information based on the set indicator,
A process of causing the display unit to display the index and the acquired information in association with the acquired image;
Setting means for setting an index for analyzing a specific operation of a subject in the image for the image acquired by the image acquisition means;
Control means for displaying on the display means the information acquired by the information acquisition means in association with the image acquired by the image acquisition means;
DESCRIPTION OF SYMBOLS 100 Imaging device 1 Central control part 6 Image analysis part 6a Image acquisition part 6b Index processing part 6c Information acquisition part 7 Display part 7a Display panel 7b Display control part 8 Operation input part
A display control device characterized by that.
The indicator includes a first indicator and a second indicator that is the reference line,
The setting unit automatically sets a first index in the image acquired by the image acquisition unit, and sets a second index at a position selected by the user in the image acquired by the image acquisition unit. And
The information acquisition means acquires information about an operation corresponding to each of the first index and / or the second index,
The control means associates the image acquired by the image acquisition means, the first index and the second index, and information related to the operation corresponding to each of the index and the second index. The display control apparatus according to claim 1, wherein the display is displayed on the display unit.
The display control apparatus according to claim 2, wherein the setting unit automatically sets a predetermined straight line as the first index and manually sets a reference line as the second index.
The display control apparatus according to claim 2, wherein the information acquisition unit acquires information about an angle formed by a predetermined straight line and the reference line as information related to the operation.
The control means further includes
5. The display device according to claim 1, wherein the predetermined color information acquired by the information acquisition unit is added between the reference line and a predetermined straight line and displayed on the display unit. The display control apparatus described.
The setting means sets a plurality of the reference lines,
The display control apparatus according to claim 1, wherein the information acquisition unit further acquires information on an angle formed by the reference lines.
The image acquisition means acquires a plurality of image groups including a subject,
The setting unit sets an index for acquiring information related to a specific operation of a subject in the image for each of the plurality of image groups acquired by the image acquisition unit,
The information acquisition unit acquires information on an operation based on the index set in the plurality of image groups by the setting unit,
The control means causes the display means to display a plurality of image groups acquired by the image acquisition means, the index, and information related to the action acquired by the information acquisition means, in association with each other.
The display control apparatus according to claim 1, wherein the display control apparatus is a display control apparatus.
A selection unit that selects a first image group and a second image group from the plurality of image groups acquired by the image acquisition unit;
Further comprising difference information acquisition means for acquiring difference information of information relating to operations based on the respective indices of the first image group and the second image group selected by the selection means;
The control means causes the first image group and the second image group to be displayed on the display means in association with the respective indicators, information relating to operations based on the indicators, and the difference information.
The display control apparatus according to claim 7.
The display control apparatus according to claim 1, wherein the information acquisition unit acquires information related to an operation corresponding to the index after the position adjustment by the adjustment unit.
The setting means sets a plurality of indexes on the image,
The display control apparatus according to claim 1, wherein the plurality of indexes are displayed on the display unit using different corresponding colors.
A first process for acquiring an image of a subject;
A second process for setting a reference line as an index for acquiring information related to a specific operation of a subject in the image for the acquired image;
A third process for acquiring information related to the operation based on the set reference line;
A fourth process for displaying on the display means the information related to the action acquired in the third process in association with the acquired image;
The third process acquires predetermined color information corresponding to the type of the other lines forming the reference line and the angle,
The fourth process causes the display unit to display the index and information of the predetermined color acquired in the third process in association with the acquired image.
Control means for displaying on the display means the information related to the operation acquired by the index and the information acquisition means in association with the image acquired by the image acquisition means;
The control means functions to cause the display means to display the indicator and the predetermined color information acquired by the information acquisition means in association with the image acquired by the image acquisition means. Program to do.
JP2013237931A 2013-11-18 2013-11-18 Display control apparatus, display control method, and program Active JP6314438B2 (en)
JP2013237931A JP6314438B2 (en) 2013-11-18 2013-11-18 Display control apparatus, display control method, and program
JP2015099968A JP2015099968A (en) 2015-05-28
JP2015099968A5 JP2015099968A5 (en) 2017-01-05
JP6314438B2 true JP6314438B2 (en) 2018-04-25
ID=53376357
JP2013237931A Active JP6314438B2 (en) 2013-11-18 2013-11-18 Display control apparatus, display control method, and program
JP (1) JP6314438B2 (en)
JPH10201898A (en) * 1996-11-21 1998-08-04 Taimu World:Kk Portable sports motion photographing/reproducing device
JP3050448U (en) * 1998-01-08 1998-07-14 正治 井川 Golf guidance support device
JP2004229109A (en) * 2003-01-24 2004-08-12 Is Engineering:Kk Device and method for operation analysis as well as recording medium
JP2011110074A (en) * 2009-11-24 2011-06-09 Casio Computer Co Ltd Animation replaying device and program
2013-11-18 JP JP2013237931A patent/JP6314438B2/en active Active
JP2015099968A (en) 2015-05-28
JP4082318B2 (en) 2008-04-30 Imaging apparatus, image processing method, and program
JP5880182B2 (en) 2016-03-08 Image generating apparatus, image generating method, and program
JP5754312B2 (en) 2015-07-29 Image processing apparatus, image processing method, and program
KR101036858B1 (en) 2011-05-25 Image processing apparatus, image processing method, and storage medium for storing program
US8106998B2 (en) 2012-01-31 Image pickup apparatus and focusing condition displaying method
US9538085B2 (en) 2017-01-03 Method of providing panoramic image and imaging device thereof
US8072497B2 (en) 2011-12-06 Imaging apparatus and recording medium
JP4742542B2 (en) 2011-08-10 Imaging device
JP5281878B2 (en) 2013-09-04 Imaging device, lighting processing device, lighting processing method, and lighting processing program
KR101901910B1 (en) 2018-09-27 Method and apparatus for generating or storing resultant image which changes selected area
JP2006025311A (en) 2006-01-26 Imaging apparatus and image acquisition method
JP4784678B2 (en) 2011-10-05 Imaging apparatus, imaging method, and program
US8477207B2 (en) 2013-07-02 Image capturing apparatus, image capturing method, and computer program
Ref document number: 6314438