IMAGE CAPTURE APPARATUS AND CONTROL METHOD

An image capture apparatus that is wearable on a neck of a user, comprises first to fourth microphones provided on the mount portion, and a sound processing unit. The first and second microphones are provided at positions for collecting sound on a left side of the user who is wearing the image capture apparatus. The third and fourth microphones are provided at positions for collecting sound on a right side of the user who is wearing the image capture apparatus. The sound processing unit generates a first sound signal having a directivity for the left ear of the user, based on sound signals obtained by the first and second microphones, and generates a second sound signal having a directivity for the right ear of the user, based on sound signals obtained by the third and fourth microphones.

BACKGROUND OF THE INVENTION

Field of the Invention

The present invention relates to an image capture apparatus that is wearable on the body of a user.

Description of the Related Art

There are known wearable cameras capable of performing shooting while being worn on the bodies of users, so as to enable activities of the users to be recorded. In addition, a technique called binaural recording is known as a method for recording sound that has a realistic sensation (Japanese Patent Laid-Open No. 2019-54440). In binaural recording, sound is recorded by two microphones attached to the ears of a person. When listening to sound recorded through binaural recording, using headphones, the user can listen to sound with a realistic sensation that makes the user feel like he or she is at a recording site.

When the user performs binaural recording in a state where the user is wearing a wearable camera, it is desirable the wearable camera can be worn on the user without a microphone being conspicuous. In this case, when the microphone is disposed at a position distant from the ears of the user due to a form for wearing the microphone or physical differences of users, there are cases where effects of binaural recording cannot be achieved.

SUMMARY OF THE INVENTION

The present invention has been made in consideration of the aforementioned problems, and realized techniques for achieving the effect of binaural recording irrespective of a change in the distance between a microphone and an ear of a user.

In order to solve the aforementioned problems, the present invention provides an image capture apparatus that is wearable on a neck of a user, comprising: an image capture circuit; a mount portion that is disposed so as to surround the neck of the user when the image capture apparatus is worn on the user; a first microphone, a second microphone, a third microphone, and a fourth microphone provided on the mount portion, the first microphone and the second microphone being provided at positions for collecting sound on a left side of the user who is wearing the image capture apparatus, the first microphone being provided at a position closer to the left ear of the user who is wearing the image capture apparatus than the second microphone is, the third microphone and the fourth microphone being provided at positions for collecting sound on a right side of the user who is wearing the image capture apparatus, and the third microphone being provided at a position closer to the right ear of the user who is wearing the image capture apparatus than the fourth microphone is; a CPU; and a memory that stores a program for causing, when executed by the CPU, the CPU to function as: a sound processing unit that generates a first sound signal having a directivity for the left ear of the user, based on sound signals obtained by the first microphone and the second microphone, and that generates a second sound signal having a directivity for the right ear of the user, based on sound signals obtained by the third microphone and the fourth microphone.

In order to solve the aforementioned problems, the present invention provides a method of controlling an image capture apparatus that is wearable on a neck of a user, wherein the image capture apparatus includes: an image capture circuit, a mount portion that is disposed so as to surround the neck of the user when the image capture apparatus is worn on the user, a first microphone, a second microphone, a third microphone, and a fourth microphone provided on the mount portion, the first microphone and the second microphone being provided at positions for collecting sound on a left side of the user who is wearing the image capture apparatus, the first microphone being provided at a position closer to the left ear of the user who is wearing the image capture apparatus than the second microphone is, the third microphone and the fourth microphone being provided at positions for collecting sound on a right side of the user who is wearing the image capture apparatus, and the third microphone being provided at a position closer to the right ear of the user who is wearing the image capture apparatus than the fourth microphone is, and a sound processing unit, wherein the method includes: generating a first sound signal having a directivity for the left ear of the user, based on sound signals obtained by the first microphone and the second microphone, and generating a second sound signal having a directivity for the right ear of the user, based on sound signals obtained by the third microphone and the fourth microphone.

According to the present invention, the effect of binaural recording can be achieved irrespective of a change in the distance between an ear of a user and a microphone.

DESCRIPTION OF THE EMBODIMENTS

As will be described later with reference toFIG.4, a system according to the present embodiment is constituted by at least a wearable camera1and a display device2. The wearable camera1and the display device2are connected to each other so as to enable wireless communication. The wearable camera1can be worn on the body (for example, the neck) of the user who is a camera operator. The wearable camera1shoots a moving image, a still image, or the like (hereinafter, referred to as an “image”) of a subject that is present in a direction in which the user is performing observation, and transmits the shot image to the display device2. In addition, the wearable camera1can obtain and record sound (ambient sound) around the wearable camera1during shooting. In addition, the wearable camera1associates the recorded sound with the shot image, and transmits the associated sound and image to the display device2. The display device2is a mobile communication device such as a smartphone or a tablet computer held by the user or a third party, and displays an image transmitted from the wearable camera1, and reproduces the sound. Using the display device2, the user can view and listen to the image shot by the camera1and sound recorded by the camera1. An example will be described in which the wearable camera1and the display device2in the system according to the present embodiment are separately configured, but may be integrally configured.

Camera Configuration

First, an external configuration of the wearable camera1according to the present embodiment will be described with reference toFIGS.1A to1C.

The wearable camera (hereinafter, a “camera”)1includes a camera body10, a mount portion80, and a battery portion90. The mount portion80is an necklace-type annular member for connecting the camera body10and the battery portion90to each other and wearing the camera body10to the neck of the user. The camera body10includes a face detection unit13, a start button14, a stop button15, a shooting lens16, and an indicator17. Moreover, the camera body10, the mount portion80, and the battery portion90constitute an annular case. When the camera1is worn on the neck of the user, the annular case of the camera1is disposed so as to surround the neck of the user.

The face detection unit13detects position information regarding the jaw and the neck bottom of the user on which the camera1is worn, by irradiating, with infrared light, a lower portion (particularly, the jaw and the neck bottom) of the face of the user on which the camera1is worn, and capturing an image of reflected light using an infrared light image sensor built in the camera body10.

The start button14is an operation member for instructing the camera1to start shooting of a moving image. The stop button15is an operation member for instructing the camera1to stop shooting of a moving image. The shooting lens16is an optical member for forming an image of a subject image using an image sensor42built in the camera body10. The indicator17is a light emitting diode (LED) for displaying an operation state of the camera1by emitting light.

The mount portion80is provided with a plurality of microphones (hereinafter, mikes)19LT,19LB,19RB, and19RT for collecting ambient sound on the left side and the right side of the user when the camera1is worn on the user. The mikes19LT and19LB obtain sound on the left side of the user and convert the obtained sound into analog sound signals. The mikes19RT and19RB obtain sound on the right side of the user and convert the obtained sound into analog sound signals. The analog sound signals output from the mikes19LT,19LB,19RB, and19RT are processed by a sound processing unit104as will be described later with reference toFIGS.7A and7B. A sound signal of a left channel (Lch) that has a directivity suitable for the vicinity of the left ear of the user is then generated based on the sound signals obtained by the mikes19LT and19LB. In addition, a sound signal of a right channel (Rch) that has a directivity suitable for the vicinity of the right ear of the user is generated based on the sound signals obtained by the mikes19RT and19RB. Such the directivities are provided to the sound signals of the left and right channels by the sound processing unit104performing mike beam forming processing.

The mikes19LT and19LB are disposed on a left side surface portion of the mount portion80in a state where the camera1is being worn on the user, so as to be able to collect sound on the left side of the user who is wearing the camera1. The mikes19RB and19RT are disposed on a right side surface portion of the mount portion80in a state where the camera1is being worn, so as to be able to collect sound on the right side of the user. The mike19LT is provided at a closer position to the left ear of the user who is wearing the camera1, than the mike19LB is. The mike19RT is provided at a position closer to the right ear of the user who is wearing the camera1, than the mike19RB is.

Hereinafter, the mikes19LT and19RT may also be referred to as “upper mikes”, the mikes19LB and19RB may also be referred to as “lower mikes”, the mikes19LT and19LB may also be referred to as “left mikes”, and the mikes19RT and19RB may also be referred to as “right mikes”. Analog sound signals output from the mikes19LT,19LB,19RT and19RB are converted into digital sound signals by the sound processing unit104to be described later, and the digital sound signals are subjected to mike beam forming processing, which will be described later with reference toFIG.7A and7B, and are given a directivity.

Openings (sound holes) for guiding ambient sound to the respective mikes19LT,19LB,19RB, and19RT are provided in the mount portion80. The mikes19LT,19LB,19RB, and19RT are exposed to the outside through the corresponding openings. The distance between the sound holes for the left mikes19LT and19LB is set to shorter than or equal to a distance that is shorter than one wavelength of the sound signal of the L channel. Also, the distance between the sound holes for the right mikes19RT and19RB is set to shorter than or equal to a distance that is shorter than one wavelength of the sound signal of the R channel.

Note that one of the left mikes19LT and19LB and the right mikes19RB and19RT may be disposed on a front surface portion of the camera body10or a rear surface portion of the battery portion90.

FIG.1Bis a diagram showing a state where the camera1is worn on the neck of the user.

The mount portion80and the camera body10of the camera1are configured to allow the user to easily wear and remove the camera1, due to a connection/disconnection mechanism (not illustrated) provided at two end portions of the camera body10. In view of this, the camera1is worn on the neck of the user by the user hanging the mount portion80on the neck of the user in a state where the mount portion80is detached from the camera body10, and connecting two end portions of the mount portion80to the two end portions of the camera body10. The camera1is worn such that the battery portion90is positioned on the back side of the neck of the user, and the camera body10is positioned on the front side of the neck of the user. The camera body10is biased to the chest immediately under the neck of the user by the mount portion80. Accordingly, the camera body10is positioned near front portions of the clavicles of the user, and the face detection unit13is positioned below the jaw of the user. An infrared light collecting lens26, which will be described later with reference toFIG.2E, is built in the face detection unit13. The optical axis (detection optical axis) of the infrared light collecting lens26is directed in a direction different from the optical axis (image capture optical axis) of the shooting lens16, and a face direction detection unit20to be described later detects face direction information indicating the direction of the face of the user (the angle of the face relative to the face when facing the front), and determines a direction in which the user is performing observation. Accordingly, it is possible to detect the direction in which a subject that the user is observing is present. A method for correcting a shooting direction or a shooting area based on physical differences of users and the posture of the camera1being worn on the user will be described later.

By disposing the camera body10on the front side of the neck of the user and disposing the battery portion90on the back side, the weight of the camera1can be distributed, thus relieving fatigue of the user who is wearing the camera1, and reducing displacement of the camera1when the user moves.

Note that, in the present embodiment, an example is illustrated in which the camera1is worn such that the camera body10is positioned near the front portions of the clavicles of the user, but there is no limitation thereto. The camera1may be worn at any position of the body of the user besides the neck of the user, as long as the face direction detection unit20of the camera1can detect a direction in which the user is performing observation (hereinafter, referred to as an “observation direction”) and the direction in which a subject is present can be detected.

FIG.1Cis a diagram of the battery portion90of the camera1as viewed from the rear side ofFIG.1A.

The battery portion90includes a charge cable connection portion91, extension/retraction buttons92L and92R, and a notch portion93.

The charge cable connection portion91is an adopter for connecting the camera1to a charge cable for connection to an external power supply (not illustrated) when charging the battery portion90. The battery portion90performs charging using power supplied from the external power supply via the charge cable, and supplies the power to the camera body10.

The extension/retraction buttons92L and92R are operation members for lengthening/shortening band portions82L and82R of the mount portion80. The extension/retraction button92L is capable of adjusting the length of the left band portion82L. The extension/retraction button92R is capable of adjusting the length of the right band portion82R. Note that, in the present embodiment, a configuration is illustrated in which the lengths of the band portions82L and82R are individually adjusted using the extension/retraction buttons92L and92R, but a configuration may also be adopted in which the lengths of the band portions82L and82R can be adjusted at the same time using a single button. Hereinafter, the band portions82L and82R are collectively referred to as “band portions82”.

The notch portion93is a shape portion for avoiding abutment with the spine portion of the neck of the user such that the battery portion90does not interfere with the spine portion. This makes it possible to reduce uneasiness when the camera1is worn, and to prevent the camera1from moving in the left-right direction during shooting or moving.

FIG.1Dis an external view of the display device2.

InFIG.1D, the display device2includes an A button202, a display unit203, a B button204, an in-camera205, a face sensor206, an angular velocity sensor207, and an acceleration rate sensor208. In addition, the display device2includes a communication interface (not illustrated) such as a wireless LAN interface that enables high-speed wireless communication with the camera1.

The A button202is an operation member for switching on or off a power supply for the display device2, and accepts an instruction to switch on or off the power supply when a long press is performed, and accepts an instruction to start or end other processing when a short press is performed.

The display unit203is a display device constituted by an LCD or organic EL display for displaying an image transmitted from the camera1and displaying a menu screen for performing setting of the camera1. In the present embodiment, a touch sensor is provided integrally with the display unit203, making it possible to accept a touch operation performed on a screen (for example, the menu screen) that is being displayed. The B button204is an operation member for instructing a calibrator3, which will be described later with reference toFIG.4, to perform calibration processing. The in-camera205is capable of shooting an image of the face of the user observing the display device2.

The face sensor206detects the shape and features of the face of the user who is observing the display device2, and a direction in which the user is performing observation. The face sensor206can be realized by a structure light sensor , a ToF sensor, and a millimeter-wave radar, for example.

The angular velocity sensor207is a gyro sensor for detecting movement (rotation and direction) of the display device2as angular velocities in three axial directions orthogonal to one another. The acceleration rate sensor208detects the posture of the display device2by detecting the gravity direction of the display device2. In the display device2, calibration processing, which will be described later with reference toFIG.4, is executed by the calibrator3based on detection results of the angular velocity sensor207and the acceleration rate sensor208.

The display device2according to the present embodiment can realize the system according to the present embodiment by firmware for a smartphone or the like supporting/complying with firmware of the camera1. Note that it is also possible to realize the system according to the present embodiment by firmware of the camera1supporting applications and the OS of a smartphone that serve as the display device2.

FIGS.2A to2Fshow a configuration of the camera body10. Hereinafter, configurations that have already been described are given the same reference signs, and a description thereof is omitted.

FIG.2Ais a front view of the camera body10.

The mount portion80includes a right mount portion80R and a left mount portion80L. The right mount portion80R is positioned on the right side of the body of the user, and is connected to the right end portion of the camera body10. The left mount portion80L is positioned on the left side of the body of the user, and is connected to the left end portion of the camera body10. The right mount portion80R includes an angle holding portion81R for holding the angle between the right end portion of the camera body10and the right mount portion80R, the angle holding portion81R being made of a hard material, and a band portion82R made of a flexible material. The left mount portion80L includes an angle holding portion81L for holding the angle between the left end portion of the camera body10and the left mount portion80L, the angle holding portion81L being made of a hard material, and a band portion82L made of a flexible material.

FIG.2Bshows a configuration of the right band portion82R of the right mount portion80R and the left band portion82L of the left mount portion80L, and the angle holding portions81R and81L are indicated by dotted lines.

The right band portion82R includes a right connection portion83R and a right electric cable84R. The left band portion82L includes a left connection portion83L and a left electric cable84L. The right connection portion83R is a connection surface between the angle holding portion81R and the band portion82R, and has a cross-sectional shape that is not an exact circle, and, here, the cross-section has an oblong shape. The left connection portion83L is a connection surface between the angle holding portion81L and the band portion82L, and has a cross-sectional shape that is not an exact circle, and, here, the cross-section has an oblong shape. The right connection portion83R and the left connection portion83L have a positional relation in which the distance between the right connection portion83R and the left connection portion83L decreases toward the upper side ofFIG.2B. Moreover, when the user wears the camera1on his or her neck, the major axial directions of the connection portions83R and83L of the mount portions80R and80L extend along the body of the user. For this reason, the user feels comfortable when the band portions82come into contact with the body of the user, and the camera body10is unlikely to move in left-right direction and the front-rear direction.

The right electric cable84R is disposed in the band portion82R, and electrically connects the battery portion90, the right mikes19RT and19RB, and the camera body10to one another. The left electric cable84L is disposed in the band portion82L, and electrically connects the battery portion90, the left mikes19LT and19LB, and the camera body10to one another. The electric cables84R and84L are electric paths for supplying power of the battery portion90to the camera body10, and transmitting/receiving signals to/from an external device.

FIG.2Cis a rear view of the camera body10.FIG.2Cis a diagram of the camera body10as viewed from a direction in which the camera body10comes into contact with the neck of the user, that is to say, the direction opposite to the direction ofFIG.2A, and thus the positional relation between the right mount portion80R and the left mount portion80L is opposite to that inFIG.2A. On the rear side of the camera body10, a power button11, a shooting mode button12, and chest connection pads18R and18L are provided.

The power button11is an operation member for switching power-on or power-off of the camera1. In the present embodiment, the power button11is a slide lever, but there is no limitation thereto. The power button11may also be a button to be pressed, or may also be configured integrally with a slide cover (not illustrated) of the shooting lens16, for example.

The shooting mode button12is an operation member for changing the shooting mode of the camera1. In the present embodiment, the shooting mode can be switched to one of a still image mode, a moving image mode, and a preset mode. In the present embodiment, the shooting mode button12is a slide lever that enables one of “Photo”, “Normal”, and “Pre” to be selected. The shooting mode changes to the still image mode when “Photo” is set, the shooting mode changes to the moving image mode when “Normal” is set, and the shooting mode changes to the preset mode when “Pre” is set. Note that, as long as the shooting mode button12is a button for enabling the shooting mode to be changed, there is no limitation to the present embodiment. Three buttons “Photo”, “Normal”, and “Pre” may be provided as the shooting mode button12, for example.

When the camera body10is biased to the chest of the user immediately below the neck, the chest connection pads18R and18L abut on the neck or chest of the user. The camera body10has an outer shape such that the entire length in the horizontal direction (left-right direction) thereof is longer than the entire length in the vertical direction (up-down direction) thereof when the camera is worn on the neck of the user, and the chest connection pads18are disposed near the two end portions of the camera body10. Accordingly, it is possible to reduce blurring due to the camera body10rotating in the left-right direction during shooting. In addition, the chest connection pads18make it possible to prevent the power button11and the shooting mode button12from coming into contact with the body of the user. Furthermore, the chest connection pads18have a role of preventing heat from being transmitted to the body of the user when the temperature of the camera body10increases due to long-time shooting, and also have a role of adjusting the angle of the camera body10.

FIG.2Dis a top view of the camera body10.

The face detection unit13is provided at a central portion of the upper surface portion of the camera body10, and the chest connection pads18protrude from the two end portions of the camera body10.

FIG.2Eshows an internal configuration of the camera body10.

An infrared light detector27is disposed below the face detection unit13. The infrared light detector27includes an infrared light emission unit22and a light collecting lens26. Each infrared light emission unit22is an infrared light LED that projects infrared light23(seeFIG.5) toward the user via the face detection unit13. The infrared light23projected from the infrared light emission unit22is reflected by the user, and the light collecting lens26forms an image from the light, namely a reflected light beam25(seeFIG.5), on an infrared light image sensor (light receiving element) built in the infrared light detector27.

FIG.2Fis a left side view of the camera body10.

A left angle adjustment button85L is an operation member for adjusting the angle of the left angle holding portion81L relative to the left end portion of the camera body10. Note that, similarly, a right angle adjustment button85R (not illustrated) for adjusting the angle of the right angle holding portion81R relative to the right end portion of the camera body10is provided on a right side surface portion of the camera body10, at a position symmetrical to the left angle adjustment button85L. Hereinafter, the right angle holding portion81R and the left angle holding portion81L are collectively referred to as “angle holding portions81”. In addition, the right angle adjustment button85R and the left angle adjustment button85L are collectively referred to as “angle adjustment buttons85”. The angle adjustment buttons85are positioned so as to be viewed also inFIGS.2A,2C, and2D, but, for ease of description, illustration thereof is omitted.

The user can change the angle between the camera body10and each angle holding portion81by swinging the angle holding portion81in the up-down direction inFIG.2Fwhile pressing the angle adjustment button85. In addition, it is possible to change an angle by which the chest connection pad18protrudes from the camera body10. Accordingly, the direction of the shooting lens16of the camera body10can be adjusted to the horizontal direction for the differences in shape of neck and chest between users.

FIGS.3A to3Cshow a configuration of the battery portion90.

FIG.3Ais a rear view of the battery portion90. Inside the battery portion90, a left battery94L and a right battery94R (hereinafter, collectively referred to as “batteries94”) are disposed symmetrically relative to a center in the left-right direction. Accordingly, weight balance in the left-and-right direction of the battery portion90is held, and displacement of the camera1is reduced. Note that the battery portion90may be configured to be equipped with only one battery, but may also be configured to be equipped with three or more batteries.

FIG.3Bis a top view of the battery portion90. The batteries94are disposed symmetrically in the left-right direction relative to the notch portion93. Accordingly, it is possible to mount the battery portion90that is relatively weighty without causing any burden on the user.

FIG.3Cis a front view of the battery portion90, and is a diagram as viewed from the opposite direction to that ofFIG.3Athat shows a side of the battery portion90that comes into contact with the body of the user. The notch portion93is provided in the up-down direction in the center in the left-right direction of the battery portion90so as to extend along the spine of the user.

Functional Configuration of Camera

Next, a functional configuration of the camera1according to the present embodiment will be described with reference toFIG.4.

The camera1includes the face direction detection unit20, a shooting area determination unit30, an image capture unit40, an image processing unit50, a primary recording unit60, a communication unit70, and other control unit111. These are controlled by a camera control unit101(seeFIG.5) that performs overall processing of the camera1.

The face direction detection unit20includes the infrared light emission unit22and the infrared light detector27, and detects the face direction of the user in order to estimate the observation direction of the user, and outputs an estimation result to the shooting area determination unit30and the sound processing unit104.

The shooting area determination unit30performs computation based on the observation direction of the user estimated by the face direction detection unit20, and determines processing information indicating a position and area of an image that is extracted as an image to be recorded, from an image captured by the image capture unit40. The determined processing information is generated and is output to the image processing unit50.

The image capture unit40performs shooting of an image, generates image data, and outputs the image data to the image processing unit50.

The image processing unit50extracts and develops a portion of an image captured by the image capture unit40based on the processing information obtained from the shooting area determination unit30. The extracted image is output to the primary recording unit60as an image of the observation direction of the user.

The primary recording unit60includes a primary memory103(see FIG.5), records the image output from the image processing unit50, and outputs the image to the communication unit70at a necessary timing.

The communication unit70performs wireless communication with the display device2(seeFIG.1D), the calibrator3, and a simplified display device4, which are predetermined communication partners.

The display device2can communicate with the communication unit70using a wireless LAN that enables high-speed communication (hereinafter, high-speed wireless communication). In the present embodiment, a communication method that complies with the IEEE 802.11ax (WiFi (registered trademark) 6) standard is adopted for high-speed wireless communication, but a communication method that complies with another standard such as the WiFi 4 standard or the WiFi 5 standard may be also applied. In addition, the display device2may be a device developed specifically for the camera1.

As a method of communication between the communication unit70and the display device2, low-power wireless communication may be used, both high-speed wireless communication and low-power wireless communication may be used, or high-speed wireless communication and low-power wireless communication may be switched. In the present embodiment, a large amount of data such as a moving image to be described later is transmitted through high-speed wireless communication, and a small amount of data such as a still image and data that requires a transmission time are transmitted through low-power wireless communication. In the present embodiment, Bluetooth (registered trademark) is adopted for low-power wireless communication, but near field (short distance) wireless communication such as near field communication (NFC) may also be applied.

The calibrator3performs initial setting and individual setting of the camera1, and can communicate with the communication unit70through high-speed wireless communication, similarly to the display device2. Note that the display device2may also have the function of the calibrator3.

The simplified display device4can communicate with the communication unit70only through low-power wireless communication. The simplified display device4cannot transmit/receive an image to/from the communication unit70due to restrictions of communication capacity, but can perform transmission of a timing signal for starting/stopping shooting, transmission of an image merely for layout check, and the like. In addition, the simplified display device4may be a device dedicated for the camera1similarly to the display device2, or may be a smart watch or the like.

FIG.5is a block diagram showing a hardware configuration of the camera1. Note that configurations that have already been described are given the same reference signs, and a description thereof is omitted. The components inFIG.5are included in the camera body10. In addition, components other than the above mikes19LT,19LB,19RB, and19RT in a sound input unit19are included in the camera body10.

The camera1includes the camera control unit101, the power button11, the shooting mode button12, the face detection unit13, the start button14, the stop button15, the shooting lens16, and the indicator17. In addition, the camera1includes an infrared lighting circuit21, the infrared light emission unit22, the infrared light collecting lens26, and the infrared light detector27, which constitute the face direction detection unit20(seeFIG.4). In addition, the camera1includes an image sensor drive circuit41, the image sensor42, and a captured image signal processing circuit43, which constitute the image capture unit40(seeFIG.4). In addition, the camera1includes a low-power wireless communication unit61and a high-speed wireless communication unit62, which constitute the communication unit70(seeFIG.4).

The camera1according to the present embodiment is provided with only one image capture unit40, but may also be provided with two or more image capture units40. Including a plurality of image capture units makes it possible to perform shooting of a3D image, shooting of an image that has a wider field of view than that can be obtained by one image capture unit40, shooting of an image in a plurality of directions, and the like.

In addition, the camera1includes a large capacity non-volatile memory51, a built-in non-volatile memory102, and the primary memory103. Furthermore, the camera1includes the sound processing unit104, a sound output unit105, a vibration unit106, an angular velocity sensor107, an acceleration sensor108, and various operating units110.

The camera control unit101includes a processor such as a CPU that performs overall control of the camera1. The functions of the shooting area determination unit30, the image processing unit50, and the other control unit111that have been described with reference toFIG.4are realized by the camera control unit101executing a program stored in the primary memory103or the like.

The infrared lighting circuit21controls on and off of the infrared light emission unit22. The infrared light emission unit22emits the user with the infrared light23. The face detection unit13includes a visible light cut filter, and hardly allows visible light to pass, and allows the infrared light23and the reflected light beam25to pass. The infrared light collecting lens26collects the reflected light beam25.

The infrared light detector27includes an infrared light image sensor for detecting the reflected light beam25collected by the infrared light collecting lens26. The infrared light image sensor generates image data by photoelectrically converting the reflected light beam25collected by the infrared light collecting lens26and formed into an image by the infrared light image sensor, and outputs the generated image data to the camera control unit101.

As shown inFIG.1B, in a state where the user is wearing the camera1, the face detection unit13is positioned below the jaw of the user. For this reason, the infrared light23projected from the infrared light emission unit22passes through the face detection unit13, and an infrared light emission surface24, which is a surface of skin in the vicinity of the jaw of the user, is emitted with the infrared light23. The infrared light23reflected by the infrared light emission surface24passes through the face detection unit13as the reflected light beam25, and is formed into an image on the infrared light image sensor of the infrared light detector27through the infrared light collecting lens26.

The various operating units110are operation members for executing functions other than the afore-mentioned functions of the camera1.

The image sensor drive circuit41includes a timing generation circuit and the like, and generates a timing signal for controlling an image capture operation that is performed by the image sensor42. The image sensor42generates captured image signals by photoelectrically converting a subject image formed by the shooting lens16shown inFIG.1A, and outputs the generated signals to the captured image signal processing circuit43. The captured image signal processing circuit43generates image data by performing clamp processing, A/D conversion processing, and the like on the captured image signals from the image sensor42, and outputs the generated image data to the camera control unit101.

The built-in non-volatile memory102is a flash memory or the like, and stores a program to be executed by the camera control unit101, constants and variables for executing the program, and the like. The camera1according to the present embodiment can change the shooting field of view (shooting area) and set the intensity of anti-vibration control, and thus setting values thereof are also stored in the built-in non-volatile memory102.

The primary memory103is a RAM or the like, and temporarily stores image data that is being processed, or temporarily stores a result of computation performed by the camera control unit101. Processed image data is written as a moving image file or a still image file to the large capacity non-volatile memory51, and such a file is read out from the large capacity non-volatile memory51. The large capacity non-volatile memory51may be a recording medium built in the camera body10, or may be a removable recording medium such as a memory card, or may be used along with the built-in non-volatile memory102.

The low-power wireless communication unit61performs data communication with the display device2, the calibrator3, and the simplified display device4through low-power wireless communication. The high-speed wireless communication unit62performs data communication with the display device2, the calibrator3, and the simplified display device4through high-speed wireless communication.

The sound input unit19that includes a plurality of mikes19LT,19LB,19RB, and19RT is connected to the sound processing unit104. The sound processing unit104generates digital sound signals by sampling analog sound signals output from the mikes, for each predetermined period.

The indicator17, the sound output unit105, and the vibration unit106notify the user of the state of the camera1or issue an alert by emitting light, generating sound, and vibrating.

The angular velocity sensor107detects movement (rotation and direction) of the camera body10. The acceleration sensor108detects posture information of the camera body10. The posture information of the camera body10is, for example, inclination of the shooting optical axis of the camera body10(upper, lower, left, and right angles). Note that the angular velocity sensor107and the acceleration sensor108are built in the camera body10, and the angular velocity sensor207and the acceleration rate sensor208are provided in the display device2.

Configuration of Display Device

FIG.6is a block diagram showing a hardware configuration of the display device2. Note that configurations that have already been described are given the same reference signs, and a description thereof is omitted.

The display device2includes a display device control unit201, the A button202, the display unit203, the B button204, the in-camera205, the face sensor206, the angular velocity sensor207, the acceleration rate sensor208, a captured image signal processing circuit209, and various operation units211.

In addition, the display device2includes a built-in non-volatile memory212, a primary memory213, a large capacity non-volatile memory214, a sound output unit215, a vibration unit216, an indicator217, a sound processing unit220, a low-power wireless communication unit231, and a high-speed wireless communication unit232.

The display device control unit201includes a processor such as a CPU that performs overall control of the display device2.

The captured image signal processing circuit209has functions similar to those of the image sensor drive circuit41, the image sensor42, and the captured image signal processing circuit43of the camera1, and such functions are collectively shown inFIG.6. Data output from the captured image signal processing circuit209is processed by the display device control unit201.

The various operation units211are operation members for executing functions other than the aforementioned functions of the display device2.

The angular velocity sensor207detects movement of the display device2. The acceleration rate sensor208detects the posture of the display device2.

Note that the angular velocity sensor207and the acceleration rate sensor208are built in the display device2, and have functions similar to those of the angular velocity sensor107and the acceleration sensor108built in the camera1.

The built-in non-volatile memory212is a flash memory or the like, and stores a program to be executed by the display device control unit201, and constants and variables for executing the program, and the like.

The primary memory213is a RAM or the like, and temporarily stores image data that is being processed, and temporarily stores a result of computation performed by the display device control unit201. In the present embodiment, during moving image shooting, data detected by the angular velocity sensor107at the shooting time of each frame is associated with the frame, and is held in the primary memory213.

Processed image data and image data transmitted from the camera1are written as a moving image file or a still image file to the large capacity non-volatile memory214, and such a file is read out from the large capacity non-volatile memory214. The large capacity non-volatile memory214may be a recording medium built in the display device2, or may be a removable recording medium such as a memory card, or may be used along with the built-in non-volatile memory212.

The sound output unit215, the vibration unit216, and the indicator217notify the user of the state of the display device2or issue an alert by generating sound, vibrating, and emitting light.

The sound processing unit220is connected to a sound input unit219that includes a plurality of mikes219L and219R for collecting sound in the surroundings of the display device2, and generates digital sound signals by sampling analog sound signals output from the mikes.

The low-power wireless communication unit231performs data communication with the camera1through low-power wireless communication. The high-speed wireless communication unit232performs data communication with the camera1through high-speed wireless communication.

The face sensor206includes an infrared lighting circuit221, an infrared light emission unit222, an infrared light collecting lens226, and an infrared light detector227.

The infrared lighting circuit221controls on and off of the infrared light emission unit222. The infrared light emission unit222emits the user with infrared light223. The infrared light collecting lens226collects a reflected light beam225. The infrared light detector227includes an infrared light image sensor for detecting the reflected light beam225collected by the infrared light collecting lens226. The infrared light image sensor generates image data by photoelectrically converting the reflected light beam225collected by the infrared light collecting lens226and formed into an image by the infrared light image sensor, and outputs the generated image data to the display device control unit201.

When the face sensor206is directed to the user, an infrared light emission surface224, which is the entire face of the user, is emitted with the infrared light223projected from the infrared light emission unit222as shown inFIG.6. The infrared light223reflected by the infrared light emission surface224, that is to say, the reflected light beam225is formed into an image on the infrared light image sensor of the infrared light detector227through the infrared light collecting lens226.

Another function unit230executes a telephone function, other functions, and the like, other than the afore-mentioned functions of the display device2.

Configuration of Sound Processing Unit

Next, a configuration and functions of the sound processing unit104of the camera1according to the present embodiment will be described with reference toFIGS.7A and7B.

FIG.7Ais a block diagram showing a configuration of the sound processing unit104of the camera1according to the present embodiment.FIG.7Bis a block diagram showing a configuration of a beam forming unit of the sound processing unit104inFIG.7A.

The sound processing unit104includes an Lch A/D converter121L, an Rch A/D converter121R, a signal processing unit122, and an ALC unit123. In addition, the signal processing unit122includes an Lch beam forming unit122L and an Rch beam forming unit122R. The sound input unit19includes the mikes19LT,19LB,19RB, and19RT.

The Lch A/D converter121L converts sound signals for the left ear (L1 and L2 channels) obtained by the left mikes19LT and19LB, from analog sound signals into digital sound signals. The Rch A/D converter121R converts sound signals for the right ear (R1 and R2 channels) obtained by the right mikes19RT and19RB, from analog sound signals into digital sound signals. In A/D conversion processing that is performed by the Lch A/D converter121L and the Rch A/D converter121R, processing for multiplying each sound signal by a predetermined gain is performed so as to obtain a desired signal level in accordance with the sensitivity of the mike. A programable gain amplifier (PGA) is used as a method for multiplying a signal by a gain, for example. In addition, various methods are used for A/D conversion, but delta-sigma A/D conversion is mainly used for sound signals.

The signal processing unit122executes gain adjustment, filter processing such as removal of low frequency components or removal of high frequency components, and beam forming processing on sound signals of L1, L2, R1, and R2 channels subjected to A/D conversion processing, and generates sound signals of two types of channels, namely left and right channels. The Lch beam forming unit122L performs beam forming processing on the sound signals of the L1 and L2 channels. The Rch beam forming unit122R performs beam forming processing on the sound signals of the R1 and R2 channels. Beam forming processing will be described in detail later with reference toFIG.7B.

The auto level control (ALC) unit123adjusts the levels of the sound signals of the L channels and the sound signals of the R channels subjected to beam forming processing, so as to achieve appropriate volume, and outputs the sound signals to the primary memory103. Sound data obtained by performing predetermined sound processing on sound signals obtained by the mikes during moving image shooting performed by the camera1is stored in the primary memory103in association with moving image data, and the sound data and the moving image data are stored in the large capacity non-volatile memory51as a moving image file and a sound file.

FIG.7Bis a block diagram showing a configuration of the Lch beam forming unit122L and the Rch beam forming unit122R inFIG.7A.

The Lch beam forming unit122L and the Rch beam forming unit122R provide a directivity to the sound signals of the L channels and the sound signals of the R channels by correcting the phase delay time of the sound signal obtained by the upper mike19LT or the upper mike19RT by multiplying the phase delay time by a gain, based on information regarding the distance between the camera body10and the face of the user detected by the face direction detection unit20(chin distance to be described later with reference toFIGS.9A to9C) and information regarding the posture (upper, lower, left, and right angles) of the camera1detected by the acceleration sensor108. A delay sum method is used for beam forming processing, and, for example, a phase change filter of a delay time that is based on the angle of the camera1for which sound is desired to be emphasized is applied to the sound signal obtained by the upper mike19LT or the upper mike19RT, the sound signal obtained by the lower mike19LB or lower mike19RB is then added, and sound arriving from the camera1at the angle for which sound is desired to be emphasized is intensified, whereby a sound signal that has a desired directivity is generated.

The Lch beam forming unit122L and the Rch beam forming unit122R each include a signal delay unit124and an amplification unit125. The signal delay unit124applies, to the sound signals obtained by the upper mike19LT and the upper mike19RT, a phase change filter of a delay time that is based on the posture of the camera1detected by the acceleration sensor108. In the present embodiment, the delay time corresponds to one sample period by which the sound signals of the upper mikes19LT and19RT are delayed relative to the sound signals of the lower mikes19LB and19RB. The amplification unit125corrects the delay time that is applied by the signal delay unit124, by multiplying the delay time by a predetermined gain, in accordance with the spaced distance between the camera body10and the face of the user detected by the face direction detection unit20.

Control Processing

Control processing of the camera1and the display device2will be described below.

FIG.8Ais a flowchart showing control processing of the camera1and the display device2according to the present embodiment.

The processing of the camera1inFIG.8Ais realized by switching on the power supply of the camera1, the camera control unit101loading a program stored in the built-in non-volatile memory102to the primary memory103, and executing the program, and thereby controlling components of the camera1. In addition, the processing of the display device2inFIG.8Ais started when the power supply of the display device2is switched on and the camera1is worn on the user, and is realized by the display device control unit201loading a program stored in the built-in non-volatile memory212to the primary memory213, and executing the program, and thereby controlling components of the display device2.

Note that steps S100to S700inFIG.8Aare processing that is executed by the camera1. Steps S800to S1000inFIG.8Aare processing that is executed by the display device2.

In step S100, when the power button11is switched on, and the camera1is powered on, the camera control unit101is started. The camera control unit101reads out a program from the built-in non-volatile memory102, and executes shooting preparation processing for performing shooting setting of the camera1. The shooting preparation processing will be described later in detail with reference toFIG.8B.

In step S200, the face direction detection unit20estimates a direction in which the user is performing observation. Face direction detection processing will be described later in detail with reference toFIG.8C.

In step S300, the shooting area determination unit30determines a shooting direction and a shooting field of view of the camera1. Note that the face direction detection processing in step S200and the shooting area determination processing in step S300are repeatedly executed in a state where the power supply of the camera1is on. In addition, a configuration may also be adopted in which, during a period from when the image capture unit40starts shooting in accordance with an operation performed on the start button14until when shooting is stopped in accordance with an operation performed on the stop button15, the processing of step S200and the processing of step S300are repeatedly performed, and, during a period other than that, the processing of step S200and the processing of step S300are not performed.

In step S400, the image capture unit40performs shooting of an image in accordance with the user giving an instruction to start shooting, and generates image data. Shooting processing will be described later in detail with reference toFIG.8D.

In step S500, the image processing unit50extracts an image from the image data generated in step S400and develops the extracted area, based on the shooting direction and the shooting field of view determined in step S300.

In step S600, the primary recording unit60stores the image data developed in step S500in the primary memory103.

In step S700, the communication unit70transmits the image data stored in the primary memory103in step S600, to the display device2at a predetermined timing.

In step S800, the display device control unit201performs optical correction on the image data transmitted from the camera1in step S700.

In step S900, the display device control unit201performs anti-vibration processing on the image data subjected to the optical correction executed in step S800.

Note that the order of the processing of step S800and the processing of step S900may be reversed. In other words, optical correction may be performed after anti-vibration processing of image data is performed.

In step S1000, the display device control unit201stores the image data subjected to the optical correction in step S800and the anti-vibration processing in step S900, in the large capacity non-volatile memory214(secondary recording).

Preparation Processing

FIG.8Bis a flowchart showing shooting preparation processing of step S100inFIG.8A.

In step S101, the camera control unit101determines whether or not the power button11is on. The camera control unit101waits when the power supply is off, and advances the procedure to step S102when it is determined that the power supply has been switched on.

In step S102, the camera control unit101determines an operation mode selected using the shooting mode button12. When it is determined that the operation mode is a moving image mode, the camera control unit101advances the procedure to step S103. When it is determined that the operation mode is a still image mode, the camera control unit101advances the procedure to step S106. When it is determined that the operation mode is a preset mode, the camera control unit101advances the procedure to step S108.

In step S103, the camera control unit101reads out settings of the moving image mode from the built-in non-volatile memory102, and stores the settings in the primary memory103. The settings of the moving image mode include, for example, a field-of-view setting value ang (which is set to 90° as an initial value in advance in the present embodiment) and an anti-vibration level designated as “high”, “moderate”, “off”, or the like.

In step S104, the camera control unit101causes the image sensor drive circuit41to start operating for the moving image mode.

In step S106, the camera control unit101reads out settings of the still image mode from the built-in non-volatile memory102, and stores the settings in the primary memory103. The settings of the still image mode include, for example, a field-of-view setting value ang (which is set to 45° as an initial value in advance in the present embodiment) and an anti-vibration level designated as “high”, “moderate”, “off”, or the like.

In step S107, the camera control unit101causes the image sensor drive circuit41to start operating for the still image mode.

In step S108, the camera control unit101reads out settings of the preset mode from the built-in non-volatile memory102, and stores the settings in the primary memory103. The preset mode is a custom shooting mode in which an external device such as the display device2changes the settings of the camera1. The camera1is a small-sized wearable device, and is not provided with an operation member for performing detailed settings or a display unit for displaying a menu screen and the like, and thus the external device such as the display device2changes the settings of the camera1.

A case is envisioned in which, for example, it is desirable to perform shooting with a field of view of 90° and a field of view of 110° in a row during moving image shooting. The field of view of 90° is set for a normal moving image mode, and thus, in order to change the field of view and perform shooting, there is a need to perform an operation of, first, performing shooting in the normal moving image mode, then ending shooting, displaying a setting screen of the camera1on the display device2, and changing the field of view to 110°. In this case, when the display device2is performing some form of event such as when the display device2is on the phone, an operation of changing settings that is performed by the display device2becomes complicated.

In contrast, in the preset mode, when the field of view is set to 110° in advance, the field of view is immediately changed to 110° merely by setting the shooting mode button12to “Pre” after moving image shooting has ended with the field of view of 90°, and moving image shooting can be continued. In this manner, the user can change the settings of the moving image mode without suspending the current mode and performing a complicated operation.

Note that the settings of the preset mode may include not only the field of view, but also an anti-vibration level that is designated as “high”, “moderate”, “off”, or the like, settings of voice recognition, and the like.

In step S109, the camera control unit101causes the image sensor drive circuit41to start operating for the preset mode.

Face Direction Detection Processing

FIG.8Cis a flowchart showing face direction detection processing of step S200inFIG.8A.

First, a face direction detection method that is performed by the face direction detection unit20according to the present embodiment will be described with reference toFIGS.9A to9C.

As shown inFIG.9A, in a state where the user is wearing the camera1, the face detection unit13is disposed immediately below the jaw of the user. The infrared light emission unit22of the face direction detection unit20emits a bottom of the jaw with infrared light through the face detection unit13, and the infrared light detector27captures an infrared light image of an area extending from the jaw of the face to the neck bottom. The face direction detection unit20then executes binarization and edge extraction of the infrared light image.

As shown inFIG.9B, the face direction detection unit20sets, as a chin position207, the position of a dark-colored portion of a binary image that corresponds to a protrusion of an edge, and sets, as a neck bottom position206, the position of a light-colored portion that is close to a central portion of a lower surface of the face detection unit13. Furthermore, the face direction detection unit20calculates the distance between the neck bottom position206and the chin position207, and calculates a first face direction θh of the user based on the amount of time-series displacement of the chin position207. The first face direction θh is information indicating the direction of the face of the user when the user turns his or her neck to the left or right, assuming that a state where the user faces the front in a state where the user is wearing the camera1is set to 0°.

Furthermore, the face direction detection unit20calculates distribution ratios of regions ranging from a dark-colored region to a light-colored region in the area extending from the neck bottom position206to the chin position207, and calculates a chin distance F between the face detection unit13and the chin position207as shown inFIG.9C. In addition, the face direction detection unit20calculates a second face direction θv of the user based on the amount of time-series change of the chin distance F. The second face direction θv is information indicating the direction of the face of the user when the user bends his or her neck forward or backward, assuming that a state where the user faces the front in a state where the user is wearing the camera1is set to 0°.

The face direction detection processing of step S200inFIG.8Athat is performed using the face direction detection method described with reference toFIGS.9A to9Cwill be described later with reference toFIG.8C.

In step S201, the face direction detection unit20outputs a control signal to the infrared lighting circuit21at time t1, so as to stop emission from the infrared light emission unit22.

In step S202, the infrared light detector27of the face direction detection unit20captures an image. The face direction detection unit20reads out captured image data of one frame from the infrared light detector27, and stores the image data as Frame 1 in the primary memory103.

In step S203, the infrared light emission unit22of the face direction detection unit20emits a bottom of the jaw of the user with infrared light through the face detection unit13at time t2.

In step S204, the infrared light detector27of the face direction detection unit20captures an infrared light image of an area extending from the jaw of the face of the user to the neck bottom at time t2. The face direction detection unit20reads out captured image data of one frame from the infrared light detector27, and stores the image data as Frame 2, in the primary memory103.

In step S205, the face direction detection unit20outputs a control signal to the infrared lighting circuit21, so as to stop emission from the infrared light emission unit22.

In step S206, the face direction detection unit20reads out Frame 1 and Frame 2 from the primary memory103, and calculates a light intensity Fn of the reflected light beam25based on the difference between Frame 2 and Frame 1 (dark subtraction processing).

In step S207, the face direction detection unit20extracts a neck bottom position (neck rotation center) based on the light intensity Fn calculated in step S206.

In step S208, the face direction detection unit20extracts the chin position207and the neck bottom position206from the light intensity Fn calculated in step S206. Furthermore, the face direction detection unit20calculates the distance between the neck bottom position206and the chin position207, and calculates the first face direction θh of the user based on the amount of time-series displacement of the chin position207.

In step S209, the face direction detection unit20calculates the chin distance F between the face detection unit13and the chin position207based on the light intensity Fn calculated in step S206and the neck bottom position206and the chin position207extracted in step S208. In addition, the face direction detection unit20calculates the second face direction θv of the user based on the amount of time-series change in the chin distance F.

In step S210, the face direction detection unit20stores, in the primary memory103, the first face direction θh and the second face direction θv respectively calculated in steps S208and S209, as an observation direction v of the user. An observation direction vo when the user is performing observation at the center on the front, for example, is vector information [0°, 0°] since the first face direction θh is 0° and the second face direction θv is 0°. In addition, an observation direction vr when the user is performing observation at a right angle of 45° is vector information [45°, 0°].

Shooting Processing and Recording Processing

Next, recording processing in the shooting processing of step S400inFIG.8Awill be described with reference toFIGS.8D and10.

FIG.8Dis a flowchart showing recording processing in the shooting processing of step S400inFIG.8A.FIG.10is a diagram illustrating the recording processing in the shooting processing that is performed by the camera1according to the present embodiment. The processing inFIG.8Dis repeatedly executed while the shooting processing is being executed.

In the present embodiment, let us assume that, as shown inFIG.10, there is a point sound source at a distant position on a line1001that connects the left mikes19LT and19LB aligned in the up-down direction (the same applies to the right mikes19RT and19RB). Then, a delay time that occurs when acoustic waves are transmitted is corrected by performing beam forming processing based on sound pressure obtained by the upper and lower mikes, and a directivity is provided to the sound signals so as to emphasize a sound field near the ear of the user by emphasizing acoustic waves arriving from the direction of the point sound source. Accordingly, a sound collection area1002of the left mikes19LT and19LB can be brought close to the ear of the user as with an earphone equipped with a mike (the same applies to the right mikes19RT and19RB), thus enabling binaural recording that does not give a feeling that something is amiss.

In step S401, the camera control unit101initializes the sound input unit19. The sound processing unit104starts to energize the mikes19LT,19LB,19RT, and19RB, inputs a clock signal, and prepares for obtaining sound signals from the respective mikes.

In step S402, the camera control unit101initializes the sound processing unit104. Regarding the sound processing unit104, a gain of A/D conversion processing and the like are initialized. In addition, effects of gain correction of sound signals through beam forming processing described with reference toFIGS.7A and7Bchange according to physical differences of users and the posture of the camera1being worn on the user. For this reason, initial values (thresholds) are set for the chin distance for determining physical differences of the user and upper, lower, left, and right angles of the camera1for determining the posture of the camera1being worn on the user, and phase delay times of the upper mikes19LT and19RT are set to the initial values.

In step S403, the camera control unit101reads out the chin distance F obtained in step S210inFIG.8C, from the primary memory103.

In step S404, the camera control unit101compares the chin distance F read out in step S403with the initial value (threshold) of the chin distance. When it is determined that the chin distance F is longer than the threshold, the camera control unit101advances the procedure to step S405. When it is determined that the chin distance F is shorter than or equal to the threshold, the camera control unit101advances the procedure to step S406.

In step S405, the camera control unit101increases the gain of the amplification unit125so as to increase a phase delay time caused by beam forming processing performed on the sound signals of the upper mikes19LT and19RT, and performs correction by multiplying the phase delay time of the signal delay unit124by the gain. The phase delay time is determined using the chin distance F based on 1/F×100, assuming that the initial value of the chin distance is 1.

In step S406, the camera control unit101decreases the gain of the amplification unit125so as to decrease a phase delay time caused by beam forming processing performed on the sound signals of the upper mikes19LT and19RT, and performs correction by multiplying the phase delay time of the signal delay unit124by the gain.

In step S407, the camera control unit101executes recording processing of the sound signals subjected to beam forming processing performed by the sound processing unit104. The camera control unit101causes the image capture unit40to start shooting processing in accordance with an operation performed on the start button14, and to stop shooting processing in accordance with an operation performed on the stop button15.

As described above, according to the present embodiment, the effect of binaural recording is achieved irrespective of a change in the position of an ear of the user and a change in the position of a mike.

OTHER EMBODIMENTS

This application claims the benefit of Japanese Patent Application No. 2023-021864, filed Feb. 15, 2023 which is hereby incorporated by reference herein in its entirety.