Smart headphone

The present disclosure provides a smart headphone. The smart headphone includes a sensor configured to sense external information, a memory configured to store feature information, and a controller operatively connected to the sensor and the memory, respectively, and the controller is configured to compare the external information sensed by the sensor with the feature information stored in the memory, and to control a playback state of audio information in the smart headphone according to the result of the comparison.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application claims priority to Chinese patent application No. 201710682434.8, entitled “SMART HEADPHONE” and filed on Aug. 10, 2017, which is incorporated herein by reference in its entirety.

TECHNICAL FIELD

The present disclosure relates to the field of headphone technology, and in particular, to a smart headphone.

BACKGROUND

In daily life, headphones have been widely used as important electronic accessories. Currently, the common headphones mainly include in-ear headphones and headphones.

Taking the headphone as an example, when a user is using the headphone to listen to a song or listen to a broadcast, the user's ears may hear audio information continuously played back in the headphone. At this time, if someone wants to talk to the user, the audio information continuously played back in the headphone must interfere with the user, so that the user cannot get what others are saying. In this case, the user needs to remove the headphone so as to have a barrier-free conversation with others. In this way, however, the use of the headphone may not be convenient, which thus affects the user's experience.

SUMMARY

In order to at least partially solve or alleviate the above problem, some embodiments according to the present disclosure provide a smart headphone. The smart headphone provided by the present disclosure includes a sensor configured to sense external information; a memory configured to store feature information; and a controller operatively connected to the sensor and the memory, respectively, and configured to compare the external information sensed by the sensor with the feature information stored in the memory, and configured to control a playback state of audio information in the smart headphone according to the result of the comparison.

DETAILED DESCRIPTION

To make the above objectives, features, and advantages of the present disclosure more comprehensible, the following describes the technical solutions in the embodiments of the present disclosure clearly and completely with reference to the accompanying drawings in the embodiments of the present disclosure. Obviously, the described embodiments are merely some but not all of the embodiments of the present disclosure. All other embodiments which may be obtained by the skilled in the art based on the embodiments of the present disclosure without creative labor shall fall within the protection scope of the present disclosure.

As shown inFIG. 1, the present embodiment provides a smart headphone, which includes a sensor1, a memory2, and a controller3. The sensor1is configured to sense external information; the memory2is configured to store feature information; and the controller3is operatively connected to the sensor and the memory, respectively, and configured to compare the external information sensed by the sensor1with the feature information stored in the memory2, and control a playback state of audio information within the smart headphone according to the result of the comparison.

In the process of the user listening to the audio information using the smart headphone, the sensor1senses the external information surrounding the user, and transmits the sensed external information to the controller3, the controller3compares the external information sensed by the sensor1with the feature information stored in the memory2, and when it is determined by the comparison that there is information in the external information which matches the feature information, the controller3may control a playback state of the audio information in the smart headphone automatically. Compared to other headphones, the smart headphone provided in the present embodiment may automatically switch the playback status of the audio information, and the user does not need to manually remove the smart headphone, thereby improving the user's experience in using the smart headphone.

In the above embodiment, the sensor1may sense the external information in real time, and may also sense the external information in any time as needed. For example, when the user uses the smart headphone indoors, the sensor1may sense the external information in real time in order to prevent missing information sent from other person in the room to the user. Accordingly, the controller3compares the external information sensed by the sensor1in real time with the feature information stored in the memory2in real time. For another example, when the user uses the smart headphone in a public place, the sensor1may be enabled in actual situations to sense the external information only within a specific period of time, and does not sense the external information during other periods. This may not only save energy of the smart headphone, but also reduce information processed amount in the smart headphone.

In some embodiments, the external information sensed by the sensor1may be external sound information and/or external image information. For example, when the external information sensed by the sensor1is the external sound information, the feature information stored in the memory2is sound feature information accordingly. As shown inFIG. 2, when the external information sensed by the sensor1is the external sound information, the sensor1generally includes a sound sensor11, the controller3includes a sound processing module31and a control module32, and the sound processing module31is operatively connected to the sound sensor11, the memory2and the control module32, respectively.

The sound processing module31is configured to compare the external sound information sensed by the sound sensor11with the sound feature information stored in the memory2. When the sound processing module31determines that the external sound information contains sound matching information that matches the sound feature information, the control module controls the smart headphone to stop the playback of the audio information or to play back the audio information.

Illustratively, the sound feature information may include a first type of sound feature information for identifying a start of conversation and a second type of sound feature information for identifying an end of conversation. The first type of sound feature information may specifically include sound feature information, such as Hello, HI, user's name etc. The second type of sound feature information may specifically include sound feature information, such as Goodbye, BYEBYE, and the like. Of course, the first type of sound feature information and the second type of sound feature information may also include other sound feature information, and may be set according to actual situations.

When the user listens to the audio information using the smart headphone, the sound sensor11senses the external sound information. When the sound processing module31determines that there is a first type of sound matching information, which matches the first type of sound feature information, in the external sound information sensed by the sound sensor11, it means that someone wants to start a conversation with the user at this time. Thus, the control module32may control the smart headphone to enter a conversation mode, and automatically stop the playback of the audio information. In addition, when the smart phone is in the conversation mode, the sound sensor11continues to sense the external sound information. When the sound processing module31determines that there is a second type of sound matching information, which matches the second type of sound feature information, in the external sound information sensed by the sound sensor11, it means that the conversation ends at this time. Thus, the control module32may control the smart headphone to exit the conversation mode, so as to continue to play back the audio information automatically.

Further, the sensor1may also sense image information. Accordingly, the feature information stored in the memory2may also include face image feature information. Referring again toFIG. 2, the sensor1further includes an image sensor12, and the controller3further includes an image processing module33. The image sensor12is operatively connected to the sound processing module31. When the sound processing module31determines that the external sound information contains sound matching information that matches the sound feature information, the image sensor12is configured to sense the external image information. The image processing module33is operatively connected to the memory2, the image sensor12, and the control module32, respectively. The image processing module33is configured to compare the external image information sensed by the image sensor12with the face image feature information stored in the memory2.

It can be understood that the face image feature information stored in the memory2may include face image information of persons who are acquainted with the user. Illustratively, when the sound processing module31determines that the external sound information contains the first type of sound matching information that matches the first type of sound feature information, the image sensor12starts to sense the external image information, and the image processing module33will compare the external image information sensed by the image sensor12with the face image feature information stored in the memory2. When the image processing module33determines that the external image information contains the face image matching information that matches the stored face image feature information, it means that the first type of sound matching information identified by the sound processing module31is issued from the person who is acquainted with the user, and thus it is determined that the person who issues the first type of sound matching information wants to have a conversation with the user. At this time, the smart headphone may be controlled by the control module32to enter the conversation mode, and stop the playback of the audio information. However, when the image processing module33determines that the external image information does not contain the face image matching information that matches the stored face image feature information, it means that the first type of sound matching information identified by the sound processing module31is issued from the person who is not acquainted with the user. It means that it is a stranger around the user that is in conversation with others. At this time, the smart headphone does not need to enter the conversation mode, and the control module32controls the smart headphone to continue the playback of the audio information.

Similarly, when the sound processing module31determines that the external sound information contains the second type of sound matching information that matches the second type of sound feature information, the image processing module33may also compare the external image information sensed by the image sensor12with the face image feature information stored in the memory2. When the image processing module33determines that the external image information contains the face image matching information that matches the face image feature information, it means that the person who issues the second type of sound matching information has not left yet, and the conversion with the user has not ended. At this time, the control module32controls the smart headphone to stop the playback of the audio information. When the image processing module33determines that the external image information does not contains the face image matching information that matches the face image feature information, it means that the person who has the conversation with the user has left, and the conversation has ended. At this time, the control module32controls the smart headphone to continue to play back the audio information.

When the sensor1includes the image sensor12and the controller3includes the image processing module33, the external image information may be further compared after the sound processing module31determines that the sensed external sound information contains the sound matching information that matches the sound feature information, so that the identity of the person who issues the sound matching information may be further determined, and thus whether the smart headphone needs to enter the conversation mode or exit the conversation mode may be determined more accurately.

With reference to the connection diagram of the smart phone as shown inFIG. 3, a front view of the smart phone as shown inFIG. 4a, and a top view of the smart phone as shown inFIG. 4b, in order to sense the external sound information omnidirectionally, the sound sensor11may include a plurality of sound sub-sensors111arranged on top of the smart headphone in a circular manner for sensing the external sound information omnidirectionally. The plurality of sound sub-sensors111are operatively connected to the sound processing module31. Similarly, the image sensor12can also be arranged on top of the smart headphone to sense the external image information omnidirectionally.

When the sound processing module31determines that the external sound information contains sound matching information that matches the sound feature information, the image processing module33may be enabled to be operatively connected to the plurality of sound sub-sensors111, in order to control the image sensor12to sense the external image information. In this way, the image processing module33may determine a position of a sound sub-sensor111that has a larger volume of the sensed sound matching information, and thus determine a sound source location of the sound matching information, according to volumes of the sound matching information sensed by the plurality of sound sub-sensors111; and control the image sensor12to sense the external image information at the sound source location according to the determined sound source location.

It should be noted that when the plurality of sound sub-sensors111sense the external sound information in real time, the image processing module33may determine the sound source location of the sound matching information in real time according to the volumes of the sound matching information sensed in real time by the plurality of sound sub-sensors111, respectively. That is, the image sensor12may also sense the external image information at the sound source location in real time according to the sound source location determined in real time.

Further, as shown inFIG. 5, the controller3may further include a location processing module34, and the location processing module34is operatively connected to the control module32and the image processing module33, respectively.

When the image processing module33determines that the external image information sensed by the image sensor12contains the face image matching information that matches the face image feature information stored in the memory2, the location processing module34judges whether the relative location between the person corresponding to the face image matching information and the user is within a preset location range, according to the face image matching information identified by the image processing module33. When it is judged that the relative location between the person corresponding to the face image matching information and the user is within the preset location range, it means that the relative location between the person and the user is in accordance with a relative location which should be in when the two persons are in conversation. Thus, it is further proved that the person is in conversation with the user. At this time, the control module32controls the smart headphone to stop the playback of the audio information. When the location processing module34judges that the relative location between the person corresponding to the face image matching information and the user exceeds the preset location range, it means that the relative location between the person and the user is not in accordance with the relative location which should be in when the two persons are in conversation. Thus, it is proved that the person is not in conversation with the user. At this time, the control module32controls the smart headphone to play back the audio information.

It should be noted that judging whether the relative location between the person corresponding to the face image matching information and the user exceeds the preset location range can be performed by judging whether a relative angle between the face of the person and the face of the user exceeds a preset angle range. For example, when it is identified that the angle between the face of the person and the face of the user is +180°, it means that the person is face-to-face with the user, that is, the person is in front of the user, which is in accordance with the relative location that should be in when the two persons are in conversation. When it is identified that the angle between the face of the person and the face of the user is 0°, it means that the face of the person is towards the back of the user, that is, the person is in rear of the user, which is not in accordance with the relative location that should be in when the two persons are in conversation. The preset angle range may be set according to actual situations, which is not particularly limited in this embodiment.

In addition, as shown inFIG. 6, the sensor1may further include a distance sensor13operatively connected to the image processing module33. Correspondingly, the controller3further includes a distance processing module35. The distance processing module35is operatively connected to the control module32and the distance sensor13, respectively. When the image processing module33determines that the sensed external image information contains the face image matching information that matches the stored face image feature information, the distance sensor13senses a relative distance between the person corresponding to the face image matching information and the user, according to the face image matching information determined by the image processing module; and the distance processing module35judges whether the relative distance sensed by the distance sensor13is within a preset distance range.

Illustratively, when the sound processing module31determines that the external sound information contains the first type of sound matching information that matches the first type of sound feature information, and the image processing module33determines that the sensed external image information contains the face image matching information that matches the stored face image feature information, the distance sensor13senses the relative distance between the person corresponding to the face image matching information and the user according to the face image matching information identified by the image processing module33. When the sound processing module31determines that the external sound information contains the second type of sound matching information that matches the second type of sound feature information, if the distance processing module35determines that the relative distance between the person corresponding to the face image matching information and the user is within the preset distance range, it means that the conversation between the person and the user has not ended. At this time, the control module32controls the smart headphone to stop the playback of the audio information. If the distance processing module35determines that the relative distance between the person corresponding to the face image matching information and the user exceeds the preset distance range, it means that the person who has talked with the user has left and the conversation ends. At this time, the control module32controls the smart headphone to play back the audio information.

Based onFIG. 6andFIG. 9, the smart headphone provided in this embodiment will be described below more clearly in conjunction with the control method of the smart headphone.

Step S1of storing the first type of sound feature information, the second type of sound feature information, and/or the face image feature information in the memory2in advance;

Step S2of sensing the external sound information around the user by the plurality of sound sub-sensors111;

Step S3of comparing, by the sound processing module31, the external sound information sensed by the sound sub-sensors111with the first type of sound feature information stored in the memory2, and proceeding to Step S4when it is determined that the external sound information contains the first type of sound matching information that matches the first type of sound feature information;

Step S4of determining, by the image processing module33, the sound source location of the first type of sound matching information, according to the volumes of the first type of sound matching information respectively sensed by the plurality of sound sub-sensors111; and controlling the image sensor12to sense the external image information at the sound source location, according to the determined sound source location;

Step S5of comparing, by the image processing module33, the external image information sensed by the image sensor12with the face image feature information stored in the memory2; controlling, by the control module32, the audio information within the smart headphone to be in the playback state, when it is determined by comparison that the external image information does not contain the face image matching information that matches the face image feature information; and proceeding to Step S6when it is determined by comparison that the external image information contains the face image matching information that matches the face image feature information;

Step S6of judging, by the location processing module34, whether the angle between the person corresponding to the face image matching information and the user is within the preset angle range, according to the face image matching information identified by the image processing module33; when it is judged that the angle between the person corresponding to the face image matching information and the user exceeds the preset angle range, controlling, by the control module32, the smart headphone to play back the audio information; and when it is judged that the angle between the person corresponding to the face image matching information and the user is within the preset angle range, controlling, by the control module32, the smart headphone to stop the playback of the audio information;

Step S7of comparing, by the sound processing module31, the external sound information sensed by the sound sub-sensor111with the second type of sound feature information stored in the memory2; and proceeding to Step S8, when it is determined by comparison that the external sound information contains the second type of sound matching information that matches the second type of sound feature information;

Step S8of comparing, by the image processing module33, the external image information sensed by the image sensor12with the face image feature information stored in the memory2; controlling, by the control module32, the audio information within the smart headphone to be in the stop playback state, when it is determined by comparison that the external image information contains the face image matching information that matches the face image feature information; and controlling, by the control module32, the audio information within the smart headphone is in the playback state, when it is determined by comparison that the external image information does not contain the face image matching information that matches the face image feature information.

It should be noted that when the sensor1includes the distance sensor13and the controller3includes the distance processing module35, when it is determined by comparison in Step S5that the external image information contains the face image matching information that matches the face image feature information, the distance sensor13may also sense the relative distance between the person corresponding to the face image matching information and the user according to the face image matching information identified by the image processing module33.

Correspondingly, Step S8may also be: judging, by the distance processing module35, whether the relative distance sensed by the distance sensor13is within the preset distance range; when it is judged that the relative distance between the person corresponding to the face image matching information and the user is within the preset distance range, controlling, by the control module32, the smart headphone to stop the playback of the audio information; and when it is judged that the relative distance between the person corresponding to the face image matching information and the user exceeds the preset distance range, controlling, by the control module32, the smart headphone to play back the audio information.

It needs to be further noted that the foregoing steps S1to S8are merely for the purpose of schematically illustrating the control flow of the smart headphone from entering the conversation mode to exiting the conversation mode, and do not represent a specific limitation on the order of execution of each step.

It can be understood that, when the playback of the audio information in the smart headphone stops, the talker's sound information may be transmitted to the user's ear through the plurality of sound sub-sensors111. Further, as shown inFIG. 7, the controller3may further include a sound modulation module36. The sound modulation module36is operatively connected to the image processing module33and the plurality of sound sub-sensors111, respectively. The sound modulation module36is configured to modulate the external sound information sensed by the plurality of sound sub-sensors111according to the sound source location of the sound matching information determined by the image processing module33, and transmit the modulated external sound information to the user's ear.

The sound modulating module36may modulate the external sound information sensed by the plurality of sound sub-sensors111by way of proportional addition. Illustratively, the sound modulation module36may increase the volume of the external sound information sensed by the sound sub-sensor111at the sound source location according to the sound source location of the sound matching information determined by the image processing module33; and/or, decrease the volumes of the external sound information sensed by the remaining sound sub-sensors111, so that the volume of the sound information issued by the talker may be increased compared to a volume of noise in the external sound information, thereby enabling a targeted noise suppressing in the surrounding environment. Thus, the users will not be interfered by the external noise, and quality of the conversation may be improved.

It should be noted that, as shown inFIG. 8, the smart headphone provided by the present embodiment may include an arc bracket and two earpieces, wherein the two earpieces are detachably provided at both ends of the arc bracket. The sound sub-sensor111may be a microphone. The image sensor12may be a panoramic camera. The distance sensor13may be an infrared detector. The controller3may be a Micro Control Unit (MCU) integrated with the sound processing module31, the control module32, the image processing module33, the location processing module34, the distance processing module35, and the sound modulation module36. Among them, the panoramic camera and the plurality of microphones are respectively arranged on top of the arc bracket, so as to realize sensing of the external image information and the external sound information omnidirectionally. The infrared detector and the MCU may be respectively arranged within the two earpieces of the smart headphone, or arranged within the same earpiece of the smart headphone. It should be noted that the respective modules in the controller3as described above may be hardware modules, software modules or any combination thereof.

The foregoing descriptions are merely particular implementations of the present disclosure, but the scope of protection of the present disclosure is not limited thereto. Any changes or replacements that can be easily conceived by the skilled in the art within the technical scope disclosed by the present disclosure should be fall within the scope of the present disclosure. Therefore, the protection scope of the present disclosure should be based on the protection scope of the appended claims.