Patent Description:
With rapid development of mobile terminals, technologies such as face recognition and payment by scanning a code have become common functions in people's life, and these functions are achieved by turning on a camera of a mobile terminal and acquiring information of a scanned object such as a face or a two-dimensional code through the camera, thereby recognizing the information of the scanned object.

In the related art, when functions such as the face recognition or the payment by scanning a code are performed, a user needs to perform a series of operations. The following will be described by taking an example in which the user performs the payment by scanning a code. When performing the payment by scanning a code, the user first needs to control the mobile terminal to light up a screen, then unlocks the mobile terminal, then opens an application program in the mobile terminal, and then starts a code scanning function in the opened application program, which causes a low code scanning efficiency.

D1 (<CIT>) discloses that a method enable a mobile device to change from a standby mode with low power consumption to an active mode with relatively higher power consumption, upon recognizing that a received image is substantially similar to a visual signature. The visual signature is based on an image, such as the face of the intended user, is stored in a memory. When later the mobile device is in the standby mode, it periodically performs a low power peek with a camera to receive an image of the area in front of the mobile device. If the received image is recognized as substantially related to the visual signature, the mobile device is enabled to change from the standby mode to the active mode.

D2 (<CIT>) discloses a mobile terminal with screen-off scanning function. The mobile terminal includes an indicating device, a camera and a processor, and the indicating device and the camera are electrically connected with the processor. The processor is used to turn on the camera and the indicating device and turn off the display screen of the mobile terminal. The indicating device is used to indicate the code scanning area. The camera is used to acquire the two-dimensional code in the code scanning area. The indicating device includes an auxiliary light for projecting visual indication information to indicate the code scanning area. The processor is further used to judge whether the acquired two-dimensional code is complete, and if so, identify the two-dimensional code; if not, issue adjustment instruction and/or adjustment prompt; The auxiliary light adjusts a range of the code scanning area according to the adjustment instruction.

D3 (<CIT>) discloses an information processing method. The method includes: acquiring first data by using a first image acquisition unit in an electronic device; acquiring first parameter information based on the first data; determining whether the first parameter information meets a preset condition and obtaining a first judgment result; when the first judgment result indicates that the first parameter information meets the preset conditions, controlling a second image acquisition unit in the electronic device is in a working state. The first power consumption of the first image acquisition unit is lower than the second power consumption of the second image acquisition unit. By setting two cameras with different resolutions on one side of the electronic device, the low-resolution camera is used for pre-judgment, and the high-resolution camera is only turned on when the operation that needs to capture a clear image or needs to start the high-resolution camera is detected. Because the low-resolution camera has low power consumption and occupies relatively few system resources, it solves the technical problem that the electronic device occupies more system resources when using cameras, thereby increasing the power consumption of the electronic device.

D4 (<CIT>) discloses a method for controlling a mobile terminal through use of user interaction. The method includes operating in a vision recognition mode that generates a vision recognition image through use of a signal output from a second plurality of pixels designated as vision pixels from among a plurality of pixels of an image sensor included in the mobile terminal; determining whether a predetermined object in the vision recognition image corresponds to a person; determining a gesture of the predetermined object when the predetermined object corresponds to the person; and performing a control function of the mobile terminal corresponding to the gesture of the predetermined object.

Embodiments of the present disclosure provide an object recognition method and a mobile terminal, so as to solve a problem of low code scanning efficiency of the mobile terminal.

In order to solve the above technical problem, the present disclosure is implemented as follows.

In a first aspect, embodiments of the present disclosure provide an object recognition method. The object recognition method includes:.

An operating power of the camera in the second operating state is higher than an operating power of the camera in the first operating state.

In a second aspect, embodiments of the present disclosure further provide a mobile terminal. The mobile terminal has a camera, and includes:.

In a third aspect, embodiments of the present disclosure further provide a mobile terminal. The mobile terminal includes a memory, a processor and computer programs stored in the memory and capable of running on the processor. The computer programs, when executed by the processor, cause the processor to perform steps of the object recognition method described above.

In a fourth aspect, embodiments of the present disclosure further provide a readable storage medium. The computer-readable storage medium stores computer programs that, when executed by a processor, cause the processor to perform steps of the object recognition method described above.

In the embodiments of the present disclosure, in the case where the mobile terminal is in the screen-off state, the first image is acquired through the camera in the first operating state; if the first image has the image characteristics of the target object type, the camera is controlled to enter the second operating state, and the second image is acquired through the camera in the second operating state; and if it is recognized that the second image includes the incomplete image with the image characteristics, the prompt information for indicating that the second image is incomplete is output, the operating power of the camera in the second operating state being higher than the operating power of the camera in the first operating state. In this way, the mobile terminal may acquire a scanned object in the screen-off state without a need to perform multiple interactive operations by a user to start a code scanning function for acquisition, which can improve code scanning efficiency. Moreover, when an incomplete image of the target object type is recognized, prompt information may be output to prompt the user to shift the mobile terminal to acquire a complete image, which can further improve object recognition efficiency.

In order to describe technical solutions in embodiments of the present disclosure more clearly, accompanying drawings to be used in the description of the embodiments of the present disclosure will be briefly introduced below. Obviously, the accompanying drawings to be described below are merely some embodiments of the present disclosure, and a person of ordinary skill in the art may obtain other drawings according to these drawings without paying any creative effort.

Technical solutions in embodiments of the present disclosure will be described below clearly and completely with reference to the accompanying drawings in the embodiments of the present disclosure. Obviously, the described embodiments are merely some but not all embodiments of the present disclosure. All other embodiments made on a basis of the embodiments of the present disclosure by a person of ordinary skill in the art without paying any creative effort shall be included in the protection scope of the present disclosure.

Referring to <FIG> is a flow diagram of an object recognition method, in accordance with embodiments of the present disclosure. As shown in <FIG>, the object recognition method includes the following steps.

In step <NUM>, acquiring a first image through a camera in a first operating state in a case where a mobile terminal is in a screen-off state.

An operating power of the camera in the first operating state is less than a preset power value. The preset power value may be a value preset by the mobile terminal or a value set in advance when the mobile terminal receives a user operation. The operating power of the camera in the first operating state is low, and energy consumption is low. For example, the camera operates in a low power consumption operating state with an operating power of less than <NUM> milliwatts, <NUM> milliwatts, <NUM> milliwatts or the like.

The mobile terminal may specifically control the camera to be in the first operating state by turning on part of pixel units of the camera. For example, in a <NUM>-megapixel camera, three hundred thousand pixels are uniformly selected to operate, and remaining pixels do not operate, and this operating state is the first operating state. A power of the camera when only part of the pixel units operate is less than the preset power value, and the camera may acquire a scanned object at any time by using the turn-on part of the pixel units, so that power consumption may be saved.

The screen-off state may be understood as a state when the mobile terminal is operating and information is not displayed on the screen, such as a state when information is not displayed on the screen of the mobile terminal after the screen of the mobile terminal is locked. In this step, when the mobile terminal is in the screen-off state, the camera is in a turn-on state and operates in the first operating state.

During a specific implementation, the user may set the camera of the mobile terminal to automatically turn on when the mobile terminal is started up and to continuously operate in the first operating state, which facilitates the user to use the camera to acquire the scanned object at any time. The camera may also be controlled to automatically turn on in the screen-off state, that is, the camera only turns on in the screen-off state and turns off in a screen-on state, so that the power consumption may be further saved.

In step <NUM>, if the first image has image characteristics of a target object type, the camera is controlled to enter a second operating state, and a second image is acquired through the camera in the second operating state.

An operating power of the camera in the second operating state is higher than the operating power of the camera in the first operating state. The second operating state may be an operating state in which part of the pixel units of the camera are turned on or all of the pixel units of the camera are turned on. In a case where the number of pixel units turned on in the second operating state is larger than the number of pixel units turned on in the first operating state, the operating power of the camera in the second operating state is higher than the operating power of the camera in the first operating state. For example, the camera may be set to have multiple gears according to the operating power of the camera from low to high. When an image of the target object type is detected and recognized through the camera in a gear corresponding to a lowest power, the gear corresponding to the lowest power may be switched to other gears.

The power of the camera in the first operating state is low, the first image acquired through the camera in the first operating state may be preliminarily recognized, and it is determined whether the first image has the image characteristics of the target object type. The target object types may be object types with specific characteristics preset by the mobile terminal, which include a human face, a two-dimensional code, and a gesture. For example, image characteristics of the two-dimensional code include three positioning points in a shape of a Chinese character of "<IMG>", image characteristics of the human face include distribution positions and characteristics of five sense organs, and image characteristics of the gesture include shape characteristics of the gesture. If the first image has the image characteristics of the target object type, the camera is switched from the first operating state to the second operating state.

Taking the two-dimensional code as an example, if it is recognized that the first image has the image characteristics of the two-dimensional code, the camera is switched from the first operating state to the second operating state, and acquires the two-dimensional code again. Since the operating power in the second operating state is higher than the operating power in the first operating state, the number of pixels of the second image acquired through the camera in the second operating state is greater than the number of pixels of the first image, so that specific contents of the two-dimensional code may be further recognized based on the second image, and an image recognition error may be reduced.

In step <NUM>, if it is recognized that the second image includes an incomplete image with the image characteristics, prompt information for indicating that the second image is incomplete is output.

In this step, the mobile terminal recognizes characteristics of the second image, and if the mobile terminal recognizes that the second image includes the image characteristics of the target object type and the image is an incomplete image, the mobile terminal outputs prompt information to prompt that the second image is an incomplete image. As for a specific recognition manner of the image characteristics of the target object type, reference may be made to the recognition manner in the step <NUM>. Determination of an incomplete image may be based on the image characteristics of the target object type. For example, the image shown in <FIG> is an incomplete image of a two-dimensional code. A complete image of the two-dimensional code includes three positioning points in the shape of the Chinese character of "<IMG>", and if only two positioning points in the shape of the Chinese character of "<IMG>" are detected, the image may be regarded as an incomplete image of the two-dimensional code. For example, a complete face image includes images of the five sense organs and an image of the face, and if only images of eyes and an image of a nose are detected in the image, the image may be an incomplete face image. The prompt information may be prompted by displaying an incomplete image on the screen, outputting voice, vibrating, or the like. For example, the incomplete image shown in <FIG> is displayed on the screen, and the user may move the mobile terminal to the right based on the image to acquire the complete image of the two-dimensional code, thereby improving efficiency of recognizing the two-dimensional code.

In the embodiments of the present disclosure, the object recognition method may be applied to a mobile terminal, such as a mobile phone, a tablet personal computer, a laptop computer, a personal digital assistant (PDA), a mobile Internet device (MID), or a wearable device.

For the object recognition method in the embodiments of the present disclosure, in the case where the mobile terminal is in the screen-off state, the first image is acquired through the camera in the first operating state; if the first image has the image characteristics of the target object type, the camera is controlled to enter the second operating state, and the second image is acquired through the camera in the second operating state; and if it is recognized that the second image includes the incomplete image with the image characteristics, the prompt information for indicating that the second image is incomplete is output, wherein the operating power of the camera in the second operating state is higher than the operating power of the camera in the first operating state. Therefore, the mobile terminal may acquire the scanned object in the screen-off state without a need to perform a series of interactive operations by the user to start a code scanning function for acquisition, which may improve code scanning efficiency. Moreover, when an incomplete image of the target object type is recognized, prompt information may be output to prompt the user to shift the mobile terminal to acquire a complete image, which can further improve object recognition efficiency.

Referring to <FIG>, a main difference between the present embodiment and the above embodiments is that if the second image does not include the image with the image characteristics, the camera is switched from the second operating state to the first operating state. <FIG> is a flow diagram of an object recognition method, in accordance with embodiments of the present disclosure. As shown in <FIG>, the object recognition method includes the following steps.

In step <NUM>, acquiring the first image through the camera in the first operating state in the case where the mobile terminal is in the screen-off state.

The operating power of the camera in the first operating state is less than the preset power value.

As for implementations of this step, reference may be made to the description in the step <NUM>, and details will not be repeated herein to avoid repetition.

In step <NUM>, if the first image has the image characteristics of the target object type, the camera is controlled to enter the second operating state, and the second image is acquired through the camera in the second operating state.

The operating power of the camera in the second operating state is higher than the operating power of the camera in the first operating state.

In step <NUM>, if the second image does not include the image with the image characteristics, the camera is switched from the second operating state to the first operating state.

Since the number of pixels of the camera in the first operating state is small, there may be misrecognition of the image. In this step, the mobile terminal recognizes the second image, and determines whether there is the image with the image characteristics of the target object type in the second image. If the second image does not include the image with the image characteristics of the target object type, it is indicated that the mobile terminal misrecognizes the first image, that is, there is actually no image with the image characteristics in the first image, and the camera is switched from the second operating state to the first operating state.

For example, after the mobile terminal recognizes that the first image includes the image of the two-dimensional code, the camera is switched from the first operating state of a low power consumption mode to the second operating state of a common photographing mode. Since a resolution of the second image acquired in the common photographing mode is high, an accuracy of recognition based on the second image is high. If it is recognized that there is no image of the two-dimensional code in the second image, it is indicated that the first image is misrecognized, and the camera is switched from the second operating state to the first operating state, which may save the power consumption.

Optionally, after the second image is acquired through the camera in the second operating state, the method further includes: if the second image includes the complete image with the image characteristics, controlling the screen of the mobile terminal to be lit up and display a recognition result of the complete image.

In this implementation, the mobile terminal recognizes the second image and determines whether the second image includes the complete image with the image characteristics of the target object type. The complete image may be understood as having all the image characteristics of the target object type. For example, the target object type is a two-dimensional code, and image characteristics of the two-dimensional code include three positioning points in a shape of a Chinese character of "<IMG>" and geometric figures distributed according to preset conditions. If three positioning points in the shape of the Chinese character of "<IMG>" are detected, and distribution characteristics of the geometric figures meet the preset conditions, it is indicated that a complete image of the two-dimensional code is detected.

If the second image includes the complete image with the image characteristics, the mobile terminal lights up the screen and displays a recognition result of the complete image on the screen. In this way, an image recognition accuracy may be improved by recognizing the second image. In addition, lighting up the screen automatically and displaying the recognition result of the complete image facilitate the user to further perform operations.

This implementation may also be applied to the embodiments corresponding to <FIG>, and may achieve same beneficial effects.

The step of outputting the prompt information for indicating that the second image is incomplete includes: outputting voice prompt information including a moving direction of the mobile terminal according to the characteristics of the incomplete image.

In this implementation, if the second image includes the incomplete image with the image characteristic of the target object type, the mobile terminal may determine a shift direction of the image according to the characteristics of the acquired incomplete image, thereby determining a direction in which the mobile terminal needs to be shifted. For example, as for an image of the two-dimensional code shown in <FIG>, since the mobile terminal only acquires two positioning points in a shape of a Chinese character of "<IMG>" of the two-dimensional code, and geometric figures in the image of the two-dimensional code are located on a right side of the positioning points in the shape of the Chinese character of "<IMG>", it may be determined that the image of the two-dimensional code is shifted to the right relative to the mobile terminal. Therefore, the mobile terminal needs to be shifted to the right relative to the image of the two-dimensional code to acquire a complete image of the image of the two-dimensional code.

The mobile terminal outputs the voice prompt information including the shift direction of the mobile terminal to prompt the user to move the mobile terminal according to the prompt information, thereby improving the object recognition efficiency.

Optionally, the step of outputting the prompt information for indicating that the second image is incomplete further includes: controlling a partial region of the screen of the mobile terminal to be lit up and displaying the second image in the partial region; or controlling the screen of the mobile terminal to be lit up and displaying the second image on the screen of the mobile terminal.

In this implementation, two ways of displaying the second image may be included.

One way is that the mobile terminal lights up a partial region of the screen and displays the second image in the partial region. This way may be understood as that, when the mobile terminal is in the screen-off state, only a partial region on a screen-off interface is lit up, and the second image is displayed in the partial region. As for a specific implementation, reference may be made to the related art. For example, as shown in <FIG>, the mobile terminal is in a screen-locked and screen-off state, and a date and a two-dimensional code are displayed in partial regions of the screen. In a process of displaying the second image, current code scanning situations can be obtained without a need to awake an entire screen, which can save the energy consumption.

The other way is that the mobile terminal lights up the entire screen and display the second image on the lit-up display screen. For example, as shown in <FIG>, a code scanning interface is displayed on the screen.

As for the two ways, an incomplete image may be displayed on the screen, prompt information that complete two-dimensional code data is not obtained currently may be further displayed on the screen, and the user may adjust a position of the mobile terminal based on characteristics of the incomplete image or the prompt information, thereby obtaining a complete image, and improving the object recognition efficiency.

For further understanding of the present embodiment, the following will be described in conjunction with a flow diagram and a specific implementation.

As shown in <FIG>, the low power consumption mode of the camera is started when the mobile terminal is started up or the screen of the mobile terminal is turned off, that is, the camera operates in the first operating state. The camera in the low power consumption mode acquires a picture, and the camera recognizes the picture preliminarily to determine whether there is a two-dimensional code, i.e., a target object type, in the picture. If there is no two-dimension code in the picture, the low-power-consumption camera continues to acquire pictures.

If there is a two-dimension code in the picture, the camera is switched to a normal photographing mode, i.e., the second operating state, and acquires the picture. Since a resolution of a picture acquired through the camera in the normal photographing mode is higher than a resolution of a picture acquired in the low power consumption mode, the mobile terminal recognizes whether a two-dimensional code is included again based on the picture obtained in the normal photographing mode.

If it is recognized that the picture does not include a two-dimensional code, the camera is switched to the low power consumption mode.

If it is recognized that the picture includes a complete two-dimensional code, the mobile terminal will jump to an interface corresponding to the two-dimensional code.

If it is recognized that the picture includes an incomplete two-dimension code, the screen may be lit up and automatically display the code scanning interface; or a partial region of the screen may be lit up in the screen-off state, and the obtained image is displayed in the partial region, and the user is prompted that the complete two-dimensional code data is not obtained currently. The user may adjust the position of the mobile terminal based on the displayed information, thereby enabling the mobile terminal to scan the code.

In this way, the mobile terminal may obtain the code scanning situations without the need to awake the entire screen, which can save the energy consumption and improve the code scanning efficiency.

As for the object recognition method in the embodiments of the present disclosure, in the screen-off state, after the first image acquired through the camera in the first operating state is preliminarily recognized, the camera is switched to the second operating state and acquires the second image, and the second image is recognized, which can improve the image recognition accuracy. In a case where the second image does not include the image with the image characteristics of the target object type, the second operating state is switched to the first operating state, which can save the power consumption.

Referring to <FIG> is a diagram showing a structure of a mobile terminal, in accordance with embodiments of the present disclosure. As shown in <FIG>, the mobile terminal <NUM> includes a first acquisition module <NUM>, a second acquisition module <NUM>, and an output module <NUM>.

The first acquisition module <NUM> is used to acquire a first image through a camera in a first operating state in a case where the mobile terminal is in a screen-off state.

The second acquisition module <NUM> is used to control the camera to enter a second operating state if the first image has image characteristics of a target object type, and to acquire a second image through the camera in the second operating state.

The output module <NUM> is used to output prompt information for indicating that the second image is incomplete if it is recognized that the second image includes an incomplete image with the image characteristics.

Optionally, as shown in <FIG>, the mobile terminal further includes:
a switching module <NUM> used to switch the camera from the second operating state to the first operating state if the second image does not include an image with the image characteristics.

Optionally, as shown in <FIG>, the mobile terminal further includes:
a display module <NUM> used to control the screen of the mobile terminal to be lit up if the second image includes a complete image with the image characteristics, and to display a recognition result of the complete image on the screen.

The output module <NUM> is specifically used to output voice prompt information including a moving direction of the mobile terminal according to characteristics of the incomplete image.

The mobile terminal <NUM> can implement each process implemented by the mobile terminal in the above method embodiments, and details will not be repeated herein to avoid repetition.

As for the mobile terminal <NUM> in the embodiments of the present disclosure, the mobile terminal may acquire a scanned object in the screen-off state without a need to perform multiple interactive operations by a user to start a code scanning function for acquisition, which improves code scanning efficiency. Moreover, when the mobile terminal recognizes an incomplete image of the target object type, it may output prompt information to prompt the user to shift the mobile terminal to acquire a complete image, which can further improve object recognition efficiency.

<FIG> is a schematic diagram showing a hardware structure of a mobile terminal for implementing the embodiments of the present disclosure. The mobile terminal <NUM> includes, but is not limited to, components such as a radio frequency unit <NUM>, a network module <NUM>, an audio output unit <NUM>, an input unit <NUM>, a sensor <NUM>, a display unit <NUM>, a user input unit <NUM>, an interface unit <NUM>, a memory <NUM>, a processor <NUM>, and a power supply <NUM>. A person skilled in the art will understand that, the structure of the mobile terminal shown in <FIG> does not constitute a limitation on the mobile terminal, and the mobile terminal may include more or fewer components than those shown in the figure, or a combination of certain components, or components with different arrangements. In the embodiments of the present disclosure, the mobile terminals include, but are not limited to, a mobile phone, a tablet computer, a notebook computer, a palmtop computer, a vehicle-mounted terminal, a wearable device and a pedometer.

The processor <NUM> is used to acquire a first image through a camera in a first operating state in a case where the mobile terminal is in a screen-off state; to control the camera to enter a second operating state if the first image has image characteristics of a target object type, and to acquire a second image through the camera in the second operating state; and to output prompt information for indicating that the second image is incomplete if it is recognized that the second image includes an incomplete image with the image characteristics, wherein an operating power of the camera in the second operating state is higher than an operating power of the camera in the first operating state.

In this way, the mobile terminal may acquire a scanned object in the screen-off state without a need to perform multiple interactive operations by a user to start a code scanning function for acquisition, which can improve code scanning efficiency. Moreover, when an incomplete image of the target object type is recognized, prompt information may be output to prompt the user to shift the mobile terminal to acquire a complete image, which can further improve object recognition efficiency.

Optionally, after the processor <NUM> performs the acquisition of the second image through the camera in the second operating state, the method further includes: if the second image does not include an image with the image characteristics, switching the camera from the second operating state to the first operating state.

Optionally, after the processor <NUM> performs the acquisition of the second image through the camera in the second operating state, the method further includes: if the second image includes a complete image with the image characteristics, controlling the screen of the mobile terminal to be lit up and displaying a recognition result of the complete image on the screen.

Performing, by the processor <NUM>, the output of the prompt information for indicating that the second image is incomplete: outputting voice prompt information including a moving direction of the mobile terminal according to characteristics of the incomplete image.

It will be understood that, in the embodiments of the present disclosure, the radio frequency unit <NUM> may be used to receive and transmit signals in a process of receiving and sending information or during a call. Specifically, the radio frequency unit <NUM> receives downlink data from a base station and then transmits the downlink data to the processor <NUM> to process the data. In addition, the radio frequency unit <NUM> transmits uplink data to the base station. Generally, the radio frequency unit <NUM> includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, and a duplexer. In addition, the radio frequency unit <NUM> may also communicate with a network and other devices through a wireless communication system.

The mobile terminal provides the user with wireless broadband access to Internet through the network module <NUM>, such as helping the user to send and receive e-mails, to browse web pages, and to access streaming media.

The audio output unit <NUM> may convert audio data received by the radio frequency unit <NUM> or the network module <NUM> or stored in the memory <NUM> into audio signals and output the audio signals as sound. Moreover, the audio output unit <NUM> may also output audio associated with a specific function performed by the mobile terminal <NUM> (e.g., call signal reception sound and message reception sound). The audio output unit <NUM> includes a speaker, a buzzer, and a receiver.

The input unit <NUM> is used to receive audio signals or video signals. The input unit <NUM> may include a graphics processing unit (GPU) <NUM> and a microphone <NUM>. The GPU <NUM> processes image data of still pictures or videos obtained by an image capture device (e.g., a camera) in a video capture mode or an image capture mode. The processed image frames may be displayed on the display unit <NUM>. The image frames processed by the GPU <NUM> may be stored in the memory <NUM> (or other storage media) or sent via the radio frequency unit <NUM> or the network module <NUM>. The microphone <NUM> may receive sound and is capable of processing such sound into audio data. The processed audio data may be converted into a format that may make the processed audio data transmitted to a mobile communication base station through the radio frequency unit <NUM> in a case of a phone call mode.

The mobile terminal <NUM> further includes at least one type of sensor <NUM>, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor. The ambient light sensor may adjust brightness of a display panel <NUM> according to brightness of ambient light. The proximity sensor may turn off the display panel <NUM> and/or backlight when the mobile terminal <NUM> is moved to an ear. As a type of the motion sensor, an accelerometer sensor may detect magnitudes of accelerations in various directions (generally three axes), and may detect a magnitude and a direction of gravity when the accelerometer sensor is still, and may be used to recognize postures of the mobile terminal (e.g., horizontal-vertical screen switching, related games, and magnetometer posture calibration), and recognize related functions (e.g., pedometer and knocking) through vibration. The sensor <NUM> may further include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, or an infrared sensor, and details will not be repeated herein.

The display unit <NUM> is used to display information input by the user or information provided to the user. The display unit <NUM> may include the display panel <NUM>, which may be configured in a form of a liquid crystal display (LCD), organic light-emitting diodes (OLEDs), or the like.

The user input unit <NUM> may be used to receive input digital or character information and generate input key signals related to user settings and function control of the mobile terminal. Specifically, the user input unit <NUM> includes a touch panel <NUM> and other input devices <NUM>. The touch panel <NUM>, also referred to as a touch screen, may acquire a touch operation by the user on or near the touch panel <NUM> (e.g., an operation by the user on or near the touch panel <NUM> by using a finger, a stylus, or any other suitable object or attachment). The touch panel <NUM> may include two portions, i.e., a touch detection device and a touch controller. The touch detection device detects a position touched by the user, and a signal from the touch operation and transmits the signal to the touch controller. The touch controller receives touch information from the touch detection device, converts the touch information into coordinates of a touch point, sends the coordinates of the touch point to the processor <NUM>, receives a command from the processor <NUM>, and executes the command. In addition, the touch panel <NUM> may be implemented by various types of touch panels such as a resistive touch panel, a capacitive touch panel, an infrared touch panel, and a surface acoustic wave touch panel. The user input unit <NUM> may further include other input devices <NUM> in addition to the touch panel <NUM>. Specifically, the other input devices <NUM> may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys and an on/off key), a trackball, a mouse, and a joystick, and details will not be repeated herein.

Further, the touch panel <NUM> may cover the display panel <NUM>. After the touch panel <NUM> detects a touch operation on or near it, the touch panel <NUM> sends the touch operation to the processor <NUM> to determine a type of the touch event. Then, the processor <NUM> provides a corresponding visual output on the display panel <NUM> according to the type of the touch event. Although in <FIG>, the touch panel <NUM> and the display panel <NUM> are used as two separate components to implement an input function and an output function of the mobile terminal, in some embodiments, the touch panel <NUM> may be integrated with the display panel <NUM> to implement the input function and the output function of the mobile terminal, which is not specifically limited herein.

The interface unit <NUM> is an interface for connecting an external device to the mobile terminal <NUM>. For example, the external device may include a port for wired or wireless headsets, a port for an external power supply (or battery charger), a port for wired or wireless data, a port for a memory card, a port for connecting a device with a recognition module, an audio input/output (I/O) port, a video I/O port, and an earphone port. The interface unit <NUM> may be used to receive input from the external device (e.g., data information and power) and transmit the received input to one or more elements in the mobile terminal <NUM>, or may be used to transmit data between the mobile terminal <NUM> and the external device.

The memory <NUM> may be used to store software programs and various data. The memory <NUM> may mainly include a program storage region and a data storage region. The program storage region may store an operating system and application programs required by at least one function (e.g., a sound playing function or an image playing function). The data storage region may store data (e.g., audio data and a phonebook) created according to use of a mobile phone. In addition, the memory <NUM> may include a high-speed random access memory, and may further include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage device.

The processor <NUM> is a control center of the mobile terminal. The processor <NUM> is used to connect various parts of the entire mobile terminal through various interfaces and wires, and perform various functions of the mobile terminal and process data by running or executing software programs and/or modules stored in the memory <NUM> and invoking data stored in the memory <NUM>, thereby monitoring the mobile terminal entirely. The processor <NUM> may include one or more processing units. Optionally, an application processor and a modem processor may be integrated in the processor <NUM>. The application processor is mainly responsible for the operating system, user interfaces and application programs, and the modem processor is mainly responsible for wireless communication. It will be understood that, the modem processor may not be integrated in the processor <NUM>.

The mobile terminal <NUM> may further include the power supply <NUM> (e.g., a battery) for supplying power to various components. Optionally, the power supply <NUM> may be logically connected to the processor <NUM> through a power management system, so that functions such as charging management, discharging management and power consumption management are achieved through the power management system.

In addition, the mobile terminal <NUM> includes some functional modules that are not shown, which will not be repeated herein.

Optionally, embodiments of the present disclosure further provide a mobile terminal. The mobile terminal includes a processor <NUM>, a memory <NUM>, and computer programs stored in the memory <NUM> and capable of running on the processor <NUM>. The computer programs, when executed by the processor <NUM>, cause the processor <NUM> to perform each process in the above embodiment of the object recognition method. The mobile terminal can achieve same technical effects as the object recognition method, and details will not be repeated herein to avoid repetition.

Embodiments of the present disclosure further provide a computer-readable storage medium. The computer-readable storage medium stores computer programs that, when executed by a processor, cause the processor to perform each process in the above embodiment of the object recognition method. The computer-readable storage medium can achieve same technical effects as the object recognition method, and details will not be repeated herein to avoid repetition. The computer-readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

It will be noted that, the terms such as "includes", "including", or any other variants thereof herein are intended to cover a non-exclusive inclusion, so that a process, a method, an article or a device that includes a series of elements not only includes those elements, but also includes other elements not explicitly listed, or includes elements inherent to the process, the method, the article or the device. In a case where there is no more limitation, an element defined by the phrase "including a. " does not exclude existence of other identical elements in a process, a method, an article, or a device that includes the element.

Claim 1:
An object recognition method applied to a mobile terminal with a camera, wherein the method comprises:
acquiring (<NUM>, <NUM>) a first image through the camera in a first operating state in a case where the mobile terminal is in a screen-off state;
if the first image has image characteristics of a target object type, controlling (<NUM>, <NUM>) the camera to enter a second operating state, and acquiring (<NUM>, <NUM>) a second image through the camera in the second operating state; and
if it is recognized that the second image includes an incomplete image with the image characteristics, outputting (<NUM>) prompt information for indicating that the second image is incomplete;
wherein an operating power of the camera in the second operating state is higher than an operating power of the camera in the first operating state;
characterized in that
outputting (<NUM>) the prompt information for indicating that the second image is incomplete comprises:
outputting voice prompt information including a moving direction of the mobile terminal according to characteristics of the incomplete image.