Patent Description:
With continuous development of communication technologies and services, and in particular, coming of an era of a 5th generation (5th generation, <NUM>) mobile communications system or a new radio (new radio, NR) communications system, in addition to a smartphone, an increasing quantity of electronic devices in various forms have increasingly clear requirements on communication, for example, a speaker, a television, a tablet, a watch, a camera, and a peephole.

More devices indicate more user operation entries. If each device has an independent third-party application (application, App) for communication, user energy is greatly wasted, user experience deteriorates, interworking is inconvenient, and device management costs are correspondingly increased.

<CIT> refers to a method for adding a smart home device and a system. In the system, a first mobile phone and a smart home device log in by using an account of a first user, and a second mobile phone logs in by using an account of a second user; the first mobile phone stores contact information of the second user, and the second mobile phone stores contact information of the first user; the first mobile phone is configured to set, by using the contact information of the second user, that the second mobile phone is allowed to make a call to the smart speaker; the second mobile phone is configured to automatically add contact information of the smart home device; and the second mobile phone may make a voice call or a video call with the smart home device by using the contact information of the smart home device.

Further, <CIT> refers to systems and methods to automatically discover if an email address contact is video chat capable. A server receives a request from an electronic device to determine video chat capability associated with an email address. It compares the email address with a listing of email addresses, wherein the listing includes email addresses associated with other electronic devices having video chat capability. If an entry in the listing matches the email address, it returns a message configured to automatically enable addition of the email address as a video chat contact on the electronic device.

Further, <CIT>refers to a data processing system on a communal electronic device, the data processing system comprising a memory device to store instructions and one or more processors to execute the instructions stored on the memory device. The instructions cause the one or more processors to provide a virtual assistant to receive commands at the communal electronic device, where the virtual assistant, via the one or more processors, is configured to receive a command at the communal electronic device and determine whether the command is to access personal data of a user associated with the communal electronic device. Personal data of the user includes data that is specific to the user. In response to a determination that the command is to access personal data of the user, the virtual assistant can send a request to a personal electronic device of the user to process at least a portion of the command. Further, <CIT>refers to methods and systems for facilitating communications between shared electronic devices. In some examples, a group account may be assigned to a shared electronic device. The group account may include one or more user accounts, where individuals associated with those user accounts may interact with the shared electronic device, and also may form a part of the group account. When a message is sent from one shared electronic device to another personal device or shared electronic device, the message may be indicated as being sent from the group account, as if the shared electronic device corresponds to its own separate account. In some examples, speaker identification processing may be employed to determine a speaker of the message and, if the speaker is able to be identified, the message may be sent from the corresponding speaker's user account instead of the shared electronic device's corresponding group account.

In the descriptions in the embodiments of this application, unless otherwise specified, "/" means "or". For example, A/B may represent A or B. In this specification, "and/or" describes only an association relationship between associated objects and represents that three relationships may exist. In addition, in the descriptions in the embodiments of this application, "a plurality of" means two or more.

The following terms "first" and "second" are merely intended for a purpose of description, and shall not be understood as an indication or implication of relative importance or implicit indication of a quantity of indicated technical features. Therefore, a feature limited by "first" or "second" may explicitly or implicitly include one or more features.

The address book-based device discovery method provided in the embodiments of this application may be applied to an electronic device such as a mobile phone, a tablet computer, a wearable device, a vehicle-mounted device, an augmented reality (augmented reality, AR) device/a virtual reality (virtual reality, VR) device, a notebook computer, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook, or a personal digital assistant (personal digital assistant, PDA). A specific type of the electronic device is not limited in the embodiments of this application.

For example, <FIG> is a schematic diagram of a structure of an electronic device <NUM>. The electronic device <NUM> may include a processor <NUM>, an external memory interface <NUM>, an internal memory <NUM>, a universal serial bus (universal serial bus, USB) interface <NUM>, a charging management module <NUM>, a power management module <NUM>, a battery <NUM>, an antenna <NUM>, an antenna <NUM>, a mobile communications module <NUM>, a wireless communications module <NUM>, an audio module <NUM>, a speaker 170A, a receiver 170B, a microphone 170C, a headset jack 170D, a sensor module <NUM>, a button <NUM>, a motor <NUM>, an indicator <NUM>, a camera <NUM>, a display <NUM>, a subscriber identification module (subscriber identification module, SIM) card interface <NUM>, and the like. The sensor module <NUM> may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, an optical proximity sensor <NUM>, a fingerprint sensor <NUM>, a temperature sensor 180J, a touch sensor <NUM>, an ambient light sensor <NUM>, a bone conduction sensor <NUM>, and the like.

It may be understood that the structure shown in this embodiment of this application does not constitute a specific limitation on the electronic device <NUM>. In some other embodiments of this application, the electronic device <NUM> may include more or fewer components than those shown in the figure, or some components may be combined, or some components may be split, or different component arrangements may be used. The components shown in the figure may be implemented by using hardware, software, or a combination of software and hardware.

The processor <NUM> may include one or more processing units. For example, the processor <NUM> may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, a neural-network processing unit (neural-network processing unit, NPU), and/or the like. Different processing units may be independent components, or may be integrated into one or more processors.

The controller may be a nerve center and a command center of the electronic device <NUM>. The controller may generate an operation control signal based on instruction operation code and a time sequence signal, to complete control of instruction reading and instruction execution.

A memory may be further disposed in the processor <NUM>, and is configured to store instructions and data. In some embodiments, the memory in the processor <NUM> is a cache. The memory may store instructions or data just used or cyclically used by the processor <NUM>. If the processor <NUM> needs to use the instructions or the data again, the processor <NUM> may directly invoke the instructions or the data from the memory. This avoids repeated access, reduces waiting time of the processor <NUM>, and improves system efficiency.

The I2C interface is a two-way synchronization serial bus, and includes a serial data line (serial data line, SDA) and a serial clock line (derail clock line, SCL). In some embodiments, the processor <NUM> may include a plurality of groups of 12C buses. The processor <NUM> may be separately coupled to the touch sensor <NUM>, a charger, a flashlight, the camera <NUM>, and the like through different I2C bus interfaces. For example, the processor <NUM> may be coupled to the touch sensor <NUM> through an I2C interface, so that the processor <NUM> communicates with the touch sensor <NUM> through the I2C bus interface, to implement a touch function of the electronic device <NUM>.

The I2S interface may be configured to perform audio communication. In some embodiments, the processor <NUM> may include a plurality of groups of I2S buses. The processor <NUM> may be coupled to the audio module <NUM> through the I2S bus, to implement communication between the processor <NUM> and the audio module <NUM>. In some embodiments, the audio module <NUM> may transmit an audio signal to the wireless communications module <NUM> through the I2S interface, to implement a function of answering a call through a Bluetooth headset.

The PCM interface may also be configured to: perform audio communication, and sample, quantize, and code an analog signal. In some embodiments, the audio module <NUM> may be coupled to the wireless communications module <NUM> through a PCM bus interface. In some embodiments, the audio module <NUM> may alternatively transmit an audio signal to the wireless communications module <NUM> through the PCM interface, to implement a function of answering a call through a Bluetooth headset. Both the I2S interface and the PCM interface may be configured to perform the audio communication.

The UART interface is a universal serial data bus, and is configured to perform asynchronous communication. The bus may be a two-way communication bus. The bus converts to-be-transmitted data between serial communication and parallel communication. In some embodiments, the UART interface is usually configured to connect the processor <NUM> to the wireless communications module <NUM>. For example, the processor <NUM> communicates with a Bluetooth module in the wireless communications module <NUM> through the UART interface, to implement a Bluetooth function. In some embodiments, the audio module <NUM> may transmit an audio signal to the wireless communications module <NUM> through the UART interface, to implement a function of playing music through the Bluetooth headset.

The MIPI interface may be configured to connect the processor <NUM> to a peripheral component such as the display <NUM> or the camera <NUM>. The MIPI interface includes a camera serial interface (camera serial interface, CSI), a display serial interface (display serial interface, DSI), and the like. In some embodiments, the processor <NUM> communicates with the camera <NUM> through the CSI, to implement a photographing function of the electronic device <NUM>. The processor <NUM> communicates with the display <NUM> through the DSI, to implement a display function of the electronic device <NUM>.

The GPIO interface may be configured by using software. The GPIO interface may be configured as a control signal, or may be configured as a data signal. In some embodiments, the GPIO interface may be configured to connect the processor <NUM> to the camera <NUM>, the display <NUM>, the wireless communications module <NUM>, the audio module <NUM>, the sensor module <NUM>, or the like. The GPIO interface may be further configured as the I2C interface, the I2S interface, the UART interface, the MIPI interface, or the like.

The USB interface <NUM> is an interface that conforms to a USB standard specification, and may be specifically a mini USB interface, a micro USB interface, a USB Type C interface, or the like. The USB interface <NUM> may be configured to connect to the charger to charge the electronic device <NUM>, or may be configured to transmit data between the electronic device <NUM> and a peripheral device, or may be configured to connect to a headset, to play audio through the headset. The interface may be further configured to connect to another electronic device such as an AR device.

It may be understood that an interface connection relationship between modules illustrated in this embodiment of this application is merely an example for description, and does not constitute a limitation on the structure of the electronic device <NUM>. In some other embodiments of this application, the electronic device <NUM> may alternatively use an interface connection manner different from that in the foregoing embodiment, or a combination of a plurality of interface connection manners.

The charging management module <NUM> is configured to receive a charging input from a charger. The charger may be a wireless charger or a wired charger. In some embodiments of wired charging, the charging management module <NUM> may receive a charging input from the wired charger through the USB interface <NUM>. In some embodiments of wireless charging, the charging management module <NUM> may receive a wireless charging input through a wireless charging coil of the electronic device <NUM>. The charging management module <NUM> may further supply power to the electronic device by using the power management module <NUM> when the battery <NUM> is charged.

The power management module <NUM> is configured to connect the battery <NUM>, the charging management module <NUM>, and the processor <NUM>. The power management module <NUM> receives an input from the battery <NUM> and/or the charging management module <NUM>, and supplies power to the processor <NUM>, the internal memory <NUM>, an external memory, the display <NUM>, the camera <NUM>, the wireless communications module <NUM>, and the like. The power management module <NUM> may be further configured to monitor parameters such as a battery capacity, a quantity of battery cycles, and a battery health status (electric leakage or impedance). In some other embodiments, the power management module <NUM> may alternatively be disposed in the processor <NUM>. In some other embodiments, the power management module <NUM> and the charging management module <NUM> may alternatively be disposed in a same device.

The antenna <NUM> and the antenna <NUM> are configured to transmit and receive electromagnetic wave signals. Each antenna in the electronic device <NUM> may be configured to cover one or more communication bands. Different antennas may be further multiplexed to improve antenna utilization. For example, the antenna <NUM> may be multiplexed as a diversity antenna in a wireless local area network. In some other embodiments, the antenna may be used in combination with a tuning switch.

The mobile communications module <NUM> can provide a solution, applied to the electronic device <NUM>, to wireless communication including <NUM>, <NUM>, <NUM>, <NUM>, and the like. The mobile communications module <NUM> may include at least one filter, a switch, a power amplifier, a low noise amplifier (low noise amplifier, LNA), and the like. The mobile communications module <NUM> may receive an electromagnetic wave through the antenna <NUM>, perform processing such as filtering or amplification on the received electromagnetic wave, and transmit a processed electromagnetic wave to the modem processor for demodulation. The mobile communications module <NUM> may further amplify a signal modulated by the modem processor, and convert the signal into an electromagnetic wave for radiation through the antenna <NUM>. In some embodiments, at least some function modules of the mobile communications module <NUM> may be disposed in the processor <NUM>. In some embodiments, at least some function modules of the mobile communications module <NUM> may be disposed in the same device as at least some modules of the processor <NUM>.

The modem processor may include a modulator and a demodulator. The modulator is configured to modulate a to-be-sent low-frequency baseband signal into a medium-frequency or high-frequency signal. The demodulator is configured to demodulate a received electromagnetic wave signal into a low-frequency baseband signal. Then, the demodulator transmits the low-frequency baseband signal obtained through demodulation to the baseband processor for processing. The baseband processor processes the low-frequency baseband signal, and then transfers an obtained signal to the application processor. The application processor outputs a sound signal by using an audio device (which is not limited to the speaker 170A, the receiver 170B, or the like), or displays an image or a video on the display <NUM>. In some embodiments, the modem processor may be an independent component. In some other embodiments, the modem processor may be independent of the processor <NUM>, and is disposed in the same device as the mobile communications module <NUM> or another function module.

The wireless communications module <NUM> may provide a solution, applied to the electronic device <NUM>, to wireless communication including a wireless local area network (wireless local area network, WLAN) (for example, a wireless fidelity (wireless fidelity, Wi-Fi) network), Bluetooth (Bluetooth, BT), a global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication (near field communication, NFC), an infrared (infrared, IR) technology, and the like. The wireless communications module <NUM> may be one or more components integrating at least one communications processor module. The wireless communications module <NUM> receives an electromagnetic wave through the antenna <NUM>, performs frequency modulation and filtering processing on the electromagnetic wave signal, and sends a processed signal to the processor <NUM>. The wireless communications module <NUM> may further receive a to-be-sent signal from the processor <NUM>, perform frequency modulation and amplification on the signal, and convert a processed signal into an electromagnetic wave for radiation through the antenna <NUM>.

In some embodiments, in the electronic device <NUM>, the antenna <NUM> and the mobile communications module <NUM> are coupled, and the antenna <NUM> and the wireless communications module <NUM> are coupled, so that the electronic device <NUM> can communicate with a network and another device by using a wireless communications technology. The wireless communications technology may include a global system for mobile communications (global system for mobile communications, GSM), a general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), wideband code division multiple access (wideband code division multiple access, WCDMA), time-division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, a GNSS, a WLAN, NFC, FM, an IR technology, and/or the like. The GNSS may include a global positioning system (global positioning system, GPS), a global navigation satellite system (global navigation satellite system, GLONASS), a BeiDou navigation satellite system (BeiDou navigation satellite system, BDS), a quasi-zenith satellite system (quasi-zenith satellite system, QZSS), a satellite based augmentation system (satellite based augmentation system, SBAS), and/or the like.

The electronic device <NUM> implements a display function by using the GPU, the display <NUM>, the application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display <NUM> and the application processor. The GPU is configured to perform mathematical and geometric calculation, and render an image. The processor <NUM> may include one or more GPUs that execute program instructions to generate or change display information.

The display <NUM> is configured to display an image, a video, and the like. The display <NUM> includes a display panel. The display panel may be a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (organic light-emitting diode, OLED), an active-matrix organic light emitting diode (active-matrix organic light emitting diode, AMOLED), a flexible light-emitting diode (flexible light-emitting diode, FLED), a mini-LED, a micro-LED, a micro-OLED, a quantum dot light emitting diode (quantum dot light emitting diode, QLED), or the like. In some embodiments, the electronic device <NUM> may include one or N displays <NUM>, where N is a positive integer greater than <NUM>.

The ISP is configured to process data fed back by the camera <NUM>. For example, during photographing, a shutter is pressed, and a ray of light is transmitted to a photosensitive element of a camera through a lens. An optical signal is converted into an electrical signal. The photosensitive element of the camera transmits the electrical signal to the ISP for processing, and converts the electrical signal into a visible image. The ISP may further perform algorithm optimization on noise, brightness, and complexion of the image. The ISP may further optimize parameters such as exposure and color temperature of a photographing scenario. In some embodiments, the ISP may be disposed in the camera <NUM>.

The camera <NUM> is configured to capture a static image or a video. An optical image of an object is generated through the lens, and is projected onto a photosensitive element. The photosensitive element may be a charge coupled device (charge coupled device, CCD) or a complementary metal-oxide-semiconductor (complementary metal-oxide-semiconductor, CMOS) phototransistor. The photosensitive element converts an optical signal into an electrical signal, and then transmits the electrical signal to the ISP for converting the electrical signal into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard format such as RGB or YUV. In some embodiments, the electronic device <NUM> may include one or N cameras <NUM>, where N is a positive integer greater than <NUM>.

The digital signal processor is configured to process a digital signal, and may process another digital signal in addition to the digital image signal. For example, when the electronic device <NUM> selects a frequency, the digital signal processor is configured to perform Fourier transformation on frequency energy.

The video codec is configured to compress or decompress a digital video. The electronic device <NUM> may support one or more video codecs. In this way, the electronic device <NUM> can play or record videos in a plurality of encoding formats, for example, moving picture experts group (moving picture experts group, MPEG)-<NUM>, MPEG-<NUM>, MPEG-<NUM>, and MPEG-<NUM>.

The NPU is a neural-network (neural-network, NN) computing processor, quickly processes input information by referring to a structure of a biological neural network, for example, by referring to a mode of transmission between human brain neurons, and may further continuously perform self-learning. Applications such as intelligent cognition of the electronic device <NUM>, for example, image recognition, facial recognition, speech recognition, and text understanding, may be implemented through the NPU.

The external memory interface <NUM> may be configured to connect to an external memory card, for example, a micro SD card, to extend a storage capability of the electronic device <NUM>. The external storage card communicates with the processor <NUM> through the external memory interface <NUM>, to implement a data storage function. For example, files such as music and videos are stored in the external storage card.

The internal memory <NUM> may be configured to store computer-executable program code. The executable program code includes instructions. The processor <NUM> runs the instructions stored in the internal memory <NUM>, to implement various function applications and data processing of the electronic device <NUM>. The internal memory <NUM> may include a program storage area and a data storage area. The program storage area may store an operating system, an application required by at least one function (for example, a voice playing function or an image playing function), and the like. The data storage area may store data (such as audio data and a phone book) and the like that are created during use of the electronic device <NUM>. In addition, the internal memory <NUM> may include a high-speed random access memory, or may include a nonvolatile memory, for example, at least one magnetic disk storage component, a flash memory, or a universal flash storage (universal flash storage, UFS).

The electronic device <NUM> may implement an audio function such as music playing and recording through the audio module <NUM>, the speaker 170A, the receiver 170B, the microphone 170C, the headset jack 170D, the application processor, and the like.

The audio module <NUM> is configured to convert digital audio information into an analog audio signal for output, and is also configured to convert an analog audio input into a digital audio signal. The audio module <NUM> may be further configured to code and decode an audio signal. In some embodiments, the audio module <NUM> may be disposed in the processor <NUM>, or some function modules in the audio module <NUM> are disposed in the processor <NUM>.

The speaker 170A, also referred to as a "loudspeaker", is configured to convert an audio electrical signal into a sound signal. The electronic device <NUM> may be used to listen to music or answer a call in a hands-free mode through the speaker 170A.

The receiver 170B, also referred to as an "earpiece", is configured to convert an audio electrical signal into a sound signal. When a call is answered or a voice message is received through the electronic device <NUM>, the receiver 170B may be put close to a human ear to listen to a voice.

The microphone 170C, also referred to as a "mike" or a "mic", is configured to convert a sound signal into an electrical signal. When making a call or sending a voice message, a user may make a sound by moving a human mouth close to the microphone 170C, to input the sound signal to the microphone 170C. At least one microphone 170C may be disposed in the electronic device <NUM>. In some other embodiments, two microphones 170C may be disposed in the electronic device <NUM>, to implement a noise reduction function, in addition to collecting the sound signal. In some other embodiments, three, four, or more microphones 170C may alternatively be disposed in the electronic device <NUM>, to collect a sound signal, implement noise reduction, and identify a sound source, so as to implement a directional recording function and the like.

The headset jack 170D is configured to connect to a wired headset. The headset jack 170D may be the USB interface <NUM>, or may be a <NUM> open mobile terminal platform (open mobile terminal platform, OMTP) standard interface or a cellular telecommunications industry association of the USA (cellular telecommunications industry association of the USA, CTIA) standard interface.

The pressure sensor 180A is configured to sense a pressure signal, and may convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A may be disposed on the display <NUM>. There are a plurality of types of pressure sensors 180A, such as a resistive pressure sensor, an inductive pressure sensor, and a capacitive pressure sensor. The capacitive pressure sensor may include at least two parallel plates made of conductive materials. When a force is applied to the pressure sensor 180A, capacitance between electrodes changes. The electronic device <NUM> determines pressure intensity based on a capacitance change. When a touch operation is performed on the display <NUM>, the electronic device <NUM> detects intensity of the touch operation by using the pressure sensor 180A. The electronic device <NUM> may also calculate a touch location based on a detection signal of the pressure sensor 180A. In some embodiments, touch operations that are performed at a same touch location but have different touch operation intensity may correspond to different operation instructions. For example, when a touch operation whose touch operation intensity is less than a first pressure threshold is performed on a Messages icon, an instruction for viewing an SMS message is executed. When a touch operation whose touch operation intensity is greater than or equal to the first pressure threshold is performed on an icon of Messages, an instruction for creating an SMS message is executed.

The gyroscope sensor 180B may be configured to determine a motion posture of the electronic device <NUM>. In some embodiments, an angular velocity of the electronic device <NUM> around three axes (namely, axes x, y, and z) may be determined by using the gyroscope sensor 180B. The gyroscope sensor 180B may be configured to perform image stabilization during photographing. For example, when the shutter is pressed, the gyroscope sensor 180B detects an angle at which the electronic device <NUM> shakes, and calculates, based on the angle, a distance for which a lens module needs to compensate, and allows the lens to eliminate the shake of the electronic device <NUM> through reverse motion, to implement image stabilization. The gyroscope sensor 180B may also be used in a navigation scenario and a somatic game scenario.

The barometric pressure sensor 180C is configured to measure barometric pressure. In some embodiments, the electronic device <NUM> calculates an altitude based on a value of the barometric pressure measured by the barometric pressure sensor 180C, to assist in positioning and navigation.

The magnetic sensor 180D includes a Hall sensor. The electronic device <NUM> may detect opening and closing of a flip cover leather case by using the magnetic sensor 180D. In some embodiments, when the electronic device <NUM> is a clamshell phone, the electronic device <NUM> may detect opening and closing of a flip cover by using the magnetic sensor 180D. Further, a feature such as automatic unlocking of the flip cover is set based on a detected opening or closing state of the leather case or a detected opening or closing state of the flip cover.

The acceleration sensor 180E may detect magnitudes of accelerations of the electronic device <NUM> in various directions (usually on three axes), and may detect magnitude and a direction of gravity when the electronic device <NUM> is still. The acceleration sensor 180E may be further configured to identify a posture of the electronic device, and applied to an application such as switching between landscape mode and portrait mode or a pedometer.

The distance sensor 180F is configured to measure a distance. The electronic device <NUM> may measure the distance in an infrared manner or a laser manner. In some embodiments, in a photographing scenario, the electronic device <NUM> may measure a distance by using the distance sensor 180F to implement quick focusing.

The optical proximity sensor <NUM> may include, for example, a light-emitting diode (LED) and an optical detector such as a photodiode. The light-emitting diode may be an infrared light-emitting diode. The electronic device <NUM> emits infrared light by using the light-emitting diode. The electronic device <NUM> detects infrared reflected light from a nearby object by using the photodiode. When sufficient reflected light is detected, the electronic device <NUM> may determine that there is an object near the electronic device <NUM>. When insufficient reflected light is detected, the electronic device <NUM> may determine that there is no object near the electronic device <NUM>. The electronic device <NUM> may detect, by using the optical proximity sensor <NUM>, that the user holds the electronic device <NUM> close to an ear for a call, to automatically turn off a screen for power saving. The optical proximity sensor <NUM> may also be used in a smart cover mode or a pocket mode to automatically perform screen unlocking or locking.

The ambient light sensor <NUM> is configured to sense ambient light brightness. The electronic device <NUM> may adaptively adjust brightness of the display <NUM> based on the sensed ambient light brightness. The ambient light sensor <NUM> may also be configured to automatically adjust white balance during photographing. The ambient light sensor <NUM> may further cooperate with the optical proximity sensor <NUM> to detect whether the electronic device <NUM> is in a pocket, to prevent an accidental touch.

The fingerprint sensor <NUM> is configured to collect a fingerprint. The electronic device <NUM> may use a feature of the collected fingerprint to implement fingerprint-based unlocking, application lock access, fingerprint-based photographing, fingerprint-based call answering, and the like.

The temperature sensor 180J is configured to detect a temperature. In some embodiments, the electronic device <NUM> executes a temperature processing policy based on the temperature detected by the temperature sensor 180J. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the electronic device <NUM> lowers performance of a processor located near the temperature sensor 180J, to reduce power consumption to implement thermal protection. In some other embodiments, when the temperature is less than another threshold, the electronic device <NUM> heats the battery <NUM> to prevent the electronic device <NUM> from being shut down abnormally due to a low temperature. In some other embodiments, when the temperature is less than still another threshold, the electronic device <NUM> boosts an output voltage of the battery <NUM> to avoid abnormal shutdown due to a low temperature.

The touch sensor <NUM> is also referred to as a "touch panel". The touch sensor <NUM> may be disposed on the display <NUM>, and the touch sensor <NUM> and the display <NUM> form a touchscreen, which is also referred to as a "touchscreen". The touch sensor <NUM> is configured to detect a touch operation on or near the touch sensor <NUM>. The touch sensor may transfer the detected touch operation to the application processor, to determine a type of a touch event. A visual output related to the touch operation may be provided through the display <NUM>. In some other embodiments, the touch sensor <NUM> may alternatively be disposed on a surface of the electronic device <NUM> at a location different from that of the display <NUM>.

The bone conduction sensor <NUM> may obtain a vibration signal. In some embodiments, the bone conduction sensor <NUM> may obtain a vibration signal of a vibration bone of a human vocal-cord part. The bone conduction sensor <NUM> may also be in contact with a human pulse, to receive a blood pressure beating signal. In some embodiments, the bone conduction sensor <NUM> may alternatively be disposed in the headset, to obtain a bone conduction headset. The audio module <NUM> may obtain a voice signal through parsing based on the vibration signal that is of the vibration bone of the vocal-cord part and that is obtained by the bone conduction sensor <NUM>, to implement a voice function. The application processor may parse heart rate information based on the blood pressure beating signal obtained by the bone conduction sensor <NUM>, to implement a heart rate detection function.

The button <NUM> includes a power button, a volume button, and the like. The button <NUM> may be a mechanical button, or may be a touch-sensitive button. The electronic device <NUM> may receive a key input, and generate a key signal input related to a user setting and function control of the electronic device <NUM>.

The motor <NUM> may generate a vibration prompt. The motor <NUM> may be configured to provide an incoming call vibration prompt and a touch vibration feedback. For example, touch operations performed on different applications (for example, photographing and audio playing) may correspond to different vibration feedback effects. The motor <NUM> may also correspond to different vibration feedback effects for touch operations performed on different areas of the display <NUM>. Different application scenarios (for example, a time reminder scenario, an information receiving scenario, an alarm clock scenario, and a game scenario) may also correspond to different vibration feedback effects. A touch vibration feedback effect may be further customized.

The SIM card interface <NUM> is configured to connect to a SIM card. The SIM card may be inserted into the SIM card interface <NUM> or removed from the SIM card interface <NUM>, to implement contact with or separation from the electronic device <NUM>. The electronic device <NUM> may support one or N SIM card interfaces, where N is a positive integer greater than <NUM>. The SIM card interface <NUM> may support a nano-SIM card, a micro-SIM card, a SIM card, and the like. A plurality of cards may be simultaneously inserted into a same SIM card interface <NUM>. The plurality of cards may be of a same type or of different types. The SIM card interface <NUM> may be compatible with different types of SIM cards. The SIM card interface <NUM> may also be compatible with the external storage card. The electronic device <NUM> interacts with a network through the SIM card, to implement functions such as calling and data communication. In some embodiments, the electronic device <NUM> uses an eSIM, that is, an embedded SIM card. The eSIM card may be embedded into the electronic device <NUM>, and cannot be separated from the electronic device <NUM>.

A software system of the electronic device <NUM> may use a layered architecture, an event-driven architecture, a microkernel architecture, a micro service architecture, or a cloud architecture. In this embodiment of this application, an Android system of a layered architecture is used as an example to describe a software structure of the electronic device <NUM>.

<FIG> is a block diagram of a software structure of the electronic device <NUM> in this embodiment of this application. In a layered architecture, software is divided into several layers, and each layer has a clear role and task. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into four layers, that is, an application layer, an application framework layer, an Android runtime (Android runtime) and system library, and a kernel layer from top to bottom.

As shown in <FIG>, the application packages may include applications such as Camera, Gallery, Calendar, Phone, Map, Navigation, WLAN, Bluetooth, Music, Videos, and Messages.

The window manager is configured to manage a window program. The window manager may obtain a size of a display, determine whether there is a status bar, perform screen locking, take a screenshot, and the like.

The content provider is configured to store and obtain data, and enable the data to be accessed by an application. The data may include a video, an image, audio, calls that are made and received, a browsing history and bookmarks, a phone book, and the like.

The view system includes visual controls, such as a control for displaying a text and a control for displaying an image. The view system may be configured to construct an application. A display interface may include one or more views. For example, a display interface including an SMS notification icon may include a text display view and an image display view.

The phone manager is configured to provide a communication function of the electronic device <NUM>, for example, management of a call status (including answering, declining, or the like).

The resource manager provides, for an application, various resources such as a localized character string, an icon, an image, a layout file, and a video file.

The notification manager enables an application to display notification information in the status bar, and may be configured to convey a notification message. The notification manager may automatically disappear after a short pause without requiring a user interaction. For example, the notification manager is configured to notify download completion, provide a message notification, and the like. The notification manager may be a notification that appears in a top status bar of the system in a form of a graph or a scroll bar text, for example, a notification of an application running on the background, or may be a notification that appears on the screen in a form of a dialog window. For example, text information is prompted in the status bar, a prompt tone is produced, the electronic device vibrates, or the indicator light blinks.

The kernel library includes two parts: one part is a function that needs to be invoked by a Java language, and the other part is a kernel library of Android.

The application layer and the application framework layer run on the virtual machine. The virtual machine executes Java files of the application layer and the application framework layer as binary files. The virtual machine is configured to implement functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

The system library may include a plurality of function modules, such as a surface manager (surface manager), a media library (media library), a three-dimensional graphics processing library (for example, OpenGL ES), and a 2D graphics engine (for example, SGL).

The media library supports playback and recording in a plurality of commonly used audio and video formats, a static image file, and the like. The media library may support a plurality of audio and video coding formats, such as MPEG-<NUM>, H. <NUM>, MP3, AAC, AMR, JPG, and PNG.

The three-dimensional graphics processing library is configured to implement three-dimensional graphics drawing, image rendering, compositing, layer processing, and the like.

For ease of understanding, in the following embodiments of this application, an electronic device having the structures shown in <FIG> and <FIG> is used as an example to describe in detail, with reference to the accompanying drawings and application scenarios, the address book-based device discovery method provided in the embodiments of this application.

With continuous development of communications technologies and services, electronic devices have increasingly rich forms. Based on a form and a use scenario of the electronic device, the electronic device may be classified into a personal device and a home device. For example, a mobile phone and a watch belong to a personal device, and a speaker, a television, a tablet, a camera, and the like belong to a home shared device.

It should be understood that, the personal device is generally a mobile device, for example, may be an electronic device that can be carried by a user; and the home device is usually a fixed device, and is usually applicable to calls between close user relationships and has relatively high privacy requirements.

It should be further understood that both a current personal device and a current home device may implement a function of making a call. For example, the user may answer or make a call by using a watch. In a process of answering or making a call by using the personal device, the user does not care whether a caller uses a mobile phone <NUM>, a mobile phone <NUM>, or a watch <NUM>, provided that the user can make a call. A universal call service is provided, and the mobile phone and the watch may be set to simultaneously vibrate when a call is received.

During a family call with a family member, the user can answer a call or make a video call by using the home device. When the user makes a call by using the home device, the user has a clear answer expectation. For example, when the user dials a TV in the mom's home or a speaker in the uncle's living room, the user needs to provide capabilities of independently discovering and dialing the TV in the mom's home and the speaker in the uncle's living room.

Different device forms or user use scenarios need to meet different user requirements during a call service process. <FIG> are a schematic diagram of graphical user interfaces (graphical user interfaces, GUIs) of an address book-based audio and video communication method according to an embodiment of this application. In this application, a mobile phone is used as an electronic device to describe in detail an address book-based device discovery method provided in this application. <FIG> shows that in an unlocking mode of the mobile phone, a screen display system of the mobile phone displays currently output interface content <NUM>. The interface content <NUM> is a home screen of the mobile phone. The interface content <NUM> displays a plurality of third-party applications (applications, Apps), for example, Address book, Messages, and Contacts. It should be understood that the interface content <NUM> may further include more applications. This is not limited in this application.

In an existing call service, a user can make a call to a contact based on the address book. As shown in <FIG>, the user taps a "Contacts" application icon, and in response to a tapping operation of the user, the mobile phone enters an address book interface <NUM> shown in <FIG>. The address book interface <NUM> may include a contact list. If the user taps a list bar corresponding to "mom", the mobile phone displays an interface <NUM> shown in <FIG>. The interface <NUM> includes address book information of the contact "mom", for example, a phone number and an avatar shown in <FIG>. The interface <NUM> further includes a shortcut menu list, for example, different menu options such as "Video call", "Send message", "Share contact", "Add to favorites", and "Share my location". The user may tap different menus based on a use requirement, to implement different functions.

For example, the user may perform an operation of tapping a "video call icon <NUM>" shown in <FIG>, and in response to the tapping operation of the user, the mobile phone initiates a video call request to "mom". The foregoing lists a process in which the user initiates a video call. In the process, a call request or a video call request for another user is implemented only by using the address book of the mobile phone, and a call request or a video call request cannot be initiated between a plurality of different devices.

It should be understood that the user may initiate a video call request to the "mom" user by tapping any "video call icon <NUM>" shown in <FIG>. This is not limited in this application.

In addition, in addition to relying on a carrier to initiate a call request or a video call request to another user, some current solutions also support presenting a facetime service in the address book of the mobile phone. The user sets a same phone number, email account, or the like on an associated device such as a mobile phone and a PAD, so that the associated device such as the mobile phone, a watch, or the PAD of the user may be dialed by using one device, and a plurality of associated devices may ring simultaneously.

It should be understood that in this application, simultaneous ringing may be understood as that the associated devices vibrate simultaneously. For example, when there is an incoming call, the mobile phone and the watch of the user vibrate simultaneously, to remind the user of the current incoming call, and after the user answers the call by using any one of the associated devices, calling for other associated devices is stopped.

It should be further understood that a simultaneous ringing state is not limited to reminding the user in a manner of vibration, and may be further reminding the user in a manner of ringing or ringing and vibration. This is not limited in this application.

It can be learned from the foregoing that the existing solution provides only a call service of a mobile device. When a call is made to the personal device, the associated device may ring simultaneously. However, the solution is not extended to the home device, for example, the home shared device such as the speaker or the television. In addition, the solution lacks ecosystem scalability and cannot support more new devices in the future, such as vehicle-mounted devices and drones.

Therefore, this application provides the address book-based device discovery method, so that the personal device and the home device of the user can be discovered based on the address book, and the call service of the mobile device can be extended to the home device, thereby improving user experience.

<FIG> are a schematic diagram of user interfaces of an address book-based audio and video communication method according to an embodiment of this application. <FIG> shows that in an unlocking mode of a mobile phone, a screen display system of the mobile phone displays a currently output home screen <NUM> of the mobile phone. The home screen <NUM> may include a plurality of Apps. This is not limited in this application.

As shown in <FIG>, a user taps a "Contacts" application icon, and in response to a tapping operation of the user, the mobile phone enters an address book interface <NUM> shown in <FIG>. According to the method provided in this application, on the address book interface <NUM>, in a lower menu bar, in addition to menus of Phone, Contacts, and Favorites, this application may provide the user with a "MeeTime call" menu, for example, a MeeTime call icon <NUM> shown in <FIG>.

Optionally, when the MeeTime call icon <NUM> exists in the lower menu bar on the address book interface <NUM>, the user taps the MeeTime call icon <NUM>, so that the address book interface <NUM> of the mobile phone may display only a contact list that supports a MeeTime call function.

Optionally, the MeeTime call icon <NUM> may further exist in the contact list, for example, the MeeTime call icon <NUM> included after a "mom" option in contacts that can be dialed. The user taps the MeeTime call icon <NUM> that is included after the "mom" option, to directly and quickly enable the MeeTime call function, and initiate a video call request to "mom".

It should be understood that the "MeeTime call" function provided in this application is used to implement audio and video communication between a plurality of devices. For example, when the MeeTime call function is enabled, the user may perform audio and video communication between a personal device and a home device.

It should be further understood that an audio and video communication service in this application is a self-built IP service, and is different from a phone of a carrier.

It should be further understood that, in this application, as shown in <FIG>, an icon <NUM> is used to indicate that the device supports answering and making a call, an icon <NUM> is used to indicate that the device supports an audio call, and an icon <NUM> is used to indicate that the device supports a video call. A shape, a quantity, and an arrangement sequence of icons are not limited in this application.

The address book interface <NUM> of the mobile phone may further include information about an owner user, for example, "Me" shown in <FIG>. The user taps a "Me" option, and the mobile phone displays a details interface <NUM> of the owner user shown in <FIG>. On the interface <NUM>, a plurality of devices in different forms that can be dialed by the owner user may be displayed. For example, a current mobile phone is Huawei P30, and devices that can be dialed may include a mobile phone Huawei Mate <NUM> X, a tablet, a smart screen, a watch, a speaker, and the like. When the user taps a dialing icon of a "My watch" option shown in <FIG>, in response to a tapping operation of the user, the mobile phone enters a call interface <NUM> shown in <FIG>. Correspondingly, on a called watch end, a called interface <NUM> shown in <FIG> may be presented.

It should be understood that each device in a device list that is displayed on the interface <NUM> and that can be dialed by the owner user may be added. In a possible implementation, the user may edit and add corresponding device information on the mobile phone, which is similar to an operation of manually adding a contact by the user. For example, information about a device such as the tablet, the smart screen, the watch, or the speaker is added to the "Me" option.

In another possible implementation, a dedicated App of different devices may be used to import information into the "Me" option. For example, a plurality of different devices may be registered by using a same phone number, in other words, devices such as the tablet, the smart screen, the watch, and the speaker are all corresponding to a phone number of a "Me" user. The mobile phone may automatically discover information about the devices such as the tablet, the smart screen, the watch, and the speaker that are corresponding to the same phone number, and automatically add the information to the list of devices that can be dialed.

Alternatively, when the plurality of different devices correspond to one manufacturer, for example, the tablet, the smart screen, the watch, and the speaker are all Huawei products, the user logs in with one Huawei enterprise account. In this case, the mobile phone may automatically discover information about devices such as the tablet, the smart screen, the watch, and the speaker that are corresponding to the same Huawei enterprise account, and automatically add the information to the list of devices that can be dialed. A quantity of devices included in the list of devices that can be dialed and a device adding manner are not limited in this application.

According to the method described in <FIG>, a plurality of different devices of one account, such as a personal device and a home device, may be discovered, and audio and video communication may be performed between the plurality of different devices associated with one account, so that an audio and video communication requirement of the user may be met in different scenarios. For example, when the user wants to make a video call with a family member, the user may associate the home TV and the user mobile phone as devices under one account. The user may select a TV from the list of devices that can be dialed and tap "Video call" to send a video call request to the home TV, so as to make a video call with the family member on the TV. Alternatively, when the user cannot find the watch at home, the user may send a dialing service to the watch, and the watch alerts the user of an incoming call in a manner of vibration or ringing, so that the user can find the watch conveniently.

It should be understood that, in this application, an account may be an account registered by using a phone number, or an enterprise account of a device manufacturer. This is not limited in this application.

<FIG> are a schematic diagram of user interfaces of another address book-based audio and video communication method according to an embodiment of this application. <FIG> shows that in an unlocking mode of a mobile phone, a screen display system of the mobile phone displays a currently output home screen <NUM> of the mobile phone. The home screen <NUM> may include a plurality of Apps. This is not limited in this application.

As shown in <FIG>, a user taps a "Contacts" application icon, and in response to a tapping operation of the user, the mobile phone enters an address book interface <NUM> shown in <FIG>. As shown in <FIG>, the user taps a Contacts menu at the bottom of the interface <NUM>, and the mobile phone displays an interface <NUM> of all contacts shown in <FIG>.

The interface <NUM> includes information about a plurality of contacts. The plurality of contacts include a contact that can make a MeeTime call and a contact that cannot make a MeeTime call. A MeeTime call icon <NUM> may be displayed in a list of contacts that can make a MeeTime call. A contact list that does not display the MeeTime call icon <NUM> includes a contact that cannot make a MeeTime call. For example, if a list of "mom" and "Nana" includes the MeeTime call icon <NUM>, "mom" and "Nana" are contacts that can make the MeeTime call.

It should be understood that, in this application, the contact that can make a MeeTime call may be a user of a MeeTime call service registered with or received by the contact. Optionally, when a user B taps the MeeTime call icon <NUM> in the lower right menu in <FIG> for the first time, the user authorizes to enable a MeeTime call function, or the user registers in the MeeTime call function. A cloud end or a server corresponding to the MeeTime call may obtain information about the user B, for example, registered phone number information, user name, and account information, so that the user B may be displayed in an address book list of a user A as the contact that can make the MeeTime call. This is not limited in this application.

As shown in <FIG>, the user taps a list bar of "mom", and the mobile phone displays an interface <NUM> shown in <FIG>. The interface <NUM> includes address book information of the contact "mom". The interface <NUM> may include a MeeTime call menu. When the user taps the MeeTime call menu, the mobile phone displays an interface <NUM> shown in <FIG>. The interface <NUM> includes a plurality of different devices associated with "mom", for example, a tablet, a speaker, a television, and a television <NUM> of "mom". The tablet, the television, and the television <NUM> may support a video call, and the speaker may support an audio call. In this case, if the user wants to make a video call with "mom" on the television, as shown in <FIG>, the user taps the MeeTime call icon <NUM> of the television option, to initiate a video call request to the television of "mom".

In a possible implementation, when the user initiates a call request to a personal device such as a tablet, a mobile phone B, or a watch by using a mobile phone A, the user may set the mobile phone A and the personal device such as the tablet, the mobile phone B, and the watch to a simultaneous ringing state. Therefore, when the user initiates a call request to any one of the personal devices such as the tablet, the mobile phone B, and the watch by using the mobile phone A, all the devices in the personal devices such as the tablet, the mobile phone B, and the watch vibrate, to remind the user that the call can be answered by using any one of the personal devices.

In another possible implementation, when the user initiates a call request to a home device such as a speaker or a television by using the mobile phone A, the mobile phone A and the home device such as the speaker or the television may be set to a non-simultaneous ringing state. Therefore, when the user initiates a call request to any one of home devices such as the speaker and the television by using the mobile phone A, only the device selected by the user to call vibrates, so as to remind the user to answer the call, and other home devices do not vibrate.

It should be understood that, because the home device has a stricter privacy policy, the home device may be set to the non-simultaneous ringing state. It should be further understood that the user may also set the personal device such as the tablet, the mobile phone B, or the watch to the non-simultaneous ringing state, and set the home device such as the speaker or the television to the simultaneous ringing state based on a personal use requirement. This is not limited in this application.

It should be further understood that the simultaneous ringing state is not limited to reminding the user in a manner of vibration, and may be further reminding the user in a manner of ringing or ringing and vibration. This is not limited in this application.

It should be further understood that in addition to simultaneous ringing, sequential ringing may be further included. Sequential ringing means that a first of a plurality of associated devices is called first in a call process, and when the first device does not answer within preset time, a second of the plurality of associated devices is called in a preset sequence, and so on. In addition, after the user answers the call by using any one of the associated devices, the user usually does not make a subsequent call to another associated device. This is not limited in this application.

According to the method described in <FIG>, the mobile phone may discover, based on the address book, different devices of different accounts. For example, an address book of the user B is stored on a mobile phone of the user A, and the mobile phone of the user A may discover a personal device of the user B that supports the MeeTime call. Alternatively, after the user B discloses home device information, the mobile phone of the user A may also discover a home device of the user B that supports the MeeTime call. In this way, the user A may initiate audio and video communication requests to a plurality of different devices of the user B, so that audio and video communication requirements of the user can be met in different scenarios.

Optionally, the user B may set whether to disclose information about a plurality of devices associated with the user B.

For example, if the user B sets to disclose information about the plurality of devices associated with the user B, the mobile phone of the user A may discover the plurality of devices associated with the user B. The mobile phone of the user A may display "discovering a newly enabled contact" shown in <FIG>, and add the plurality of devices associated with the user B to an interface of the list of devices that can be dialed shown in <FIG>.

Alternatively, the user B sets to disclose information about some devices associated with the user B. For example, only information about a personal device of the user B is disclosed. The mobile phone of the user A can discover only the information about the personal device of the user B, and add the personal device associated with the user B to the interface of the list of devices that can be dialed shown in <FIG>.

Alternatively, the user B sets to disclose information about some home devices of the user B, for example, disclose only information about a speaker associated with the user B. The mobile phone of the user A can discover only the information about the speaker of the user B, and add the speaker associated with the user B to the interface of the list of devices that can be dialed shown in <FIG>. This is not limited in this application.

It should be understood that the foregoing different implementations may be controlled by using a unique App of each device. For example, when the user B initially logs in to a smart screen device, the user B needs to register or log in to the smart screen by using an App unique to the smart screen. The user B may further establish a device address book for the smart screen. The device address book is only for the smart screen device of the user B. Only when the user authorizes to import the device address book of the smart screen to a mobile phone of the user B, the user B can view the address book of the smart screen of the user B from the mobile phone and determine whether the address book contains information about another device such as a speaker and a tablet of the user B.

In addition, the foregoing smart screen is for a private user, and the user B may share the device address book in a plurality of electronic devices such as the tablet, the mobile phone, and the speaker of the user B. A majority of smart screen devices of enterprises are purchased for performing a video conference. Therefore, the smart screen address book may be set, in a unique control App corresponding to the smart screen, to be visible to all, or visible to a specified address book, or invisible to all. This is not limited in this application.

In the foregoing method, the user may set permissions based on different use requirements, so that when being discovered by another device, privacy requirements of different devices during use processes in different scenarios are met.

In conclusion, the mobile phone of the user A is used as the center, the mobile phone may find the call service, the personal device, the home device, and the like in the address book, and may not only make a call to each device of the user (user A), but also call another contact (user B) or the home device of the user B. This method not only inherits an address book-based call habit of the user, but also provides easy-to-use and easy-to-expand device access capabilities for an internet of everything <NUM> era, improving user experience.

In addition, in a registration process, the personal device and the home device may use a same account, for example, bind a same phone number or use a same enterprise account, so as to discover the personal device and the home device that support the call service. In addition, a list of call services, personal devices, and home devices is presented in the address book of the mobile phone. This is easy-to-operate and easy-to-evolve and improves user experience.

With reference to the foregoing embodiments and related accompanying drawings, the embodiments of this application provide the address book-based device discovery method and the audio and video communication method. The method may be implemented by the electronic device (for example, a mobile phone or a tablet computer) having the touchscreen and the camera in <FIG> and <FIG>.

To implement the address book-based device discovery method and the audio and video communication method described in <FIG> and <FIG>, a connection architecture between a plurality of modules needs to be established. <FIG> is a schematic diagram of a system architecture according to an embodiment of this application. As shown in <FIG>, the architecture <NUM> includes a mobile phone <NUM>, another device <NUM>, a communication account system <NUM>, and an audio and video communications system <NUM>. The mobile phone <NUM> may include a mobile phone of a user A and a mobile phone of a user B. In this application, it is assumed that the user A and the user B are an address book contact of each other. Specifically, details are as follows:.

<NUM>: A first user performs account registration with the communication account system <NUM> by using a first phone number of the first user.

<NUM>: Query device information and communication information of a second user by using a second phone number of the second user.

<NUM>: The second user performs account registration with the communication account system <NUM> by using the second phone number of the second user.

<NUM>: The first user initiates an audio and video call request to the second user by using the audio and video communications system.

It should be understood that this application may be implemented provided that a device can be connected to a network.

It should be further understood that, after the first user performs registration by using the first phone number, and the second user performs registration by using the second phone number, both the first user and the second user enable an audio and video communication capability.

For example, a personal device of the second user may include a mobile phone, a watch, or the like. For example, when the first user initiates a call request to a mobile phone of the second user, the first user first sends a request for calling the personal device of the second user to the audio and video communications system, and the audio and video communications system initiates a call request to the mobile phone of the second user.

For example, account list information may include the following content.

As shown in Table <NUM>, in a process in which the first user and the second user register with the communication account system, the account list information may be stored in the communication account system. The account list information may include account information of each user, device identifiers of M devices associated with each account, communication identifiers of the M devices, communication policies of the M devices, and the like, where M is a positive integer.

It should be understood that the account information of the user may be a phone number of the user, that is, a phone number of the user during registration, and is used as an identifier discovered during communication. The device identifier may be a physical identifier of each device, and is used to distinguish different devices. The communication identifier is a communication ID allocated by the communication account system, for example, "<NUM><NUM><NUM><NUM>", and is used to accurately send a call request. The communication policy may be the foregoing information such as resonance, for example, performing resonance on the M devices during an audio and video call.

In the foregoing solution, first, one or more personal devices of the user are registered with the communication account system by using a phone number, to enable a communication capability of the user. If device discovery needs to be performed in one address book entry, a plurality of devices of the second user may use a same phone number for registration. After registration, the communication account system is responsible for maintaining a binding relationship between the device and the phone number for capability discovery and query.

<FIG> and <FIG> are a schematic interaction diagram of an audio and video communication method according to an embodiment of this application. As shown in <FIG> and <FIG>, the method may include the following steps:.

For example, the personal device of the second user may include a mobile phone, a watch, or the like. For example, when the first user initiates a call request to the mobile phone of the second user, the first user first sends a request for calling the personal device of the second user to the audio and video communications system, and then performs step <NUM>. The audio and video communications system initiates a call request to the mobile phone of the second user.

Alternatively, when the first user initiates a call request to the watch of the second user, the first user first sends a request for calling the personal device of the second user to the audio and video communications system, and then performs step <NUM>. The audio and video communications system initiates a call request to the watch of the second user.

It should be understood that the first user initiates a call request, or referred to as a call service (Hi call), to a device of the second user by using the audio and video communications system. The call service does not need to use a communications system of a carrier. When a network is connected, the call service may be initiated by using the system architecture <NUM> described in <FIG>.

It should be further understood that, because a personal device of a user is generally a mobile device, a universal call service may be provided. In other words, the first user and the second user only need to successfully answer a call, and may answer the call by using any personal device. Therefore, the personal device of the second user may be set to a simultaneous ringing state. When the first user sends the request for calling the personal device of the second user to the audio and video communications system, one request message may be reused. This is not limited in this application.

In addition, when the first user initiates a call request to a home device of the second user, where the home device may include a television, a speaker, and the like, because the home device is a fixed device, is generally used to make a call between close users, and has a relatively high privacy requirement, the home device is set to a non-simultaneous ringing state by default. When sending a request for calling the home device of the second user to the audio and video communications system, the first user separately sends request messages for different home devices to the audio and video communications system.

<NUM>: The first user initiates a call request to the television of the second user. First, the first user sends a request for calling the television of the second user to the audio and video communications system.

<NUM>: The audio and video communications system then initiates a call request to the television of the second user.

<NUM>: Alternatively, the first user initiates a call request to the speaker of the second user. First, the first user sends a request for calling the speaker of the second user to the audio and video communications system.

<NUM>: The audio and video communications system then initiates a call request to the speaker of the second user.

In the foregoing solution, first, one or more personal devices of the user are registered with the communication account system by using a phone number, to enable a communication capability of the user. If devices need to be discovered in one address book entry, a plurality of devices of the user may use a same phone number for registration. When a device registers with the communication account system by using the phone number, security authentication can be ensured by using an SMS authentication code or by using a password-free one-click login provided by a third-party enterprise (such as the carrier). This improves security of the registration process. After registration, the communication account system is responsible for maintaining a binding relationship between the device and the phone number for capability discovery and query.

In a process in which the first user dials audio and video communication to a device of the second user, a list of devices that meet a privacy policy needs to be first queried based on the second phone number of the second user, and a list of devices that can dial audio and video communication needs to be presented in an address book. Then, the first user may dial the personal device of the second user by using the call service, and the personal device can ring simultaneously. Alternatively, the first user may directly dial the home device of the second user, such as the speaker or the television.

To enable a home device in a high privacy scenario, such as a television or a speaker, to be discovered and called in the address book of the first user, a clear privacy policy needs to be formulated. For example, the television has its own device address book, and only when the first user is in the device address book of the television, the television can be found in the address book of the first user and an audio and video call request can be initiated to the television.

In the foregoing solution, a call service may be provided based on an address book, so that calls can be made to different devices of a same user, and the call service may be extended to a home device, a vehicle-mounted device, or even more <NUM> communications devices in a high-privacy scenario, so as to implement one-click discovery, dialing, and call services, provide easy-to-use communication solutions for different use scenarios, and improve user experience.

In another possible implementation, when registering with the communication account system, the first user and the second user may perform registration by using a phone number, or may perform registration by using another account, a user name, or the like. Herein, the first phone number, another account, user name, or the like may be used to uniquely determine the first user or the second user. This is not limited in this application.

For example, if the third-party enterprise (such as a mobile phone manufacturer) or a service provider has a complete account system, the audio and video communication capability is only a new service and can be integrated with an existing account system. Specifically, before a device performs registration, the device logs in to a third-party account system to obtain symbols or identifiers (tokens) for different users. Then, the device registers with the communication account system and completes identifier authentication of different users on a cloud side. That is, an authentication standard of OAuth2. <NUM> is met.

In this embodiment, the first user, the second user, the device of the first user, and the device of the second user all have corresponding registrations in the third-party account system, and different users have different user identifiers in the third-party account system.

<FIG> and <FIG> are a schematic interaction diagram of another audio and video communication method according to an embodiment of this application. As shown in <FIG> and <FIG>, the method may include the following steps:.

It should be understood that, through the foregoing steps, registration in the third-party account system is unified with registration of a user in the communication account system by using a phone number. If a third-party account has been registered by using the phone number, an audio and video communication capability may also directly obtain the phone number to complete device-cloud verification. In this way, processes such as entering the phone number and SMS authentication are saved, which facilitates user operations and improves user experience.

In addition, steps <NUM> to <NUM> are device discovery and call processes, which are the same as steps <NUM> to <NUM> in Example <NUM>. Refer to the foregoing description.

In the foregoing solution, the registration of the user in the third-party account system is first unified with the registration of the user in the communication account system by using the phone number, to enable a communication capability of the user. If a plurality of devices of a same user are registered by using a same phone number for registration, the devices can be discovered in one address book entry for capability discovery and query.

In a process in which the first user dials audio and video communication to a device of the second user, a list of devices that meet a privacy policy needs to be first queried based on the second phone number of the second user, and a list of devices that can dial audio and video communication needs to be presented in an address book. Then, the first user may dial a personal device of the second user by using a call service, and the personal device can ring simultaneously. Alternatively, the first user may directly dial a home device of the second user, such as a speaker or a television.

To enable a home device in a high privacy scenario, such as a television or a speaker, to be discovered and called in an address book of the first user, a clear privacy policy needs to be formulated. For example, the television has its own device address book, and only when the first user is in the device address book of the television, the television can be found in the address book of the first user and an audio and video call request can be initiated to the television.

It may be understood that, to implement the foregoing functions, the electronic device includes corresponding hardware and/or software modules for performing the functions. With reference to algorithm steps of each example described in the embodiments disclosed in this specification, this application may be implemented in a form of hardware or a combination of hardware and computer software. Whether a function is performed by hardware or hardware driven by computer software depends on particular applications and design constraints of the technical solutions. A person skilled in the art may use different methods to implement the described functions for each particular application with reference to the embodiments, but it should not be considered that the implementation goes beyond the scope of this application.

In the embodiments, the electronic device may be divided into function modules based on the foregoing method examples. For example, each function module corresponding to each function may be obtained through division, or two or more functions may be integrated into one processing module. The integrated module may be implemented in a form of hardware. It should be noted that the module division in the embodiments is an example, and is merely logical function division. In an actual implementation, another division manner may be used.

When each function module corresponding to each function is obtained through division, <FIG> is a schematic diagram of possible composition of an electronic device <NUM> in the foregoing embodiments. As shown in <FIG>, the electronic device <NUM> may include a display unit <NUM>, a communications unit <NUM>, and a processing unit <NUM>.

The display unit <NUM>, the communications unit <NUM>, and the processing unit <NUM> cooperate, and may be configured to support the electronic device <NUM> in performing the steps and the like in the foregoing methods <NUM> and <NUM>, and/or are used in another process of the technology described in this specification.

It should be noted that all related content of the steps in the foregoing method embodiments may be cited in function description of corresponding function modules.

The electronic device provided in this embodiment is configured to perform the address book-based device discovery method. Therefore, an effect the same as the effect of the foregoing implementation methods can be achieved.

When an integrated unit is used, the electronic device may include a processing module, a storage module, and a communication module. The processing module may be configured to control and manage actions of the electronic device, for example, may be configured to support the electronic device in performing the steps performed by the display unit <NUM>, the communications unit <NUM>, and the processing unit <NUM>. The storage module may be configured to support the electronic device to store program code, data, and the like. The communications module may be configured to support communication between the electronic device and another device.

The processing module may be a processor or a controller. The processing module may implement or execute various example logical blocks, modules, and circuits described with reference to content disclosed in this application. Alternatively, the processor may be a combination of processors implementing a computing function, for example, a combination of one or more microprocessors, or a combination of a digital signal processing (digital signal processing, DSP) and a microprocessor. The storage module may be a memory. The communications module may be specifically a device that interacts with another electronic device, such as a radio frequency circuit, a Bluetooth chip, or a Wi-Fi chip.

In an embodiment, when the processing module is a processor and the storage module is a memory, the electronic device in this embodiment may be a device in the structure shown in <FIG>.

An embodiment further provides a computer storage medium. The computer storage medium stores computer instructions. When the computer instructions are run on an electronic device, the electronic device is enabled to perform the foregoing related method steps, to implement the address book-based device discovery method and the audio and video communication method in the foregoing embodiments.

An embodiment further provides a computer program product. When the computer program product runs on a computer, the computer is enabled to perform the foregoing related steps, to implement the address book-based device discovery method and the audio and video communication method in the foregoing embodiments.

In addition, an embodiment of this application further provides an apparatus. The apparatus may be specifically a chip, a component, or a module. The apparatus may include a processor and a memory that are connected to each other. The memory is configured to store computer-executable instructions. When the apparatus runs, the processor may execute the computer-executable instructions stored in the memory, to enable the chip to perform the address book-based device discovery method and the audio and video communication method in the foregoing method embodiments.

The electronic device, the computer storage medium, the computer program product, and the chip provided in the embodiments are all configured to perform a corresponding method provided above. Therefore, for beneficial effects that can be achieved by the electronic device, the computer storage medium, the computer program product, or the chip, refer to beneficial effects of the corresponding method provided above.

The foregoing descriptions about implementations allow a person skilled in the art to understand that, for the purpose of convenient and brief description, division of the foregoing function modules is taken as an example for illustration. In actual application, the foregoing functions can be allocated to different modules and implemented based on a requirement, that is, an inner structure of an apparatus is divided into different function modules to implement all or some of the functions described above.

In the several embodiments provided in this application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the module or unit division is merely logical function division and may be other division in actual implementation. For example, a plurality of units or components may be combined or integrated into another apparatus, or some features may be ignored or not performed. In addition, the displayed or discussed mutual couplings or direct couplings or communication connections may be implemented through some interfaces.

The units described as separate parts may or may not be physically separate, and parts displayed as units may be one or more physical units, may be located in one place, or may be distributed on different places. Some or all of the units may be selected based on actual requirements to achieve the objectives of the solutions in the embodiments.

Claim 1:
A device discovery method performed by a first device, the method comprising the steps of:
• sending second account information of a second user for establishing an audio and video communication with the second user to a communication account server storing account list information,
wherein a contact list of the first device stores the second account information, and the account list information comprises the second account information and device identifiers of M second devices, wherein the M devices are associated with the second account information, and wherein M is a positive integer;
• receiving device identifiers of N second devices out of the M second devices from the communication account server, wherein N is less than or equal to M, N is a positive integer, and all the N second devices support audio and video communication, wherein the N second devices are devices whose device address book comprises a user corresponding to the first device; and
• updating the contact list of the first device based on the device identifiers of the N second devices, and displaying the N second devices in the contact list.