Patent ID: 12223219

DESCRIPTION OF EMBODIMENTS

This application provides a screen combination method. For a screened terminal device with a camera, a screen combination scenario can be automatically detected without using any other specific sensor or manual orientation configuration, and a relative orientation of a screen can be automatically calculated based on an orientation of an overlapping area of a picture taken by the camera, so as to complete a screen combination process, thereby providing a user with simple and intelligent screen splicing experience.

FIG.1Bis a schematic diagram of an architecture of a screen splicing system according to an embodiment of this application. As shown inFIG.1B, the system may include one or more electronic devices, for example, a router100, a television101, a television102, a television103, and a television104. The television101, the television102, the television103, and the television104may be connected to a same local area network (LAN) based on the router100. Certainly, the screen splicing system may further include more electronic devices. This is not limited in this application.

FIG.1Cis a schematic diagram of an architecture of another screen splicing system according to an embodiment of this application. The system may include one or more electronic devices, for example, a television101, a television102, a television103, and a television104as shown inFIG.1C. Every two of the television101, the television102, the television103, and the television104may be connected by using a short-range communication technology (for example, a Wi-Fi Direct technology or a Bluetooth technology). Certainly, the screen splicing system may further include more electronic devices. This is not limited in this application.

As shown inFIG.2A, a television101, a television102, a television103, or a television104may be a screen110. The screen110may include, a processor111, a memory112, a wireless communication processing module113, a power switch114, a wired LAN communication processing module115, an HDMI communication processing module116, a universal serial bus (universal serial bus, USB) communication processing module117, a display118, an audio module119, a speaker119A, a microphone119B, and the like.

The processor111may be configured to read and execute a computer-readable instruction. In specific implementation, the processor111may mainly include a controller, an arithmetic logical unit, and a register. The controller is mainly responsible for decoding an instruction and sending a control signal for an operation corresponding to the instruction. The arithmetic logical unit is mainly responsible for storing a register operand, an intermediate operation result, and the like that are temporarily stored during instruction execution. In specific implementation, a hardware architecture of the processor111may be an application-specific integrated circuit (ASIC) architecture, an MIPS architecture, an ARM architecture, an NP architecture, or the like.

In some embodiments, the processor111may be configured to parse a signal received by the wireless communication processing module113and/or a signal received by the wired LAN communication processing module115. The processor111may be configured to perform a corresponding processing operation based on a parsing result, for example, respond to a data request, or control displaying of the display118and/or control output of the audio module119based on a control request.

In some embodiments, the processor111may be further configured to generate a signal sent by the wireless communication processing module113and/or a signal sent by the wired LAN communication processing module115, for example, a Bluetooth broadcast signal or a beacon signal.

The memory112is coupled to the processor111, and is configured to store various software programs and/or a plurality of sets of instructions. In specific implementation, the memory112may include a high-speed random access memory, or may include a non-volatile memory, such as one or more magnetic disk storage devices, a flash memory device, or another non-volatile solid-state storage device. The memory112may store an operating system, for example, an embedded operating system such as uCOS, VxWorks, or RTLinux. The memory112may further store a communication program, where the communication program may be used to communicate with another device.

The wireless communication processing module113may include a Bluetooth (BT) communication processing module113A and a WLAN communication processing module113B.

In some embodiments, one or more of the Bluetooth (BT) communication processing module113A and the WLAN communication processing module113B may listen to a signal transmitted by another device, for example, a probe request or a scanning signal, and may send a response signal, for example, a probe response or a scanning response, so that the another device can discover the screen110, and establish a wireless communication connection to the another device, so as to communicate with the another device by using one or more of wireless communication technologies in Bluetooth or WLAN. The WLAN communication processing module113B may provide a WLAN communication solution including one or more of Wi-Fi Direct, Wi-Fi LAN, and Wi-Fi SoftAP.

In some other embodiments, the one or more of the Bluetooth (BT) communication processing module113A and the WLAN communication processing module113B may alternatively transmit a signal, for example, a broadcast Bluetooth signal or a beacon signal, so that another device can discover the screen110, and establish a wireless communication connection to the another device, so as to communicate with the another device by using one or more wireless communication technologies in Bluetooth or WLAN.

In some embodiments, the screen110may be connected to the Internet by using a WLAN wireless communication technology, to establish a communication connection to a server (for example, a channel identification server or a video-on-demand resource server) on the Internet.

The wireless communication processing module113may further include an infrared communication processing module113C. The infrared communication processing module113C may communicate with another device (for example, a remote control) by using an infrared remote control technology.

The power switch114may be configured to control a power supply to supply power to the display118.

The wired LAN communication processing module115may be configured to communicate with another device in a same wired LAN by using the LAN, and may be further configured to connect to a WAN by using the wired LAN, and communicate with a device in the WAN.

The HDMI communication processing module116may be configured to communicate with a device such as a set-top box through an HDMI port. For example, the HDMI communication processing module116may receive, through the HDMI port, media content sent by the set-top box, and the like.

The USB communication processing module117may be configured to communicate with another device through a USB interface.

The display118may be configured to display an image, a video, and the like. The display118may be a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (organic light-emitting diode, OLED) display, an active-matrix organic light emitting diode (active-matrix organic light emitting diode, AMOLED) display, a flexible light-emitting diode (flexible light-emitting diode. FLED) display, a quantum dot emitting diode (quantum dot emitting diode, QLED) display, or the like.

The audio module119may be configured to convert a digital audio signal into an analog audio signal for output, and may also be configured to convert an analog audio input into a digital audio signal. The audio module119may be further configured to encode and decode an audio signal. In some embodiments, the audio module119may be disposed in the processor111, or some functional modules in the audio module119are disposed in the processor111. The audio module119may transmit an audio signal to the wireless communication module113through a bus interface (for example, a UART interface), to implement a function of playing the audio signal through a Bluetooth speaker.

The speaker119A may be configured to convert an audio signal sent by the audio module119into a sound signal.

In some embodiments, the screen110may further include a microphone119B, which is also referred to as a “mike” or a “mic”, and is configured to convert a sound signal into an electrical signal. When sending a voice control instruction, a user may make a sound through the mouth, to input a sound signal to the microphone119B.

The camera120may be configured to capture a still image or a video.

It may be understood that the screen110may have more or fewer components than those shown inFIG.2A, may combine two or more components, or may have different component configurations. Components shown inFIG.2Amay be implemented by hardware including one or more signal processing or application-specific integrated circuits, software, or a combination of hardware and software.

As shown inFIG.2B, application packages may include applications such as Camera, Gallery. Calendar, Phone, Map, Navigation, WLAN, Bluetooth, Music, Video, and Messaging.

In this embodiment of this application, an application layer may further include a screen splicing management service, and the screen splicing management service is used to manage screen splicing (screen combination) between a plurality of devices. The screen splicing management service may be integrated into a system app or a third-party app, for example, an AI Life app, a smart interconnection app, or a setting app. This is not limited in this application.

An application framework layer provides an application programming interface (application programming interface, API) and a programming framework for an application at the application layer. The application framework layer includes some predefined functions.

As shown inFIG.2B, the application framework layer may include an activity manager, a window manager, a content provider, a view system, a resource manager, a notification manager, and the like. This is not limited in this embodiment of this application.

The activity manager (Activity Manager) is used to manage a lifecycle of each application. An application usually runs in an operating system in a form of an activity. For each activity, there is a corresponding application record (ActivityRecord) in the activity manager, and the ActivityRecord records a status of the activity of the application. The activity manager may use the ActivityRecord as an identifier to schedule an activity process of the application.

The window manager (WindowManagerService) is used to manage a graphical user interface (graphical user interface, GUI) resource used on a display, and may be specifically used to: obtain a display resolution, create and destroy a window, display and hide a window, arrange a window, manage a focus, manage an input method and wallpaper, and the like.

The system library and the kernel layer below the application framework layer may be referred to as an underlying system, and the underlying system includes an underlying display system for providing a display service. For example, the underlying display system includes a display driver at the kernel layer, a surface manager in the system library, and the like.

The content provider is used to store and obtain data, and enable the data to be accessed by an application. The data may include a video, an image, audio, calls that are made and answered, a browsing history and bookmarks, an address book, and the like. The view system includes visual controls such as a control for displaying a text and a control for displaying a picture. The view system may be used to construct an application. A display interface may include one or more views. For example, a display interface including an SMS message notification icon may include a text display view and a picture display view. The resource manager provides various resources for an application such as a localized character string, an icon, a picture, a layout file, and a video file. The notification manager enables an application to display notification information in a status bar, and may be used to convey a notification message. The notification manager may automatically disappear after a short pause without requiring a user interaction. For example, the notification manager is used to notify download completion, provide a message notification, and the like. The notification manager may alternatively be a notification that appears in a top status bar of the system in a form of a graph or a scroll bar text, for example, a notification of an application that runs on a background, or may be a notification that appears on the screen in a form of a dialog window. For example, text information is prompted in the status bar, an alert sound is played, the terminal vibrates, or the indicator light blinks.

As shown inFIG.2B, the Android runtime includes a core library and a virtual machine. The Android runtime is responsible for scheduling and management of the Android system. The core library includes two parts: a function that needs to be called in Java language and a core library of Android. The application layer and the application framework layer run on the virtual machine. The virtual machine executes Java files of the application layer and the application framework layer as binary files. The virtual machine is used to implement functions such as object lifecycle management, stack management, thread management, security and abnormality management, and garbage collection.

As shown inFIG.2B, the system library may include a plurality of functional modules, for example, a surface manager (surface manager), a media library (Media Library), an OpenGL ES, and an SGL.

The surface manager is used to manage a display subsystem and provide fusion of 2D and 3D layers for a plurality of applications.

The media library supports playback and recording in a plurality of commonly used audio and video formats, still image files, and the like. The media library may support a plurality of audio and video encoding formats such as MPEG-4, H.264, MP3, AAC, AMR, JPG, and PNG.

The OpenGL ES is used to implement three-dimensional graphics drawing, image rendering, composition, layer processing, and the like.

The SGL is a drawing engine for 2D drawing.

As shown inFIG.2B, the kernel layer is a layer between hardware and software. The kernel layer includes at least a display driver, a camera driver, an audio driver, and a sensor driver.

FIG.3Ais a schematic diagram of connection between a television101, a television102, a television103, and a television104is provided. The television101, the television102, the television103, and the television104each may include hardware modules such as a processor, a display, a camera, and a communication unit. The television101, the television102, the television103, and the television104may be connected to each other by using a communication unit, so as to perform communication.

FIG.3Bis another schematic diagram of connection between a television101, a television102, a television103, and a television104. The television101, the television102, the television103, and the television104each may include an application layer, an application framework layer, an Android runtime and system library, and a kernel layer. In this embodiment of this application, screen splicing may be automatically performed between the television101, the television102, the television103, and the television104by using a screen splicing management service.

The following describes technical solutions in the embodiments of this application with reference to accompanying drawings in the embodiments of this application. In the description of this application, unless otherwise specified, “at least one” means one or more, and “plurality” means two or more. In addition, to clearly describe the technical solutions in the embodiments of this application, terms such as “first” and “second” are used in the embodiments of this application to distinguish between same items or similar items that provide basically same functions or purposes. A person skilled in the art may understand that the words such as “first” and “second” do not limit a quantity or an execution sequence, and the words such as “first” and “second” do not indicate a definite difference.

For ease of understanding, the following describes screen combination methods provided in embodiments of this application in detail with reference to the accompanying drawings.

As shown in (a) inFIG.3C, a home screen300of the television101is shown. When the television101determines that a distance D1between the television101and the television102is less than or equal to a maximum combination radius R1corresponding to the television101and the television102(for a concept of the maximum combination radius, refer to related descriptions of step406abelow), as shown in (b) inFIG.3C, the television101may display a pop-up box301to inform the user that a nearby device is detected. The pop-up box301may include a Yes button302and a No button303, so that the user can select whether to perform screen combination. As shown in (c) inFIG.3C, in response to an operation of clicking the Yes button302(for example, clicking the button302by using a remote control or a touchscreen) by the user, as shown in (d) inFIG.3C, the user may be prompted that screen combination is being performed.

Optionally, the television101may also prompt the user with an identifier or an ID of the nearby device. For example, as shown inFIG.3D, the television101may display a pop-up box304to inform the user that a nearby device222xxx(222xxxis an ID of the television102) is detected. The pop-up box304may include a Yes button302and a No button303, so that the user can select whether to perform screen combination on a current device and a television in a living room.

It is assumed that display content of the television101and display content of the television102before splicing are respectively shown in (a) and (b) inFIG.3E. After screen splicing is performed, as shown in (c) inFIG.3E, the television101and the television102may jointly display a desktop of the television101(for example, the television101is a master device, and for a process of determining the master device, refer to related descriptions of step409below); or as shown in (d) inFIG.3E, the television101and the television102may separately display a desktop of the television101.

In some embodiments, if a television103is newly added to a screen group (for example, a first screen group) including the television101and the television102(that is, when the television101is spliced with the television102, the newly added television103needs to be further spliced with the television101and the television103). For example, as shown in (a) inFIG.3F, the television103may gradually approach the screen group including the television101and the television102; and then as shown in (b) inFIG.3F, the television101and the television102each may display a pop-up box305to inform the user that a device123xxx(123xxxis an ID of the television103) is detected. The pop-up box305may include a Yes button302and a No button303, so that the user can select whether to add the device to the screen group. Optionally, the television103may also prompt the user with an identifier or an ID of a nearby device. For example, the television103may display a pop-up box306to inform the user that a device111xxx(111xxxmay be an ID of the television101) is detected. The pop-up box306may include a Yes button302and a No button303, so that the user can select whether to perform screen combination. In response to an operation of clicking the Yes button302by the user, as shown in (c) inFIG.3F, the television101, the television102, and the television103may form a new screen group (for example, a second screen group).

In some embodiments, as shown in (a) inFIG.3G, the screen group including the television101, the television102, and the television103may jointly display corresponding display content. If the television103needs to be deleted from the screen group including the television101, the television102, and the television103(for example, the television103is removed after the television101, the television102, and the television103are spliced together), for example, as shown in (b) inFIG.3G, the television101and the television102each may display a pop-up box307to inform the user that it is detected that the device123xxxhas been removed from the current screen group. The pop-up box307may include an OK button308. In response to an operation of clicking the OK button308by the user, the television101determines that information in the pop-up box307is known to the user, and may hide the pop-up box307. Alternatively, the pop-up box307may be automatically hidden after being displayed for a few seconds (for example, 2 s), to avoid affecting the display content of the television101and the television102.

In some other embodiments, as shown in (a) inFIG.3H, a screen group including the television101, the television102, and the television103may jointly display corresponding display content. If the television103needs to be deleted from the screen group including the television101, the television102, and the television103(for example, the television103is removed after the television101, the television102, and the television103are spliced together), for example, as shown in (b) inFIG.3H, the television101, the television102, and the television103may maintain previous display content of the television101, the television102, and the television103, and the television101and the television102each may display a pop-up box309, to prompt the user to determine whether to remove the device123xxxfrom the current screen group. The pop-up box309may include an OK button310and a Cancel button311. In response to an operation of clicking the OK button310by the user, as shown in (c) inFIG.3H, the television101and the television102may jointly display corresponding display content (the display content of the television101and the display content of the television102may be determined by the processor of the television101(the master device)), and the television103independently displays corresponding display content (the display content of the television103may be determined by the processor of the television103). In addition, if the user clicks the Cancel button311, as shown in (b) inFIG.3H, the television101, the television102, and the television103may maintain the previous display content.

As shown inFIG.4AandFIG.4B, a specific implementation process of the screen combination method provided in this embodiment of this application is described by using an example in which screen splicing is performed on a television101and a television102, including the following procedure.

401: The television101starts a screen splicing management service.

After the television101is powered on, the screen splicing management service may be started. Herein, the screen splicing management service may be integrated into a system app or a third-party app on the television101, for example, an AI Life app, a smart interconnection app, or a settings app. This is not limited in this application.

402: The television102starts the screen splicing management service.

After the television102is powered on, the screen splicing management service may be started. For the screen splicing management service, refer to related descriptions of step401. Details are not described herein again.

403: The television101and the television102establish a network connection, and share device information of the television101and the television102.

In an implementation, the television101and the television102may access a same local area network, so as to establish a network connection between the television101and the television102.

After the television101starts the screen splicing management service, the screen splicing management service of the television101may complete, based on a short-range communication technology (for example, a Bluetooth/Wi-Fi proximity discovery technology), discovery of another nearby device (for example, the television102) on which the screen splicing management service is installed.

Similarly, after the television102starts the screen splicing management service, the screen splicing management service may discover another nearby screen device (for example, the television101) based on a short-range communication technology (for example, a Bluetooth/Wi-Fi proximity discovery technology).

In some embodiments, the television101and the television102may directly discover and connect to each other by using a technology such as Bluetooth/Wi-Fi Direct.

404a: The television101establishes a list of nearby devices.

The screen splicing management service of the television101may exchange information with the screen splicing management service of another device (for example, the television102) connected to the television101, to obtain the list of nearby devices. For example, the list of nearby devices established by the television101may be shown in Table 1.

TABLE 1Nearby Device (connected)MAC Address/IDTelevision 102MAC2/ID2

Certainly, the television101may further be connected to more devices, for example, may be connected to devices such as the television103and the television104. In this way, the list of nearby devices established by the television101may be shown in Table 2.

TABLE 2Nearby Device (connected)MAC Address/IDTelevision 102MAC2/ID2Television 103MAC3/ID3Television 104MAC4/ID4

Optionally, the television101may further obtain, from each device in the list of nearby devices, information about each device, such as a name, size information (for example, a length and a width of the device), and antenna information (an installation position of an antenna in the device, and a type, precision, and a size of the antenna).

404b: The television102establishes a list of nearby devices.

For example, the list of nearby devices established by the television102may be shown in Table 3.

TABLE 3Nearby Device (connected)MAC Address/IDTelevision 101MAC1/ID1

Certainly, the television102may further be connected to more devices, for example, may be connected to devices such as the television103and the television104. In this way, the list of nearby devices established by the television102may be shown in Table 4.

TABLE 4Nearby Device (connected)MAC Address/IDTelevision 101MAC1/ID1Television 103MAC3/ID3Television 104MAC4/ID4

Optionally, the television102may further obtain, from each device in the list of nearby devices, information about each device, such as a name, size information (for example, a length and a width of the device), and antenna information (an installation position of an antenna in the device, and a type, precision, and a size of the antenna).

405: The television101and the television102send a short-range signal to each other.

In a possible design, the television101may separately measure a distance between the television101and each device in the list of nearby devices by using a short-range communication technology (for example, a Bluetooth/Wi-Fi signal ranging technology). For example, the television101may obtain a distance D1between two devices based on a received signal strength indicator (received signal strength indicator, RSSI) of a short-range signal sent by the television102.

The television102may measure a distance between the television102and each device in the list of nearby devices of the television102. For example, the television102may obtain the distance D1between the two devices based on an RSSI of a short-range signal sent by the television101. Alternatively, the television101may inform the television102of the measured distance D1.

406a: The television101determines that a distance D1between the television101and the television102is less than or equal to a maximum combination radius R1corresponding to the television101and the television102.

The television101may measure a distance between the television101and each device in the list of nearby devices, and determine a distance between every two devices (two devices) and a maximum combination radius corresponding to the every two devices.

For example, the television101may measure the distance D1between the television101and the television102and determine a value of D1and a maximum combination radius R1between the television101and the television102.

The maximum combination radius corresponding to the television101and the television102may be determined based on sizes of the two devices (the television101and the television102) and positions of antennas. The antenna may be, for example, a Bluetooth antenna or a Wi-Fi antenna.

For example, as shown in (a) inFIG.5, it is assumed that two devices (for example, a television101and a television102) have a same size, a height of h, and a width of w, where w≥h; and an upper left corner of each device is considered as coordinates (0, 0) of a coordinate system, coordinates of a center point of each screen are (x, y), and coordinates of each antenna may be (x1, y1). Precision of an antenna distance identification may be a centimeters.

In a scenario in which two devices are combined left and right, assuming that the antenna is located in the middle of each device in a vertical direction, that is, y1=y and x1>x, a combination radius corresponding to the two devices is w+2*(x1−x)+2*a. Similarly, in a scenario in which two devices are combined from top to bottom, it is assumed that an antenna is located in the middle of a horizontal direction of each device, that is, x1=x, and y1>y, a combination radius corresponding to the two devices is h+2*(y1−y)+2*a.

As shown in (b) inFIG.5, in a scenario in which two devices are diagonally combined, it is assumed that each of antennas is located at an edge of the corresponding device, for example, the antennas are respectively located in the upper left and the lower right. In this case, a combination radius corresponding to the two devices is 2*r+2*d+2*a, where d is a distance between the antenna and a center point of the device, and d=√{square root over ((x1−x)2+(y1−y)2)}; and r is a maximum distance between the center point of each device and an edge, and

r=(w2)2+(h2)2.

It may be understood that the combination radius corresponding to the two devices in the diagonal splicing scenario is the largest. To ensure that the combination radius is effective as much as possible, the maximum combination radius corresponding to the two devices may be R1=2*r+2*d+2*a. That is, the maximum combination radius corresponding to the two devices may be determined based on the distance between the television101and the television102in the diagonal splicing scenario.

The foregoing has described a method for calculating the maximum combination radius corresponding to two devices of the same size. If two devices of different sizes are combined, as shown in Table 5, assuming that size parameters corresponding to a device1are r1 and d1, and size parameters corresponding to a device2are r2 and d2, a maximum combination radius of the device1and the device2is R2=(r1+r2)+(d1+d2)+2*a. r1 is a maximum distance from a center point of the device1to an edge, and d1 is a distance between an antenna of the device1and the center point of the device1; r2 is a maximum distance from a center point of the device2to an edge, and d2 is a distance between the antenna of the device2and the center point of the device2; and precision of antenna distance identification is a centimeters.

TABLE 5Screen SizeScreen SizeMaximum Combination Radiusof theof theBetween the First DeviceFirst DeviceSecond Deviceand the Second Devicer, dr, dR1 = 2*r + 2*d + 2*ar1, d1r2, d2R2 = (r1 + r2) + (d1 + d2) + 2*a

If the distance between the television101and the television102is less than or equal to the maximum combination radius corresponding to the television101and the television102, it indicates that the two devices have an assembly intention (a combination intention) or are in an assembled state (a combined state).

The following uses an example in which the television101and the television102have a same size. When the television101determines that the distance between the television101and the television102is less than or equal to R1, the television101and the television102may be marked as a ready-to-combine state (a ready-to-splice state). That is, when the television101determines that the distance (placement interval) between the television101and the television102is less than or equal to the maximum combination radius R1corresponding to the television101and the television102, it is determined that the television101and the television102have a combination intention and may be prepared for combination. The television101may group and organize devices that are marked as a combination preparation state, to form a screen combination preparation device group, that is, the television101and the television102may form a screen combination preparation device group.

The television101may further measure a distance D2between the television101and the television103, and determine a value of D2and a maximum combination radius R2between the television101and the television103. The television101may further measure a distance D3between the television101and the television104, and determine a value of D3and a maximum combination radius R3between the television101and the television104. For a specific process, refer to the foregoing related descriptions. Details are not described herein again.

406b: The television102determines that the distance D1between the television101and the television102is less than or equal to the maximum combination radius R1corresponding to the television101and the television102.

The television102may measure a distance between the television102and each device in the list of nearby devices, and determine a distance between every two devices and a maximum combination radius corresponding to the every two devices.

For a specific process, refer to related descriptions of step406a. Details are not described herein again.

406c: The television102sends first information to the television101, where the first information includes distance information obtained by the television102through measurement.

The television101may receive the first information from the television102, where the first information may include a distance between the television102and each device in a list of nearby devices of the television102, and/or a result that is determined by the television102and that is of a comparison between a distance between every two devices and a maximum combination radius corresponding to the every two devices.

Optionally, the television101may further receive, from another device, distance information and/or a comparison result obtained by the another device through measurement.

For another example, the television101may further receive the second information from the television103. The second information may include a distance between the television103and each device in a list of nearby devices of the television103, and/or a result that is determined by the television103and that is of a comparison between a distance between every two devices and a maximum combination radius corresponding to the every two devices.

For still another example, the television101may further receive third information from the television104. The third information may include a distance between the television104and each device in the list of nearby devices of the television104, and/or a result that is obtained by the television104and that is of a comparison between a distance between every two devices and a maximum combination radius corresponding to the every two devices.

In this way, the television101may determine a distance between every two devices (two devices) in a current local area network, and/or a result of a comparison between the distance between every two devices and the maximum combination radius corresponding to the two devices, so that the television101may determine a plurality of devices that currently need to be spliced together, and the plurality of devices that need to be spliced together may form a screen group.

It should be understood that a same local area network may include a plurality of screen combination preparation device groups (screen groups for short), each screen group may include at least two devices, the at least two devices may be spliced together, and the at least two devices may be directly or indirectly connected. For example, the television101and the television102may form a screen group, and the television101and the television102may be directly connected (the distance D1between the television101and the television102is less than or equal to the maximum combination radius corresponding to the television101and the television102).

406d: The television101sends the second information to the television102, where the second information includes distance information obtained by the television101through measurement.

For a specific process, refer to step406c. Details are not described herein again.

If the television101determines that the distance D1between the television101and the television102is less than the maximum combination radius R1corresponding to the television101and the television102, that is, determines that the television101and the television102need to form a screen group, the television101may perform step407.

407: The television101displays first prompt information, where the first prompt information is used to prompt the user to determine whether to perform screen combination.

The user may set a screen combination policy on the television101in advance, for example, may set automatic screen combination or manual screen combination.

If the user sets automatic screen combination, the television101may automatically start a screen combination/splicing detection program by using a short-range communication technology. The screen combination/splicing detection program detects whether a distance between every two devices is less than or equal to a maximum combination radius corresponding to the two devices, so as to determine whether screen combination/splicing needs to be performed. Optionally, the screen combination/splicing detection program may be automatically started in specific scenarios such as power-on and standby wake-up.

If the user sets manual screen combination, the user may access a screen splicing management service of an application, for example, an AI Life app, a smart interconnection app, or a setting application, and start a screen combination/splicing detection program manually (for example, by clicking a specific control). The television101may provide an interface prompt, and determine, according to an operation of the user, whether to perform screen combination. In this way, an error caused by automatic triggering of screen combination can be avoided.

For example, as shown in (a) inFIG.3C, a home screen300of the television101is shown. When the television101determines that a distance D1between the television101and the television102is less than or equal to a maximum combination radius R1corresponding to the television101and the television102, as shown in (b) inFIG.3C, the television101may display a pop-up box301to inform the user that a nearby device is detected. The pop-up box301may include a Yes button302and a No button303, so that the user can select whether to perform screen combination.

Optionally, the television101may also prompt the user with an identifier or an ID of a nearby device. For example, as shown inFIG.3D, the television101may display a pop-up box304to inform the user that a nearby device222xxx(222xxxis an ID of the television102) is detected. The pop-up box304may include a Yes button302and a No button303, so that the user can select whether to perform screen combination on a current device and a television in a living room.

Optionally, the television102may also display the first prompt information. When the television101and the television102each provide an interface prompt for the user to select whether to perform screen combination, if the user has confirmed on one device (for example, has confirmed on the television101), the television101may send confirmation information of the user to the television102, and the user does not need to confirm on the devices one by one.

In some embodiments, any device (for example, the television101) in the screen group may provide an interface prompt (for example, display the first prompt information), so that the user can select whether to perform screen combination, that is, the television102may no longer provide an interface prompt.

408a: The user clicks a button for agreeing to perform screen combination.

For example, as shown in (c) inFIG.3C, in response to the operation of clicking the Yes button302(for example, clicking the button302by using a remote control or a touchscreen) by the user, as shown in (d) inFIG.3C, the user may be prompted that screen combination is being performed. In response to the operation of clicking, by the user, the button for agreeing to perform screen combination, step409may be performed. Alternatively, if the user sets automatic screen combination, in this case, step409may be directly performed without a need to prompt whether to perform screen combination on an interface (that is, neither step407nor step408needs to be performed).

409: The television101and the television102form a screen group, and the television101is elected as a master device.

The television101may perform weighted scoring on resources of the devices according to resource conditions of the devices in the current screen group, sequence the resources in descending order of resource scores, and use a device with a highest real-time resource score as the master device. The resource condition of the device may include hardware resource capabilities such as a central processing unit (central processing unit, CPU)/read-only memory (read only memory, ROM)/random access memory (random access memory. RAM). After the master device is determined, other devices in the screen group may be used as slave devices. For example, if the television101may be used as a master device, the television102may be used as a slave device.

Optionally, the user may manually select the master device. For example, the user may start a device setting application to select the master device. Alternatively, after the master device is automatically elected, the television101may display a pop-up box to prompt the user of an identifier of the current master device (for example, the user may be reminded that the current master device is a television in a living room (that is, the television101)). The user may click an OK button in the pop-up box to confirm that the television101is used as a master device, or the user may click a modification button in the pop-up box to modify the master device. In this case, when the television101is used as the master device, it may be understood that the television101includes a host for controlling a screen group and a screen for displaying an image, and the host is integrated into the television101.

The following uses an example in which the television101is a master device for description

410: The master device sends a first notification message to the television102, where the first notification message is used to instruct the television102to take a photo and perform orientation identification.

For example, in a scenario in which the television101and the television102need to be combined, the master device (that is, the television101) may take a photo by using a camera, and the television101may send the first notification message to the television102, where the first notification message is used to instruct the television102to take a photo (image/picture) by using the camera, and instruct the television102to perform orientation identification according to the taken photo and a photo obtained from another device.

411a: The television101takes a photo.

The television101may control, by using the screen splicing management service, a camera of the television101to take a photo.

411b: After receiving the first notification message, the television102takes a photo.

The television102may control, by using the screen splicing management service, a camera of the television102to take a photo. The television101and the television102may negotiate to take photos at a same moment.

412a: The television101sends the photo taken by the television101to the television102.

412b. The television102sends the photo taken by the television102to the television101.

412c: The television101determines an orientation relationship between the television101and the television102according to the photo taken by the television101and the photo taken by the television102.

After receiving, from the television102, the photo taken by the television102, the television101may perform, by using an image matching algorithm, image matching (comparison) on the photo taken by the television101and the photo taken by the television102, to determine an overlapping area (that is, a similar image part/image content) between the two photos. Image matching is to determine an overlapping part of the two photos by analyzing correspondences between the two photos in terms of image content, feature, structure, relationship, texture, grayscale, and the like and analyzing similarity and consistency between the two photos.

For example, the image matching algorithm may include scale-invariant feature transform (scale invariant feature transform. SIFT), speeded up robust features (speeded up robust features, SURF), a fast nearest neighbor search algorithm (Flann-based matcher), and the like.

Then, the television101may determine a relative position relationship (a relative orientation relationship) between the television101and the television102based on a position of the overlapping area in the photo taken by the television101. That is, the relative position relationship between the television101and the television102is determined based on a mapping relationship between a position of an overlapping area and a photographing orientation. The relative orientation relationship between the television101and the television102may be, for example, that the television101is located in a direction such as upper, lower, left, right, upper left, lower left, upper right, or lower right of the television102. Alternatively, the relative orientation relationship between the television101and the television102may be that the television102is located in a direction such as upper, lower, left, right, upper left, lower left, upper right, or lower right of the television101.

The splicing mode of the television101and the television102may include three modes: up-down splicing, left-right splicing, and diagonal splicing. For example, when the television101is located above or below the television102, the splicing mode of the television101and the television102may be up-down splicing; or when the television101is located to the left or right of the television102, the splicing mode of the television101and the television102may be left-right splicing; or when the television101is located in the upper left, lower left, upper right, or lower right of the television102, the splicing mode of the television101and the television102may be diagonal splicing.

For example, as shown inFIG.6, a dashed box represents a photo taken by the screen television101, and a solid box represents the photo taken by the screen television102. In this case, an orientation of the screen television101relative to the screen television102is shown in Table 6.

TABLE 6Splicing/CombinationUp-Left-Up-Left-ModedownDiagonalrightDiagonaldownDiagonalrightDiagonalOrientation ofUpperUpperRightLowerLowerLowerLeftUpperthe televisionrightrightleftleft101 relative tothe television102Position of theLowerLowerLeftUpperUpperUpperRightLoweroverlappinghalflefthalflefthalfrighthalfrightarea in theareacornerareacornerareacornerareaareaphoto takenby thetelevision 101Position of theUpperUpperRightLowerLowerLowerLeftUpperoverlappinghalfrighthalfrighthalflefthalfleftarea in theareacornerareacornerareacornerareaareaphoto takenby thetelevision 102

For example, as shown in (a) inFIG.6, if the overlapping area is located in a lower right area (lower right corner) of the photo taken by the television101and is located in an upper left area (upper left corner) of the photo taken by the television102, it is determined that the television101is located to the upper left (at the upper left corner) of the television102. As shown in (b) inFIG.6, if the overlapping area is located in a lower half area of (right below) the photo taken by the television101and is located in an upper half area of (right above) the photo taken by the television102, it is determined that the television101is located above (right above) the television102. As shown in (c) inFIG.6, if the overlapping area is located at the lower left corner (in the lower left) of the photo taken by the television101and is located at the upper right corner (in the upper right) of the photo taken by the television102, it is determined that the television101is located to the upper right (at the upper right corner) of the television102. As shown in (d) inFIG.6, if the overlapping area is located in the right half area of the photo taken by the television101and is located in the left half area of the photo taken by the television102, it is determined that the television101is located to the left of the television102. As shown in (e) inFIG.6, if the overlapping area is located in the left half area of the photo taken by the television101and is located in the right half area of the photo taken by the television102, it is determined that the television101is located to the right of the television102. As shown in (f) inFIG.6, if the overlapping area is located at an upper right corner of the photo taken by the television101and is located at a lower left corner of the photo taken by the television102, it is determined that the television101is located to the lower left of the television102. As shown in (g) inFIG.6, if the overlapping area is located in the upper half area of the photo taken by the television101and is located in the lower half area of the photo taken by the television102, it is determined that the television101is located below the television102. As shown in (h) inFIG.6, if the overlapping area is located at an upper left corner (lower left) of the photo taken by the television101and is located at lower right corner (lower right) of the photo taken by the television102, it is determined that the television101is located to the lower right (at the lower right corner) of the television102.

In a possible design, image matching may be performed on the photo taken by the television101and the photo taken by the television102, to identify an overlapping area between the two photos. Then, orientations of the overlapping area in the photo taken by the television101and the photo taken by the television102are separately calculated, and then a relative position relationship between the television101and the television102is detected by searching Table 6. For example, the overlapping area is in a lower half area of the photo taken by the television101, and an orientation of the television101relative to the television102is upper, that is, the television101is located above the television102.

In another possible design, a photo taken by each device (for example, the television101or the television102) may be divided into several sub-areas (for example, 6, 9, or 12, which is not limited in this application); matching is performed between each sub-area in the photo taken by the television101and each sub-area in the photo taken by the television102, to determine a number of each matched sub-area; orientations of each matched sub-area in the photo taken by the television101and the photo taken by the television102are determined according to the number of each matched sub-area; and then a relative position relationship between the television101and the television102is detected by searching Table 6.

For example, as shown inFIG.7, it is assumed that the photo taken by the television101may be divided into six sub-areas: 1, 4, 7, 2, 5, and 8; and the photo taken by the television102may be divided into six sub-areas: 2, 5, 8, 3, 6, and 9. It can be learned that the matched sub-areas include 2, 5, and 8. Because 2, 5, and 8 are located in the right half area of the photo taken by the television101, it can be learned, by searching Table 6, that the television101is located to the left of the television102, that is, the television102is located to the right of the television101. Alternatively, because 2, 5, and 8 are located in the left half area of the photo taken by the television102, it can be learned, by searching Table 6, that the television101is located to the left of the television102, that is, the television102is located to the right of the television101.

In still another possible design, in a process of identifying a relative orientation relationship between devices whose screens are to be combined/spliced, a specific identification object, such as a face, a human body action, a specific object, or an appliance, may be added to a field of view of a camera of the device.

For example, after the screen combination assembly program starts, an operation prompt may be first displayed on the television101and/or the television102, so that the user ensures that a specific identification object (for example, a face) can be seen in a picture of a camera of the television101and/or the television102, and then a relative orientation relationship between the devices is determined according to a position of the face in a photo taken by the television101and/or a photo taken by the television102.

It should be noted that the position of the specific identification object in the photo taken by each device may have latitudes in a plurality of directions, for example, may include upper and lower latitudes and left and right latitudes. The latitudes in the same direction may be ignored, and the latitudes in different directions may be used as the basis for determining the orientation relationship between the devices. For example, as shown inFIG.8, it is assumed that sub-areas of the photo taken by the television101include 1, 2, 4, 5, 7, and 8, sub-areas of the photo taken by the television101and sub-areas of the photo taken by the television102include 8 and 2, 3, 5, 6, 8, and 9, and a face is located in an area2. Because the area2is located to the upper right of the photo taken by the television101, and the area2is located to the upper left of the photo taken by the television102, it may be determined, by searching Table 7, that the television101is located to the left of the television102. That is, the latitudes in the same direction are ignored (that is, the latitudes in the “upper” direction in the upper right and upper left are ignored), and the latitudes in the left and right directions are used as the basis for determining the orientation relationship between the devices.

TABLE 7Splicing/CombinationLeft-rightLeft-rightModeOrientation of the televisionRightLeft101 relative to thetelevision 102Position of the specificLeftLowerUpperRightLowerUpperidentification object in ahalfleftlefthalfrightrightphoto taken by theareacornercornerareacornercornertelevision 101Position of the specificRightLowerUpperLeftLowerUpperidentification object in ahalfrightrighthalfleftleftphoto taken by theareacornercornerareacornercornertelevision 102

Optionally, a related program may be preset in the screen splicing management service, to prompt the user to provide a cooperation measure through screen display, sound prompt, or the like, so as to accelerate identification of a specific position by the camera, thereby accelerating identification of a relative position of a picture. Alternatively, a specific image input is provided to a camera of a device to mark an orientation of the corresponding device.

412d: Optionally, the television102determines an orientation relationship between the television101and the television102according to a photo taken by the television102and a photo taken by the television101.

For a specific process, refer to the description in step412a. Content such as an execution body may be simply replaced, and details are not described herein again.

412e: The television102sends, to the television101, the orientation relationship between the television101and the television102that is determined by the television102.

413a: The master device determines relative orientation relationships between all devices in the screen group.

The master device may collect and summarize information about the relative orientation relationship between every two devices in the screen group, perform unified orchestration in a coordinate system according to the orientation information, and record information such as a number and coordinates for each device.

Orientations of all devices in the screen group may be represented by using an array, for example, may be (a device1, a device2, a direction of the device1relative to the device2). For example, it is assumed that the screen group includes only the television101and the television102, and an orientation of the television101relative to the television102may be (the television101, the television102, above), indicating that the television101is located above the television102. Alternatively, an orientation of the television102relative to the television101may be (the television102, the television101, down), indicating that the television102is located below the television101.

As shown in (a) inFIG.9, if the master device determines that the orientation of the television101relative to the television102is (the television101, the television102, left), that is, the television101is located to the left of the television102, the television101and the television102may be arranged in the coordinate system from left to right, and the television101and the television102may be arranged as “(1), (2)”, that is, the television101and the television102are respectively arranged from left to right.

As shown in (b) inFIG.9, if the master device determines that an orientation of the television101relative to the television102is (the television101, the television102, up), that is, the television101is located above the television102, the television101and the television102may be arranged in a downlink direction in the coordinate system, and the television101and the television102may be arranged as “(1), (2)”, that is, the television101and the television102are respectively arranged from top to bottom.

In a possible design, the master device may number the devices in a screen group one by one in a direction from upper left to lower right. For example, the devices spliced together may be arranged into an n*m matrix, where n may represent a row, m may represent a column, n is an integer greater than or equal to 1, m is an integer greater than or equal to 1, and n and m are not both1. For example, as shown in (a) inFIG.9, it is assumed that n=1 and m=2. During encoding, encoding may start from the top device in the first column. After encoding of the devices in the first column is completed, encoding may start from the top device in the second column until encoding of the devices in the second column is completed. In this way, encoding of n*m devices may be completed. For another example, as shown in (b) inFIG.9, it is assumed that n=2 and m=1. During encoding, encoding may start from the leftmost device in the first row. After encoding of the devices in the first row is completed, encoding may start from the leftmost device in the second row until encoding of the devices in the second row is completed. In this way, encoding of n*m devices may be completed.

413b: The master device synchronizes basic screen group splicing information to the television102.

The master device may synchronize the basic screen group splicing information to all devices in the screen group. Each device in the screen group may receive a synchronization message sent by the master device. The synchronization message includes the basic screen group splicing information. The basic screen group splicing information includes a quantity of devices included in the screen group, a MAC address/an ID of each device, master-slave information (that is, information about the master device and the slave device), information about an orientation relationship between devices, and the like. For example, the current basic screen group splicing information may include the quantity (for example, 2) of the devices included in the screen group, the MAC address/ID of each device (for example, IDs of the television101and the television102), the master-slave information (for example, the master device is the television101, and the slave device is the television102), and the information about the orientation relationship between devices (for example, the television101and the television102are in a left-right splicing state).

After each device in the screen group receives the synchronization message sent by the master device, a heartbeat link may be established between every two devices, so as to maintain a combination relationship between the devices in real time. For example, it is assumed that the heartbeat link is established between the television101and the television102. If the television101may send a heartbeat monitoring data frame (which may also be referred to as a heartbeat packet) to the television102at an interval of one minute (or 30 s, 2 minutes, 3 minutes, or the like), and the television102may send a response frame after receiving the heartbeat monitoring data frame, the television101determines that the connection is normal, otherwise, it indicates that the connection is disconnected or abnormal.

414a: The television101separately determines display information of the television101and display information of the television102according to the basic screen group splicing information.

The television101may separately determine the display information of the television101and the display information of the television102according to the basic screen group splicing information. That is, in a running process of a screen group system, the master device may implement, based on the basic screen group splicing information, picture output display arrangement of the screen group, interface focus switching, and the like.

414b: The television101sends the display information of the television102to the television102.

414c: The television101displays a corresponding display picture according to the display information of the television101.

414d: The television102displays a corresponding display picture according to the display information of the television102.

For example, the television101may divide the display content of the television101into N parts (for example, two parts), and then allocate the N parts to each device (for example, the television101itself and the television102) in the screen group, where N is less than or equal to a quantity of devices included in the screen group.

For example, it is assumed that display content of the television101and display content of the television102before splicing are respectively shown in (a) and (b) inFIG.3E. After splicing, as shown in (c) inFIG.3E, the television101and the television102may jointly display a desktop of the master device (for example, the television101); or as shown in (d) inFIG.3E, the television101and the television102may separately display a desktop of the master device (for example, the television101).

It should be noted that, in a process of using the screen combination, each device in the screen group may continuously detect an increase or decrease of a device, and update basic screen group splicing information. Adding devices may mean that new devices are added to the current screen group. Reducing devices may mean that some devices are actively disassembled or removed from the current screen group, or some devices passively get offline due to power-off. The television101may detect, through short-range communication, whether a new device is added. The television101may detect, according to the heartbeat link, whether the peer device is offline. Alternatively, the television101may determine, through short-range communication detection, whether a device is offline. Alternatively, the user may manually remove a device on a management interface.

In some embodiments, if a television103is newly added to a screen group including the television101and the television102, as shown inFIG.10AtoFIG.10C, the screen group splicing method may further include the following steps.

415a: Send a short-range signal between the television101and the television102.

The short-range signal may be periodically sent between the television101and the television102.

415b: Send a short-range signal between the television102and the television103.

The short-range signal may be periodically sent between the television102and the television103.

415c: The television101/the television102determines, according to the short-range signal, that the television103needs to be added to the current screen group.

The television101may measure a distance between the television101and the television103according to the short-range signal, and the television102may measure a distance between the television102and the television103according to the short-range signal.

If one of the following conditions is met, it may be considered that the television103needs to be added to the current screen group. (1) The distance D2between the television101and the television103is less than or equal to a corresponding maximum combination radius R2between the television101and the television103, that is, D2≤R2; and (2) The distance D4between the television102and the television103is less than or equal to the corresponding maximum combination radius R4between the television102and the television103, that is, D4≤R4.

The television101compares the distance D2between the television101and the television103and the corresponding maximum combination radius R2between the television101and the television103. Optionally, the television101may further obtain, from the television102, information about the distance D4between the television102and the television103and information about the corresponding maximum combination radius R4between the television102and the television103.

If the television101determines that the distance D2between the television101and the television103is less than or equal to the maximum combination radius R2between the television101and the television103, that is, D2≤R2, the television101determines that the television101, the television102, and the television103may form a screen group. For a process of determining the maximum combination radius R2between the television101and the television103, refer to related descriptions of step406a. Details are not described herein again.

The television102may compare the distance D4between the television102and the television103and the corresponding maximum combination radius R4between the television102and the television103. If D4>R4, the television102may further obtain, from the television101, information that D2is less than or equal to R2, to determine that the television103needs to be added to the current screen group.

For example, in a scenario in which three devices such as the television101, the television102, and the television103are combined, the television101and the television102may be within a corresponding maximum combination radius (that is, the maximum combination radius corresponding to the television101and the television102); the television101and the television103may be within a corresponding maximum combination radius (that is, the maximum combination radius corresponding to the television101and the television103); and the television102and the television103may not be within a corresponding maximum combination radius (that is, the maximum combination radius corresponding to the television102and the television103). That is, the television103may be indirectly spliced with the television102(the distance D2between the television103and the television102is greater than the maximum combination radius corresponding to the television103and the television102); and the television103may be directly spliced with the television101(the distance D3between the television103and the television101is less than or equal to the maximum combination radius corresponding to the television103and the television101). Because the television101and the television102are spliced together, and the television101and the television103are spliced together, the television101, the television102, and the television103are spliced together.

Every two of the television101, the television102, and the television103may perform orientation identification (that is, identify a splicing mode of every two devices). For example, the television101and the television102may perform orientation identification according to a photographed photo (that is, identify whether the television101and the television102may be spliced vertically, horizontally, or diagonally); the television101and the television103may perform orientation identification according to the photographed photo; and the television102and the television103may perform orientation identification according to the photographed photo.

It should be noted that, if the television103is a device that has joined the local area network, the television101/the television102may directly perform step416a. If the television103is a device newly added to the local area network, the television101and the television102may establish a connection to the television103based on the local area network and discover each other based on a short-range communication technology; or the television101and the television102may establish a direct connection to the television103; the television101and the television102may update a list of nearby devices, and the television103may create a list of nearby devices; and then the television101/the television102may perform step416a.

416a: The television101and the television102display second prompt information, where the second prompt information is used to inform the user that a new device is detected in the current screen group.

For example, as shown in (b) inFIG.3F, the television101and the television102each may display a pop-up box305to inform the user that a device123xxx(123xxxis an ID of the television103) is detected. The pop-up box305may include a Yes button302and a No button303, so that the user can select whether to add the device to the screen group. Optionally, the television103may also prompt the user with an identifier or an ID of a nearby device. For example, the television103may display a pop-up box306to inform the user that a device111xxx(111xxxmay be an ID of the television101) is detected. The pop-up box306may include a Yes button302and a No button303, so that the user can select whether to perform screen combination on the current device and the television103.

416b: The user clicks a button for agreeing to add the newly added device to the screen group.

In response to the operation of clicking, by the user, the button for agreeing to add the newly added device to the screen group, step417may be performed.

417: The television101, the television102, and the television103form a screen group, and the television101is elected as the master device.

For a process of electing the master device, refer to the descriptions in step409. Details are not described herein again. In this case, when the television101is used as the master device, it may be understood that the television101includes a host for controlling a screen group and a screen for displaying an image, and the host is integrated into the television101.

The following uses the television101as the master device for description.

418a: The television101sends a first notification message to the television102.

The first notification message is used to instruct the television102to take a photo and perform orientation identification according to the photo taken by the television102and a photo obtained from another device.

418b: The television101sends a second notification message to the television103.

The second notification message is used to instruct the television103to take a photo and perform orientation identification according to the photo taken by the television103and a photo obtained from another device.

419a: The television101takes a photo.

The television101may control, by using the screen splicing management service, a camera of the television101to take a photo.

419b: After receiving the first notification message sent by the master device, the television102takes a photo.

The television102may control, by using the screen splicing management service, a camera of the television102to take a photo. The television101and the television102may negotiate to take photos at a same moment.

419c: After receiving the second notification message sent by the master device, the television103takes a photo.

The television103may control, by using the screen splicing management service, a camera of the television103to take a photo. The television101and the television103may negotiate to take photos at a same moment.

It may be understood that the television101, the television102, and the television103may negotiate to take photos at a same moment.

The photos taken by the television101, the television102, and the television103may be shared, that is, steps419dto419imay be performed.

419d: The television101sends the photo taken by the television101to the television102.

419e: The television102sends the photo taken by the television102to the television103.

419f: The television102sends the photo taken by the television102to the television101.

419g: The television103sends the photo taken by the television103to the television102.

419h: The television101sends the photo taken by the television101to the television103.

419i: The television103sends the photo taken by the television103to the television101.

420a: The television101separately obtains the photos taken by the television102and the television103, and identifies an orientation relationship between the television101and the television102and an orientation relationship between the television101and the television103.

For a corresponding orientation identification process, refer to related descriptions of step412a. Details are not described herein again.

420b: The television102separately obtains the photo taken by the television101and the photo taken by the television103, and identifies an orientation relationship between the television102and the television101and an orientation relationship between the television102and the television103.

For a corresponding orientation identification process, refer to related descriptions of step412a. Details are not described herein again.

420c: The television103separately obtains the photo taken by the television101and the photo taken by the television102, and identifies an orientation relationship between the television103and the television101and an orientation relationship between the television103and the television102.

For a corresponding orientation identification process, refer to related descriptions of step412a. Details are not described herein again.

420d: The television102sends the orientation relationship between the television102and the another device to the television101.

420e: The television103sends the orientation relationship between the television103and the another device to the television101.

421: The master device determines relative orientation relationships between all devices in the screen group.

For example, the relative orientation relationship between the television101and the television102may be, for example, that the television101is located in a direction such as upper, lower, left, right, upper left, lower left, upper right, or lower right of the television102.

If the screen group includes more than two devices, the relative orientations between the devices are identified. Every two devices located within a maximum combination radius (that is, a distance between two devices is less than or equal to a maximum combination radius corresponding to the two devices) may be considered as a screen group with a same radius, and an orientation of each device relative to another device may be identified by identifying a relative orientation of each screen group with a same radius.

For example, it is assumed that the screen group includes three devices: a television101, a television102, and a television103. A relative orientation relationship between every two devices can be identified, so that orientations of each device relative to other devices can be identified.

As shown inFIG.11A, for example, three devices, namely the television101, the television102, and the television103, are horizontally arranged. It is assumed that a sequence of identifying every two devices from left to right is as follows: the television103and the television101, and the television101and the television102. A sequencing process of determining the three devices may be as follows: It is determined that the television103is located on the leftmost side of the other two devices (the television101and the television102) by traversing an orientation relationship between every two devices; then it is determined that the television101is located on the leftmost side of another device (the television102) by traversing an orientation relationship between every two devices; then it is determined that the television102is located on the rightmost side by traversing an orientation relationship between every two devices; and finally, it is determined that the three devices, namely the television103, the television101, and the television102, are sequenced as “(1), (2), (3)”, that is, the television103, the television101, and the television102are respectively arranged from left to right.

In some cases, information about an orientation relationship between some devices is redundant, and the information may not be used, or an identification result may be checked with reference to the redundant information. As shown inFIG.11A, orientations of an overall screen group are identified based on the orientation relationship between the television103and the television101and the orientation relationship between the television101and the television102. In this case, information about the orientation relationship between the television103and the television102is redundant. Optionally, the orientations of the overall screen group may be checked based on the orientation relationship between the television103and the television102, so as to improve accuracy of identifying the orientations of the overall screen group.

In addition, the television101, the television102, and the television103are also spliced in an up-down manner (vertically spliced). For relative orientation relationships between the devices, refer to the foregoing related descriptions. Details are not described herein again.

For another example, it is assumed that the screen group includes nine devices: a television101, a television102, a television103, a television104, a television105, a television105, a television107, a television108, and a television109. After the information about the orientation relationship between every two devices is identified, relative orientation relationships between all devices in the screen group may be summarized by collecting statistics on the orientation relationship between every two devices.

As shown inFIG.11B, for example, three devices, namely a television101, a television102, and a television103are horizontally arranged. A sequence of identifying every two devices from left to right is as follows: the television101and the television102, the television101and the television103, and the television102and the television103. A sequencing process of determining the three devices may be as follows: It is first determined that the television101is located to the left of the television102by reading the relative orientations of the television101and the television102; and then it is determined that the television103is located to the right of the television101by reading the relative orientations of the television101and the television103. In this case, the relative orientations of the television101and the television103cannot be determined, and the relative orientations of the television102and the television103need to be further read. Finally, it is determined that the three devices such as the television101, the television102, and the television103are sequenced as “(1), (2), (3)”, that is, the television101, the television102, and the television103are respectively arranged from left to right.

For example, three devices, namely a television101, a television105, and a television109are diagonally arranged. A sequence of identifying every two devices from upper left to lower right is as follows: the television101and the television105, the television101and the television109, and the television105and the television109. It may be determined, by traversing relative orientations of the two devices, that the top left device is the television101, the television105is located to the lower right of the television101, and the television109is located to the lower right of the television105. Therefore, it is finally determined that the three devices, namely the television101, the television105, and the television109are sequenced as “(1), (5), (9)”, that is, the television101, the television105, and the television109are respectively arranged from upper left to lower right.

It should be noted that the foregoing describes an example of a method for determining relative orientation relationships between all devices in a screen group. Actually, there are a plurality of other methods for determining the relative orientation relationships between all devices in the screen group. This is not limited in this application.

In some other embodiments, step420ato step421may be replaced with step S1:

S1: The television101separately obtains a photo taken by the television102and a photo taken by the television103, and separately identifies an orientation relationship between the television101and the television102, an orientation relationship between the television101and the television103, and an orientation relationship between the television102and the television103. That is, the master device may identify the orientation relationships between the devices in the screen group. In this way, the television102and the television103may not need to perform orientation identification, and power consumption of the television102and the television103may be reduced.

422a: The master device synchronizes the basic screen group splicing information to the television102.

422b: The master device synchronizes the basic screen group splicing information to the television103.

The master device synchronizes the basic screen group splicing information to each device in the screen group.

For example, the current basic screen group splicing information may include a quantity (for example, 3) of devices included in the screen group, the MAC address/ID of each device (for example, IDs of the television101, the television102, and the television103), master-slave information (for example, the master device is the television101, and the slave devices include the television102and the television103), and inter-device orientation information (for example, the television103, the television101, and the television102are sequentially spliced from left to right).

422c: The television101separately determines display information of the television101, the television102, and the television103according to the basic screen group splicing information.

The television101may separately determine the display information of the television101and the display information of the television102according to the basic screen group splicing information. That is, in a running process of a screen group system, the master device may implement, based on the basic screen group splicing information, picture output display arrangement of the screen group, interface focus switching, and the like. For example, the television101may divide the display content of the television101into N parts (for example, three parts) and then allocate the N parts to the devices (for example, the television101itself, the television102, and the television103) in the screen group, where N is less than or equal to a quantity of devices included in the screen group.

422d: The television101sends the display information of the television102to the television102.

422e: The television101sends the display information of the television103to the television103.

422f: The television101displays a corresponding display picture according to the display information of the television101.

422g: The television102displays a corresponding display picture according to the display information of the television102.

422h: The television103displays a corresponding display picture according to the display information of the television103.

In some embodiments, devices may be deleted from a screen group. Deleting devices may mean that devices are actively disassembled or removed from the current screen group, or some devices passively get offline due to power-off. For example, each device in the screen group may detect, according to the heartbeat link, whether a device is offline. Alternatively, each device in the screen group may determine, through short-range communication detection, whether a device is offline. Alternatively, in response to an operation of manually deleting a device from the screen group by the user on the management interface, information about the device deleted by the user may be marked, so that each device in the screen group determines that the device is offline.

If the television103is deleted (removed) from a screen group including the television101, the television102, and the television103, as shown inFIG.12, the screen group splicing method may further include the following steps.

423a: Send a short-range signal between the television101and the television102.

A short-range signal may be periodically sent between the television101and the television102, so as to measure a distance between the television101and the television102according to the short-range signal.

423b: Send a short-range signal between the television102and the television103.

A short-range signal may be periodically sent between the television101and the television103, so as to measure a distance between the television101and the television103according to the short-range signal.

423c: The television101/the television102deletes the television103from the current screen group according to the short-range signal.

For example, if the television101determines, through short-range signal detection, whether the television103is offline, the television101may compare a distance D2between the television101and the television103and a corresponding maximum combination radius R2between the television101and the television103. If the television101determines that the distance D2between the television101and the television103is greater than the maximum combination radius R2between the television101and the television103, that is, D2>R2, the television101determines that the television101and the television103are not in a splicing state, and deletes the television103from the screen group including the television101, the television102, and the television103.

The television102may obtain, from the television101, information that D2is greater than R2, to determine that the television103needs to be deleted from the current screen group.

424: The television101and the television102display third prompt information, where the third prompt information is used to inform the user that it is detected that a device has been removed from the current screen group.

In some embodiments, as shown in (a) inFIG.3G, the screen group including the television101, the television102, and the television103may jointly display corresponding display content. If the television103needs to be deleted from the screen group including the television101, the television102, and the television103(for example, the television103is removed after the television101, the television102, and the television103are spliced together), for example, as shown in (b) inFIG.3G, the television101and the television102each may display a pop-up box307to inform the user that it is detected that the device123xxxhas been removed from the current screen group. The pop-up box307may include an OK button308. In response to an operation of clicking the OK button308by the user, the television101determines that information in the pop-up box307is known to the user, and may hide the pop-up box307. Alternatively, the pop-up box307may be automatically hidden after being displayed for a few seconds (for example, 2 s), to avoid affecting the display content of the television101and the television102.

In some other embodiments, when detecting that the television103is removed, the television101/the television102may inform the user that a device has been removed; and the device may be removed from the current screen group in response to an operation of determining, by the user, to remove the device. For example, as shown in (a) inFIG.3H, a screen group including the television101, the television102, and the television103may jointly display corresponding display content. If the television103needs to be deleted from the screen group including the television101, the television102, and the television103(for example, the television103is removed after the television101, the television102, and the television103are spliced together), for example, as shown in (b) inFIG.3H, the television101, the television102, and the television103may maintain previous display content of the television101, the television102, and the television103, and the television101and the television102each may display a pop-up box309, so that the user can determine whether to remove the device123xxxfrom the current screen group. The pop-up box309may include an OK button310and a Cancel button311. The television103is removed from the screen group in response to an operation of clicking the OK button310by the user. As shown in (c) inFIG.3H, the television101and the television102may jointly display corresponding display content (the display content of the television101and the display content of the television102may be determined by the processor of the television101(the master device)), and the television103independently displays corresponding display content (the display content of the television103may be determined by the processor of the television103). In addition, if the user clicks the Cancel button311, as shown in (b) inFIG.3H, the television101, the television102, and the television103may maintain the previous display content.

It should be noted that, if the removed device is a master device in the current screen group, the remaining devices in the screen group may re-elect a master device.

The master device updates the basic screen group splicing information and synchronizes the information to all devices in the screen group, so that each device in the screen group knows which device is removed from the screen group. For example, the updated current basic screen group splicing information may include the quantity (for example, 2) of the devices included in the screen group, the MAC address/ID of each device (for example, IDs of the television101and the television102), the master-slave information (for example, the master device is the television101, and the slave device is the television102), and the information about the orientation relationship between devices (for example, the television101and the television102are in a left-right splicing state). In the running process of the screen group system, the master device may implement, based on the basic screen group splicing information, picture output display arrangement, interface focus switching, and the like. For example, the television101may divide the display content of the television101into N parts (for example, two parts), and then allocate the N parts to each device (for example, the television101itself and the television102) in the screen group, where N is less than or equal to a quantity of devices included in the screen group.

It should be noted that, when a device is removed from a screen group, it may be considered that the screen group is regrouped, and relative orientation relationships between devices in the screen group may be re-determined, for example, steps410to414may be performed again.

According to the method provided in this embodiment of this application, in a screen combination/splicing process, a camera of each device may be used to take a photo, and the photos taken by the devices are identified and compared. For example, the orientations of the photos in which the overlapping area is located may be determined, so that a relative orientation relationship between the two devices is identified, and a user does not need to perform manual setting, thereby improving user experience. In addition, in this embodiment of this application, a distance between devices may be dynamically monitored, an intention of combining the devices may be automatically identified, and a screen assembly program may be started, so that the user does not need to manually set the screen assembly program, which is more intelligent and convenient.

In addition, in some embodiments, the orientation relationships between the devices may be determined through human-computer interaction. For example, different actions (gestures) or objects may be used in front areas of cameras of the television101and the television102to indicate orientations of different devices. For example, as shown in (a) inFIG.13, first, the television101and the television102may prompt the user to select arrangement manner of the devices, where the arrangement manner of the devices may include, for example, (1) up-down arrangement; and (2) left-right arrangement. As shown in (b) inFIG.13, in response to the user's selection of left-right arrangement in (2), the television101and the television102may prompt the user to make a “gesture 1” in the front area of the camera of the first device from the left, and make a “gesture 2” in the front area of the camera of the second device from the left. After reading the prompt, the user may make the “gesture 1” in the front area of the camera of the first device (for example, the television101) from the left, and make the “gesture 2” in the front area of the camera of the second device (for example, the television102) from the left. The television101may detect whether a hand of a person appears in the field of view of the camera; and if it is determined that the hand of the person appears, an image may be photographed. In addition, the television102may detect whether a hand of a person appears in the field of view of the camera; and if it is determined that the hand of the person appears, an image may be photographed. The television101determines whether a gesture in the image photographed by the television101matches the “gesture 1” or the “gesture 2”; and if the gesture matches the “gesture 1”, it is determined that the television101is the first device from the left. The television102may determine whether a gesture in the image photographed by the television102matches the “gesture 1” or the “gesture 2”; and if the gesture matches the “gesture 2”, it is determined that the television102is the second device from the left. In this way, it may be determined that the television101is located to the left of the television102. In this way, engagement and fun of the user in a screen splicing process can be improved.

As shown inFIG.14, an embodiment of this application provides a screen combination method which may be applied to a screen splicing system. The screen splicing system includes at least two screens and a host, where the at least two screens include a first screen and a second screen, and the host is integrated into the first screen or the second screen; or the host is independent of the first screen or the second screen. The method includes:

1401: Form a first screen group by using the first screen and the second screen, where the first screen and the second screen are in communication connection.

Optionally, before the first screen and the second screen form a first screen group, the method further includes: the first screen and the second screen send a first short-range signal to each other at a preset frequency, and the first screen or the second screen determines a distance between the first screen and the second screen according to a received signal strength indicator RSSI of the first short-range signal transmitted between the first screen and the second screen; and when the distance between the first screen and the second screen is less than or equal to a maximum combination radius corresponding to the first screen and the second screen, the first screen and the second screen form the first screen group, where the maximum combination radius corresponding to the first screen and the second screen is determined according to sizes of the first screen and the second screen and positions of antennas.

Optionally, before the first screen and the second screen form the first screen group, the first screen and/or the second screen may display first prompt information, where the first prompt information is used to inform the user that a nearby device is detected and prompt the user to determine whether to perform screen splicing.

1402: The host sends a first indication to the first screen.

In some embodiments, if the host is disposed in the first screen (for example, the television101), the first indication may be a signal sent by the host to a camera of the television101.

1403: The host sends a second indication to the second screen.

In some embodiments, if the host is disposed in the first screen (for example, the television101), the television101may send a second indication to the second screen (for example, the television102). For the second indication, refer to the foregoing first notification message. Details are not described herein again.

1404: The first screen photographs a first image according to the first indication.

The first image refers to an image (a photo/picture) photographed by the first screen (for example, the television101).

1405: The second screen photographs a second image according to the second indication.

The second image refers to an image (a photo/picture) photographed by the second screen (for example, the television102).

1406: Determine orientation information of the first screen and orientation information of the second screen respectively according to the first image and the second image.

In some embodiments, the determining orientation information of the first screen and orientation information of the second screen respectively according to the first image and the second image includes: the first screen sends the first image to the second screen; the second screen sends the second image to the first screen; the first screen determines the orientation information of the first screen according to the first image; the second screen determines the orientation information of the second screen according to the second image; the first screen and the second screen respectively send the orientation information determined by the first screen and the orientation information determined by the second screen to the host; and the host sends the orientation information of the first screen according to the orientation information determined by the first screen, and determines the orientation information of the second screen according to the orientation information determined by the second screen.

In some other embodiments, the determining orientation information of the first screen and orientation information of the second screen respectively according to the first image and the second image includes: the first screen sends the first image to the host; the second screen sends the second image to the host; and the host determines the orientation information of the first screen and the orientation information of the second screen respectively according to the first image and the second image.

In a possible design, the determining orientation information of the first screen and orientation information of the second screen respectively according to the first image and the second image includes: performing image matching on the first image and the second image according to an image matching algorithm, to determine an overlapping area between the first image and the second image; and determining an orientation of the first screen relative to the second screen according to orientations of the overlapping area in the first image and the second image. The image matching algorithm includes at least one of a scale-invariant feature transform SIFT algorithm, a speeded up robust features SURF algorithm, or a fast nearest neighbor search algorithm.

For example, if the overlapping area is located in a lower half area of the first image and is located in an upper half area of the second image, determining that the first screen is located above the second screen; or if the overlapping area is located at a lower left corner of the first image and is located at an upper right corner of the second image, determining that the first screen is located to the upper right of the second screen; or if the overlapping area is located in a left half area of the first image and is located in a right half area of the second image, determining that the first screen is located to the right of the second screen; or if the overlapping area is located at an upper left corner of the first image and is located at a lower right corner of the second image, determining that the first screen is located to the lower right of the second screen; or if the overlapping area is located in an upper half area of the first image and is located in a lower half area of the second image, determine that the first screen is located below the second screen; or if the overlapping area is located at an upper right corner of the first image and is located at a lower left corner of the second image, determining that the first screen is located to the lower left of the second screen; or if the overlapping area is located in a right half area of the first image and is located in a left half area of the second image, determining that the first screen is located to the left of the second screen; or if the overlapping area is located in a lower right area of the first image and is located in an upper left area of the second image, determining that the first screen is located to the upper left of the second screen.

In another possible design, if it is determined that the first image and the second image include a target object, determining the orientation of the first screen relative to the second screen according to orientations of the target object in the first image and the second image.

In still some other embodiments, before the first screen photographs a first image according to the first indication, and the second screen photographs the second image according to the second indication, the method further includes; the host sends layout information to the first screen and the second screen, where the layout information includes at least one combination mode; and the host sends operation information to the first screen and the second screen in response to an operation of selecting one combination mode from the at least one combination mode by the user, where the first screen and/or the second screen indicate, based on the operation information, the user to perform a first gesture or action in a first position and perform a second gesture or action in a second position. The determining orientation information of the first screen and orientation information of the second screen respectively according to the first image and the second image includes: if it is determined that an area that is in the first image and that includes the first gesture or action is greater than or equal to a preset threshold, determining that the first screen is located in the first position; or if it is determined that an area that is in the second image and that includes the second gesture or action is greater than or equal to the preset threshold, determining that the second screen is located in the second position.

Optionally, the first screen or the second screen scores resource statuses of the first screen and the second screen, where the resource statuses include at least one of a processing capability of a central processing unit CPU, a storage capability of a read-only memory ROM, or a storage capability of a random access memory RAM; and if a score of the first screen is higher than the score of the second screen, the host is integrated into the first screen; or if a score of the second screen is higher than a score of the first screen, the host is integrated into the second screen.

Optionally, the host determines display information corresponding to the first screen and display information corresponding to the second screen respectively according to the orientation information of the first screen and the orientation information of the second screen; the host sends the display information corresponding to the first screen to the first screen; the first screen displays a corresponding display picture according to the display information corresponding to the first screen; the host sends the display information corresponding to the second screen to the second screen; and after receiving the display information corresponding to the second screen, the second screen displays a corresponding display picture according to the display information corresponding to the second screen.

Optionally, the screen splicing system further includes a third screen, and the method further includes: the first screen and the third screen send a second short-range signal to each other; the second screen and the third screen send a third short-range signal to each other; determining a distance between the first screen and the third screen according to an RSSI of the second short-range signal; determining a distance between the second screen and the third screen according to an RSSI of the third short-range signal; and when the distance between the first screen and the third screen is less than or equal to a maximum combination radius corresponding to the first screen and the third screen, forming a second screen group by using the first screen, the second screen, and the third screen, where the maximum combination radius corresponding to the first screen and the third screen is determined according to sizes of the first screen and the third screen and positions of antennas; or when the distance between the second screen and the third screen is less than or equal to a maximum combination radius corresponding to the second screen and the third screen, forming a second screen group by using the first screen, the second screen, and the third screen, where the maximum combination radius corresponding to the second screen and the third screen is determined according to sizes of the second screen and the third screen and positions of antennas.

Optionally, the first screen and/or the second screen display/displays second prompt information, where the second prompt information is used to inform the user that a nearby device is detected and prompt the user to determine whether to perform screen splicing.

In a possible design, if the first condition is met, the method further includes: displaying third prompt information on the first screen and/or the second screen, where the third prompt information is used to inform the user that the third screen has been removed from the current screen group.

The first condition includes: a heartbeat connection between the third screen and the first screen is disconnected, or a heartbeat connection between the third screen and the second screen is disconnected; or the host receives an operation of deleting the third screen by the user; or the distance between the first screen and the third screen is greater than the maximum combination radius corresponding to the first screen and the third screen; or the distance between the second screen and the third screen is greater than the maximum combination radius corresponding to the second screen and the third screen.

After the third screen is removed from the current screen group, the method further includes: the host re-determines the display information corresponding to the first screen and the display information corresponding to the second screen respectively according to the orientation information of the first screen and the orientation information of the second screen.

It should be noted that the first screen in the embodiment inFIG.14may be the television101in the foregoing embodiments, the second screen may be the television102, and the third screen may be the television103. For a part that is not described in detail in the embodiment inFIG.14, refer to the foregoing embodiments. Details are not described herein again.

Based on the method provided in this embodiment of this application, in a screen combination/splicing process, a camera built in a device (the first screen or the second screen) may be used to take photos, and the photos taken by the devices may be identified and compared. For example, the orientations of the photos in which the overlapping area is located may be determined, so as to identify a relative orientation relationship between the two devices, and the user does not need to perform manual setting, thereby improving user experience. In addition, in this embodiment of this application, a distance between devices may be dynamically monitored, an intention of combining the devices may be automatically identified, and a screen assembly program may be started, so that the user does not need to manually set the screen assembly program, which is more intelligent and convenient.

Another embodiment of this application provides a chip system. As shown inFIG.15, the chip system includes at least one processor1501and at least one interface circuit1502. The processor1501and the interface circuit1502may be interconnected by using a line. For example, the interface circuit1502may be configured to receive a signal from another apparatus (for example, a memory of a first screen, a memory of a second screen, or a memory of a third screen). For another example, the interface circuit1502may be configured to send a signal to another apparatus (for example, the processor1501).

For example, the interface circuit1502may read instructions stored in a memory of a device, and send the instructions to the processor1501. When the instructions are executed by the processor1501, the first screen or the second screen (the screen110shown inFIG.2A) is enabled to perform the steps in the foregoing embodiments.

Certainly, the chip system may further include another discrete device. This is not specifically limited in this embodiment of this application.

Some other embodiments of this application provide a first screen (the screen110shown inFIG.2A). The first screen may include a communication module, a memory, and one or more processors. The communication module and the memory are coupled to the processor. The memory is configured to store computer program code, and the computer program code includes computer instructions.

An embodiment of this application further provides a computer-readable storage medium. The computer-readable storage medium includes computer instructions. When the computer instructions are run on a first screen or a second screen (the screen110shown inFIG.2A), the screen110is enabled to perform the functions or steps performed by the television101or the television102in the foregoing method embodiments.

An embodiment of this application further provides a computer program product. When the computer program product runs on a computer, the computer is enabled to perform the functions or steps performed by the first screen (for example, the television101) or the second screen (for example, the television102) in the foregoing method embodiments.

The foregoing descriptions about implementations allow a person skilled in the art to clearly understand that, for convenient and brief description, division of the foregoing functional modules is taken as an example for illustration. In actual application, the foregoing functions can be allocated to different modules and implemented based on a requirement, that is, an inner structure of an apparatus is divided into different functional modules to implement all or some of the functions described above.

In the several embodiments provided in this application, it should be understood that the disclosed apparatuses and methods may be implemented in other manners. For example, the described apparatus embodiments are merely examples. For example, division into the modules or units is merely logical function division and may be other division in actual implementation. For example, a plurality of units or components may be combined or integrated into another apparatus, or some features may be ignored or not performed. In addition, the displayed or discussed mutual couplings or direct couplings or communication connections may be implemented by using some interfaces. The indirect couplings or communication connections between the apparatuses or units may be implemented in electronic, mechanical, or other forms.

The units described as separate components may or may not be physically separate, and components displayed as units may be one or more physical units, that is, may be located in one place, or may be distributed in a plurality of different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the solutions in embodiments.

In addition, functional units in embodiments of this application may be integrated into one processing unit, each of the units may exist alone physically, or two or more units are integrated into one unit. The integrated unit may be implemented in a form of hardware, or may be implemented in a form of a software functional unit.

When the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, the integrated unit may be stored in a readable storage medium. Based on such an understanding, the technical solutions of embodiments of this application essentially, or the part contributing to the conventional technology, or all or some of the technical solutions may be implemented in a form of a software product. The software product is stored in a storage medium, and includes several instructions for instructing a device (which may be a single-chip microcomputer, a chip, or the like) or a processor (processor) to perform all or some of the steps of the methods described in the embodiments of this application. The foregoing storage medium includes any medium that can store program code, such as a USB flash drive, a removable hard disk, a read-only memory (read-only memory, ROM), a random access memory (random access memory, RAM), a magnetic disk, or an optical disc.

The foregoing descriptions are merely specific implementations of this application, but are not intended to limit the protection scope of this application. Any variation or replacement within the technical scope disclosed in this application shall fall within the protection scope of this application. Therefore, the protection scope of this application shall be subject to the protection scope of the claims.