Display system with improved graphics abilities while switching graphics processing units

Methods and apparatuses are disclosed for improving graphics abilities while switching between graphics processing units (GPUs). Some embodiments may include a display system, including a plurality of graphics processing units (GPUs) and a memory buffer coupled to the GPUs via a timing controller, where the memory buffer stores data associated with a first video frame from a first GPU within the plurality of GPUs and where the timing controller is switching between the first GPU and a second GPU within the plurality.

RELATED APPLICATIONS

TECHNICAL FIELD

The present invention relates generally to graphics processing units (GPUs) of electronic devices, and more particularly to switching between multiple GPUs during operation of the electronic devices.

BACKGROUND

Electronic devices are ubiquitous in society and can be found in everything from wristwatches to computers. The complexity and sophistication of these electronic devices usually increase with each generation, and as a result, newer electronic devices often include greater graphics capabilities their predecessors. For example, electronic devices may include multiple GPUs instead of a single GPU, where each of the multiple GPUs may have different graphics capabilities. In this manner, graphics operations may be shared between these multiple GPUs.

Often in a multiple GPU environment, it may become necessary to swap control of a display device among the multiple GPUs for various reasons. For example, the GPUs that have greater graphics capabilities may consume greater power than the GPUs that have lesser graphics capabilities. Additionally, since newer generations of electronic devices are more portable, they often have limited battery lives. Thus, in order to prolong battery life, it is often desirable to swap between the high-power GPUs and the lower-power GPUs during operation in an attempt to strike a balance between complex graphics abilities and saving power.

Regardless of the motivation for swapping GPUs, swapping GPUs during operation may cause defects in the image quality, such as image glitches. This may be especially true when switching between an internal GPU and an external GPU. Accordingly, methods and apparatuses that more efficiently switch between GPUs without introducing visual artifacts are needed.

SUMMARY

Methods and apparatuses are disclosed for improving graphics abilities while switching between graphics processing units (GPUs). Some embodiments may include a display system, including a plurality of graphics processing units (GPUs) and a memory buffer coupled to the GPUs via a timing controller, where the memory buffer stores data associated with a first video frame from a first GPU within the plurality of GPUs and where the timing controller is switching between the first GPU and a second GPU within the plurality.

Other embodiments may include a method of switching between GPUs during operation of a display system, the method may include indicating an upcoming GPU switch from a first GPU within a plurality of GPUs to a second GPU within a plurality of GPUs, storing a first video frame from the first GPU in a memory buffer, switching between the first GPU and the second GPU, and refreshing a display from the memory buffer during the switching from the first GPU to the second GPU.

Still other embodiments may include a tangible computer readable medium including computer readable instructions, said instructions including a plurality of instructions capable of being implemented while switching between at least two GPUs in a plurality of GPUs, said instructions including displaying data from a current GPU in the plurality of GPUs, indicating an upcoming GPU switch, storing a future data frame, switching between the current GPU and a new GPU in the plurality, and refreshing a display from a memory buffer while switching between the current GPU and the new GPU.

The use of the same reference numerals in different drawings indicates similar or identical items.

DETAILED DESCRIPTION OF THE INVENTION

The following discussion describes various embodiments of a display system that may minimize visual artifacts, such as glitches, which may be present when switching from a current GPU to a new GPU. Some embodiments may implement a memory buffer in the display system that retains one or more portions of a video frame from the current GPU prior to the GPU switch. By refreshing the display system with the contents of this memory buffer during the switch the user may continue to see the same image as before the switch instead of glitches.

Although one or more of these embodiments may be described in detail, the embodiments disclosed should not be interpreted or otherwise used as limiting the scope of the disclosure, including the claims. In addition, one skilled in the art will understand that the following description has broad application. Accordingly, the discussion of any embodiment is meant only to be exemplary and is not intended to intimate that the scope of the disclosure, including the claims, is limited to these embodiments.

FIG. 1illustrates an exemplary display system100that may be implemented in one embodiment. Prior to delving into the specifics ofFIG. 1, it should be noted that the components listed inFIG. 1, and referred to below, are merely examples of one possible implementation. Other components, buses, and/or protocols may be used in other implementations without departing from the spirit and scope of the detailed description. Also, although one or more components of the display system100are represented using separate blocks, it should be appreciated that one or more of the components of the display system100may be part of the same integrated circuit.

Referring now toFIG. 1, the display system100may include a host computer system105. In some embodiments, the host computer105may be a laptop computer operating on battery power. In other embodiments, the host computer105may be a desktop computer, enterprise server, or networked computer device that operates off of wall power. During operation, the host computer105may communicate control signals and other communication signal to various devices within the system.

The display system also may include multiple GPUs110A-110n. These GPUs110A-110nmay exist within the computer system100in a variety of forms and configurations. In some embodiments, the GPU110A may be implemented as part of another component within the system100. For example, the GPU110A may be part of a chipset in the host computer105(as indicated by the dashed line115) while the other GPUs110B-110nmay be external to the chipset. The chipset may include any variety of integrated circuits, such as a set of integrated circuits responsible for establishing a communication link between the GPUs110-A-110nand the host computer105, such a Northbridge chipset.

A timing controller (T-CON)125may be coupled to both the host computer105and the GPUs110A-110n. During operation, the T-CON125may manage switching between the GPUs110A-110nsuch that visual artifacts are minimized. The T-CON125may receive video image and frame data from various components in the system. As the T-CON125receives these signals, it may process them and send them out in a format that is compatible with a display130coupled to the T-CON125. The display130may be any variety including liquid crystal displays (LCDs), plasma displays, cathode ray tubes (CRTs) or the like. Likewise, the format of the video data communicated from the T-CON125to the display130may include a wide variety of formats, such as display port (DP), low voltage differential signaling (LVDS), etc.

During operation of the video system100, the GPUs110A-110nmay generate video image data along with frame and line synchronization signals. For example, the frame synchronization signals may include a vertical blanking interval (VBI) in between successive frames of video data. Further, the line synchronization signals may include a horizontal blanking interval (HBI) in between successive lines of video data. Data generated by the GPUs110A-110nmay be communicated to the T-CON125.

When the T-CON125receives these signals, it may process them and send them out in a format that is compatible with a display130coupled to the T-CON125, such as DP, LVDS, etc. In addition to sending these signals to the display130the T-CON125also may send these signals to a memory buffer135. The precise configuration of the memory buffer135may vary between embodiments. For example, in some embodiments, the memory buffer135may be sized such that it is capable of storing a complete frame of video data. In other embodiments, the memory buffer135may be sized such that it is capable of storing partial video frames. In still other embodiments, the memory buffer135may be sized such that it is capable of storing multiple complete video frames.

AlthoughFIG. 1illustrates the memory buffer135coupled to the T-CON125such that signals may be written to the memory buffer135and the display130in parallel, other embodiments are possible where the memory buffer135may be coupled between the T-CON125and the display130. Furthermore, the format of data stored in the memory buffer135may vary. For example, in some embodiments, the data may be stored in the memory buffer135in red-green-blue (RGB) format at varying resolutions so that the data may be directly painted to the display130. In other embodiments, the video data may be stored in the memory buffer135in a format such that the T-CON125decodes the stored data prior to painting it.

Referring still toFIG. 1, the GPUs110A-110nmay have different operational capabilities. For example, as mentioned above, the GPU110A may be integrated within another device in the display system100, such as a chipset in the host computer105, and as such, the GPU110A may not be as graphically capable as the GPU110B, which may be a stand alone discrete integrated circuit. In addition to having different operational capabilities, the GPUs110A-110nmay consume different amounts of power. Because of this, it may be necessary to balance the desire to use the GPU110B (i.e., have more graphical capabilities) with the desire to use the GPU110A (i.e., consume less power) by switching among the GPUs110A-110n.

In conventional approaches to switching between these GPUs, there may be periods of time when the link providing video data is lost. For example, if the GPU110A is currently providing video data, and a GPU switch occurs, there may be a period during the switch where there is no video available to be painted on the display130. In some embodiments, however, the memory buffer may be used to refresh the display130.

FIG. 2illustrates exemplary operations that may be performed by the display system100to minimize screen glitches and/or visual artifacts during a GPU switch. During normal operations, the T-CON125may obtain video display data from the main video data source, such as the GPU110A. This is shown in block202.

In block205, one or more components within the system100may indicate that a GPU switch is about to occur. This may occur as a result of power and/or graphic performance considerations. For example, the host computer105may determine that too much power is being consumed and that a GPU switch may be in order. Alternatively, the host computer105may determine that greater graphics capabilities are needed and indicate an upcoming switch per block205.

The precise timing of when the indication per block205occurs may vary between embodiments. That is, in some embodiments, the indication in block205may occur a predetermined number of frames prior to actually switching between the GPUs110A-110nto allow one or more components within the system100enough time to prepare for a switch. In other embodiments, the indication per block205may occur just prior to the GPU switch.

Subsequent to the indication in block205, one or more frames may be stored in the memory buffer135per block210. As mentioned previously, the number of frames stored during block210may vary. For example, in some embodiments, a single complete data frame may be stored in the memory buffer135and this data frame may be painted to the display130during the GPU switch. In other embodiments, a series of data frames may be stored in the memory buffer135and one or more of this series of data frames may be painted to the display130during the GPU switch. In still other embodiments, multiple data frames may be stored in the memory buffer135and the last frame of data may be painted to the display130during the GPU switch.

Thus, if the video data coming from the GPUs110A-110nis lost during the GPU switch, then the image to the display130may be substantially unchanged. In other words, by implementing the memory buffer135, the visual artifacts that may be present in a conventional GPU switch may be minimized and/or avoided.

Although some embodiments may include the memory buffer135storing upcoming frames (per block210) as a result of the host computer105indicating a switch is about to occur (per block205), other embodiments may store each data frame regardless of whether a GPU switch is about to occur.

In some embodiments, the memory buffer135may only store video data when a switch is about to occur. Referring briefly to the configuration shown inFIG. 1, the T-CON125may be connected to the memory buffer135and the display130in parallel. As a result, the memory buffer135shown inFIG. 1may be written to in parallel with the display130. In this manner, the memory buffer135shown inFIG. 1may be powered down until a switch is about to occur, and therefore, the overall power consumed by the display system100may be reduced.

Referring again toFIG. 2, one or more components within the display system100may receive an acknowledgement as to when to begin using the stored data. This is shown in block215. For example, in some embodiments, once the memory buffer135has completed storing the requested video data, it may optionally send an acknowledgement to the T-CON125. In other embodiments, the current GPU may send an acknowledgement to the T-CON125when it has completed storing data to the memory buffer135. In the embodiments where multiple data frames (in either complete or partial form) are stored, the acknowledgement of block215may be a batch acknowledgement.

After the acknowledgement of block215is received, the system100may wait for the main data link to actually be lost. As mentioned previously, the time between the indication of an upcoming switch (block205) and losing the main data link may be indeterminate. Thus, control in block220may loop back upon itself for this indeterminate time until the main data link is actually lost.

The actual triggering of the loss of the data link may vary between embodiments. In some embodiments, the loss may be triggered when the T-CON125fails to receive video data signals from the current GPU. Other embodiments may include one or more components sending a link-lost signal a predetermined number of frames after the indication in block205. Regardless of the method of triggering the loss of the data link, once the link is lost, the contents of the memory buffer135may be used to refresh the display130during periods of loss. This is shown in block225.

This refresh may occur as a result of the T-CON125continually reading the video frame data stored in the memory buffer135and painting the display130with the same. For example, the video frame data in the memory buffer135shown inFIG. 1may be stored in an encoded format, to conserve memory space, the T-CON125may decode this stored data and paint the display130with the same. In some embodiments, there may be a plurality of data frames stored in the memory buffer135, and as a result, the refresh from the memory buffer135may be a refresh of the last frame of data from the memory buffer135.

Referring again toFIG. 2, with the display130being refreshed from the memory buffer135, the T-CON125may perform a GPU switch (per block230) without introducing screen glitches into the images painted on the display130. In some embodiments, the T-CON125may include switching circuitry, such that multiple GPUs may be powered on concurrently. In other embodiments, the GPUs110A-110nmay be wired to the T-CON125via wired-OR connections and only one GPU may be able to be active at a time.

In still other embodiments, the GPU switch of block230may be optional as shown by the dashed lines. That is, the system100may reevaluate whether the conditions that provoked the need for a GPU switch (e.g., power consumption or increased graphics need) still exist and may forgo switching in block230.

In block232, the display system100may signal the T-CON125that the main data link is about to be available again. As a result, the T-CON125may await its availability in block234. If the main data link is not available, control may flow back to block234so that the T-CON125may continue to monitor the main data link's availability. On the other hand, if the main data link does become available, then control may flow to the block236, where the T-CON125is re-synchronized with the video data signal from the new GPU. This may include recovering a clock signal from within the video data signal.

Once the T-CON125is synchronized, control may flow to block240where the new GPU may be checked to see if it is undergoing a blanking period. In the event that the new GPU is undergoing a blanking period, then the normal display operations may resume (per block202) from the new GPU at the conclusion of the blanking period.

FIG. 3illustrates exemplary timing diagrams resulting from displaying video data from a memory buffer during a GPU switch. Referring toFIG. 3in conjunction withFIG. 2, during a period302, video data may be displayed from the current GPU as the main data source (per block202). As shown by the arrow305, the current GPU may indicate that it is about to undergo a GPU switch (per block205), store an upcoming frame in the memory buffer135(per block210), and begin refreshing from the memory buffer135(per block225). Thus, during a period306, video data may be displayed from the memory buffer135. The length of the period306may last until the new GPU enters a blanking period (per block240). Thereafter, display may commence from the new GPU as shown by the arrow307and a display period308, which may correspond to displaying from the main data source per block202.