# Patent

## Title
Apparatus and method for reducing power consumption of a processor by estimating engine load

## Abstract

A computer system has a processor and a queue for storing instructions for execution by the processor. The processor is capable of being clocked at a plurality of different clock frequencies. In one embodiment, the clocking frequency is determined by estimating a short or long term load associated with the stored instructions. In another embodiment, the clocking frequency is determined by analyzing a set of the stored instructions.

## Background
CROSS REFERENCE TO RELATED APPLICATION
This application is a continuation of U.S. patent application Ser. No. 10/813,595, filed Mar. 30, 2004, which issued as U.S. Pat. No. 7,167,994 on Jan. 23, 2007, which is a continuation of U.S. patent application Ser. No. 09/767,086, filed Jan. 22, 2001, which issued as U.S. Pat. No. 6,715,089 on Mar. 30, 2004, which are incorporated by reference as if fully set forth.


BACKGROUND
The invention relates to power management in a computer system. More particularly, the invention relates to reducing power consumption of microprocessors in a computer system.
Reducing power consumption in computer systems is highly desirable. Reduced power consumption decreases the heat generated by the system. As the packaging of computer systems becomes more compact, the dissipation of heat generated by the system becomes problematic. Accordingly, it is desirable to reduce the generated heat by reducing power consumption. Additionally, portable or handheld computer systems usually rely on portable power supplies or batteries. Lower power consumption prolongs the usage of a single battery or power supply without a recharge.
The clock frequency of a microprocessor has a highly correlated relationship with the power consumption. A microprocessor running with a higher clock frequency consumes more power and produces more heat than the same microprocessor running with a lower clock frequency. A typical computer system fixes the clock frequency of its microprocessor at initialization. However, instead of running at the initialized clock frequency in both busy or idle modes, it is better to switch the system to a lower clock frequency if the computer is in an idle mode.
One approach to triggering a reduction in clock frequency is to monitor inputs from input devices, such as a keyboard, mouse, or trackball. If there is no input from any of the input devices, for a predetermined period of time, the system will automatically switch from a normal system clock frequency to a slower one. The clock frequency returns to normal when the system receives an input from an input device, such as a keystroke or mouse movement. The input monitoring approach has drawbacks. Although the computer is not receiving an input, it may be engaged in heavy data processing, which a reduced clock frequency hinders this heavy processing.
Another approach for triggering a reduction in clock frequency is to analyze the number of instructions executed by the microprocessor for a predetermined period of time. If the number of executed instructions is low, the clock frequency is reduced. If the number of executed instructions increases, the clock frequency is increased to normal. One drawback to analyzing past instruction execution is that the past number of instructions may not accurately reflect future processing requirements. Accordingly, it is desirable to have alternate approaches to reduce power consumption.
SUMMARY
A computer system has a processor and a queue for storing instructions for execution by the processor. The processor is capable of being clocked at a plurality of different clock frequencies. In one embodiment, the clocking frequency is determined by estimating a short or long term load associated with the stored instructions. In another embodiment, the clocking frequency is determined by analyzing a set of the stored instructions.



BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a simplified diagram illustrating the functional relationships among the microprocessor, system clock and instruction cache.
FIG. 2 is a functional block diagram of a computer system with separate reducing power consumption mechanisms for the microprocessor and the graphics processor.
FIG. 3 is a detailed block diagram of the clock estimation device.
FIG. 4 is a functional block diagram of a computer system with long term and short term load estimation mechanisms.



DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
A computer system for reducing power consumption mechanism with various clock frequencies is shown in FIG. 1. The clock 55 provides a clocking signal for a microprocessor 50. The microprocessor 50 may be a central processing unit (CPU), a graphics processor, such as a D3D engine, or any other processor. The microprocessor 50 has an associated instruction cache 65. The cache 65 stores instructions for execution by the microprocessor 50. The cache 65 may be on the same chip as the microprocessor 50 or off chip. The system also has a memory buffer 66 storing instructions to be input to the instruction cache 65.
A load and estimation clock device 75 is used to control the clocking rate of the system. The estimation device 75 controls the frequency of the clock signal being input into the microprocessor 50. Based on a control signal from the estimation device 75, the clock 55 outputs the selected clocking frequency for the microprocessor among a plurality of available clock frequencies.
One approach to selecting the clock frequency is to analyze the queued instructions. Initially, the microprocessor 50 is set to run at an initialization clock frequency. All instructions waiting to be executed by the microprocessor 50 will be first queued at the memory buffer 66. The instructions queued in the memory buffer 66 are fed to the instruction cache 65 to be queued for execution by the microprocessor 50. Subsequent clock frequencies are estimated based on the number of queued instructions.
To further optimize the system's performance, the estimation device 75 analyzes the types of instructions queued. Certain instructions require more intense processing than others. To compensate for the varying intensities, each instruction is weighted based on its intensity.
Additionally, the estimation device 75 may use the measured microprocessor temperature, as determined by the temperature monitor 70, to maintain the computer system at an acceptable range of operating temperature. If the temperature of the microprocessor 50 is approaching an unacceptable level, the power consumption may need to be reduced to prevent circuit damage regardless of the backlog of instructions. To compensate for temperature, the clock estimation device 75 factors in the measured temperature.
FIG. 2 illustrates a computer system having separate monitoring mechanisms for a microprocessor 90 and a graphics processor 115 which process instructions queued in an instruction cache 120 and/or a memory buffer 125. The microprocessor 90 and the graphics processor 115 each have their own load and clock estimation device 100, 105, respectively. The first load and clock estimation device 100 controls the frequency of a clocking signal outputted from a first clock 95 to the microprocessor 90. The second load and clock estimation device 105 controls the frequency of a clocking signal outputted from a second clock 110 to the graphics processor 115.
One advantage to the individual monitoring of the two processors 90, 115 is that synchronization between the two estimation devices 100, 105 can be achieved. One estimation device 100, 105 can use the other device's 105, 100 information to determine its clocking frequency. One situation where this synchronization may be desirable is when one processor 90 has a larger backlog of instructions than the other 115. Although the estimation device 105 for the smaller backlog processor 115 indicates a higher clocking speed, the clocking speed may be reduced to equalize the backlog between the microprocessors 90, 115. The equalization may improve the system's performance.
Another approach to estimating the clock frequency is to analyze the complexity of a set of n instructions 155, as shown in FIG. 3. Within the clock estimation device 100 or 105, an instruction queue monitoring and data collection block 130 collects information concerning the n instructions 155 which are queued in either queues 65 or 66. Based on the system design and the clock estimation algorithm latency, the set of n instructions may not be the next n instructions for execution by the microprocessor 150 in the queues 65, 66. To illustrate, the following instructions are queued for execution:

. . . , Ik+n+1, Ik+n, Ik+n−1, . . . , Ik+1, Ik, . . . , I;

I is the instruction ready for execution. Ik is the first queued instruction selected for analysis. According to Ik, the last instruction selected for analysis is Ik+n. The resulting latency in the queue is k−i. Based on the flexibility of the clock adjustment circuitry, the number of instructions n and algorithm latency k−i can be chosen to perform clock optimization frequently or in longer periods. A load estimation and clock estimation block 135 takes the collected data and estimates the required microprocessor performance. Based on the load estimation, a clock frequency is selected for clock 140. To reduce processing, instead of analyzing the entire instruction set, a moving average of the instruction's intensity can be taken. The moving average allows for a new load estimate every instruction cycle.
One approach to load and clock estimation uses a fuzzy logic controller. Using fuzzy logic, the n instructions are grouped into fuzzy sets, such as five sets. To illustrate, five fuzzy sets based on estimated engine load are very high load, high load, medium load, low load and very low load. The fuzzy controller outputs a fuzzy variable. After defuzzication of the fuzzy variable, the clock frequency is determined. Additional inputs may be added to the fuzzy controller, such as the current clock frequency, the processor's draw of current and the temperature. To more adaptively adjust the clock control algorithm, a neural network controller is used. The control algorithm is learned by the neural network controller.
To enhance performance, a short term and a long term estimate may be used, as shown in FIG. 4. An integrated circuit (IC) chip 160 includes a short term instruction queue monitoring and data collection device 165, a short term load estimation device 170, an optimum clock estimation device 175, a clock 180 and a microprocessor 185. The short term load estimation device 170 analyzes a set of instructions 190 stored in a cache (not shown) on the IC chip 160. Since the analysis is performed on a silicon level, the analysis is performed frequently.
Long term load estimation devices 200, 205, 210 analyze a set of instructions 195 queued off-chip, such as in an off-chip cache or in memory. Based on the long term analysis, the optimum clock estimation device 175 on the IC chip 160 determines a preferred long term clocking frequency for the clock 180. The update of the long term frequency may be performed at the same or a lower rate than the short term analysis. The optimum clock estimation device 175 also determines the clock frequency for the clock 180 based on the short term analysis and the preferred long term clocking frequency. Using this two-tier approach, short term performance can be adjusted at a fast rate.

## Claims

1. A method for reducing power consumption of at least one processor, the at least one processor is associated with at least one queue for storing instructions, the method comprising:
providing a series of instructions stored in the at least one queue;
estimating a short or long term load associated with the series of instructions;
selecting a clock rate out of a plurality of clocking rates based on in part the estimated short or long term load; and
clocking the at least one processor at the selected clock rate.

2. The method of claim 1, wherein the at least one processor is a graphics processor.

3. The method of claim 1, wherein the short term load is associated with the series of instructions stored in the at least one queue on a chip including the at least one processor.

4. The method of claim 1, wherein the long term load is associated with the series of instructions stored in the at least one queue off a chip including the at least one processor.

5. The method of claim 1, wherein the selected clock rate is also based on the current draw of the at least one processor.

6. A system for reducing power consumption of at least one processor, the system comprising:
at least one queue having stored instructions;
a controller that estimates a short or long term load associated with a series of instructions stored in the at least one queue and selects a clock rate for a clock out of a plurality of clocking rates based on in part the estimated short or long term load; and
the clock clocking the at least one processor at the selected clock rate.

7. The system of claim 6, wherein the at least one processor is a graphics processor.

8. The system of claim 6, wherein the short term load is associated with the series of instructions stored in the at least one queue on a chip including the at least one processor.

9. The system of claim 6, wherein the long term load is associated with the series of instructions stored in the at least one queue off a chip including the at least one processor.

10. The system of claim 6, wherein the selected clock rate is also based on the current draw of the at least one processor.

11. A method for reducing power consumption of at least one processor, the at least one processor is associated with at least one queue storing instructions for execution by the at least one processor, the method comprising:
estimating a load by at least analyzing a set of instructions stored in the at least one queue;
selecting a clock rate out of a plurality of clocking rates based on in part the estimated load; and
clocking the at least one processor at the selected clock rate.

12. The method of claim 11, wherein the analyzing the set of instructions includes determining a moving average of an intensity of instructions in the set of instructions.

13. The method of claim 11, wherein the analyzing the set of instructions includes determining a queue latency of the at least one queue.

14. The method of claim 11, further comprising:
grouping the set of instructions into at least one fuzzy set based on the estimated load;
outputting a fuzzy variable based on the at least one fuzzy set; and
selecting a clock rate out of a plurality of clocking rates based on in part the fuzzy variable.

15. The method of claim 11, wherein the at least one queue is on a chip including the at least one processor.

16. A system for reducing power consumption of at least one processor, the system comprising:
a clock adjustment device that estimates a load by at least analyzing a set of instructions stored in at least one queue and selects a clock rate for a clock out of a plurality of clocking rates based on in part the estimated load;
wherein the clock adjustment device controls the clock such that the at least one processor is clocked at the selected clock rate.

17. The system of claim 16, wherein analyzing the set of instructions includes determining a moving average of an intensity of instructions in the set of instructions.

18. The system of claim 16, wherein the analyzing the set of instructions includes determining a queue latency of the at least one queue.

19. The system of claim 16, further comprising:
a fuzzy logic controller grouping the set of instructions into at least one fuzzy set based on the estimated load and outputting a fuzzy variable based on the at least one fuzzy set; and
selecting the clock rate for the clock out of a plurality of clocking rates based on in part the fuzzy variable.

20. The system of claim 16, wherein the at least one queue is on a chip including the at least one processor.

21. A system for reducing power consumption of at least one processor, the system comprising:
means for storing instructions;
means for estimating a short or long term load associated with a series of instructions stored in the means for storing instructions and for selecting a clock rate for a clock out of a plurality of clocking rates based on in part the estimated short or long term load; and
means for clocking the at least one processor at the selected clock rate.