Measuring workload usage of a central processing unit.

Abstract: A method and apparatus is disclosed for measuring central processing unit (CPU) (3) usage required to execute a predetermined workload that includes system overhead usage of the CPU as well as direct usage of the CPU. The CPU is driven to run processing cycles to perform a workload task (22) or to perform a CPU bound task (20). The CPU bound task is cycle soaker; a cycle soaker task runs directly on the CPU and has no system overhead. The cycle soaker task runs whenever there is no workload task ready to run. A monitor module measures (28) the total of all cycles run by the central processing unit from beginning to end of execution of the workload and measures the soaker cycles run by the CPU from beginning to end of execution of the workload. CPU usage attributable to the workload is measured (30) by deducting the soaker cycles from the total of all cycles.

Description: Background Of The Invention Field Of The Invention: This invention relates to a method and apparatus for measuring direct and indirect usage of a central processing unit (CPU) attributable to a workload running on a data processing system containing the central processing unit. More particularly, this invention relates to measuring not only the direct usage of the CPU by the workload but also the system overhead usage of the CPU required to complete the workload. The indirect or system overhead usage refers to usage of the CPU by subsystems or devices in the data processing system when performing tasks that are part of the workload. Description Of Related Art: Measuring central processing unit (CPU) run time or cycles, as the data processing system runs a workload, is used for the purpose of managing a data processing system. Managing includes optimizing the hardware and software configuration the system, diagnosing the system, and charging users of the system for jobs run on the system. For main frame computing systems all operations for a job were tracked for CPU running time. Indirect usage or system overhead cycles of the CPU were tagged with a task identifier and the task was traced back to a job. Thus, the system could track all CPU cycles, direct or indirect, to the job or workload they were performing. This consumed some processing time for the system, but for a large system this CPU run time for system management purposes was acceptable. With the advent of personal computing systems or personal computing workstations, users were less willing to allot processing time simply for the purpose of accurately tracking CPU running time per job or workload (multiple jobs). Particularly in the UNIX® operating environment a practice evolved where only the direct usage of the CPU by a job was measured. Direct usage refers to tasks directly executed for the job by the CPU. System overhead, or indirect usage, of the CPU by subsystems working on the same job for the most part are not measured. Accordingly, half or more of the CPU cycles to perform a job may not be accumulated in measuring CPU time for the job if half or more of the tasks for the job are being performed by subsystems using the CPU indirectly for the job. Some systems will measure direct CPU usage and estimate indirect CPU usage based on the amount of direct usage. Of course this is simply an estimate and is only as good as the criteria used for making the estimate. To date, there is no simple solution to the problem of measuring the entire CPU usage, all CPU cycles, consumed in running a given workload without tracking all the operations performed for the workload. DE-A-2,558,368 discloses a CPU workload usage measuring method which measures the total time which is expended during the execution of an application program. A clock generator operates to measure a present time interval that is longer than the elapsed time to run the application program. An auxiliary time program, of lower priority than the application program, is made operative when the application program and the clock generator start, but is not run until the application program run is completed. The auxiliary time program does not run at any time during the running of the application program. The auxiliary time program comprises self-repeating program loops whose executions are counted to measure the length of time it is running. The auxiliary time program stops running when the longer time interval measured by the clock generator times out. Thus, DE-A-2,558,368 measures a total time expended for an application program or workload task, as the difference between the long time interval measured by the clock generator and the shorter time interval defined by the auxiliary time program run time. This includes CPU idle time that occurs during the running of the workload task, so that an accurate measure of actual direct CPU usage by the workload task is not obtained. Furthermore, there is an inherent inefficiency in that the CPU is required to waste time after completion of the workload task waiting for the auxiliary time program to stop. Summary of the Invention It is object of this invention to measure the combined direct usage and indirect usage (system overhead) of a central processing unit (CPU) by a workload without tracking all the operations performed for the workload. In accordance with this invention, there is provided a method and apparatus for measuring workload usage of a central processing unit in a data processing system according to claims 1 and 6, which follow. The above object may be accomplished by a computing system having a monitor module and a workload driver controlling a workload module and a CPU bound module. The monitor module measures direct CPU usage by the CPU bound module and measures the elapsed time to complete the workload. The workload module has workload tasks that are called directly by the workload to run on the CPU and other tasks, constituting system overhead for the workload, that are called from the computing system to run on the CPU. The CPU bound module only has tasks that run directly on the CPU; i.e. there is no system overhead with the CPU bound module. The workload driver starts the CPU bound module and workload module. Tasks of the workload module have priority over tasks of the CPU bound module. If there is a task (direct or indirect) of the workload module to be run on the CPU, the workload task will run. However, if there are no workload tasks ready to run, a task from the CPU bound module will run. There will always be a task available from the CPU bound module. Thus, the CPU during a usage measurement for a given workload is always running and never idle. When the workload driver detects the workload module is complete, the workload driver stops the CPU bound module and the monitor module. The monitor module after the workload is complete provides an elapsed time measurement from start to stop of the predetermined workload. Also the monitor module provides a measure of the CPU usage by the CPU bound module during the interval between start and stop of the predetermined workload. The workload driver receives the elapsed time and the CPU bound usage of the CPU and deducts the CPU bound usage from the elapsed time. The result is the total usage of the CPU by the workload including direct usage and system overhead. The inventive process for measuring CPU usage by a predetermined workload begins with the step of running processing cycles in the central processing unit to perform a workload task or to perform a CPU bound task. The CPU bound task is a cycle soaker; a cycle soaker task or routine runs directly on the CPU consuming a CPU cycle or cycles and may or may not perform actual work. As its name indicates, the purpose of a cycle soaker task is to consume one or more CPU cycles. The inventive process continues by measuring the total of all cycles run by the central processing unit from beginning to end of execution of the workload and by measuring the soaker cycles run by the CPU from beginning to end of execution of the workload. The inventive process detects CPU usage attributable to the workload by deducting the soaker cycles from the total of all cycles. The invention is useful in providing a quick and efficient way to manage a computing system. Actual CPU run time, including system overhead, for a given job can be measured quickly and easily using the invention. Also the invention can measure the impact of adding new hardware or software to a computing system. For example, the invention is used to measure system performance change resulting from adding additional disk drives and/or a new software file system to the computing system. The foregoing and other objects, features and advantages of the invention will be apparent from the following more particular description of a preferred embodiment of the invention as illustrated in the accompany drawings. Brief Description Of Drawings Fig. 1 shows the flow of control and information between the logical operations of the preferred embodiment of the invention. Fig. 2 shows a data processing system which provides the operative elements to perform the logical operations of the invention. Fig. 3 is a flow diagram of the preferred embodiment of the invention illustrating the logical operations and steps performed in measuring workload usage of a central processing unit. Fig. 4 shows the process flow for one preferred embodiment in implementing operations 22 through 26 in Fig. 3. Fig. 5 is an example of a cycle soaker process. Fig. 6 shows another preferred embodiment for implementing the process for loading a run queue with tasks from the workload and with cycle soaker tasks. Fig. 7 shows a run CPU process flow that works with the load run queue process of Fig. 6. Detailed Description Fig. 1 illustrates the interaction between the main operative elements of the preferred embodiment of the invention. These elements cooperate to measure the central processing unit usage required to support a predetermined workload. The workload driver 10 controls two process modules which together consume all of the CPU available cycles during the performance of the workload. One process module is workload process module 12 and the other process module is the CPU bound process module 14. The workload process 12 is the process whose central processing unit usage time is being measured. CPU usage by the workload process in module 12 consists of direct workload cycles and system overhead cycles. In Fig. 1, the CPU usage 16 thus contains a portion for workload cycles and a portion for system overhead to the extent the central processing unit is performing system overhead associated with the workload tasks from workload process 12. As the workload is performed, there will be significant periods of idle time for the CPU. CPU bound process 14 operates to consume this CPU idle time. The workload process, including system overhead for the workload, has priority over the CPU bound process. When the CPU is not performing a workload cycle or an overhead cycle, then the CPU bound process 14 will cause the CPU to perform a cycle having no particular purpose other than to consume a CPU cycle. Such CPU bound processes are typically referred to as cycle soakers. In other words, the CPU bound process soaks up all unused cycles of the CPU so that there is no CPU idle time. The monitor module 18 has the capability to measure the direct usage cycles of any process operating with the CPU. In Fig. 1, measuring the CPU direct usage cycles by the workload process would only give a partial measurement of CPU usage consumed by the workload since it would not contain the overhead usage of the CPU attributable to the workload process. On the other hand, measuring the direct usage of the CPU bound process 14 would give a complete measure of all CPU usage by that CPU bound process. This is because there is no overhead associated with the CPU bound process 14. Therefore, monitor module 18 will generate two outputs. The first output indicates the total elapsed time of the CPU from start to stop of the workload process, i.e. elapsed CPU run time (or total cycles) from start to stop of the workload. The second output indicates CPU bound usage of the CPU by the cycle soaker during the elapsed run time from start to stop of the workload process. Workload driver 10 receives this information and subtracts the CPU bound usage from the total usage. The result is an accurate measure of direct and indirect CPU cycles to perform the workload. Thus, the workload driver can effectively detect all usage of the CPU by the workload process whether that usage is direct workload cycles or indirect system overhead cycles. To recap the preferred operation of the invention, workload driver 10 starts the CPU bound process and the workload process and also the monitor module 18. As the workload process is executed by the CPU, all unused or idle cycles of the CPU are consumed by the CPU bound process 14. When the workload process 12 is completed, a stop or complete condition is detected by the workload driver 10 which then stops the CPU bound process and stops the monitor module 18. The monitor module 18 then provides a measure of the total elapsed time from start to stop of the workload process and a measure of the CPU bound process usage from start to stop of the workload process. The workload driver by deducting the CPU bound usage from the total elapsed time arrives at a usage measurement which includes both workload cycles for the workload process and system overhead cycles for the workload process. The operating environment in which the present invention is used encompasses the general distributed computing system, wherein general purpose computers, workstations, or personal computers are connected via communication links of various types, in a client-server arrangement, wherein programs and data, many in the form of objects, are made available by various members of the system. Some of the elements of a general purpose workstation computer are shown in Fig. 2, wherein a processor 1 is shown, having an input/output (I/O) section 2, a central processing unit (CPU) 3 and a memory section 4. The I/O section 2 is connected to a keyboard 5, a display unit 6, a disk storage unit 9 and a CD-ROM drive unit 7. The CD-ROM unit 7 can read a CD-ROM medium 8 which typically contains programs 11 and data. The computer program products containing mechanisms to effectuate the apparatus and methods of the present invention may reside in the memory section 4, or on a disk storage unit 9, or on the CD-ROM 8 of such a system. Examples of such systems include SPARC® systems offered by Sun Microsystems, Inc., personal computers offered by IBM Corporation and by other manufacturers of IBM-compatible personal computers, and systems running the UNIX® operating system. Fig. 3 illustrates a preferred embodiment for the logical operations or process steps of the invention accomplishing the operations illustrated in Fig. 1. The process begins at step 20 which starts the cycle soaker process 20. As soon as the cycle soaker process starts, step 22 starts the workload process. At this point in the process, the central processing unit (CPU) will be performing tasks for the workload process whenever those tasks are available either directly or indirectly. If none of the workload tasks are ready for processing, then the CPU will process a cycle soaker task. The wait operation 24 detects when the workload process is completed. When workload complete is detected by operation 24, operation 26 stops the cycle soaker. With the workload complete, it is now possible to measure the CPU cycles used by, or the CPU time consumed in, performing the workload. Step 28 measures the total usage of the central processing unit and the cycle soaker usage of the central processing unit. Total usage is the elapsed time, or total CPU run cycles, from the start of operations at step 20 to the stopping of operations at step 26. The number of total cycles used by the CPU from start 20 to stop 26 will equal the number of cycles used directly and indirectly by the workload process and will also include the number of cycles used by the cycle soaker. Step 28 also measures the amount of CPU run time, or the number of cycles used by the CPU, in performing cycle soaker tasks when no workload tasks were ready. In step 30, the CPU workload usage, including both direct usage and overhead usage, may be detected from the total usage and the cycle soaker usage. By deducting the cycle soaker usage from the total usage, the number of cycles or the amount of timed left is a measure of the workload usage, i.e. , the amount of time used by the CPU to perform the workload cycles both direct workload cycles and system overhead cycles. Fig. 4 illustrates one preferred embodiment for implementing steps 20, 22, 24 and 26 of Fig. 3. In other words, the process in Fig. 4 manages the running of the workload task and the running of the cycle soaker task from start of the workload process to completion of the workload process. The process begins at operation 32 which loads workload tasks into a run queue. Operation 32 is an ongoing parallel process to the remaining process steps in Fig. 4. Thus, operation 32 begins loading workload tasks in the run queue and continues loading such tasks until there are no more workload tasks available for loading. Workload tasks may not be available because all workload tasks are completed or because remaining workload tasks are not ready for loading in the run queue. In the latter event, these tasks would be loaded by operation 32 into the run queue as soon as the workload tasks become available. Operation 34 queries the run queue looking for a task to be run on the CPU. Decision operation 36 branches the process to step 38 if there is a task in the run queue. Operation 38 runs the workload task. When the task is completed, decision operation 40 tests whether the workload is complete. If the workload is complete, the process in Fig. 4 is finished, and the process flow moves onto operation 28 in Fig. 3 where total usage and cycle soaker usage are measured. If the workload is not completed, the process returns to operation 34 to query the run queue for the next task in the queue. If decision operation 36 detects that there are no tasks in the run queue, the process branches to decision operation 42 to detect whether the workload is complete. If the workload is complete, then the process in Fig. 4 is finished, and again the process returns to step 28 in Fig. 3. If the workload is not complete, the process branches to operation 44 to run a cycle soaker task. The cycle soaker task runs one or more cycles of the CPU to process the cycle soaker task and then returns the process flow to operation 34 to query the run queue. In effect, the process remains in a loop 46 through operations 34, 36, 42, and 44 until the next workload task is in the run queue or until a workload complete condition is detected. In this way, all idle cycles of the CPU are consumed by the cycle soaker tasks until a next workload task is available to be run. The cycle soaker may be implemented in many different ways. All that is required is that the CPU be kept busy by direct usage of the cycle soaker routine until the next workload task is ready to run on the CPU. In Fig. 5, a simple cycle soaker process is shown. The cycle soaker begins with the query operation 48 to query whether standard event such as a stop interrupt has been received by the CPU. Decision operation 50 tests whether the stop interrupt was received. If the interrupt was not received, the process loops back to operation 48 to query for a stop interrupt. If a stop interrupt is detected by decision operation 50, the cycle soaker process completes, and in Fig. 4, the process returns to query run queue 34. The simple cycle soaker loop in Fig. 5 may be referred to as a task as well as a process. Of course, a cycle soaker process might consist of more than one task. Again, it is only required that the cycle soaker process be a direct usage process, i.e., no system overhead, of the central processing unit so that the measure operation 28 in Fig. 3 can measure all of the CPU time consumed by the cycle soaker. Fig. 6 illustrates another preferred embodiment of the invention where both workload tasks and cycle soaker tasks are loaded into the run queue. The process of loading the run queue in Fig. 6 begins with operation 52 which queries for a workload task. Decision operation 54 detects whether a workload task is available as a result of query operation 52. If the workload task is available, operation 56 loads the workload task into the run queue, and decision operation 58 tests for more workload tasks. If there are no more workload tasks, the load process in Fig. 6 is completed. If, however, there are more workload tasks whether or not they are currently available, the process in Fig. 6 is not completed and branches back to operation 52. If decision operation 54 had detected that a workload task was not available then the process branches "no" to operation 60. Operation 60 loads a cycle soaker task into the run queue. After the cycle soaker task is loaded, the process returns to operation 52 to again query for a workload task. In effect, the process in Fig. 6 will load a run queue with cycle soaker tasks only if a workload task is not available. Finally, after all the workload tasks have been loaded, no more cycle soaker tasks are loaded into the run queue. Fig. 7 illustrates a CPU run process for running tasks from a run queue loaded in accordance with the process in Fig. 6. In other words, the process in Fig. 7 will run either workload tasks or cycle soaker tasks on the CPU depending on the task retrieved from the run queue. The process begins at step 62 which queries the run queue for the task at the head of or the top of the run queue. Operation 62 reads the task at the top of the run queue, and decision operation 64 detects whether the task is a workload task or a cycle soaker task. If the task is a cycle soaker task, the process branches to operation 66 to retrieve the task from the run queue and run the cycle soaker task on the CPU. After the cycle soaker task operation is run, the process returns to the query operation 62 to read in the next task in the run queue. If the task in the run queue is a workload task, then decision operation 64 branches "yes" to operation 68. Operation 68 retrieves the workload and runs the workload task on the central processing unit. After the workload task has run, the process proceeds to decision step 70. Decision step 70 detects whether all tasks in the workload have been run. If the answer is "yes", then the workload is complete and the process in Fig. 7 returns to step 28 in Fig. 3 where the total usage and cycle soaker usage are measured. If the workload is not complete, then the process in Fig. 7 returns to operation 62 to query the run queue for the next task. When the workload is completed, the process returns to step 28 in Fig. 3.

Claims: A method for measuring workload usage of a central processing unit (3) in a data processing system, as the system performs a predetermined workload, having a workload process module (12) for running high priority workload cycles and system overhead cycles, and a central processing unit bound module (14) with no system overhead for consuming idle time cycles in a total elapsed time period including the start to finish of a workload task, and a monitoring module (18) for obtaining a measure of said total elapsed time period, wherein said method determines workload usage by subtracting a measure of the time taken up by idle time cycles from the measure of total elapsed time, characterized by; running central processing unit bound module (14), only during all time intervals when neither a high priority workload cycle nor a high priority overhead cycle is running on the workload process module (12), to perform (20) a cycle soaker task, to soak up all unused cycles so no idle time exists during the time period of execution of the workload process module (12), so that the central processing unit is not idle during workload usage measurement, measuring (28) a total number of cycles run by the central processing unit during a total elapsed time period which does not exceed the start to finish of the performance of the workload, measuring (28) the number of soaker cycles performed during the total elapsed time period, and thereby detecting (30) a workload usage measurement by subtracting the number of soaker cycles from the said total number of cycles. The method of claim 1 and in addition: loading (56) a workload task at a next available location in a run queue, said run queue for queuing up tasks to be executed by the central processing unit; loading (60) a cycle soaker task at the next available location in the run queue when no workload task is ready for loading in the run queue; and said running step running a workload task (68) or a cycle soaker task (66) depending on which of these tasks is at a first position in the run queue. The method of claim 1 and in addition: loading (32) a workload task at a next available location in a run queue, said run queue for queuing up workload tasks to be executed by the central processing unit; testing (34) the run queue for a workload task to be executed and indicating (36) if a workload task is present or not present in the run queue; and said running step (38) responsive to a workload task present in the run queue for running a workload task from the run queue; said running step (44) responsive to a workload task not present in the run queue for running a cycle soaker task. The method of claim 1 wherein said cycle soaker task (20) comprises the steps of: querying (48) for a standard event performed by the data processing system; and detecting (50) the presence or absence of the standard event; repeating said querying step when said detecting step detects the absence of the standard event; ending the cycle soaker task when said querying step detects the presence of the standard event. The method of claim 4 wherein said standard event is a stop interrupt. Apparatus for measuring workload usage of a central processing unit (3) in a data processing system, as the system performs a predetermined workload, having a workload process module (12) for running high priority workload cycles and system overhead cycles, and a central processing unit bound module (14) with no system overhead for consuming idle time cycles in a total elapsed time period including the start to finish of a workload task, and a monitoring module (18) for obtaining a measure of said total elapsed time period, and means for determining workload usage by subtracting a measure of the time taken up by idle time cycles from the measure of total elapsed time, characterized by; the central processing unit bound module (14) being adapted to run, only during all time intervals when neither a high priority workload cycle nor a high priority overhead cycle is running on the workload process module (12), to perform (20) a cycle soaker task, to soak up all unused cycles so no idle time exists during the time period of execution of the workload process module (12), so that the central processing unit is not idle during workload usage measurement, the monitoring module being adapted to measure (28) a total number of cycles run by the central processing unit during a total elapsed time period which does not exceed the start to finish of the performance of the workload, and to measure (28) the number of soaker cycles performed during the total elapsed time period, and means for detecting (30) a workload usage measurement by subtracting the number of soaker cycles from the said total number of cycles. The apparatus of claim 6, and in addition: means for loading (56) a workload task at a next available location in a run queue, said run queue for queuing up tasks to be executed by the central processing unit; said loading means loading (60) a cycle soaker task at the next available location in the run queue when no workload task is ready for loading in the run queue; and means for retrieving a workload task or a cycle soaker task depending on which of these tasks is at a first position in the run queue. The apparatus of claim 6, and in addition: means for loading (32) a workload task at a next available location in a run queue, said run queue for queuing up workload tasks to be executed by the central processing unit; means for querying (34) the run queue for a workload task to be executed and detecting (36) if a workload task is present or not present in the run queue; and said central processing unit being responsive to a workload task present in the run queue for running a workload task from the run queue; said central processing unit being responsive to a workload task not present in the run queue for running a cycle soaker task. The apparatus of claim 6, and in addition: a workload driver (10) for issuing a start command to said workload module (12), said CPU bound module (14) and a monitor module (18), said workload module (12) indicating workload complete when said predetermined workload has been completed; said workload driver (10) responsive to workload complete for issuing a stop command to said workload module and said monitor module.

Inventors: FULLER BILLY, FULLER, BILLY
Applicants: SUN MICROSYSTEMS INC, SUN MICROSYSTEMS, INC.
Application year: 1996
Main classification: G06F11
IPC codes: G06F9, G06F11