Detecting performance problems in a computer system

Abstract: A method and apparatus is provided that measures performance in a computer system (100) having a windowed graphic display (202). The method and apparatus provides for a performance survey application (208) which allows for detecting whether performance of the computer system (100) has degraded. An indication (210) is provided on the display (202). Also provided on the display is a survey button that when clicked by the user generates a record indicating that perceived performance is poor. The status of the system is updated in response to user clicks. This in turn causes appropriate updates in the display. Finally, the record associated with the user's click is written to the appropriate memory location. In so doing, a system is provided that allows for continuous indication of the performance of the computer system.

Description: FIELD OF THE INVENTION The present invention relates to a computer system and more particularly to a method and apparatus for detecting performance problems in a computer system. BACKGROUND OF THE INVENTION Computer systems sometimes fail to deliver the expected level of performance. There are many reasons for the performance level not being at the expected level. Some reasons for the performance problems are changes in workload, the occurrence of hardware or software errors, under-configuration (e.g., too little memory), configuration errors, lack of tuning, and over-commitment of resources. Addressing these problems requires first that they be detected (or anticipated, if possible); then that the reasons for their occurrence be identified; next, steps are taken to remedy the situation; and finally, the fix must be verified. Detection of performance problems is difficult. The relevant data is not centrally available in many computer systems such as UNIX systems or the like (UNIX is a registered trademark in the United States and other countries licensed exclusively through X/Open Company Limited). Further, the interpretation of that data often requires expertise not commonly associated with system administration. However, identifying performance problems is important, for their presence diminishes a customer's investment in a computer system by robbing the customer of purchased resources. A key concern in managing a computer installation is developing metrics that adequately quantify performance. For mainframe systems, internal measures of performance are commonly used (e.g., response time for CPU transactions). Unfortunately, such metrics often bear only an indirect relationship to performance as it is perceived by end-users, and hence these metrics are often ineffective at detecting performance problems. JP-A-04 080838 discloses a system in which when a user experiences a deterioration in the performance of a computer system and pushes a specified key on a keyboard, the time, program name, screen information and the like information are recorded onto a storage device. The specified key on a keyboard may be replaced with selection by a mouse pointer of an icon. No feedback to the user is disclosed. EP A-0 529 770 discloses a system monitoring device including a user interface for viewing system information. the user interface is interactive and allows the user to select and display information in a historical record of information. Whilst the selection and display of the information is interactive, the user provides no direct input to the information. Detecting performance problems is even more difficult for window-based workstations (e.g., workstations running X-Windows, Microsoft Windows, or the OS/2 Presentation Manager) in that having a long response time for an action initiated in one window does not mean that the end-user is delayed since the user can still have useful interactions in other windows. Accordingly, what is needed is a system for measuring performance in a window based environment. The system should be one in which the user can quickly and easily indicate that a problem is occurring in the computer. The present invention addresses such a need. DISCLOSURE OF THE INVENTION A performance survey method and system in a computer system having a windowed graphic display is disclosed. The invention, as defined in detail in the appended in dependent claims, employs displaying an actionable window for indicating the performance of the computer. A method and apparatus in accordance with the present invention also includes receiving a user input action related to the actionable window and then providing an indicator on the display acknowledging that the end-user perception of performance has changed. Through the method and system of the present invention, a system administrator, who is not co-located with the end-user, can continuously monitor the end-user perception of performance. Accordingly, an administrator can more easily detect and diagnose a performance problem within the computer. In addition, through this system a user can determine how a particular application program's performance is being affected by the underlying performance of the computer system and its components. BRIEF DESCRIPTION OF THE DRAWINGS The invention will now be described, by way of example only, with reference to the accompanying drawing, in which: Figure 1 is a schematic diagram of a computer system for use with the present invention; Figure 2 is a block diagram of a first embodiment of a system in accordance with the present invention; Figure 3 is a block diagram of a second embodiment of a system in accordance with the present invention; and Figure 4 is a flow chart of the operation of the system in accordance with the present invention. DETAILED DESCRIPTION OF THE INVENTION The present invention relates to an improvement in the detection and diagnosis of performance problems in a computer system. More particularly, the present invention directs the operation of a computer system having the components shown generally in Figure 1. Processing is provided by a central processing unit (CPU) 102. CPU 102 acts on instructions and data stored in random access memory 104. One or more disks 122, controlled by a disk controller 120, provide long term storage. A variety of other storage media could be employed, including tape, CD-ROM, or WORM drives. Removable storage media may also be provided to store data or computer process instructions. Users communicate with the system through I/O devices which are controlled by I/O controller 112. Display 114 presents data to the user, while keyboard 116 and pointing device 118 allow the user to direct the computer systems. Communications adapter 106 controls communications between this processing unit and other processing units connected to a network by network interface 108. Accordingly a system is provided that secures the involvement of a user in a relatively unobtrusive manner. This mechanism requires having an additional program running, which is referred to as the performance survey application. Whenever the end-user feels that performance is inadequate, he/she clicks on an area displayed by the performance survey application. The action causes the application to generate a measurement event that includes at least two pieces of information: the time of the user's click and the identification of the survey application window. (The latter is required to provide real-time diagnosis and to permit having multiple performance survey applications running on a workstation, each associated with a different end-user application.) In addition, the performance survey application records the times during which survey events are logged, which is necessary to convert complaint events into complaint rates. The information collected by the performance survey application can be used in several ways. First, it provides a direct measure of end-user dissatisfaction with system performance, and hence provides an effective means for detecting performance problems. Second, the times at which performance complaints occur can be correlated with system resource activity (e.g., workstation, LAN and server activity) so as to pinpoint the underlying cause. In addition, if the performance survey application is run on multiple workstations in a network, the times at which users complain can be compared so as to identify problems that are common to multiple users. Figure 2 shows a simplified diagram of one embodiment of a performance survey system 200. Depicted in block 202 is the user desktop (that is, what an end-user might see on the display device); the desktop contains two entities (in general, many more are present), the user's application program 203 (e.g., a spreadsheet, a wordprocessor) and a performance survey icon 205. The icon 205 consists of three fields: a survey button 201 used for input (i.e., action with a mouse), an indicator part 210 used for output and an acknowledgement part 214 also used for output. In this embodiment, a user's click of the mouse on the survey icon button 201 results in a signal to a window manager 206 via line 204. (This is typical behaviour for window-based environments; users interact with screen objects through mouse actions, and these interactions result in signals to the window manager. The window manager is responsible for routing those signals to the appropriate programs.) The window manager 206 directs the signal to the performance survey program 208. In general, it would be this program that caused the survey icon to be displayed; the window manager 206 ensures that user interactions on this icon are directed in the form of signals/interrupts back to the survey program 208. The survey program 208 now updates the acknowledgement 214 and indicator 210 fields in the icon 205. The indicator 210 is updated to reflect the revised end-user perception of performance. It is assumed that users employ the performance survey system at times of poor performance; therefore, the indicator 210 will be updated to reflect the perception that performance has worsened. There are many ways that the indicator 210 could indicate poorer performance; for example, the indicator 210 could change from green to red, or it could become darker, or there could be some change in shape (e.g., from a 'happy face' to a 'frowning face'). The acknowledgement field 214 is updated to acknowledge that the user's complaint has been registered. This field 214 provides a textual means to reflect receipt of the complaint; it also affords an opportunity for feedback in the form of a preliminary diagnosis (providing the analysis is available to perform such a diagnosis). Also shown in Figure 2, the performance survey program 208 produces a logged record of user complaints by producing a trace record 212. The trace record 212 consists of several fields; a coded status reflecting the numeric encoding of the status information that is simultaneously reflected in the updated indicator display 210, a timestamp, and a window handle for the performance survey icon 205. The trace record 212 is delivered in some manner appropriate to the computer's operating system (e.g., a trace file, an internal system trace buffer, via an event notification mechanism). In general, the event is logged to some storage medium where it can be utilized for other purposes. For example, the status can be written out to a file that is subsequently accessed to provide input to a performance analysis. In another example, the information may be written out through a synchronous event mechanism in which another application (e.g., a performance management agent) could be informed of the event's occurrence thus causing some further action to occur. This further action could be a realtime performance diagnostic routine, possibly returning its assessment to the end-user via the survey icon acknowledgement field 214. Accordingly, performance complaints can be registered by clicking on the button. The indicator area 210 provides an immediate response when the survey button is clicked (e.g., "problem recorded at 9:30 am on January 31, 1993"); this facility is provided to avoid having users be frustrated about the lack of immediate feedback. The acknowledgement area 214 is used as an extension to the indicator area. For example, when the click rate exceeds a threshold, an analysis program could be initiated that would provide a preliminary diagnosis (e.g., "you are experiencing poor performance because the network is congested"). Implementation only requires a straight-forward application of existing software technology. Referring now to Figure 3, what is shown is a performance survey system 300 similar to the system shown in Figure 2 except that there are multiple, in this case three, application programs running as indicated by blocks 303. The system operates similarly to that shown in Figure 2, except that in addition to the time stamp and window information, a window handle 310 is utilized to monitor which program is causing the performance problems. Hence, for example, each application program (blocks 303) provides its own status indication. Hence, the manner in which overall performance of the computer system is affecting each of the application programs can be determined either individually or cumulatively. To more particularly describe the operation of a performance survey system in accordance with the present invention refer now to Figure 4, which is a flow chart of the operation of the system. In this embodiment, an interrupt is received via step 402. The first item that is determined is whether the interrupt is a timer interrupt or a user interrupt via step 404. If the interrupt is a timer interrupt then the status record is updated via step 406 and then the performance survey icon window is updated via step 408. This update reflects an ageing of the status back to the neutral state via step 408. As a practical consideration, the timer interrupts should not be so frequent as to adversely affect performance diagnosis. If, on the other hand the interrupt is a user interrupt then a determination is made whether the perceived performance of the computer system is good, via step 410. If the performance is good, then the status is updated positively via step 412. The appropriate record is then determined via step 414. Thereafter, the window is updated via step 416. Thereafter, the appropriate record is written via step 418. Typically, the user will only access the performance survey system if the performance has been affected negatively. Hence, when the perceived performance has worsened via step 410, then the status is updated negatively via step 420. The appropriate record is determined via step 422. Thereafter, the window is updated via step 416. The appropriate record is then written via step 418 and then return to the idle mode step 401. Accordingly, a performance survey system in accordance with the present invention will allow an enterprise to quantify better when performance is inadequate so that actions can be taken to correct problems before end-user productivity suffers. In addition, the performance survey system in accordance with the present invention provides a truly external measure of the end-user perception of performance, the present invention also aids in diagnosing computer performance problems. Finally, although the present invention has been disclosed in the context of a particular environment, the system has application to any window-based computer system.

Claims: A method of surveying the performance of a computer system (100) having a windowed graphic display (202) and at least one program (203) visible on the windowed graphic display (202), the method comprising the steps of: displaying an actionable performance survey window (205) on the windowed graphic display (202) for indicating the performance of the computer system (100), the actionable performance survey window (205) including an input field (201), the input field (201) being for detecting a user interrupt (204); receiving (402,404) a user interrupt related to said actionable performance survey window (205); and recording (418) the performance of the computer system (100) in a record (212) in a storage location including an identification of the actionable performance survey window (205); characterised in that : the actionable performance survey window (205) further includes an indicator field (210) and an acknowledgement field (214); and in that the method further comprises the steps of: updating an indication in the acknowledgement field (214) in response to the user interrupt to acknowledge that the user interrupt has been registered; and updating (412,420) the indicator field (210) to reflect the performance of the computer system (100). A method as claimed in Claim 1 further comprising the steps of: receiving (402,404) a timer interrupt; and updating (408) the indicator field (210) to a neutral state in response to the timer interrupt. A method as claimed in Claim 1 or Claim 2 in which the updating the indicator field step includes sequentially aging the indication in the actionable performance survey window (205) to a neutral state. A method as claimed in Claim 1 in which there are a plurality of application programs (303) running on the computer system (100). A system for surveying the performance in a computer system (100) having a windowed graphic display (202) and at least one program (203) visible on the windowed graphic display (202), the system comprising: means for displaying an actionable performance survey window (205) on the windowed graphic display (202) for indicating the performance of the computer system (100), the actionable performance survey window (205) including an input field (201), the input field (201) being for detecting a user interrupt (204); means, responsive to the means for displaying, for receiving (402,404) a user interrupt related to said actionable performance survey (205) window, and means, responsive to the means for receiving, for recording (418) the performance of the computer system (100) in a record (212) in a storage location including an identification of the actionable performance survey window (205); characterised in that : the actionable performance survey window (205) further includes an indicator field (210) and an acknowledgement field (214); and in that the system further comprises: means, responsive to the means for receiving, for updating an indication in the acknowledgement field (214) to acknowledge that the user interrupt has been registered; and means for updating (412,420) the indicator field (210) to reflect the performance of the computer system (100). A system as claimed in Claim 5 further comprising: means for receiving (402,404) a timer interrupt; and means, responsive to receiving a timer interrupt, for updating (408) the indicator field (210) to a neutral state. A system as claimed in Claim 5 or Claim 6 in which the means for updating the indicator field includes means for sequentially aging the indication in the actionable performance survey window (205) to a neutral state. A system as claimed in Claim 5 in which there are a plurality of application programs (303) running on the computer system (100).

Inventors: BERRY ROBERT FRANCIS, HELLERSTEIN JOSEPH, BERRY, ROBERT FRANCIS, HELLERSTEIN, JOSEPH
Applicants: IBM, INTERNATIONAL BUSINESS MACHINES
Application year: 1995
Main classification: G06F11
IPC codes: G06F11