Automatic part testing

Automatic part testing includes: booting a part under testing into a first operating environment; executing, via the first operating environment, one or more test patterns on the part; performing a comparison between one or more observed characteristics associated with the one or more test patterns and one or more expected characteristics; and modifying one or more operational parameters of a central processing unit of the part based on the comparison.

BACKGROUND

Performance of central processing unit parts differs from a testing environment due to environmental variance and part degradation over time. Accordingly, the capabilities of a particular part changes over time or when placed in an environment different than the tested environment.

DETAILED DESCRIPTION

In some embodiments, a method of automatic part testing includes: booting a part under testing into a first operating environment; executing, via the first operating environment, one or more test patterns on the part; performing a comparison between one or more observed characteristics associated with the one or more test patterns and one or more expected characteristics; and modifying one or more operational parameters of a central processing unit of the part based on the comparison.

In some embodiments, the method includes providing the one or more observed characteristics to one or more of a basic input/output system (BIOS) or a system management unit. In some embodiments, modifying the one or more operational parameters of the central processing unit includes applying an offset or a modification to a voltage frequency curve. In some embodiments, the one or more observed characteristics include a failure state, and modifying the one or more operational parameters includes the one or more operational parameters to avoid the failure state. In some embodiments, the method includes booting the part into a second operating environment. In some embodiments, the second operating environment includes an operating system. In some embodiments, booting into the first operating environment includes loading the first operating environment from basic input/output system read-only memory (BIOS ROM).

In some embodiments, an apparatus for automatic part testing performs steps including: booting a part under testing into a first operating environment; executing, via the first operating environment, one or more test patterns on the part; performing a comparison between one or more observed characteristics associated with the one or more test patterns and one or more expected characteristics; and modifying one or more operational parameters of a central processing unit of the part based on the comparison.

In some embodiments, the steps include providing the one or more observed characteristics to one or more of a basic input/output system (BIOS) or a system management unit. In some embodiments, modifying the one or more operational parameters of the central processing unit includes applying an offset or a modification to a voltage frequency curve. In some embodiments, the one or more observed characteristics include a failure state, and modifying the one or more operational parameters includes the one or more operational parameters to avoid the failure state. In some embodiments, the steps include booting the part into a second operating environment. In some embodiments, the second operating environment includes an operating system. In some embodiments, booting into the first operating environment includes loading the first operating environment from basic input/output system read-only memory (BIOS ROM).

In some embodiments, a computer program product for automatic part testing disposed upon a computer readable medium includes computer program instructions that, when executed, cause a computer to perform steps including: booting a part under testing into a first operating environment; executing, via the first operating environment, one or more test patterns on the part; performing a comparison between one or more observed characteristics associated with the one or more test patterns and one or more expected characteristics; and modifying one or more operational parameters of a central processing unit of the part based on the comparison.

In some embodiments, the steps include providing the one or more observed characteristics to one or more of a basic input/output system (BIOS) or a System Management Unit (SMU). In some embodiments, modifying the one or more operational parameters of the central processing unit includes applying an offset or a modification to a voltage frequency curve. In some embodiments, the one or more observed characteristics include a failure state, and modifying the one or more operational parameters includes the one or more operational parameters to avoid the failure state. In some embodiments, the steps include booting the part into a second operating environment. In some embodiments, the second operating environment includes an operating system. In some embodiments, booting into the first operating environment includes loading the first operating environment from basic input/output system read-only memory (BIOS ROM).

Automatic part testing in accordance with the present disclosure is generally implemented with computers, that is, with automated computing machinery. For further explanation, therefore,FIG. 1sets forth a block diagram of automated computing machinery including an exemplary computer100configured for automatic part testing according to embodiments of the present invention. The computer100ofFIG. 1includes at least one computer processor102or ‘CPU’ as well as random access memory104(‘RAM’) which is connected through a high speed memory bus106and bus adapter108to processor102and to other components of the computer100.

Stored in RAM104is an operating system110. Operating systems useful in computers configured for automatic part testing include UNIX™, Linux™, Microsoft Windows™, and others as will occur to those of skill in the art. The operating system110in the example ofFIG. 1is shown in RAM104, but many components of such software typically are stored in non-volatile memory also, such as, for example, on data storage112, such as a disk drive. Also stored in RAM is the testing module114for automatic part testing according to certain embodiments.

The computer100ofFIG. 1includes disk drive adapter116coupled through expansion bus118and bus adapter108to processor102and other components of the computer100. Disk drive adapter116connects non-volatile data storage to the computer100in the form of data storage112. Disk drive adapters useful in computers configured for automatic part testing include Integrated Drive Electronics (‘IDE’) adapters, Small Computer System Interface (‘SCSI’) adapters, and others as will occur to those of skill in the art. In some embodiments, non-volatile computer memory also is implemented for as an optical disk drive, electrically erasable programmable read-only memory (so-called ‘EEPROM’ or ‘Flash’ memory), RAM drives, and so on, as will occur to those of skill in the art.

The example computer100ofFIG. 1includes one or more input/output (‘I/O’) adapters120. I/O adapters implement user-oriented input/output through, for example, software drivers and computer hardware for controlling output to display devices such as computer display screens, as well as user input from user input devices122such as keyboards and mice. The example computer100ofFIG. 1includes a video adapter124, which is an example of an I/O adapter specially designed for graphic output to a display device126such as a display screen or computer monitor. Video adapter124is connected to processor102through a high speed video bus128, bus adapter108, and the front side bus130, which is also a high speed bus.

For further explanation,FIG. 2sets forth a flow chart illustrating an exemplary method for automatic part testing that includes booting202(e.g., by a testing module114) a part (e.g., the computer100or a component of the computer100) under testing into a first operating environment. The testing module114is loaded and executed as part of a boot process of the computer100. The first operating environment includes a micro operating system or bootable operating environment separate from the main operating system110of the computer100. Accordingly, the first operating environment is booted into prior to the main operating system110as part of a same boot process. In some embodiments, the first operating environment is a micro operating system or light-weight operating system dedicated to performing test operations on the computer100, as set forth below. In an embodiment, the first operating environment is booted202in response to a selection or confirmation from a user. For example, a user interface presents a user with an option to boot202into the first operating environment prior to booting into a second operating environment such as a main operating system100. In an embodiment, the first operating environment202is loaded from Read-Only Memory or other non-volatile storage on a motherboard or other hardware component separate from disk or mass storage.

The method ofFIG. 2also includes executing204, via the first operating environment, one or more test patterns on the part. The one or more test patterns test the performance of one or more parts of the computer100under varying configuration or operational settings. For example, the one or more test patterns include stress tests designed to test whether one or more parts will fail under particular configuration or operational settings. Examples of such configuration or operational settings include clock speed (e.g., frequency), voltage, etc. Examples of parts targeted by the one or more test patterns include individual cores of the processor102, the data fabric, cache, memory, etc. In some embodiments, the one or more test patters correspond to test patterns used to test a particular part (e.g., the processor102) during development or manufacture to ensure that the given part can operate under “worst case scenario” conditions, such as a given thermal condition or under a particular stress test. In some embodiments, the one or more test patterns are automatically selected for execution. In other embodiments, the one or more test patterns are selected for execution from a plurality of test patterns in response to a user input, in response to a predefined scheduling or ordering of test pattern performance, based on other criteria.

The method ofFIG. 2also includes performing206a comparison between one or more observed characteristics associated with the one or more test patterns and one or more expected characteristics. As parts degrade over time, and as the computer100in which the parts are installed is operating in an environment different from the environment in which the parts were initially tested, the performance of the parts varies over time. Accordingly, the one or more expected characteristics correspond to expected performance metrics when executing the one or more test patterns. For example, the one or more expected characteristics include metrics relating to the execution of the one or more test patterns as a whole (e.g., a total time to execute a given test pattern or multiple test patterns, whether or not a test pattern failed execution, which operation caused a failure of a particular test pattern, etc.). As another example, the one or more expected characteristics include metrics related to the performance of a particular part (e.g., an observed frequency or voltage of a given core, whether or not a particular part failed, what test patterns or operations caused a particular part to fail, etc.).

The one or more observed characteristics are samplings or observations corresponding to the one or more expected characteristics as observed during or after the execution of the one or more test patterns. Thus, the one or more observed characteristics are compared to the one or more expected characteristics to determine how actual performance of the parts differs from the expected performance of the parts. Accordingly, the comparison identifies differentials including a difference in execution time for one or more of the test patterns, a difference in operating voltage for one or more cores at particular points during execution of the test patterns, a difference in thermal conditions, a difference in whether or not and/or where a failure state was entered for a particular part or test pattern, etc.

The method ofFIG. 2also includes modifying one or more operational parameters of a central processing unit (e.g., the processor100) of the part based on the comparison. In some embodiments, modifying the one or more operational parameters includes applying an offset or modifications to the voltage frequency curve of a particular core. The voltage frequency curve is expressed as a graph with one axis corresponding to a voltage of the core another axis corresponding to a frequency of the core with temperature providing a third axis. Thus, the voltage frequency curve indicates, for a given voltage and temperature, a frequency (e.g., a maximum frequency) at which the core can operate. Accordingly, applying an offset to a voltage frequency curve includes increasing or decreasing one or more points on the voltage frequency curve by a particular value. In other embodiments, modifying the one or more operational parameters includes applying an offset to the margin of the voltage frequency curve. The frequency curve includes minimum and maximum values for the voltage and frequency across temperature. These minimum and maximum values are the margins of the voltage frequency curve. Applying an offset to a margin of the voltage frequency curve includes increasing or decreasing a minimum or maximum allowable voltage and/or frequency for the given core.

Modifying208the one or more operational parameters includes determining one or more modifications to apply. In an embodiment, observed differentials correspond to a predefined modification to apply. For example, when an execution time for a particular test falls below an expected execution time by an amount exceeding a threshold, a predefined offset to the voltage frequency curve is applied. As another example, where an expected failure state was not entered, a predefined offset to the voltage frequency curve is applied. In other embodiments, modifications are programmatically calculated based on the comparison. For example, differentials between one or more characteristics are provided as input to a function or algorithm to calculate one or more modifications to be applied.

In some embodiments, where the observed characteristic is an observed failure state, the one or more operational parameters are modified to exclude a particular configuration of the parts during the failure state. For example, where a particular voltage or voltage/frequency or voltage/frequency/temperature combination of a core caused an error, that core is modified to avoid the particular voltage or voltage frequency or voltage/frequency/temperature combination.

In an embodiment, the testing module114facilitates sending of the one or more observed characteristics and/or the one or more modifications to operational parameters to a server or other entity. For example, data indicating the one or more observed characteristics and/or the one or more modifications to operational parameters is stored in non-volatile memory. The data is then accessed by an application executed in the main operating system110and sent to the server or other entity.

After modifying208the one or more operational parameters, the testing module114allows a boot process of the computer100to resume. For example, the testing module114causes the computer100to boot into a primary operating system110for operation.

For further explanation,FIG. 3sets forth a flow chart illustrating an exemplary method for automatic part testing that includes booting202(e.g., by a testing module114) a part under testing into a first operating environment; executing204, via the first operating environment, one or more test patterns on the part; performing206a comparison between the one or more observed characteristics associated with the one or more test patterns and one or more expected characteristics; and modifying208one or more operational parameters of a central processing unit of the part based on the comparison.

The method ofFIG. 3differs fromFIG. 2in that the method ofFIG. 3also includes providing302(e.g., by the first operating environment304) the one or more observed characteristics306to a Basic Input/Output System (BIOS)308. For example, the first operating environment304stores data indicating the one or more observed characteristics306in non-volatile memory accessible to the Basic Input/Output System (BIOS)308. As another example, the first operating environment302provides the one or more observed characteristics306as an argument or parameter to the Basic Input/Output System (BIOS)308. Having been provided302the one or more observed characteristics306, the Basic Input/Output System (BIOS)308then performs206the comparison between the one or more observed characteristics306and the one or more expected characteristics and modifies208the one or more operational parameters based on the comparison.

For further explanation,FIG. 4sets forth a flow chart illustrating an exemplary method for automatic part testing that includes booting202(e.g., by a testing module114) a part under testing into a first operating environment; executing204, via the first operating environment, one or more test patterns on the part; performing206a comparison between the one or more observed characteristics associated with the one or more test patterns and one or more expected characteristics; and modifying208one or more operational parameters of a central processing unit of the part based on the comparison.

The method ofFIG. 4differs fromFIG. 2in that the method ofFIG. 4also includes providing402(e.g., by the first operating environment404) the one or more observed characteristics406to a System Management Unit (SMU)408. For example, the first operating environment404stores data indicating the one or more observed characteristics406in non-volatile memory accessible to the System Management Unit (SMU)408. As another example, the first operating environment402provides the one or more observed characteristics406as an argument or parameter to a function of the System Management Unit (SMU)408. Having been provided402the one or more observed characteristics406, the System Management Unit (SMU)408then performs206the comparison between the one or more observed characteristics406and the one or more expected characteristics and modifies208the one or more operational parameters based on the comparison.

For further explanation,FIG. 5sets forth a flow chart illustrating an exemplary method for automatic part testing that includes booting202(e.g., by a testing module114) a part under testing into a first operating environment; executing204, via the first operating environment, one or more test patterns on the part; performing206a comparison between the one or more observed characteristics associated with the one or more test patterns and one or more expected characteristics; and modifying208one or more operational parameters of a central processing unit of the part based on the comparison.

The method ofFIG. 5differs fromFIG. 2in that the method ofFIG. 5also includes booting502the part into a second operating environment. For example, the second operating environment includes an operating system110(e.g., a main operating system110of the computer100). Thus, after modifying208the one or more operational parameters, the testing module114automatically initiates booting502of the main operating system110for the user.

For further explanation,FIG. 6sets forth a flow chart illustrating an exemplary method for automatic part testing that includes booting202(e.g., by a testing module114) a part under testing into a first operating environment; executing204, via the first operating environment, one or more test patterns on the part; performing206a comparison between the one or more observed characteristics associated with the one or more test patterns and one or more expected characteristics; and modifying208one or more operational parameters of a central processing unit of the part based on the comparison.

The method ofFIG. 6differs fromFIG. 2in that booting202into a first operating environment includes loading602the first operating environment from Basic Input/Output System Read-Only Memory (BIOS ROM). For example, a boot operation of the computer100causes the first operating environment to be loaded602from Basic Input/Output System Read-Only Memory (BIOS ROM) to Random Access Memory (RAM) for execution. This distinguishes the first operating environment from other operating systems stored on disk or other mass storage prior to execution. This allows the first operating environment to be preinstalled on motherboards or other hardware components during manufacture.

In view of the explanations set forth above, readers will recognize that the benefits of automatic part testing according to embodiments of the present disclosure include:Improved performance of a computing system by automatically retesting hardware components over time.Improved performance of a computing system by automatically reconfiguring and tuning hardware components over time as performance changes.

It will be understood from the foregoing description that modifications and changes can be made in various embodiments of the present disclosure. The descriptions in this specification are for purposes of illustration only and are not to be construed in a limiting sense. The scope of the present disclosure is limited only by the language of the following claims.