Early clock fault detection method and circuit for detecting clock faults in a multiprocessing system

An early clock fault detection method and circuit for detecting clock faults in a multiprocessing system provides an error system that can be used to shutdown the multiprocessing system or a processor before errors caused by loss of synchronization between multiple processors can propagate from the processor causing storage or other systems to be corrupted. The detection circuit counts cycles of a high-frequency internal processor clock generated by multiplying an external master clock signal and detects whether or not a predetermined number of clock cycles have elapsed between transitions of the external master clock signal. The detection circuit provides a clock fault output within less than a master clock cycle, which can be used to shut down the processor, system or interconnect between processors, preventing loss or corruption of data before the high-frequency clock can drift enough to cause errors.

BACKGROUND OF THE INVENTION

1. Technical Field

The present invention relates generally to processors and computing systems, and more particularly, to multiprocessing systems and a circuit for early clock fault detection.

2. Description of the Related Art

Present-day high-speed processors typically use a lower frequency external clock source or resonant circuit that operates a lower frequency than the high-speed internal clock used to clock internal processor states. The internal clocks of some present-day processors exceed 2 GHz in frequency and therefore would present problematic distribution phase problems and radiate excessive electromagnetic interference (EMI) if provided from outside an integrated circuit package. Therefore, present-day processors typically employ a phase-lock loop (PLL) multiplier circuit to generate the high-frequency internal clock from a lower frequency external clock.

In multiprocessing systems, where many processors are connected and intercommunicate, often in an array or cube arrangement, a lower frequency clock is distributed to provide synchronized clocking of multiple processors so that bus communication may be supported quasi-asynchronously (i.e., without handshaking or a local bus clock). While providing an interconnect advantage, a failure of a clock driver or a clock interconnect supplying one of the processors can corrupt data and disrupt synchronized program execution of an entire system.

What is most critical is avoiding corruption of data in such a system, as invalid results may be produced in a system where a clock distribution element fails or the master clock fails and those results may be written to permanent storage or otherwise communicated outside of the multiprocessing system. A single missing external clock cycle can destroy synchronization in such a system, causing errors that propagate to fixed storage or other systems.

U.S. Pat. No. 6,466,058 describes a clock fault detection scheme that reference measures one phase of the output of a digital phase detector using the VCO output of the PLL and the a reference clock to which the VCO is locked. The counters are reset in response to the other phase out of the phase detector and flag an error if either of the two counters overflow. While the above described scheme will generate an error if either clock fails for a predetermined amount of time, such a scheme is insufficient for detecting faults that will cause the above-described multiprocessors to lose synchronization and generate errors.

It is therefore desirable to provide an early clock fault detection that can detect failure of master clock distribution in a multiprocessing system. It would further be desirable to provide early clock fault detection that can detect failure of master clock distribution within less than a single cycle of the master clock.

SUMMARY OF THE INVENTION

The objective of providing early clock fault detection within less than a cycle of a master clock in a multiprocessing system is provided in a method, a processor and multiprocessing system including a clock fault detector.

The clock fault detector detects when the input master clock signal has failed by detecting edges of the input master clock signal using the high-frequency output of an internal high-frequency oscillator that is generated as a multiple of the input master clock prior to failure of the internal clock. The clock fault detector detects that a state change of the master clock signal has not occurred within a predetermined number of high-frequency oscillator cycles and can signal clock fault logic to take preventative action prior to the processor generating an error.

DESCRIPTION OF ILLUSTRATIVE EMBODIMENT

With reference now to the figures, and in particular with reference toFIG. 1, there is depicted a block diagram of a multiprocessing system in accordance with an embodiment of the present invention. The system includes a processor group5that may be connected to other processor groups via a bridge37forming a super-scalar processor. Processor group5is connected to an L3 cache unit36system local memory38and various peripherals34, as well as to two service processors34A and34B. Service processors provide fault supervision, startup assistance and test capability to processor group5and may have their own interconnect paths to other processor groups as well as connecting all of processors30A–D.

Within processor group5are a plurality of processors30A–D, generally fabricated in a single unit and including a plurality of processor cores10A and10B coupled to an L2 cache32and a memory controller4. Cores10A and10B provide instruction execution and operation on data values for general-purpose processing functions. Bridge37, as well as other bridges within the system provide communication over wide buses with other processor groups and bus35provide connection of processors30A–D, bridge37, peripherals34, L3 cache36and system local memory38. Other global system memory may be coupled external to bridge37for symmetrical access by all processor groups. A master clock signal3, generally in the 100 Mhz range is distributed to each of processors30A–D, along with other processor groups.

Referring now toFIG. 2, details of a processor30having features identical to processor cores30A and30B are shown.

Only details pertinent to the operation of the present invention are shown, which concerns the clock generation blocks and a novel clock fault detector circuit40that provides early indication of a clock fault. Clock multiplier7receives the master clock signal from master clock3ofFIG. 1, and generates a high frequency output signal having a frequency 10 times the master clock frequency at the output of a voltage-controlled oscillator (VCO)24. Phase comparator20and low pass filter (LPF)22provide for locking the phase of a signal divided by 10 from the high-frequency output signal by a counter26, yielding a phase-lock loop (PLL) that generates the high frequency signal phase-locked to the master clock input. The PLL circuit is provided for illustration of a multiplier technique, and it should be understood that the techniques of the present invention may be used in conjunction with other multipliers, such as mixer multipliers, frequency-lock loops (FLLs) and other multiplier circuits.

A clock distribution tree29(or clock grid) comprises a plurality of buffers and transmission lines that provide clock signals to various internal blocks (e.g., exemplary execution unit21) of processor30, and each core10A–B as well as other units within processor30will generally have its own clock distribution grid. Clock fault detector40is coupled to a point in clock distribution tree29for receiving a reference version of the high frequency signal (shown as the same point that enters counter26, but may be connected to other points within clock distribution tree29or directly to the output of VCO24) . Clock fault detector40generates a clock fault output signal when a single clock fault on the master clock input signal is detected, indicating suspect behavior of master clock3. The clock fault output signal is provided to control logic within processor30and may be provided on an external interrupt to service processors34A–34B and may be provided directly to bridge37. Tn response to clock fault output signal assertion, a variety of actions may be taken, including stopping processor10, stopping the entire multiprocessing system (checkstop), and/or isolating processor group5from other processor groups. Service processors34A–B can intercommunicate with service processors in other processor groups and are operated from an independent clock, so that if the master clock signal provided to processor group5fails, indications from other groups can help determine whether the failure is/was a master clock distribution failure or an overall failure of master clock3.

Referring now toFIG. 3, details of clock fault detector40are shown. The high frequency clock input is provided to a counter42that counts cycles of the high frequency clock. Counter42is periodically reset by transitions of the master clock input signal. In the exemplary case, the transitions are positive transitions detected by a positive transition detector41, but may be negative transitions or both master clock transitions. The output of counter42is received by a binary comparator44that generates an output signal to a latch cell48when the count output of counter42is equal to a value programmed in register43. The output of latch cell48is used as the clock fault output to signal a remedial action such as a system shutdown. Clock fault detector40thus forms an early master clock fault detector, as the failure of an edge of master clock signal can be detected to within one clock cycle of the high frequency clock. The high frequency clock (generally due to the action of LPF22ofFIG. 2) will continue to run in sufficient phase or frequency lock to a previously error-free master clock signal so that remedial action can be taken before errors occur. Due to the nature of the PLL operation, several VCO24output high-frequency cycles will be produced within the tolerable window of synchronization with the previously failure-free master clock signal before the processor will drift out of sync with other synchronized processors and system blocks. Thus there is a window of several VCO output24cycles before an error or data corruption occur.

Referring now toFIG. 4, signals within clock fault detector40are shown in a timing diagram. Each positive transition of the master clock input signal results in a positive pulse on the reset input to counter42, which resets the count value to zero. Shown is one complete good cycle of master clock, followed by an exemplary clock fault where the master clock input ceases to transition. (Note—in accordance with the present invention, a master clock fault is detected for even a single missing/sufficiently delayed transition.) After the fault, count continues to increase until it reaches a value of 11, which by example is the value set in register43and the clock fault output is asserted. A value of 11 is chosen to provide a buffer zone of one high frequency clock cycle to provide for jitter and metastability in the clocking circuits, preventing false alarms. As an alternative, a value of 6 could be chosen for a clock fault detector that resets counter42on both transitions of the master clock, which would again supply a one-cycle buffer against false alarms.