Patent ID: 6480621
Filing Date: 2002-11-12
Classification: G06K,G06N

Abstract:
A method for training and operating a neural network of the type having plural layers of nodes where the nodes of one layer are connected to the nodes of a succeeding layer, and each connection has a weight value associated with it, comprising the steps of:storing a first set of digital weight values that are respectively associated with said connections, each of the weight values in said first set having a first predetermined number of bits; storing a second set of digital weight values that are respectively associated with said connections, each of the weight values in said second set having a second predetermined number of bits; supplying a sample training pattern to the neural network and generating a set of node activation values including output values in accordance with said first set of digital weight values; determining a set of error values based on the difference between the output values and a set of target values; computing a set of weight changes dependent on the error values, the node activation values, and the current values of at least said first set of weight values, said weight changes having a greater number of bits of precision than said first number of bits; adding said weight changes to a set of digital values formed by concatenating said first set of weight values as high-order parts and said second set of weight values as corresponding low-order fraction parts, to produce a set of high-precision updated weights; substituting said first number of bits of the high-order bits of said high-precision updated weights for said first set of digital weight values; and substituting said second number of bits of the subsequent bits of said high-precision updated weights for said second set of digital weight values.