Patent ID: 7370020

Claim:
A neural network apparatus comprising: a task unit having an upper and a lower neural network connected in a hierarchical relationship, wherein the upper neural network and the lower neural network each comprise at least a first layer and a second layer, the second layer having feedback to the first layer via a further layer, and at least one other task unit so that the neural network apparatus includes a plurality of task units, wherein one upper neural network is common to at least two of the plurality of task units, the upper neural network is operable to output a sequence of elements, and the order in which elements occur in the sequence determines the order in which the task units are activated; the apparatus comprises at least two upper neural networks; each task unit is interconnected with at least one other task unit of the plurality by a weighted connection; and the weighted connection between said plurality of task units is between the second layers of the upper neural networks of each respective task unit.