ARTIFICIAL NEURAL DEVICE

Abstract: An artificial neural device comprising a data storage and processing device for encoding data in an abstract form representative of stimulus-response patterns onto said data storage device whereby multiple stimulus-response patterns are superimposed onto said data storage device by said processing device; a device for decoding a previously encoded response associated with a stimulus when said data storage and processing device is stimulated by said stimulus.

Description: ARTIFICIAL NEURAL DEVICE FIELD OF THE INVENTION The present invention relates to adaptive information processing systems, and in particular to associative memories utilizing confidence-mediated associations, and especially neural network systems comprising an auto-organizational apparatus and processes for dynamically mapping any input onto a se antically congruous and contemporaneously-valid, learned response. BACKGROUND OF THE INVENTION Broadly speaking, an associative memory system is one in which stimulus/response pairs of information are stored in such a way that the introduction of a stimulus pattern results in the recall of a memory associated response. Memory systems of this type have a very broad range of potential applications including, for example, logical operations management, pattern recognition, and image interpolation. Traditional associative processes, such as those that are often used in artificial intelligence applications, are dependent on explicitly predefined rule sets that are externally impressed on an associative memory. Expert systems are examples of such traditional architectures. Such expert systems are rules-based paradigms that are managed by an inferential engine. These follow an orthodox von Neumann approach by providing a deterministic software/hardware relationship that follows a series of pre- declared relationships and sequential instructions formatted as predetermined sets of IF - THEN statements. They are inherently limited to those associations that dynamic responsiveness to changing environments or, more generally, any ability to develop a set of input-appropriate responses in the absence of an impressed set of applicable rules specifically intended to deal with a changed or changing or otherwise unknown environment. Moreover, as with any purely heuristic programming, the more complex the application, the greater number of rules that are required, and the proportionately longer the processing time required to deal with those rules. There is general acceptance that these short comings limit the practical usefulness of pre-defined-rules-based approaches to associative memory systems. Neural networks, on the other hand, generate their own rules of association through a learning process that draws on the networks exposure to either supervised or unsupervised input data samples drawn from a statistical universe. These systems have, to various degrees, some ability to make generalizations about that universe as a whole, based on the input sampling. Neural networks are associative memory systems comprising strategic organizations, (architectures) , of processing elements. Individually, these elements are each analogous to an individual neuron in a biological system. Individual processing elements have a plurality of inputs, which are functionally analogous to the dendritic processes of a neuron cell. As such, these elements are "weight, based on the current state of the systems knowledge, to SUBSTITUTE SHEET the respective inputs. The associative "weights" form the data that is stored in the associative memory of the system. Digital computer implementations of neural networks typically employ numerical methodologies to realize the desired associative recall of stimulus-appropriate responses through weighted summation of the inputs in a digital computing environment. These virtual networks take advantage of the current commercial availability of von Neumann machines, which while inherently deterministic, are nevertheless capable of being used to condition input signals in a manner which simulates the advantages attached to stochastic architectures in neural network hardware implementations. An early forerunner to modern neural networks, howsoever they may now be implemented,w as an actual hardware device that came to be known as the Perceptron. This was a pattern classification system that could identify both abstract and geometric patterns. A grid of photocells were arranged to receive a primary optical stimulus. These photocells were in turn randomly connected to a plurality of associator elements which perform the functions associated with the front end of what is now recognized as the inputs (or notional dendritic processes) of a neural network processing element. When the cumulative electrical inputs from the cells to the associators units exceeded a certain threshold, the associator units triggered response implementation, proved to have serious inherent limitations. These are concerned with the systems practical inability to learn certain known functions, in particular the logical "XOR" function of Boolean algebra. In order to be able to SUBSTITUTE SHEET l earn this type of parity function, the Perceptron paradigm would require either an architecture of multiple interconnected layers of weighted processing elements, or alternatively a system having 2 to the N hidden processing elements. The Perceptron could not properly adjust more than one layer of modifiable weights, thus precluding the first alternative. The alternative of using 2 to the N hidden processing units presents three fundamental problems: There must be 2 to the N processing units in the systems for all possible functions which the system might ever have to learn, (which amounts to system design by crystal ball gazing) ; The number of processing elements required in any such system increases exponentially with the number of required inputs to solve the functions which can ben prescribed, and quickly runs into the billions; There is empirical evidence that with large numbers of hidden processing elements, the system loses the ability to formulate reliable generalizations. With these inherent limitations, it was clear that such networks could not emulate or even approximate the functions or efficiencies of the human brain. The advent of back propagation paradigms for establishing a weighted associative memory for evaluating new stimuli as it is presented to the inputs of the processing elements, represented a major step towards overcoming some of the problems associated with the Perceptron paradigm. For example, back propagation incorporates an error handling mechanism that overcomes at least some of the "linear separability classification" limitations associated with the Perceptron. Back propagation establishes a SUBSTITUTE SHEET processing assumption that all processing elements in any given layer of a net work architecture introduce errors in the assignment of a response that issued from that layer, to any stimulus received from the preceding layer. The responsibility for that error is then quantified and distributed throughout the weightings of each of t h e processing element inputs in the previous layer, down to and inc l uding the inputs to the network. This learning process is inherently slow, in that several iterations of the back propagation are required before the desired convergence of error terms (ie "dilution" of information error) is achiever. Current state-of-the-art neural networks can, in general, all be classified as gradient descent models, in which the network data is stored as "weights" in the manner described above. In operation these networks work by having weighted, sealer input values sunned by the processing elements, then normalized in order to maintain some degree of stability in the distribution of generated output response values. Typically, normalization involves a thresholding or scaling of the summation product. Variations on the sigmoid function are usually used for this purpose. A number of examples of these subsequent developments in neural network technology have pursued models predicated on natural biological systems. One of the better known was the development of so-called "Hopfield Nets" in the early 1980's Hopfields * model SUBSTITUTE SHEET was amongst the first to clearly represent neuron operation as a specific t h resholding operation and illustrated memory as in f ormation stored in the interconnections between processing e l ements, which where cast as a minimum energy function. O ne example of a gradient descent network is the matrix algebra based associative memory model that is described in "neural Networks and Physical Systems with Emergent Collective Computational Abilities", J.J. Hopfield, Proc. Narl. Academy of Science, U.S.A. 1982, Vol. 79, pp 2554 - 2558. This model utilizes feedback and non-linear thresholding to force the output pattern to be the stored pattern which most closely matches the input pattern. A major drawback of this model is the large storage and computational effort that is inherently required for the manipulation of an association matrix memory that is used in the model. In essence this represented a special case of the more general features of the Cohen-Grossberg networks, in which the processing elements took on any real activation value resulting from a sigmoid output threshold function alternating between the minimum and maximum values to define that activation value of the processing element. The response to any external stimulus to one of these networks was shown to converge to an equilibrium based on an energy of Lyapunov function. With the ongoing advancement of neural network technology, networks have been further enhanced by various multi-layer architectures. Weighting of processing element inputs through normalization and SUBSTITUTE SHEET competition have continued to improve some of the drawbacks that nevertheless continue to be associated with neural networks. By way of example, and in addition to all the other short-comings set out above, all of these networks continue to suffer from an in h erent form of input information truncation, that is in part a legacy of von Neumann architectures. AS with any system, information loss results in an increase in error rates, and error remediation in turn requires that compensatory processing strategies be adopted. That approach in its own turn results in increased processing (both learning and response) time by depending on large numbers of computational and sampling iterations (in the hope of "diluting" out the errors by increasing the sample size) , with correspondingly increased memory storage space requirements. Moreover such remediation can at best only diminish the error that is intrinsically introduced by a gradient response regimen. It cannot eradicate it. Accordingly, while normalization in gradient descent networks is essential, it also results in collateral degradation of the informational value of input data. Note too that the making of generalizations based on the erroneous precepts that can follow from information loss, limits the reliable application of such networks to linearly non-separable stimuli. A good example of this kind of remediation problem is associated with a connectionist neural network architecture sometimes referred to as a Boltzman machine, that utilizes a back propagation paradigm. This type of machine is intended to deal with what one SUBSTITUTE SHEET aut h or h as la b elled "computational gangrene". This problem is imp l icit in any deterministic approach that is taken to problem solving, in that a mistaken decision in a deterministic path may f oreclose on any possibility of downstream remediation, thereby forever cutting-off the correct interpretative pathway that leads to t h e problems correct, or at least optimal solution. While neural networks in general, go some distance to ameliorating this problem, it continues to exist. Boltzman machines are equilibrium-seeking connectionist machines in which processing elements exhibit binary (on-off) behaviour in response to input stimuli. The response of such a processing element in any given circumstance is determined by both the weighted signals passed along by neighbouring processing elements, and also by a probabilistic signal, thus rendering the response stochastic. The behaviour of such a machine can be described in terms of Boltzman's thermodynamic equations, which allow that even though the response states of individual processing units cannot be predicted, the overall equilibrium response of the network is resolvable. In the meantime, the internal "randomness" of individual processing elements response states that contributes to the Boltzman machines overall "directed of non-random" response can help the network to avoid getting stuck in "locally attractive" but "globally sub-optimal" solutions, and thereby side steps some of the risk of computational gangrene that arises in strictly deterministic von Neumann machines. It has been observed, however, that while Boltzman machines have a greater probability of reaching SUBSTITUTE SHEET b etter solutions than are possible with von Neumann architectures, the existence of "noise" in real life problems poses a problem. Theoretically, a Boltzman machine will of necessity arrive at the optimal solution to any of a limited number of specific classification problems, provided that it is given an unlimited amount o f time for that purpose. The exigency of real time pro b lems rarely permits protracted problem solving exercises of any significant duration, however, and the inability of Boltzman machines to dependably resolve problems within a reasonable time, inherently limits their usefulness. Accordingly, there remains a need in the art of alternatives to current neural network systems. Advantages and operational characteristics relaized minimally by at least the preferred embodiments of the invention described herein are outlined below: i) The method forms a non-connectivist model in which the ability to superimpose multiple sets of indpeendent stimulus-response patters and highly complex associations exist within the individual neuron cell. In other wordsl, multiple stimulus-response patterns may be superimposed uponthe same storage medium thus creating infomration storage densities far greater than current and conventional data storage devices or methods permit. SUBSTITUTE SHEET ii) The holographic neural process facilities decoding a response associated with a given stimulus when the neural device is stimulated by said stimulus. The advantage is realized in that both the encoding (learning) and decoding (expression) functions are performed in one non- iterative transformation. Secondly, resulting from the method by which information is superimposed upon the sane storage medium within the neural device, a decoding transformation as performed upon any one neural element, transforms stimulus input simultaneously through all stimulus-response associations stored in an abstract form within said neural element. The encoding/decoding transformation properties operate in a completely deterministic manner as opposed to prior art gradient descent methods which are inherently non-deterministic. iii) The holographic neural device is general in form and may be applied in a generic fashion to accommodate encoding and decoding of substantially any form of stimulus- response pattern or association. For example the stimulus-response patterns may represent any form of sensory modality, physical parameter, abstract represen¬ tation, or differential/integral function of the above. The holographic neural device performs encoding in a generic fashion by exposing said neural device to multiple sets of stimulus-response patterns. Similarly SUBSTITUTE SHEET decoding is facilitated in a generic fashion by exposing the holographic neural device to an input pattern similar to a stimulus associated with a prior encoded stimulus- response pattern, whereby said neural device responds in generating the associated response. iv) The holographic neural process may be described to operate in a state space mapping mode (conceptually similar to state space representations as defined within conventional control theory) . In specific, a multivalued input set or stimulus input is mapped to a single valued response output state, however within a Riemann or phase domain. As stated earlier, this state space mapping for each stimulus-response association is learned in one transformation. Characteristics of the Riemann manifold within which this mapping occurs intrinsically display a high degree of generalization within the mapping process. In other words, learned stimulus patterns which have been highly distorted or of which are only partially exposed to the neural element will intrinsically associate to the learned response with low error. v) As resulting from the properties cited in points i) and iv) above, the holographic neural element has an extensive and powerful capability for association. Again SUBSTITUTE SHEET these associations are derived from stimulus-response patterns potentially representing various forms of external field intensities which may in turn be derived from any form of sensory modality or differential/ integral function thereof. One may draw the comparison that the neural element operates as a content addressable memory. Said content addressable system operates in a manner that the memory of a learned response is expressed by addressing the neuron with an associated stimulus input. Within a multilevel ultineuronal system this capability will permit associations to propagate along the network or iterate within a feedback loop. Associa¬ tions may propagate along a neural pathway bifurcating and recombining in any primitive or highly complex synaptic arrangement dependent upon the associations encoded and the neuronal interconnection configuration. The holographic neural process directly follows the non- disturbance rule. That is, prior learned stimulus- response associations are minimally influenced by subsequent learning or encoding. This property is distinct from the majority of gradient descent models which require the entire training set to be present during a learning or encoding operation. The non- disturbance property of the holographic process permits learning and expression of stimulus-response associations SUBSTITUTE SHEET to b e alternately interspersed, or to operate in any sequential order or priority. vii ) O n expression, said holographic neural process generates a response vector possessing both phase angle relating t h e learned information value within an analog range, and magnitude. The magnitude is statistically proportional to the degree of recognition for the stimulus pattern. This magnitude feature provides a very important component in the generated response providing a measure of confidence in recognition. A non-linear operation may be performed on the generated response magnitude, permitting the neural element to function as a recognition discriminator about a defined threshold. This operational feature significantly enhances the capability of the neural system in that the neural element functions as a sophisticated analog switch, turning the output response on (generating unity or large magnitude) when the associated stimulus expresses a high degree of recognition. Similarly, the generated response for the neural element switches off (generates 0 output magnitude) when exposed to an unlearned or unrecognized stimulus. Within a multilayer or feedback network, this discrimination capability will permit only learned stimulus mappings to generate responses which in turn propagate through subsequent layers within the neural SUBSTITUTE SHEET system. The ability to inherently perform switching logic on recognized stimulus patterns permits the neuron to operate concurrently within both an analog (phase information) and logical (high/low magnitude) framework. viii) Said stimulus-response patterns are not limited to binary values and are not limited to any number base system representation on conversion scale (i.e. logarithmic). Said holographic neural device permits encoding and decoding of said stimulus-response patterns whose elements are continuously variable within any defined range of analog values. ix) The holographic neural device may be modified to accommodate encoding and decoding of a large number of sets of said stimulus-response patterns as associated with any given size of stimulus field. The size of said stimulus field is defined as the number of distinct elements (elements of information) within said the stimulus field. The increase in storage capacity for stimulus-response associations within the holographic neural device may be performed by generation of higher order statistics using defined preprocessing means on stimulus input data. SUBSTITUTE SHEET S aid response output referred to in subparagraph vii) above contains a deterministic "error" of variable magnitude. This deterministic "error" characterizes a fuzziness factor or contribution within the generated response output. The probabilistic variance of said deterministic "error" within the response output is proportional to the number of stimulus-response patterns encoded into the holographic neural device. Said deterministic "error" within the response output is sufficiently small in magnitude to permit very large sets of the stimulus-response associations to be encoded or superimposed onto said holographic neural device. Efficiency of the holographic neural process is represented by the ratio of number of data storage elements within said holographic neural device to the amount of information in the form of stimulus-response associations that may be encoded in abstract mathematical form. The characteristics of said device are such that the efficiency of stimulus-response pattern storage is proportional to the number of discrete information elements within the stimulus field. That is, the number of independent stimulus-response associations which may be encoded is directly proportioned to the number of discrete elements within the stimulus field. SUBSTITUTE SHEET xii) T h e process has the capability to directly establish a dominance profile in time for learned stimulus-response associations, thus exhibiting a memory profile extending over any range from immediate short term to permanent memory. Characteristics of said holographic neural process or device are highly isomorphic to both the structural and operational characteristics of the neurobiological system. Information is represented in abstract form by a two dimensional or complex vector and may be translated directly to a pulse modulated waveform possessing frequency and magnitude. This waveform is generally characteristic of the electrochemical impulses believed to transmit information between neuron cells. Said holographic neural device stores information in a fashion analogous to the established Hebb hypothesis. The Hebb hypothesis defines the generally accepted information storage mechanism of the biological neuron. The processing elements within the holographic neural device translate the input stimulus in a sigmoidal relationship as do certain classes of biological neurons (retinal neurons) . Said device processes information in the form of stimulus-response relationships and encodes or learns the stimulus-response relationships by exposure to these associations as does the neurobiological system. Said neural device issues immediate output response (single transformation non-iterative mechanism) upon stimulation by input stimulus as does the neurobiological system. SUBSTITUTE SHEET S aid neural device inherently exhibits the characteristics of fuzzy memory or fuzzy logic. Said device has the capacity to store, recognize, and issue an encoded or learned response to vast sets of stimulus- response associations as does the neurobiological system. S aid device incorporates the capability for a memory profile as does the neurological system. one Aspect of this invention relates to an artificial neural device comprising; a unit for storing and processing data in an abstract form representative of stimulus-response patterns; a device for encoding data onto said data storage and processing unit by translating the elements of associated stimulus and response patterns into complex numbers or vectors with the associated information represented by a vector phase angle or vector orientation and a magnitude component, and generating a matrix whose elements are complex numbers or vectors encoding said multiple stimulus-response patterns, whereby each of said stimulus- response pattern is superimposed onto said storage unit; said unit decoding a response associated with an encoded stimulus-response pattern when said matrix encoded in said data storage unit is stimulated by said stimulus signal. Another aspect of this invention is a method of enhancing the storage and computing capacity of artificial neural devices comprising the steps of: encoding data by translating sets of associated stimulus and response signals into complex numbers SUBSTITUTE SHEET represented by a vector phase angle and magnitude; generating a matrix representing stimulus response patterns for each set of associated stimulus response signals whereby each said stimulus response is superimposed onto data storage and processing unit; d ecoding a response signal associated with a stimulus signal by applying said stimulus signal to said stimulus response patterns encoded in said data storage unit so as to generate said response signal associated with said stimulus signal. Another aspect of this invention relates to a pattern recognition device for generating a response signal in response to a stimulus signal comprising: a device for reading or inputting a stimulus signal; a device for translating elements of said stimulus signal into complex numbers or vectors with the associated information represented by vector phase angle or vector orientation and a magnitude component; a unit for storing said translated stimulus signals; a device for translating elements of said response signal into complex numbers or vectors with the associated information represented by vector phase angles or vector orientations and a magnitude component; a unit for storing said translated response signals; a device for generating and storing a matrix representing stimulus-response patterns for each set of translated, associated stimulus and response signals thereby superimposing each stimulus- response pattern onto the said storage unit; a device for SUBSTITUTE SHEET generating a response signal when said unit for storing said matrix and performing decoding transformations is stimulated by said stimulus signal associated with said response signal. Another aspect of this invention is a method of enhancing pattern recognition in an artificial neural device comprising the steps of: producing a stimulus signal; translating said stimulus signal by a processing unit into complex numbers represented by vector phase angle and magnitude; storing said translated stimulus signal into a storage units generating a response signal associated with a stimulus signal by said processing unit into complex numbers represented by vector phase angle and magnitude; translating said response signals by said processing unit and storing said translated response signals onto said storage unit; generating a matrix representing stimulus response patterns for each set of associated stimulus and response signals and storing each said stimulus response patterns onto said storage unit; generating a response signal when said matrix of stimulus response patterns is stimulated by said stimulus signal associated with said response signal. Another aspect of this invention relates to a vision recognition device for generating an auditory response signal in response to a visual stimulus signal comprising: a visual field input device or camera for generating a stimulus signal when operably activated; a storage unit for storing data; a unit for translating elements of SUBSTITUTE SHEET said visual stimulus signal into complex numbers with the associated information represented by vector phase angles and magnitude components and storing said translated visual stimulus signals onto said storage unit; a device for reading or inputting an auditory response signal associated with a visual stimulus signal; a unit for translating said auditory response signals into complex numbers or vectors with the associated information represented by vector phase angles and magnitude components and storing said translated character word response signals onto said storage unit; a processing device capable of performing transformations to generate a matrix representing a stimulus- response patterns for each set of associated visual stimulus and auditory response signals and superimposing each said stimulus- response patterns onto said storage unit; a processing device capable of performing transformations to generate a response signal when said processing device accessing matrix of encoded stimulus- response patterns is stimulated by said visual stimulus signal associated with said auditory response signal; a device for transforming said response signal represented by complex numbers or vectors into auditory output. Yet another aspect of this invention is a method of generating an auditory response by an artificial neural device in response to a visual stimulus signal comprising the steps of: producing a visual stimulus signal through a video camera unit then; translating said visual stimulus signal into complex numbers represented by vector SUBSTITUTE SHEET. phase angle and magnitude and storing said translated visual stimulus signal onto a storage unit; a device for generating an auditory response signal associated with said visual stimulus signal; a unit for translating said auditory response signal into complex numbers represented by vector phase angle and magnitude and storing said translated auditory response signal onto said storage unit; a device for generating and storing a matrix representing stimulus response patterns for each set of associated visual stimulus signals and auditory response signals and storing said stimulus response patterns onto said storage unit; generating an auditory response when said matrix of stimulus response patterns is stimulated by said visual stimulus signal associated with said auditory response signal. Another aspect of this invention relates to a speech recognition device for generating an output signal encoding character words or Roman numerals in response to a spoken auditory stimulus signal comprising: an auditory input or microphone device for generating an auditory stimulus signal when operably activated; a storage unit for storing data; a unit for translating elements of said auditory stimulus signal into complex numbers with the associated informa¬ tion represented by vector phase angles and magnitude components and storing said translated visual stimulus signals onto said storage unit; a device for reading or inputting a character word response signal associated with an auditory stimulus signal; a unit for translating said character word response signals into complex SUBSTITUTE SHEET num b ers or vectors with the associated information represented by vec t or phase angles and magnitude components and storing said translated character word response signals onto said storage unit; a processing device capable of performing transformations to generate a matrix storing stimulus-response patterns for each set of associated auditory stimulus and character word response signals and superimposing each said stimulus-response patterns onto said storage unit; a processing device capable of performing transforma¬ tions to generate a response signal when said processing device accessing matrix of encoded stimulus-response patterns is stimulated by said visual stimulus signal associated with said auditory response signal; a device for transforming said response signal represented by complex numbers or vectors into the character word representation. Yet another aspect of this invention relates to a robotic device for generating an output signal encoding axial position or axial rates of movement in response to stimulus signals encoding axial positions, axial rates of movements, visual input data, tactile information, etc. , the system comprising: a position sensing device for generating position and rate of movement stimulus signals; a visual field input device for generating a visual stimulus signal; a pressure sensor device or devices for generating tactile stimulus signals; a storage unit for storing data; a unit for translating elements of said axial position, axial rate of movement, visual, and tactile stimulus signals into complex numbers with the SUES i STUTE SHEET associated information represented by vector phase angles and magnitude components and storing said translated stimulus signals onto said storage unit; a device for reading or inputting a robotic axial position or axial rate of movement response signal associated with said (robotic) axial position, axial rate of movement, visual and tactile stimulus signals; a unit for translating said robotic response signals into complex numbers or vectors with the associated information represented by vector phase angles and magnitude components and storing said translated robotic response signals onto said storage unit; a ' processing device capable of performing transformations to generate one or several matrices representing stimulus-response patterns for each set of associated robotic stimulus-response signals and superimposing each said robotic stimulus-response patterns onto said storage unit; a processing device capable of performing transformations to generate a robotic response signal when said processing device accessing one or several matrices of encoded robotic stimulus-response patterns is stimulated by said robotic stimulus signal associated with said robotic response signals a device for transforming said robotic response signal represented by complex numbers or vectors into actual robotic axial movements or rates of movements. Yet another aspect of their invention relates to an expert system or automated reasoning device for generating a decision or seemingly intelligent or otherwise intelligent output in response to a stimulus signals which may represent several diverse and i U I SHEET distinct forms of sensory modalities, measured parameters, concrete or abstract concepts etc. The said output response may be embodied in any form of sensory modality (i.e. visual, auditory) however the output mode of speech shall be used for this example. The said expert system or automated reasoning device would comprise: a set of devices for reading or inputting said diverse and distinct forms of sensory modalities, measured parameters, concrete or abstract concepts for generation of the stimulus signal; a storage unit for storing data; a unit for translating elements of said multiple origin stimulus signals into complex numbers with the associated information represented by vector phase angles and magnitude components and storing said translated visual stimulus signals onto said storage unit; a device for reading or inputting an auditory response signal associated with a multiple origin stimulus signal; a unit for translating said auditory response signals into complex numbers or vectors with the associated information represented by vector phase angles and magnitude components and storing said translated character word response signals onto said storage unit; a processing device capable of performing transformations to generate one or several matrices representing stimulus-response patterns for each set of associated multiple origin stimulus and auditory response signals and superimposing each said stimulus-response patterns onto said storage unit; a processing device capable of performing transformations to generate a response signal when said processing device accessing matrices encoded stimulus- response patterns is SUBSTITUTE SHEET stimulated by said multiple origin stimulus signal associated with said auditory response signal; a device for transforming said response signal represented by complex numbers or vectors into the auditory output. Said device would optimally consist of several layers of transformation groups and signal feedback mechanisms. Said transformation group consists of a subset of stimulus-response patterns encoded into a subset of matrices whereby the stimulus input to subset of matrices originate from transformation groups in higher layers; output response from subset of matrices is fed back directly or indirectly into transformation groups in lower layers. Said feedback mechanism may consist of auditory response fed into the environment; said auditory response inducing a reaction within the environment; said reaction within the environment may be embodied in any form (i.e. sound wave propagation, reaction of external device or organism, etc.); said reaction within the environment fed back into said expert system or automated reasoning device as a stimulus signal. Said feedback mechanism may consist of a second form whereby response outputs from said transformation groups in higher layers are fed back directly as stimulus inputs to said transformation groups in the same or lower layers. It is also an aspect of this invention for enhancing the storage and capacity of the artificial neural device based on the process described herein employing any of the following methods: SUBSTITUTE SHEET (a) Employing Hermitian or other preprocessing operations upon the input stimulus field to increased the stimulus field size of the principle neural element. S uch preprocessing is performed with the intent to increase the size of the stimulus field and thus the number of stimulus-response patterns one may superimpose upon the neural element. Such preprocessing means permit stimulus-response patterns which are statistically close, or of low separation in state space, or of high degree of non-linear separability to be encoded for discreet or distinct responses. -Supplementary Disclosure: (b) Employing Hermitian or Sigmoid or similetr processes upon the stimulus or response fields to achieve the property of symmetry. Symmetry being an important requirement f or the process in that input fields must possess quality o f symmetry to approach optimal information storage densities . Symmetry in this context refers to a symmetrical distribution of vectors oriented about a two dimensional, , or complex, or Riemann, or phase plane . The sigmoid operation achieves symmetry by redistributin g Gaussian distributions, as occurring within most natural processes, to the desired symmetrical form. In addition, an input distribution expanded to higher order SUBSTITUTE SHEET statistics, for instance by processing through multiple l ayers of Hermitian matrices, asymptotically approaches the optimal symmetrical form for execution of learning (encoding) and expression (decoding) . (c) A pplying a non-linear operation on the response output magnitude to permit the neural element to operate as a recognition discriminator about a defined . threshold limit . This operation intrinsically causes the neural element to switch on (large magnitude) for recognized stimulus and switch off (small magnitude) for unrecog¬ nized stimulus . (d) Combining groups of neural elements to form a system comprised of transformation groups wherein said transfor¬ mation group encodes and decodes a plurality of informa¬ tion values or elements within the response field associated with each stimulus pattern. The transforma¬ tion group may be configured as a single modular neural device, electro-mechanically based, micro-electronic based, software based, optically based, biologically based or otherwise. (e) Combining groups of said neural devices comprising transformation groups in a parallel arrangement such that input stimulus patterns may be fed into several transfor- SUBSTITUTE SHEET mation groups and separate distinct response fields are thus issued from each transformation group in accordance with that input stimulus pattern. (f) Combining groups of said devices comprising transforma¬ tion groups into a layered arrangement such that the output response fields of transformation groups of lower layers are fed into input the input stimulus fields of higher layers of said transformation groups. (g) combining groups of said transformation groups into both layered and parallel networks in any definable inter¬ connection configuration. (h) Employing signal feedback mechanisms such that output response fields generated from transformation groups in higher layers " is fed back, either directly or indirectly via the external environment, to input stimulus fields of transformation groups in the same or lower layers. (i) Employing dynamic time variable decay of the encoded information representative of the synaptic connections and presented in an abstract form by said correlation matrix [X] . The purpose of this technique is to establish a memory profile that determines the predominance of SUBSTITUTE SHEET encoded information over any range extending from permanent or long term memory to very short term memory. Supplementary Disclosure: (j) Establishing an inhibitory /excitory classification or grouping for the synaptic connections to enhance symmetry properties . Said inhibitory /excitory grouping is performed by the translation of a subset of vector elements within the stimulus field. (k) Where calculational simplicity is required the operational system may be reduced or simplified to a one dimensional or scalar system whereby the information or phase component is limited to a binary representation. That is, the phase components are defined at 0 and it- representing a binary information system. The majority of other aspects concerning the process (i .e . higher order statistics) remain similar considering now that information representation within the phase domain is limited to only the Of- phase orientations . It is also an aspect of this invention that the artificial neural device described herein may be applied for innumerable applications including: SUBSTITUTE SHEET ( a ) Incorporation of the artificial neural device into any system or subsystem whose function is to recognize or respond to visual input stimulus. ( b ) Incorporation of the artificial neural device into any system or subsystem whose function is to recognize or respond to auditory input stimulus. (c) Incorporation of the artificial neural device into any system or subsystem whose function is to recognize or respond to input stimulus that represents any form of sensory modality or abstract representation thereof. (d) Incorporation of the artificial neural device into any system or subsystem whose function is to recognize or respond to input stimulus that represents any physical parameter or abstract representation thereof. (e) Incorporation of the artificial neural device into any control system or control subsystem. This application encompasses but is not limited to any form of process control, mechanical control, electrical control, biological control, vehicular control, robotic control. (f) Incorporation of the artificial neural device into any communication system or communication subsystem to SUBSTITUTE SHEET enhance the d ata transmission signal/noise ratio or provide ancillary functions such as translation of independent input stimulus signals to an associated response output or representation (i.e. voice to text translation) . incorporation of the artificial neural device into any (g ) system that performs artificial intelligence-related functions. This application encompasses but it not limited to expert systems and automated reasoning systems whereby input stimulus associations to an intelligent response action or decision. (h) i ncorporation of the artificial neural process or device into any computational device to increase or enhance computational efficiency. Such an application may be realized, for instance, within finite element analysis whereby external and internal parameters of the mesh node within one or a plurality of past time increments are associated to parameter states in a subsequent time step. incorporation of the artificial neural system into any (i) neuro b iological or biological prosthesis device. This application encompasses but is not limited to artificial limbs, hearing aids, pacemakers. SUBSTITUTE SHEET SUMMARY OF THE INVENTION A radically new approach to artificial neural system theory is d escribed herein. In order to effectively describe the invention a general conceptual description is provided followed by a mathematical description. A principle goal in the field of ANS research is the development of a mechanism or process to encode and superimpose a large amount of information onto a given data storage medium. The neural system must facilitate a means to decode subsequent stimulus input via the encoded information, to produce an associated response output. The optical hologram provides a system roughly analogous to the above encoding process. An information enfolding process within the optical hologram permits a visual three-dimensional object to be stored onto, and reconstructed from a two-dimensional photographic plane effectively enfolding or collapsing an apparent spacial dimension. As a result of the holographic encoding and decoding mechanisms, information storage densities within the two-dimensional plane are considerably enhanced. A similar concept is presented for the holographic neural process described herein. This neural process however deals with information in the form of stimulus-response patterns and stores the information within an abstract mathematical domain (Riemann or phase space) . These stimulus-response patterns may represent any form of sensory modality and may be read-in either via external SUBSTITUTE SHEET environmental receptors or (in the case for multineuronal systems) propagated through the system via interneuronal synaptic connections. The holographic neural process superimposes these stimulus-response patterns onto the same memory element or storage medium. The theoretical basis is roughly analogous to the optical hologram, with a principal exception that time is the apparent dimension enfolded or collapsed. On activation of the system by a stimulus pattern (decoding operation) the stimulus is processed via the accumulated information (all stimulus-response associations enfolded within the correlation set) to issue a near instantaneous response. The characteristics of the response output are described in the section pertaining to Decoding. To provide a physical analogy, one may consider the seemingly effortless human task of recognizing a face. If complicated by various translations and rotations in space, this task is largely beyond the computational abilities of current methodologies employing present day computing systems. A holographic neural system of the type described herein, however, can superimpose and store a very large set of images at various permutations of rotation and translation and, independent of the number of pattern associations stored, issue the desired response in a near instantaneous fashion. The principles outlined herein potentially present a basis for an explanation of our ability to store vast SUBSTITUTE SHEET 34 amounts of sensory information, and respond to familiar forms o sensory mo d alities at a near instantaneous fashion, and at a rat indepen d ent of the amount of information accumulated (i.e. respon a t age 4 and age 40 with roughly the same rapidity) . The context of "patterns" as used within this application refer either to sets of data or sets of stimulus-response association and the term will be used to indicate same. The data values contained within both the stimulus and the respons patterns may represent any form or type of information. Fo example, the sets of data within the stimulus or response pattern may represent pixel values within a visual field, axis position o rates of movement within a robotic device, or Fourier transfor elements for auditory input. Accordingly, both the stimulus an the response field may contain data representing any form o sensory modality, measurable parameter , or abstract representatio of the above. For purposes of illustration the stimulus signal or field will represented by the following set of scalar data S' = {s s S ,...s N }. For example, set S' may represent numerical data produc by video digitizing equipment when viewing an object such as apple, whereby s. to s N is the set of numeric or scalar valu representative of pixel intensities. Similarly the response fie R' associated with the stimulus input field may be represented b SUBSTJ a li i 5 SHEET R' — {r, , Γ, , TJ J . . . r^} where r,, to r M is again a set of real numbers. For example such numerical values can represent a character or ASCII representation of the word APPLE. The process involves translating the above information contained within both of the above scalar sets, namely the stimulus signal or field S' and response signal or field R' , to equivalent sets of complex vectors whose elements of the set possessing both phase angle and nagnitude components. Information is thus represented by vector orientations on a two dimensional, or complex, or Riemann (phase) plane. The transformation occurs by the following non¬ linear mapping whereby of the above sets of stimulus-response patterns denoted by s k and r- respectively are normalized to, or scaled within, a circular range corresponding to 2rr or 360°. This transformation produces a proportional phase angle representation for information as donated below by θ k and * j respectively, where: s = > e , Θ-Fs ( s, .) fQr stiaulus fi e ι d elements ... eq. l and r. - e for the response elements ... eq. 2 •Supplementary Disclosure: In order to maintain global symmetry, a variation of the sigmoid function Fs () is used principally within the stimulus field trans- SUB + C j i ii U S £ 5 ET f ormation. The concept of symmetry is essential to the operation o f the holographic process and its definition and implications are discussed later. The above translated sets of data defined within the Riemann or phase domain is then represented as: S = <s(λ 1 r θ 1 ) ,s(λ 2 ,θ 2 ) ,s(λ 3 ,θ 3 ) , ...} for stimulus ... eq. 4 R = {r(γ l ,θ 1 ) ,r(γ 2 ,θ 2 ) ,r(γ 3 ,θ 3 ) , ...} for response ... eq. 5 where λ - defines a vector magnitude indicating a weighting or influence factor for element k γ3 _ defines a vector element magnitude expressing a weighting or influence factor for each element j within the response field Multiple sets of stimulus-response patterns may be generated and encoded over a given time axis. In providing a rough analogy, one may visualize the above transformation of scalar sets (stimulus patterns) to a series of vectors oriented about the origin of a complex plane. Several stimulus pattern sets are generated over a given time frame whereby these planes may be distributed along a axis either orming a cylindrical geometrical space or represented by overlapping phase regions within a Riemann domain. Again, each vector within the Riemann domain represents an element of information. This concept is most conveniently expressed mathematically in complex exponential notation. The general form SUBSTITUTE SHEET of s ( λ ^ θ ^ for tne stimulus an d r(γ- ] , - 3 ) for the response are therefore expressed in most general terms as follows: s(λ k ,θ k ) = λ k e iθ r(γ- #3) = γ j e iφJ eq. SW p iN-g The encoding operation involves the formation of a mapping from an input stimulus state to a response state within phase space. In the most elementary form, the encoding operation is performed by determining the difference in phase orientation between the set of elements (or any subset) within the stimulus input field S and the set of elements (or any subset) within the output response field R. This encoding transformation involves the production of the following set of correlation values: X = <{x(λ 1 ,θ , ,γ 1 ,* 1 ), x(λ 2 ,θ 2 ,γ 2 ,Φ 2 )...} ... eq. 7 x(λ M ,θ H ,γ 2 ,* 2 )...x(λ",θ H ,γ M ,Φ")>} Elements within the above correlation set are again of complex form and are determined by the following non-linear relation: SUBSTITUTE SHEET The magnitude function h(λk , 'f~) determines an association profile between the stimulus and response fields for the above encoding transformation. This association profile is defined in terms of the characteristics governing the relative magnitude assigned to the correlation set elements. One possible characteristic for the association profile may be given simply by the following: h(λ k ,γ j )=λ k -γ j ... eq. 9 Equation (1) above expresses a transformation for one stimulus- response pattern encoded at a discrete instant in time. This encoding transformation may be applied over a series of stimulus- response patterns whereby a plurality of patterns over a given time frame are enfolded onto the same group of vectors within the correlation set. Assuming a time frame extending over tl to t2: '*,j - J h(λ J : ,γ ] rt) e i(*ϊ-θ ) dt ... eq. 10 The above encoding transformation nay be expressed in a nore canonical form using matrix notation. For any given stimulus pattern at time t the complex vector matrix is represented in a form similar to equation 4: [S] t , ...] ... eq. li SUBSTITUTE SHEET T he process is generalized as a translation from a multivalued stimulus input field to an associated response field. The response matrix has again the following representation: [R] t = i e i* t , γ t 3ei t , ...] ... eq. 12 Again, the generated mappings between the stimulus-response fields are enfolded within the correlation matrix [X]. The encoding transformation for this stimulus-response pattern is executed by the following inner product on the vector matrices: T [X] = [S] • [R] ... eq. 13 T where [S] is the transpose conjugate of [S]. The correlation matrix presents a mathematical analog of the neural synaptic connections and forms the basis for memory, containing all information encoded within the system. In general, this information is encoded as a phase angle differences between the input stimulus field vector elements (θ ) and the response vector elements (Φ- 3 ). Again, the efficiency and power of the holographic system is derived from the ability to enfold these associations or mappings for multiple stimulus-response patterns onto the same storage medium (correlation matrix element or synapse) . To illustrate this concept, the encoded matrices for stimulus-response patterns l through to T may be denoted by: SUBSTITUTE SHEET [X],» [X] 2 / X 3 ' • • • [Xlτ • •• β{ 3- I 4 [ X ] , would denote the encoded matrix for a second stimulus response pattern where for example [S] 2 may represent data obtained from video digitizing equipment when viewing an object such as a pear, while [R] 2 would numerically present an ASCII representing of the word PEAR. All of the above stimulus-response associations or mappings may be encoded onto the same correlation matrix [X] by summing the individual correlation matrix elements for each pattern set, as illustrated below for example by pattern sets 1 to T: [X] = [X], + [X] 2 + [X] 3 + . . . . + [X] τ ... eq. 15 This technique facilitates conservation of information and creates information densities of extremely high order. As discussed in the following section pertaining to Decoding, a deterministic residual "error" occurs in the generated response on storage of multiple stimulus-response associations, generating a measurable degree of fuzz in the response. This error contribution, however, is sufficiently low that a very large number of patterns or associa¬ tions may be encoded prior to accumulation of excessive fuzz within the generated response. SUBSTITUTE SHEET 41 one may represent the stimulus field as a two dimensional matrix [S I indexing the vector elements representing discrete stimulus inputs along the row and the time index along the vertical. stimulus element i.e. eq. 16 In modelling a single neuron, one vector element representing information in the response field is assumed. This response distributed over time is represented by an N by l matrix of vector elements [R] , again with the time index incremental along the vertical axis. Performing the inner product encoding transforma¬ tion eq. 13 produces a correlation matrix of the following form: SUBSTITUTE SHEET [X] = where time index over the encoding time frame vector phase angle indicating encoded response value for pattern t θ vector phase angle representing information within stimulus field element k for pattern t h(r,γ,t) magnitude component of stimulus-response association for stimulus element k and pattern t (see association profile eq. 9) The above encoding transformation defines a process whereby the dimensional parameter related to time within the correlation set is enfolded or collapsed. v Each element within the above correlation matrix (i.e. x ) sums the vector differences between element k in the stimulus field and the associated response vector over all encoded stimulus-response patterns. For example, matrix element x 2 sums the vector differences between element 2 of the stimulus field and the associated response value over all patterns l to T. The above SUBSTITUTE SHEET procedure achieves a state in which information pertaining to the encoded patterns are holographically superimposed and stored onto the same numerical value, memory location or storage space. pgcppnre The decoding operation is related to the associative recall of the appropriate encoded on "learned" response. This operation consists of reading data corresponding to any input stimulus and translating this stimulus through the correlation set. Using a practical example one may focus the video digitizing equipment upon the image of an apple to generate the associated numerical pixel data representative of the visual image. Performing a decoding transform through the correlation set X, for any stimulus bearing similarity to a pattern encoded over the established time frame, will result in the invocation of the learned output response. This decoding operation is similar to the encoding transformation in many respects. As previously defined, the stimulus field may be represented as a set of scalar values. S * = {s * ,S j ,S j , ... } The stimulus field is again mapped onto a complex vector set in which the scalar quantities are represented by phase angle orientations: S = {β'e ,^i , ββ 2 '<e .i * 2 , β & 3 <e ,^i - , . . . } ... eq. 18 SUBSTITUTE SHEET where β k - defines a complex vector magnitude indicating a weighting or influence of element k within the stimulus field. rl complex vector phase angle indicating informa¬ tion component of stimulus field element k Illustrating the operation of a single neural element, the decoding or expression of a response (r) is performed by evaluating the inner product of the stimulus field S * and correlation set X: N = 1 Σ s * (β k ,C k )-xU k ,θ k ,γ,Φ) ... eq. 19 c k where s * (β k ,C k ) = β k e i k c - renormalization constant adjusts the output magnitude to proportional values within the desired range (0-1) . This constant may be defined by any functional relationship over the stimulus and response field elements N - number of discrete vector elements within the stimulus field Rewriting equation 19 in an expanded exponential form and inte¬ grating for patterns the encoded over time tl to t2: t2 r . J ∑β k e iC J h(λ k ,γ,t)e i( *t "θ t ) dt ... eq. 20 n Supplementary Disclosure: To illustrate the property relating to expression of a learned pattern, the following limit theorem is applied . For simplicity of SUBSTITUTE SHEET illustration, all magnitude weighting values are assumed equivalent to unity (i .e . equal weighting of all vector elements) . For any stimulus field S* approaching the pattern state s encoded at time T, one may establish the following equivalence: ζ k = β k + € over stimulus elements k = 1 to N where e is a random pattern dissociation term, substituting the -*, * above into equation 20; = I N k c t2 + / .i ( » t - θ ξ j dt ^ τ*dt Applying the following limit as the stimulus field S- approaches the pattern state encoded at time T: e => 0 over t = l to N An approximation may be performed in descretizing the time integral within equation 21 . The following result if then obtained in the above limit: SUBSTITUTE SHEET r = I N eιΦ τ +Er(θf fT) ... eq. 22 c Th e f irs t term in the above solution represents the dominant vector genera t ed within the recognition response . This term displays a magnitude proportional to N with the phase angle Q^ corresponding to the dominant response phase information. The decoding transformation operates in the following manner for any stimulus input field ε- equivalent or similar to a prior encoded stimulus pattern (i .e . set S over learning time frame t - 1 to T) . On expression, the phase angle within the generated response will approach the encoded response phase angle for that associated stimulus pattern including, however, a deterministic "error" contribution as given by the above term Er() . This error term is analogous to a convolution of the remaining encoded pattern sets expressed as complex vectors within transform space and may be expanded to the following form: N . ] ζ t2 )ς Er(θ , Φ ,T) - Σe lβ T Σ e l ( *t "θ t ) . . . eq. 23 k t»ti toT This term presents a summation of the set of uncorrelated unit vectors comprising all the remaining encoded stimulus-response patterns. For an ideal case these vectors display a property of symmetry categorized by an even probabilistic distribution about the complex plan . The resultant error contribution increases with the number of patterns stored and the vector summation properties. SUBSTITUTE SHEET as illus t ra t ed by equation 23 , approximate a random walk path for the i d ea l symmetrical case . Reiterating, the response pattern store d at time T emerges as the dominant vector with a magnitude proportional to N and the random term Er() produces a fuzzinesε contribution within the generated response . The statistical variance on the magnitude for this Er() term is proportional to the total number of patterns encoded and establishes a practical limit on the number of stimulus-response associations that may be enfolded. This limit has been analyzed applying the theory of random walks (such as describing the characteristics of Brownian movement) . Empirical analysis indicates that for a multidimen¬ sional orthogonal co-ordinate system, assuming unit steps, the average magnitude resulting from a summation of n random walks is: H ... eg. 24 The above residual "error" contribution within the generated output response is deterministic and increases proportionally to the number of patterns stored. This residual contribution is in fact a function of both the number of elements in the stimulus field (N) and the number of discrete patterns stored (P) . The resultant mean error expressed as "fuzz" within the generated response may be approximated in percent full scale (2π phase region) by the following relationship for P/N ratios less than 0.5: Φ error = π vT ' *8***- aarrccttaann ... eq. 25 „*-τπ . τ*c StfEc . -Supplementary Disclosure: Th e above approximates the mean "error" with the generated phase component of the response assuming an ideal symmetrical system. A σain, symmetry refers to a uniform probabilistic distribution of vector elements orientated about an origin on the Riemann or phase plane as occurring for instance within a set of randomly generated phase angles having a uniform ' probabilistic distribution between 0 and 2π. Naturally occurring distributions displaying a more Gaussian shape may be transformed into this ideal symmetrical form by the use of a sigmoidal preprocessing function as elaborated in the section pertaining to Enhancements of Invention. It is important to note that the encoded stimulus-response patterns may be distinct and comprise complete non-linear or independent sets. Expressing the decoding transformation in a more canonical form, one may again define a matrix form to represent stimulus information: [S] * - ,...] ... eq. 26 As stated earlier, B κ is a magnitude term representing a dominance factor for each input element and vector phase angle indicating stimulus field information. The decoding operation is performed by the following inner product: [R] = B [S] ' [X] eq. 27 SUBSTITUTE SHEET where c is the variable for renor alization of the magnitude within the generated response. Supplem ntary Disclosure: C haracteristics of the decoding transformation are illustrated in the following more expansive fashion in which the output vector may b e represented as a summation of distinct response vector components . Each of these convolved vector components is a product o f the stimulus transformation through one of the stimulus-response patterns enfolded within correlation matrix [X] . An expansion for one generated response (one neuron) may be formulated as follows: where Λ t is the magnitude component for the deconvolved response vector corresponding to a stimulus transform through one stimulus -response pattern association encoded at time t Φ * t is the generated phase angle for stimulus transform through one stimulus -response pattern association encoded at time t For illustrative purposes a stimulus pattern variance term will be defined as the degree of correspondence between a reference SUBSTITUTE SHEET stimulus pattern and any subsequent input stimulus pattern . Representing the elements of these stimulus patterns conventionally within a real number domain, the pattern variance may be defined as follows: N - Σ < •*k..,t, ' * J k> y ' eg. 29 k-i" N where s. - elment k of reference stimulus * where s, - element k of input stimulus pattern Returning to the holoraphic process the response generated on translating an input stimulus [S]- through the correlation set produces a vector summation of generated responses, each response associated with a unique stimulus-response pattern enfolded within correlation set [X] as indicated by equation 28. The above deconvolved response vectors (i .e . Λ^e 1 1) resulting from the input stimulus transformation through one of the encoded stimulus- response patterns expresses a magnitude inversely proportional to the stimulus pattern variance as defined above in equation 29. In other words, each of the deconvolved response vectors possess a magnitude statistically proportional to the degree of closeness to the input stimulus pattern [S]-. As a result, encoded stimulus patterns displaying the greatest similarity to an input stimulus SUBSTITUTE SHEET [S ]- produce a proportionately dominant contribution within th generated response. Descretizing the time integral within equatio 2 0 the following summation form for the generated response i obtained . Equating the above with the expanded summation form in equation 28, each vector term within the deconvolved response may be determined k Λ k, ^•"t l e^tΣ β K.^k^^i^-θ^) eg. 3 Following the above, the magnitude and phase components may b evaluated directly where: Σ β k -h(λ k ,γ,t)cos(C k -θ ) V eg. 3 λ 12 Σ β k -h(λ k ,γ,t)sin(C k -θ k ) k J Φ t adjusting i t * for the principle angle . SUBSTITUTE SHEET Again applying the limit argument, as the elements (ζk . vitnia the stimulus input field approach stimulus pattern [S] encoded at time T, then: t iζ k _ i(θ^ - e k ) over elements k = 1 to N elements., eq. 34 where e is an error quantity. Resubstituting the above equivalence for equation 32 and 33 : Λ T =ι ∑β • h(λ k ,γ,T)cos(ej;) eg. 35 I 2,2 ∑β k -h(λ k ,γ,T)sin(£ )l I ∑β κ -hU κ ,γ,T)sin(Φ τ + eg. 36 Φ_ = arctan IC " ∑β k -h(λ k ,γ,T)cos(Φ τ +€ ) J As the elements of the stimulus field tend toward the encoded stimulus pattern, then, e_ over all k. And from this follows: SUBSTITUTE SHEET - » I Σ βk. c k hU\ γ , T) eq. 37 Φ The value Λ- represents the magnitude component for the input stimulus field transformation through stimulus-response pattern encoded at time T and presents the most dominant response phase vector component for a closely correlated stimulus pattern match . The generated phase angle Φ- ? , corresponds to the encoded response phase value for this pattern . Using a similar illustration, as the elements of the input stimulus field (ζ^) randomly diverge from pattern [S] encoded at time T, a limit may be assumed whereby a flat probabilistic distribution for e k_ is presented about the phase plane . At the limit of total non-correlation or random association between the input stimulus field [S] and encoded pattern [SJ-, the vector summation term as defined by equation 31 follows a random walk path indicating that the generated response magnitude approaches a normal probabilistic distribution centred about the origin . The uncorrelated response will generate effectively a random, however, calculable or deterministic phase angle orientation . This response vector will statistically display a distribution centred about the origin with an average magnitude approximated by: Λ β _. 1 (h(λ k ,γ,t)∑ β k )2 ~ ... eq. 38 c k SUBSTITUTE SHEET. where h() - average magnitude over stimulus elements In essence, the method by which the process operates is that a response value corresponding to any of the stored stimulus -response assumptions can be regenerated at any time by inputting a previously encoded stimulus pattern to the neural device (again recalling that the stimulus pattern could be a picture, a spoken word, or other parameter, and the generated response being the associated word, control action, respectively) . The above represents the mathematical basis for an information processing system whose canonical form for learning is presented by equation 13 and expression by equation 27. It is important to note that encoding and decoding operations may be interspersed such that both processes operate in effective simultaneity. S OF INVENTION The holographic neural device described herein may be modified in several areas to provide enhanced and improved operational characteristics. These enhancements may be realized in the application of encoding higher order statistics, non-linear filtering of the generated response, sigmoidal preprocessing, layered networks, commutative properties of neural elements, methods for establishment of a memory profile, and excitory and inhibitory synaptic connections. These are of course only a SUBSTITUTE SHEET limited subset of possible enhancements whose general concepts a described in the following: Supplementary Disclosure: NON-LINEAR FILTERING A non-linear scalar transform may be applied to the generat response, enhancing capabilities of the neural system with respe to recognition discrimination . As described previously, t response magnitude on decoding is statistically proportional to t degree of recognition . The generated response again may expressed in exponential form: 1 Σ β k e iJ Σ h(λ ,Y,t)ei(* t -θξ) . eg. c k t - λ'e 1 * The mathematical basis of operation being well defined, a threshol level on the magnitude component of the response (X ) may established, above which the neuron is known to have a hi probability of responding to a recognized (prior learned) stimulu pattern . This threshold may be applied by any class of non-linea functions but could generally employ a variation of the sigmoi function . The non-linear decoding operation may then be expresse by the following relation: SHEET (_____ -1 . .. r = ( 1+e a ) • e . . . eg. 40 where Tr - establishes the threshold limit σ - specifies the variance for the sigmoid function For a low variance within the above non-linear function, the neur element operates as a discriminator about the defined threshold limit (Tr) . This enhancement significantly extends the capability of the neural system in that the neural element functions as a highly sophisticated switch with analog capabilities, turning the output on (generating large magnitude) and propagating the response phase information only when the stimulus has a high degree of recognition. Similarly, the neural element switches off (generates 0 output magnitude) when exposed to an unlearned or unrecognized stimulus . SIGMOIDAL REDISTRIBUTION Many classes of receptor neurons are known to process input stimulus in a sigmoidal relationship. The sigmoid function forms a basis for many current neural models in its use as a threshold or scaling transformation . For the theoretical basis presented herein the sigmoid function also plays a significant role however it is employed for entirely different conceptual reasons . Sigmoidal preprocessing or variations thereof may be utilized to transform SUBSTITUTE SHEET naturally occurring distributions (i .e . distributions displaying Gaussian form) into the ideal symmetrical form. Again, the i d eal symmetrical form refers to uniform probabilistic distri b ution of vectors oriented about the origin on the phase plane . This sigmoidal redistribution is required to achieve optimal enco d ing capacity for the neural system assuming Gaussian input distributions. For example, one may assume that t h e stimulus signals, in relation to a pattern recognition application, represent pixel intensities . Typically this sort of input, as well as a large class of scalar fields representing quantities in physical systems, display an approximate Gaussian distri b ution as represented by the following probabilistic distribution f unction (p.d.f. ) : -**5(x-μ) /σ 2 p.d.f. = eg. 41 2τr where σ - standard deviation for distribution μ - mean of distribution x - scalar field intensity The sigmoid function or variation thereof may b e employed to translate scalar quantities within the stimulus fiel d into a near uniform probabilistic distribution ranging between 0 and 2 π, i.e. SUBSTITUTE SHEET The sigmoid function is commonly used within control theory applications but, more significantly, has been shown empirically as the approximate relationship by which certian classes of neuron cells, including retinal neurons, respond to input stimulus, as illustrated by Figure 4 . The inherent properties of sigmoidal preprocessing also resolves some conceptual problems encountered in the use of phase orienta¬ tions to represent sensory information or scalar field intensities . Information as represented within the phase domain typically extends over a closed range corresponding to 2π . In general, external field intensities extend over an undefined and possibly unbounded real number domain. The sigmoid function provides a direct means of transforming an unbounded real number domain defining any external stimulus field into a closed range extending about the phase plane . This sigmoidal mapping may be represented in the following form: θ k =2π [1 + e- F < s k' σ ^ ) ] " X . . . eq. 42 where in general (F(S j -.,σ,μ) - A[(s k -μ)/σ] β A,β € E s. - input stimulus element σ - standard deviation of stimulus field distribution μ - mean of stimulus field distribution - set of real numbers SUBSTITUTE SHEET I n the above transformation to a phase domain, a point d iscontinuity exists at the 0/2π orientation representing a limit at both -/+ infinity within the external real number domain . This vector orientation establishes a fixed point of reference at the phase boundary defining the +/- infinity discontinuity. In other words, limits at + and - infinity within the real number domain form a locus at a single immutable boundary in the translated phase domain (i .e . 0/2π) . A measure of initial symmetry ' for the stimulus field may be determined by performing a summation over the vector set defining the stimulus field [S]-. The resultant vector provides two important measures of input field distribution characteristics. The magnitude component is inversely proportional to the degree of symmetry in the stimulus field and the phase angle defines the principle angle analogous to the mean of the stimulus input distribution . The sigmoid function redistributes this stimulus field about the principle angle to obtain the desired symmetry. The Initial symmetry measure permits an interpolation between a sigmoidal and linear transform facilitating a means whereby information displaying any form or type of distribution may be mapped to a near ideal symmetric form. A preprocessing function employing the above concepts in an optimal form facilitates a system in which a majority form of stimulus-response data, covering a range of statistical distributions varying between Gaussian and symmetric, may be efficiently absorbed into the neural element. SUBSTITUTE SHEET. A characteristic limitation for this system relates to the number of patterns that may be encoded for a particular size of stimulus field. This limit is imposed by the statistical error relationship defined in equation 25. The pattern storage limitation may be overcome however by a preprocessing operation involving, in one form, the formation of Hermitian matrices. The process requires the formation of a set of complex vector elements relating to any subset of vectors in [S] to any other subset in [S] by their difference in phase angle orientations. The exact Hermitian form may be obtained by representing a set in S as a 1 by N matrix, whereby the following outer product is evaluated: [H] = [SJ • [S] eq. 43 The process however may be generalized such that a matrix [A] composed of any subset of the input stimulus field forms the outer product with the conjugate transpose of any other defined subset [B] e [S], i.e. T [H] = [A] • [B] where vector elements a,b e[S] ... eq. 44 To illustrate, consider the following subsets: SUBSTITUTE SHEET kN [A] = [λ k1 e iθ K.1 .Z λ' 2 e iθ .. λ kκ e .iθ eq. 45 B] = [λi'e iθJ1 , λi 2 e iθJ2 , ...λ"e iθJN ] Performing the operation defined by (44) produces an expanded input field of stimulus elements as represented below in matrix form: g(A«,λJ') β βk, - βJ, ) f , ... [H]= g (λ' 2 ,!^) e 1 6 " 2 -^, g(λ",λi 2 ) .* • <-*-*») eq. 46 where g(λ k ,λ j ) is a magnitude scaling function, i.e. typically g(λ k ,λ j ) = λ k -λJ For stimulus fields expanded as above and providing that product groups are unique, simulation results indicate the deterministic error generated within the response output follows the relationship defined by equation 25 considering now that the stimulus field contains NxM elements. SUBSTITUTE SHEET Supplementary Disclosure The above defines at an elementary level , the process by which higher order statistics may be encoded into the neural element. using this method, one may explicitly control mapping of Nth order statistics into the neural element . An input set expanded for 3rd and higher order statistics may be generated by the following sigma-pi relation, for example within the encoding transformation exoanded from eσuation 17 : where k<rυ - defines the nth element in a product term for the 4th order statistic as illustrated. The number of stimulus vector elements in the above product (i.e . 4 in this example) define the order of the statistic. The response error characteristic follows the relationship defined in equation 25 providing that the expanded set of product terms or "groups" generated for the neuron stimulus input field are unique . Unique in this context refers to the set of all combinatorial groups of n stimulus elements in which no two groups contain the exact same set of stimulus elements , uniqueness establishes a theoretical limit on both the number of groups over all statistics for any size of stimulus field. Again, "group" refers to the product of individual stimulus elements as defined below: N N π Ω λ ttn) e f(n)iθ k(n eq. 48 H«1 where N - order of statistic SUBSTITUTE SHEET k(n) - defines the nth product element for the W order statistic f(n) - operation for forming conjugate of the complex vector as any function of n The maximum number of expanded unique sets for a given statistic follows a distribution, in the order of the statistic, known as Pascals triangle . Table 3 illustrates this distributional relationship for stimulus fields from size 2 to 20. The total number of unique combinations summed over all higher order statistics is simply: 2 n where n is the number of elements within the stimulus field. The implications are important in that the generation of higher order statistics provides a mechanism by which an extremely large set of individual stimulus-response mappings may be enfolded onto one correlation set (i .e . neuron cell) . For instance, considering a relatively small stimulus field comprised of 32 information elements, 4 Billion unique higher order products may be generated permitting a proportionate number of mappings to be enfolded onto the neuron cell . The above product expansion process permits a mapping of second and higher order statistics into the neural element. Again, by expanding the stimulus input set to higher order terms it is characteristic of the holographic neural process that greatly SUBSTITUTE SHEET increased numbers of stimulus-response patterns or mappings may be encoded onto one neural element . This product expansion process also permits stimulus patterns displaying a high degree of overlap or non-linear separability to be encoded for separate or distinct responses . To illustrate the potential for increased pattern storage capacity applying the above Hermitian processing technique, consider an input stimulus field comprised of 4096 pixels (a visual field of 64 by 64 pixels) . To achieve a relative value of 5% for the average deterministic "error" within the output response, assuming random and uncorrelated patterns, the number of patterns that may be encoded (each pattern consisting of 4096 elements) is limited to less than 1000. If the input stimulus field is expanded to second order statistics, the number of stimulus-response patterns that may potentially be encoded is increased to 2.4 Million. -Supplementary Disclosure: A further important feature pertaining to the generation of higher order statistics is the property whereby any distribution of input vectors is inherently orthogonalized or made symmetric. The complex vector distribution obtained on expanding progressively higher order terms approaches an asymptote at the point of symmetry. This defines an important aspect of the holographic neural process in that any stimulus input distribution is thereb SUBSTITUTE SHEET inherently transformed into the ideal symmetrical form . Hermitian preprocessing performs a somewhat analogous function to hidden layers within gradient descent methods . For such models, hidden layers are believed to interpret the higher order statistics isometric between pattern templates categorized within a given class . Problems encountered are that one cannot analytically determine which higher order statics have been interpreted. In addition, gradient descent methods are considerably limited in the number of "higher order statistics" which they are able to decipher. Correspondingly, if the patterns vary by statistics other than those interpreted, pattern associations may not be correctly classified. One classic example of this is a claim made by one researcher, that he had devised a network which could discern between male and female faces . Upon deeper investigation of this achievement it was found that the gradient descent network had generalized a function which measured the distance between the top of the subject' s head and the edge of the picture frame . Deterministic or precise analytic control of the neuron mapping statistics as defined within the holographic neural method is not possible within gradient descent or back propagation techniques. MEMORY PROFILE An immediate observation in the application of a cumulative memory SUBSTITUTE SHEET within the holographic system is at.some point the storage capacit for stimulus-response associations is exceeded, resulting in th predominance of fuzz within generated responses. Severa techniques may be applied to prevent saturation of memory, all o which ultimately require limiting the average magnitude of vecto elements within the correlation matrix. The most obvious an direct method consists of applying a decay term to the magnitud components within the [X] matrix. The following example for given memory profile is derived from equation 17 defining a exponential decay for the encoded elements x k where: ** - c I h U k , γ, t) e^e 1 *: " θ [> — « * • 4 T - current time frame r - memory decay constant Providing that the input stimulus patterns produce a symmetri distribution over the learning time frame, the average magnitude o the correlation matrix elements x k is again governed by a norma distribution following the random walk scenario. For inpu patterns sampled at a constant rate, an equilibrium point i approached whereby the increase in the mean of the magnitud distribution I 33 for the characteristic random walk balances th exponential decay rate. As a general guide, saturation of memor can be avoided provided the above equilibrium point for a give rate of encoding and rate of memory decay r satisfies the followin relationship: SUBSTITUTE SHEET I 3 v ^ τ < (N- E(λ , γ , t) ) * . . . eq. 50 Dynamic memory may be expanded to several terms or decay coefficients in order to define a memory profile. Short term memory is characterized by coefficients defining a fast encoding rate and/or correspondingly fast decay rate, conversely long term memory is categorized by slow encode and decay rate. The memory concept permits a flexibility within the neural system to establish a dominance profile of stored information over a continuum range extending from immediate short term to long term and permanent memory. Supplementary Disclosure: iTOigirp-RT/g-TiTp-Rr QMI&VTIQ-- As mentioned previously, of principle concern are methods or processes by which any form of input distribution may be transformed into the ideal symmetrical distribution. Transformations involving mirror translations of subset of the stimulus input field may be applied to enhance symmetry properties. This process involves the mirror translation of a subset of vector elements within the stimulus field about a defined plane intersecting the origin. This process may be performed by the following operation: SUBSTITUTE SHEET λkeiθk = λ ^e i ( 2θr - θK) . . . eg. 51 where θ r - defines axis of mirror rotation the above translation substantially reduces variation in the distribution of vectors orientations within the complex or phase plane . The resultant smoothing of the distribution, by overlaying two similar distributions which are offset from each other, intrinsically enhances the symmetry of the input field. This mirror rotation process indicates an inhibitory /excitory grouping for subsets within the stimulus field, in the manner that increased stimulation of an input element within one class (i .e . inhibitory) will produce the complementary affect of increased stimulation for an input element within the alternate class (i .e . excitory) . It is significant to note that neurological studies indicate the existence of an excitory/ inhibitory grouping structure for the biological neuron and particular classes of neurons are known to possess both excitory and inhibitory connections within their synaptic arrays. fflmTrf*fcive Properties of Neurons The holographic neural process displays what shall be referred to as a "commutative" property whereby the generated response outputs from a plurality of neurons may be summed within the vector domain to produce a net response. Providing that the stimulus input SUBSTITUTE SHEET fields to all neurons are comprised of unique or non-overlapping sets of higher order statistics, the error relationship of the vector summation again follows equation 25, where N now represents the total number of stimulus input elements over all neuron cells . This vector summation operation may be indicated in a general form by the following relation: T [X] τ [S] τ = Σ [X] n [S] π n where [X] τ = {[X]-, [X] 2 , [X] 3 , . . .} [S] τ - {[S] 1f [S] 2 , [S] 3 ,- . . .} and [S], to [S] τ form unique sets of higher order product terms. Presented is a particular example of the commutative property in which the vector responses are summed over a set of 10, 000 neuron cells each possessing an input stimulus field of 10, 000 elements. Providing the higher order statistics representing all of the input elements are unique over all sets of neurons, the summed response characteristics are identical to one neuron possessing 100 Million elements within the stimulus field, said commutative property thereby permitting several million stimulus-response associations to be superimposed or enfolded onto the same correlation matrices within this body of cells . This configuration emulates particular well-defined cellular structures, indicating a potential "superneuron" structure within the cortex and cerebellum such as pertaining to the pyramidal cell complex. SUBSTITUTE SHEET Layered Networks Figure 14 illustrates a layered network where TG represents a group of neurons and refers to a device or set of devices that perform a simple transform operation from on input stimulus field [S] to an associated output response field [R] . A layered network consists of a series of transformation TGI, TG2, TG3 in which the output response field from one group or layer (TGI) feeds into the input stimulus field of a higher layer (TG2) . Any number of layers may be utilized to form more complex arrays of networks. Supplementary Disclosure: Each group of cells within a layer enfolds a large number of stimulus-response associations, such that the neuron layer functions in a manner similar to a content addressable memory. On propagation of signals throughout multiple layers, responses generated by stimulation of lower neural layers propagate associations through to higher layers . For an example, in Figure 14 the stimulus fed in at A associates to response B in the first layer, which in turn associates to response C in the second layer, and so on . In this layered configuration, associations may bifurcate along separate neural pathways or recombine in any definable arrangement depending upon the interconnection structure and the encoded stimulus-response associations . sm> i SHEET A second property of layered networks exists in the summation o response vectors . The "commutative" property of neurons permit the response output of several neurons to be summed effectivel producing a " superneuron" possessing greatly enhanced capabilitie for stimulus-response pattern storage . Multiple layers may b employed whereby each layer performs a summation over the axona processes (or generated responses) of previous layers, permittin greatly expanded numbers of stimulus-response associations to b encoded or enfolded on the same correlation set . The increase i information storage density by cascading neurons along a layer i proportional to the number of response vectors summed . Fo instance, performing a vector summation within the complex o Riemann (phase) plane for 1000 neuron cells of equivalent size wil increase the number of patterns one can enfold by a factor of on thousand. This property is contingent upon the stimulus field across all neuron cells following the property of uniqueness a described in the section pertaining to Commutative Properties o Neurons . Ptrt il Hetwprts A parallel network as illustrated in Figure 15 may be formed i which layers within the network consist of multiple neurons o transformation groups operating in a parallel configuration. I this case the output response field may feed into any of the inpu stimulus fields of a subsequent layer in any interconnection o SUBSTITUTE 72 arrangement. Any combination of both layered and parall transformation groups may be configured to form a highly compl array of interconnected neural elements. upplementary Disclosure: The advantages of parallelism in neuron layers is evidenced aga by the "commutative" property of neurons whereby the vector outpu from several cells positioned in a parallel array within a giv layer are summed within a vector space . This vector summati effectively creates a " superneuron" whose characteristics previously defined are identical to one cell possessing a stimul field size equivalent to the size of stimulus fields summed ov all neurons within the input array, facilitating informati densities of extremely high order. Feedback networks Figure 16 illustrates a system where the output response fields neural elements within higher layers feed the effects back in input stimulus fields of neural elements within lower or earli layers. Any configuration or arrangement of feedback systems m be employed. The neural device inherently provides feedba control for any situation in which the output response manipulat or modifies the local environment providing the input stimulu (ie. feedback via environment) . This concept may be visualiz SUBSTITUTE SHEET within a robotic control systems in which the input stimulus is axial position and rate sensors and the output response effects motor control. Any change in the response output (axis movement) modifies the input stimulus pattern thus effecting the subsequent generated response, and so on. It is expected that the above feedback mechanisms will significantly enhance the control capabilities within most applications of the holographic neural device. Supplemen ary Disclosure: Internal feedback or recurrent loops generated via the synaptic interconnections may also facilitate signal loops reverberating through enfolded stimulus-response associations. These recurrent loops will tend to stabilize to particular association pattern until em external stimulus effects the recurrent loop to assume a new state . Modifying or Applying Magnitude Component The form of the equations referred to earlier deal primarily with phase angle, having the magnitude component for the elements within the stimulus field set equivalent to unity. A magnitude component however may be assigned to each of these stimulus elements. This effectively assigns a "weighting factor" and determines the effective dominance of that element within the stimulus field in SUBSTITUTE SHEET generating the output response. sparse Matrix Teehniouea In some applications it may be desirable to eliminate some of the transformation elements within the correlation matrix [X] (equation 17) . This effectively produces a matrix, some of whose elements will be null or 0, and will be referred to herein as a sparse matrix. This technique has the effect of reducing the resolution thereby increasing the deterministic error or fuzziness components within the generated response field. An advantage may be realized in that the number of transformation operations are correspondingly reduced (ie. reduces execution time) . Supplementary Disclosure: -g-πr-ΛK-f HQDB In the event that calculational simplicity is desired for reasons of either speed or hardware restrictions, this holographic process may be reduced or simplified to a binary system. Operational capabilities are significantly reduced, however simplifications are realized in that the encoding /decoding transformations may be performed entirely within a simpler scalar number domain. This simplification involves elimination of one axis within the phase plane thereby allowing information representation only at the 0 and SUBSTITUTE SHEET. π phase orientations . The above simplification to a binary system hence permits only sets of stimulus-response patterns consisting of binary (-l/+l, o/l, or 0/ττ) states to be encoded / decoded . All associated enhancements stated herein operate in the same manner for this binary system as for the previously defined complex system, considering know that only two phase positions are permitted in the representation of informatio . COMPARISONS TO THE BIOLOGICAL SYSTEM In order to fully understand the operational characteristics and implications of this device, indicated are some significant similarities between the holographic neural process described herein and characteristics of the neurobiological system. It is estimated that the human brain possesses in the area of 25 Billion neurons. Like all animal cells, each neuron is bounded by a cell membrane enclosing the contents of the cell - that is the cytoplasm (cell fluid) and the nucleus. The size and shape of these neurons vary widely, but the structural plan always contains certain elements (Figure 2) : a cell body or soma, and the processes from this cell body, namely an axon (neurite) and usually several dendrites. The classification of these neuronal processes in terms of axon and dendrites is made on the basis of function. SUBSTITUTE SHEET The axon links the nerve cell with other cells. The axon of other cells terminate on the cell dendrites and also on the soma. Axons and dendrites normally divide " into a varying number of branches after emerging from the soma. The junction of an axonal ending with another neuron cell is called a synapse. The majority of neurons are connected to other neurons to form neuronal circuits or networks. the axons of a small number of neurons connect with the striated skeletal muscles, the smooth muscles of the viscera and glands and are termed afferent nerves. Conversely, specialized nerve cells that response to certain changes in the organism or its environment transmit these responses to the central nervous system and are called receptors. Each receptor cell is specialized to respond to a particular form of stimulus, thus arises the important concept of sensory modality. Vision represents one form of modality, audition another and taste yet another. Stimulus perceived by these various sensory modalities form the basis of information which is processed and stored within the neuronal system. Propagation of information within the biological neuron occurs in the following general manner; signals relayed in the form of pulse modulated waveforms received by the cell dendrites and soma and mediated via synaptic connections. Conversely, in response to these signals received, the neuron generates an output pulse modulated waveform travelling via the axon and collaterals to subsequent SUBSTITUTE SHEET layers of neuron cells. The general structure of the neuron with respect to the signal pathways is illustrated in Figure 4. The theoretical basis described herein will be reiterated within the context of the following description, as a possible mechanism for information processing within the biological neuron. It is proposed that the individual neuron cell has the ability to enfold a massive amount of information in the form of stimulus-response associations onto its synaptic connections and emulates a similar encoding/decoding mechanism as defined herein. As mentioned above, each synaptic connection within the dendritic structure of the neuron receives a plus modulated waveform characteristic of Figure 4. These waveforms may be illustrated in an abstract form with pulse frequency representing information and abstractly defining a vector orientation on a Riemann or phase plane. The stimulus waveforms received by the synaptic connections may be represented, as previously defined, by the following notation: [Sl^fλ'e 1 ® 1 ,λ 2 e iθ2 ,...λ"e iθ *] ... eq. 52 Similarly the output or response waveform learned by the cell in association to the above stimulus may be represented by the complex element γeiΦ. It s proposed that the encoded response associa- SUBSTITUTE SHEET tions are read via a pathway separate from dendritic processes, possibly via the axo-somatic connections. Following the Hebb hypothesis, biological structures within the area of the synaptic connections are modified in response to stimulation implying a mechanism for information storage. No claims or explanation is presented with respect to the biological mechanism involved, however, it is proposed that the stimulus-response associations are learned in a general sense by the vector matrix encoding transform as defined previously and presented below T [X]-[S] eq. 53 The generated set of correlation values are presented in expanded form whereby information is encoded over a descretized time axis. For simplicity, only first order statistics are indicated in the following equations: Σ h(λ , ,γ,t) ,e i ( *t- θ t ) eq. 54 [X]- t The correlation matrix forms a mathematical analogy of the synaptic connections defining a highly abstract representation for information storage. The theory proposes a mechanism whereby all learned stimulus-response associations are superimposed or enfolded SUBSTITUTE SHEET upon the same storage medium within a phase domain, in this case biological structures in the area of the synaptic connection. As mentioned previously, decoding or expression of a learned response may occur concurrently with encoding trans ormations, on stimulation of the dendritic synaptic connections by a series of externally pulse modulated waveforms, the assumption is made that the biological equivalence of the following complex vector inner product transformation occurs within the body of the cell: R-l [S] ' [X] eq. 55 c Again, the complex quantity R represents the generated response waveform travelling via the neural axon and collaterals to subsequent layers of neurons. The process indicates that relatively few cortical layers are required to perform highly intelligent associations and control actions. Supplementary Disclosnre: It is surmised that in a very general sense the lower cortical layers within the neurological structure implement functions simile-: to sigmoidal preprocessing and generation of higher order statistics . The theoretical basis would indicate that the bulk of associations and learning processes are performed within the highly bifurcated dendritic structure of the stellate and associated cells located in the cerebral cortex and cerebellum (Figure 5) . The above forms the basis for a non-connectionist approach in which the mechanism of learning (enfolding of SUBSTITUTE SHEET information) and expression is performed within the individual neuron cell. This process suggests that the neuron cell despite its extreme complexity and structural variation may process information in a highly generic fashion. Specificity of function could be determined by the synaptic interconnection map, formed as the biological system undergoes maturity. The governing equations are ideally suited in this manner to generality, in that the algorithm permits a synaptic connection matrix of infinitely flexible form, the neural elements may be structured to facilitate any permutation of cross association between various form of sensory modalities and motor effector responses . It may also be illustrated that a very close isomorphism exist between the mathematical basis and the general structure /external signal processes of the biological neuron (Figure 4) . Another operational feature of the process is that neural elements operate optimally in a completely asynchronous fashion. In other words, generality of operation is maintained in that no coordination or timing considerations are required between distinct neuron cells . Extensive simulation of the holographic theory illustrates that highly comple learned associations may be extracted from the neural system upon traversing a single layer. As mentioned previously, there exists a wide structural variation between different classes of neuron cells within the central nervous system (Figure 3) . For an example, stellate and Martinotti SUBSTITUTE SHEET cells within the cerebral cortex possess a widely bifurcated d en d ritic structure and an internal microtubular arrangement indicating a possible mechanism for encoding /decoding as defined within the fundamental holographic process . The principal cell of the cortex, the Pyramidal cell, displays few dendritic arborizations however a very large number of synaptic spines over the surface of these dendritic processes . This sort of structure is also characteristic of the principal neuron of the cerebellum, namely the Purkinje cell . Another third group of neuron cells possess quite a different structure, these being characteristic of spinal neurons whereby no defined axonal process exist, however, a plurality of dendritic-like arborizations extending from the cell receiving a plurality of inputs and generating a plurality of outputs . The holographic neural process as defined involves several important precursors and novel implications that reflect a possible role in each of the above variant types of neuron cells . One of the principal requirements again involves the fundamental concept of symmetry. As noted in the section pertaining to higher order statistics, the ideal symmetrical state may be achieved through expanding input stimulus fields to higher order statistics . The bulk of visceral and external sensory inputs axe transmitted via pathways within the corticospinal and spinocerebeller tracts. These raw signals unmodified would most generally display highly non-symmetrical distribution characteristics . Soinal neurons SUBSTITUTE SHEET possess the structure illustrated Figure 3 , indicting extensive arborizations for both input/output of signals having no defined axonal process . This neuronal structure could facilitate a modification of global input stimulus patterns whereby all forms of sensory modalities may be expanded to higher order product (i .e . higher order statistics as efferent information propagates along the spinal column) . A process of this type would inherently transform stimulus distribution characteristics into the ideal symmetrical form prior to transmission into cortex and cerebellum neural structures . The cortex contains principally three types of neurons: stellate cells, Martinotti cells and pyramidal cells . The intercortical circuits defining the interconnections of processes from these cell types are reasonably well known, however little is known regarding specificity of function. Referring to Figure 5, stellate cells receive signals originating from corticospinal tracts primarily via the thalamic system. The axonal process from the stellate cells synapse largely upon the synaptic spines of proximal pyramidal cells. These pyramidal cells, being the principal cell type of the cortex, have axonal processes terminating at all levels of the cortex, and extending down the corticospinal tract terminating upon motor neurons along the spinal cord. Martinotti cells operate primarily in a feedback mode receiving inputs from axons of pyramidal cells generating an output signal terminating upon dendritic processes of stellate and pyramidal neurons along more SUBST SHEET superficial layers of the cortex. Given the characteristics of the holographic process and the general structure of cell types, one may define a role or distinct separation between functionality for each of these cell types . Again, referring to the section pertaining to the "commutative" properties of holographic neurons, this defines a property whereby the vector summation of resonse outputs expressed over a plurality of encode/decode neurons may be executed, effectively producing a " superneuron" possessing greatly enhanced capabilities for information storage . On investigation of the above structure and intercortical pathways associated with the stellate and Martinotti cells it is evident that these cell types are ideally suited for execution of the encoding /decoding operations as defined within the principal holographic method. Pyramidal cells have a structure and intercortical connections suited for execution of the vector summation over proximal stellate and Martinotti cells thus performing an operation analogous to the "superneuron" process. This holographic model of operation indicates that one pyramidal cell, in association with the supporting proximal stellate/ Martinotti neurons, is capable of enfolding significantly greater tahn 10 s in the area of one billion stimulus-response associations onto its correlation set - (i .e . synapses of proximal stellate/ Martinotti cells) . Given that the above entails 20-40, 000 stellate /Martinotti cells and one pyramidal cell forming a very small percentage of the total cell population, the holographic SUBSTITUTE SHEET oroceεε defines a mechanism by which a structural embodiment resembling features of the central nervous system could function at a very high level cf complexity . MVMORY CAPACITY AND RATE OF PROCESSING The operational characteristics of a single pyramidal cell complex is determined below applying the holographic theory, having similar characteristics for smaller scale, systems verified by Monte Carlo simulation . This example of cortical structure and related storage /processing capabilities is based on the pyramidal cells of Betz located in the motor cortex. These pyramidal cells execute direct control in the innervation of specific motor neurons. Current study indicates that this type of pyramidal neuron contains up to 100, 000 synaptic spines receiving inputs from axonal processes of both proximal and distal stellate /Martinotti cells . The number of stimulus-response patterns that may be enfolded onto a single pyramidal cell complex is determined below applying the following assumptions: (i) the proximal stellate /Martinotti cells receive on average 40, 000 axo-dendritic synaptic inputs; (ii) the stimulus field inputs of proximal neuron cells have been transformed into ideal symmetrical form in expansion SUBSTITUTE SHEET to higher order statistics; (Hi) the set of higher order statistics or input signals are largely unique across all dendritic inputs to the group of stellate /Martinotti cells; (iv) the number of stimulus-response associations enfolded are such that deterministic "fuzz" generated on expression to a learned stimulus association is on average ± 2% of full scale (absolute) . Applying the commutative property of neurons and a configuration which represents the pyramidal complex as executing a "superneuron" process, exhibiting properties substantially equivalent to one neural element containing the following number of synaptic inputs: 100, 000 dendritic spline inputs to pyramidal cell x 40, 000 synaptic inputs per stellate /Martinotti cell = 4.0 Billion higher order statistics within the pyramidal cell complex Extensive computer simulation applying Monte Carlo techniques have shown that the error relation of equation 25 in invariant to the number of higher order statics fed into the neural element or neuron complex. Applying this error relation, the number of stimulus-response associations that may be stored within a single pyramidal neuron complex is: SUBSTITUTE SHEET p = N [tan(.02 π v8) ... eg. 56 - 710 Million stimulus-response associations Accounting for the entire set of higher order statistics, each stimulus-response association corresponds to 4 Billion elements of information (N), therefore the content of information encoded within the series of stimulus -res Donse associations is: = P x N = 4 Billion higher order terms x 710 Million stimulus-response patterns . . . eq. 57 = 3 x 10 19 elements of information In a practical sense one may assume that an element of information represents one analog value descretized to a resolution of 256 levels. This information element may be represented by one byte within a conventional computer memory. Applying the holographic theory, approximately 3 x 10— elements (bytes) of information in the form of stimulus-response associations may be encoded into one neuron complex of a structure resembling the pyramidal cell of the motor cortex. Upon stimulation via the dendritic synapses, the characteristics of the above neuron are such that the input stimulus field is transformed through the above accumulated mass of information, issuing a response in a near instantaneous fashion. To illustrate the effective processing speed, a comparison is performed with the standard linear search technique . Within all SUBSTITUTE SHEET linear search methods images to be recognized must be individuall stored and compared against pattern prototypes in a sequentia manner. Matching algorithms classify the input on a best fi approach . In general , pattern elements may be represented withi an N dimensional orthogonal space . The elemental operation withi the representative linear search algorithm computes the differenc along the dimensional axis between the input pattern and a singl reference prototype . The summation of these distances along eac axis in N space is proportional to pattern variance in which eac of the elemental terms are computed as follows: (a k - b k ) 2 ... eg. 5 If where a - element k of input stimulus field h - element k of prototype pattern t The above operation may be performed to generate a set of varianc terms for each pattern prototype . These variance terms are employed in some functional relationship F r () to generate a desired response or decision, i . e . : -! σ l i ^2 ' σ 3 ' • • • ) , ... eg. 59 where output - Σ F α t ^ τ - The holographic process performs a roughly similar function to the linear search above however the operation characteristics are significantly more computationally efficient . The elemental vector SUBSTITUTE SHEET transformation providing a corresponding function to the scalar difference solution presented previously in equation 58 is as follows: .i ( C k - θk) e i ( Φ t ) eq. 60 By representing information as complex vector orientations, the following phase translation properties are realized, whereby; as any input stimulus element approaches the corresponding prototype _ v element ( ζ *-*β ) the generated phase in the response is translated into the desired or learned response (Φ t ) . A second property resulting from this vector representation permits the above exponential terms for each element across all reference prototypes, to be convolved onto one correlation element (x. ) . A single transformation through the correlation element as performed by the holographic method is given as: 7.1 x 10° M k Σ I → ) ... eg. 61 t In consideration of the pyramidal cell example, the above transformation would perform a function mathematically analogical to 7.1 x 10 comparisons within the linear search method (i .e . equation 58) . At the biological level, illustrating a comparison with conventional processing means, one may conservatively estimate that the response cycle time for the neuron cell is 100 SUBSTITUTE SHEET milliseconds . The effective processing speed of a single pyramidal cell complex may be estimated assuming an information storage capacity of 3 x 10— bytes as determined above . In executing a response generation within 100 milliseconds using a linear search without reduction or elimination of data, the following number of comparisons per second are required: 3 x 10 19 data elements / 100 ms response period - 2 x 10 20 comparisons / second It is a fair assumption that one supercomputer could be capable of performing 100 Million comparisons per second. For a performance comparison, the above structure suggests that one would require approximately 3 x 10& supercomputers executing a linear search to approach the information processing capabilities of a single neuron complex, processing a structure similar to the human pyramidal cell of the cerebral cortex. _________________ One may regard the neural process as a new control paradigm. The representation of this control system may be illustrated in a conventional manner (Figure 6) with multivariable input, control output, and response output processes. This black box approach would define the fundamental control element . As in any control system multiple elements may be configured in any definable manner *J Cα^ l I i I- ' i ύ t SHEET to execute a particular function . The principle difference with conventional processes lies in the capability and the manner in which this control element performs its function . To provide an analogy to state space control theory, the control element permits direct encoding or mapping of multivariable input states onto a control output . The mapping scheme would require no linear dependence between sets of input states and output. The mapping scheme would require no linear dependence between sets of input states and output control- values . As confirmed through simulation, the system displays- a large immunity to input distortion such that a wide region in state space adjacent to the mapped input state will result in only slight distortion of the generated output . This immunity to input noise is performed without employing any mechanism of feedback. On a somewhat more abstract level such stimulus -response mapping defines an area of influence or "hyperellipsoid" within the N dimensional state space . One may manipulate both the geometry and size for these mapping zones by explicitly defining the Nth order statistics (Hermitian preprocess operations) and associated magnitude quantities . Employing these methods, generalizations formed during the learning process are intimately controllable. Concurrently with this response mapping or learning, the system may issue a control action as a transformation of the input state SUBSTITUTE SHEET through the accumulated state space mapping. The input state i transformed through all of the enfolded mappings in an inherentl parallel manner as discussed earlier. Each of these mapping issue a response vector whose degree of dominance convolved within th generated output is proportional to the degree of closeness to th input state . This state space comparison however is not directl applicable to conventional control theory in that the dimensiona axis are not defined in terms of real values within a Euclidia space, but vector orientations within a multidimensional phas space . One could envisage a system in which the control element dynamically learn or modify a state space mapping and emplo variables such as rate of learning and memory profile . Such control element would execute environment feedback in the followin manner. A Subset from the external field generating a stimulus i transformed through the control element issuing a response . Thi response action directly or indirectly effects the environment thu modifying the external stimulus fed back into the control element . This feedback process would continue in a closed loop fashio between the external environment and the control element. Concurrently while the above iterative feedback process i functioning the encoding or learning transformation modifies the stimulus-response state space mapping in response to the changin external environment . SUBSTITUTE SHEET The control element mapping embodies abstract representation of the external environment and its influence within this environment . The operation of the above system employing environmental feedback, even within a relatively simple framework, may preclude a reductionist analysis and appears to evolve a control system of near infinite complexity. BRIEF DESCRIPTION OF THE DRAWIMQ Embodiments of the invention will now be described by way of example only, with reference to the accompanying drawings and tables wherein: Table l represents the probabilistic standard deviation error within the response as a function of the number of encoded patterns. Table 2 list of phoneme codes. Supplementary Disclosure Table 3 lists the number of unique sets of higher order statistics as a relation of both the order of the statistic and the size of the input stimulus field. Figure 1 illustrates the general components of a neural element as standard within current gradient descent models . Figure 2 illustrates in general the components of the biological neuron. SUBSTITUTE SHEET Supplementary Disclosure Figure 3 illustrates the general structure of a variety of biological neuron cells . Figure 4 illustrates in general the signal processing characteristics of the biological neuron and sigmoidal response characteristics. Supplementary Disclosure Figure 5 illustrates the various neuronal connections and internal neuronal loops within the cerebral cortex. Figure 6 illustrates environmental feedback through a neural control element Figure 7 illustrates a simple embodiment of a hardware configuration for the artificial neural device for one neural element. Figure 8 illustrates in general an example of a hardware configuration for a visual to auditory artificial neural device. Figure 9 illustrates a digitized visual image represented by pixels within the visual field. SUBSTITUTE SHEET Figure 10 illustrates a digitized sonogram for auditory input. Figure 11 illustrates the application of an artificial neural system within an automatically controlled transportation vehicle. Figure 12 illustrates patterns that correspond to incremental movements of a robotic system over a given time frame. Figure 13 illustrates a decision tree. Figure 14 illustrates a multilayered neural network. Figure 15 illustrates a layered parallel neural network. Figure 16 illustrates a feedback neural network. Supplementary Disclosure Figure 17 illustrates eui embodiment of hardware configuration for the artificial neural device within a single processing node . Figure 18 illustrates an embodiment of a 16 node hypercube configuration for link communication between processing nodes . Like parts will be given like number throughout the figures SUBSTITUTE SHEET. DE8CRIPTIPN OF TgE PRCTgRREp gKBp IKEWTS ELEMENTARY MODEL (FIGURE 7) An innumerable variety of physical configurations or hardware embodiments of the neural process described herein may be conceived. The intent is to illustrate examples of a physical embodiment of an artificial neural device employing the described holographic neural process. The hardware embodiment of this device however is not limited to any particular type of device configuration or information storage or processing medium. The hardware embodiment is illustrated in Figure 7. In this example, sixteen stimulus inputs are shown. It is expected that analogue signal multiplexing techniques would be employed to increase the number of elements within the stimulus field [S] to any desired number. The input signals are oscillating waveforms having vector phase information represented by frequency and vector amplitude represented by signal amplitude. This signal waveform is generally similar to the neurobiologically generated impulse believed to transmit information. Employing the above mechanism for information transmission (oscillating wave or pulse modulated signal) also realizes an advantage in that only one signal line is required to transmit both phase angle and magnitude components of informtion. During an encoding operation the input stimulus field elements (1 SUBSTIT TE SHEET t o 1 6) are transformed into a digital representation of phase angle and magnitude via the demodulating circuit (A) . A separate phase and magnitude component is determined for each of the input stimulus elements. The associated output response for encoding is read in via demodulating circuit (E) and similarly converted into a digital representation of the phase angle and magnitude components. The digital encoding unit (F) performs the complex vector transformation as defined within equation 13 to encode the stimulus-response pattern into storage unit (C) . Unit (C) stores the encoded information and represents the axo-dendritic synaptic connections. During a decoding operation the input stimulus signal elements are transformed into a digital representation of phase angle and magnitude via the demodulating circuit (A) . As above, separate phase and magnitude components are determined for each of the input stimulus field elements. The decoding unit (B) reads the binary representation of the input stimulus signals and the corresponding encoded vector elements [X] from unit (C) . The appropriate elements of [X] may be determined via an address enable IN bus controlled by external logic. Unit (B) performs the decoding operation defined by equation 27 using the input stimulus elements [S] from unit (A) and the encoded elements [X] from unit (C) . The output response is transmitted to the frequency modulator unit (D) which converts the binary representation of the vector or complex number into a waveform with frequency representative of vector phase angle and SUBSTITUTE SHEET signal amplitude representative of the vector magnitude. Several of these neural elements may be connected together in an configuration to form an array of neural elements operating in simultaneous or massively parallel fashion. The followin illustrates six ANS devices that may be derived from the process referred to earlier. A virtually unlimited number of devices an applications may be conceived, however the purpose here is to illustrate the range of applications to which the ANS device as described herein may be employed. Pattern to Voice Transcription Davice (Vision Recognition) A vision recognition device embodying the invention as described above is schematically depicted in Figure 8. The visual recognition device comprises conventional hardware for capturing and input of the visual data to the encoding/ ecoding neural system. This device l employs the use of a single transformation group (TG) to perform the visual to auditory conversion. The hardware requirements for the device l are as follows: (a) video camera 2 capable of generating a standard analog video output; (b) a digitizing device such as a video signal digitizer 3 SUBSTITUTE SH capable of receiving analog video signal input. This digitizing device 3 separates video scan lines into an array of "pixels". In one application consider a pixel field of 64 by 64. Each pixel is represented by a value which is proportional to the average intensity of the scan lines within that pixel field, as shown in Figure 9. (c) a neural processor capable of storing and processing data or signal information. The artificial neural system may be embodied by any physical hardware (specialized or general purpose) configured to perform the required process as described earlier. In order to simplify this example one may assume that a series of phonemes comprising the output response will be encoded and the hardware handles the translation from phoneme to spoken output. Each spoken word consists of a list of phonemes. Approximately 36 phonemes are required to verbalize the majority of phrases within the English language. Using the artificial neural system described herein the visual data stream generated by the video signal digitizer 3 (series of pixel values) is translated to a verbal output (list of phonemes) at speaker 12. The encoding/decoding procedures performed within the process are illustrated as follows: SUBSTITUTE SHEET Encoding The video digitizing equipment 2 generates for example a series of 4096 bytes which represents a field 64 by 64 pixels for visual input. The pixel stimulus input values are translated into vector phase angles 5 such that they fall within the range of 0 to 2ιτ. The visual input field shall be represented by [S]. The corresponding output response 10 for that visual stimulus is either a spectral harmonic representation for the spoken word, or an equivalent list of phonemes- each defined by a numeric representation; the later shall be illustrated for simplicity. For example, assuming that the video camera 2 is focused on a picture of a house and the response is to be utterance of the word HOUSE. This word may be reconstructed with 4 phonemes: h , o , u , s. The representation for these four phonemes must be encoded into Memory and neural processor l. A total of 36 phonemes (See Table 2) may be chosen to make up the sound therefore a selection mechanism must be determined. For convenience, two base 6 numbers have been chosen to represent the choice of phonemes (i.e. 6 2 = 36 possibilities) . Each base six number is represented by two elements in the output response field [R]. Allowing for a capacity for 4 phonemes to be encoded requires 8 elements within the output response field [R] . Again, in representing a base six digit, the complex plane must be divided into 6 regions, each section separated by 60 degrees, for SUBSTITUTE SHEET. example, with boundaries defined t: Therefore , for the response h , o , u , s the encoded output would consist of the following: [Y] = (ϊr, jr/3 , π/3 , 4π/ 3 , 2rr , π/ 3 f 5ιτ/3 ,τr . /3 ) . . . eq. 62 h o u s The actual phoneme response could be input via keyboard 13 and the conversion to a set of complex values (phase range 0 to 27) performed. The input stimulus [S] and encoded response [R], transformed into arrays of vectors by units 5 and 6, compromise the data fed into the neural system encoding processor 9. Sigmoidal preprocessing and expansion to higher terms is per ormed on input stimulus data. A correlation matrix [X] is generated and stored in volatile memory 8 accessible to the neural decoding and encoding processors 7 and 9. The stimulus-response patterns are encoded into the correlation matrix [X] via the neural processor 9 performing the following operations. These steps are performed for each element (x. k ) within the correlation matrix [X] : 1. Read the phase [Ph] and magnitude (Mag) components for each SUBSTITUTE SHEET element of (x- and convert into real (Re) and imaginary (Im) parts. Store the converted values in a data buffer within the neural encoding processor 9. 2. Read the phase angle (Ph) component for element (s.) from the input stimulus array [S], and element (r k ) from the encoding response array [R] . Place these values in buffers within the neural encoding processor 9. 3. Perform sigmoidal preprocessing and expansion to higher under terms as defined in sections- pertaining to Enhancements of Invention. 4. Perform the following logical operations within the neural processor 9: Re(x k ) ■ COS [Ph(r k )-Ph(s.) ] + Re(x JΛ ) eq. 63 Im(x jfk ) = SIN[Ph(r k )-Ph(s.)J + Ia(x J , . eq. 64 5. Determine the phase angle (Ph) and magnitude (Mag) for the j,k component of [X] by employing the following operations: Ph(x, ... eq. 65 Note that Ph(x τ must be adjusted to the correct SUBSTITUTE SHEET quadrant within the complex plane. Mag (x j k ) = [Re (x Lk ) 2 * Im(x i k ) 2 3* . . . eq. 66 Store the phase and magnitude components of the above elements of [X] back into volatile memory 8. The above illustrates the encoding portion of the process. This process may be repeated to encode a plurality of stimulus/response patterns into the correlation matrix [x] . Note that the neural processor 9 should optimally be configured to perform the con¬ versions (step 3 to 5) in as parallel a fashion as possible. A matrix processing device or configuration within the neural processor is therefore desirable. The above operation may of course be performed sequentially as in conventional general purpose computing devices, however, processing time may become an inhibiting factor. Decoding A similar operation of encoding is performed on decoding or associating subsequent stimulus input to a response. A video signal is generated by video camera 2 and feeds input to video signal digitizer 3 separating the image into a 64 by 64 pixel array. Again the pixel values are proportional to the gray scale or intensity level. These pixel values are converted into vectors 5 (i.e. SUBSTITUTE SHEET information represented by phase angles oriented between 0 and 2ιτ) . This stimulus field shall be represented as [S] * and elements of [S]" translated into phase angles are read into volatile memory accessible to the neural decoding processor 7. The following operations are performed on the complex elements within the correlation matrix [X] and the elements within the stimulus field [S] * . 1. Read the phase (Ph) and magnitude (Mag) component for complex elements (X j k ) of the correlation matrix [X] . Store the above values in a data buffer within the neural decoding processor 7. 2. Read the phase angle component of elements (sV) from the stimulus input field[S] * and store the value in a data buffer within the neural decoding processor 7. 3. Perform same sigmoidal preprocessing and expansion to higher order terms as defined in step 3 of encoding process. 4. Each element (r * k ) within the output response field [R] * is then evaluated within the neural decoding processor by performing the following operations. Note that the following is a summation over all j=l to N elements of x.. and s ; * . SUBSTITUTE SHEET N Re(r k ) =1 r Mag(x r J X COS [Ph(s * ; ) - Ph(x r -).] eq. 67 N j=l N l m(r' k ) =1 Σ Mag(χ. k ) X SIN [Ph(s * ; ) -r Ph(x rir ).] eq. 68 N j=l ' The above steps must be performed (i.e. step 1 to 3) for each of the output elements within the response field [R] (k = 1 to 8) . 5. Following the above summation operation, each element of the output response field [R] is converted by the neural processor into the corresponding phase and magnitude values as follows: Ph(r * k ) = arctan [ In(r k ] ... eq. 69 Re(r k ) J Noting that an adjustment must be made for the principle angle. Mag(r k ) = [Im(r k ) 2 + Re(r k ) 2 3 V2 ... eq. 70 The phase component Ph(r k ) contains the output information (phoneme identification) while the magnitude component provides a value statistically proportional to the degree of recognition. The above output response elements for [R] * , are read by an output stage 10 which converts each of the phase values Ph(r * k ) SUBSTITUTE SHEET into a base 6 number, employing the following conversion formula: value - INT [ 3Ph(r"i ] - 1 ... eq. 71 I π ' J 2 Note that this illustrations pertaining to scalar stimulus and response signal conversion to and translation from phase angles is a specific implementation or functional detail being entirely modifiable depending upon specific application. The above illustration represents one example out of an unlimited variation of conversion or translation procedures that could be conceived. 7. The base six number values identifying the output phoneme each consist of two digits (output elements) . These response values are converted into the corresponding auditory response employing a conventional hardware device for generation of auditory speech output 11. The above provides a very simple illustration of an application for the neural device employing only a single transformation group. This illustration transforms the input sensory modality of vision into an effector response of audition. These visual patterns may be of any form or degree of complexity (i.e. face, vehicle, any object) . SUBSTITUTE SHEET As described in step 3 of both the encoding and decoding processes, a further embodiment related to the memory storage capacity may be performed by expanding both the input stimulus field on encoding and on decoding to higher order terms (i.e. Hermitian matrix form) . The Hermitian matrix would be evaluated within the neural processor by the following expansion operation: T [H] = [S] [S] ... eq. 72 T where [S] is the complex conjugate of [S]. The resultant effect of the above operation is that the stimulus- response storage capacity could potentially exceed several Million associations prior to onset of excessive misclassification error. The above operations would again optimally be performed by dedicated matrix processing hardware within the neural processor. voice to Text Transcription Device Voice to Text Transcription is another example of the transforma¬ tion of one form of input sensory modality (i.e. hearing) into an effector response (i.e. transcription). This neural device application would embody encoding and decoding of a voice input stimulus to an associated type or ASCII output. In this applicatio the input stimulus field would consist of a digitized sonogram. sonogram is one means of expressing auditory data and indicates SUBSTITUTE SHEET intensities of harmonic content over a given time axis. An example of a sonogram is presented in Figure 10. Much like a digitized visual input field, a sonogram may be divided into a pixel field, with frequency along the vertical axis and time along the horizontal. For this example, assume a resolution for the auditory input along 32 frequencies and 32 time steps. The output field will consist of 12 elements. These response elements may represent ASCII characters in a similar fashion as presented in the previous example (two base 6 numbers per character) . The stimulus input is therefore the spoken word and the output a typed response. For an application as specified above and assuming a distribution which may be ideally symmetrized, the number of stimulus/response patterns which may be encoded prior to excessive misclassification error is given by: P - N[tan(Er7r-8] 2 ... eq. 73 - 180 where P = number of stored patterns N = number of elements in stimulus field Er = response error (5% full scale assumed) If expansion to second order statistics is employed (i.e. Hermitian SUBSTITUTE SHEET preprocessing) the number of associations that may be encoded exceeds 200,000. This value is significantly greater than the number of common usage within the English language. An advantage could therefore be realized within multi-user voice recognition systems whereby several variations of each word could be encoded, each displaying varying tones and inflections. Current voice recognition systems require extensive user training (ie. voice sampling) however it is expected that a system based on the principle described herein, once encoded with sufficient samples, would not require further programming or training for specific individuals. In addition, due to the nature in which information is holograpihcally encoded onto the same data medium, it is expected that the processing time would be sufficiently reduced to facilitate real time continuous speech voice recognition systems. Robotic Devices Robotic or cybernetic applications requiring a level of complexity somewhat beyond the devices described above. It is expected for applications within cybernetic control, arrays of transformation groups (TG) will be required, employing various feedback control modes. Figure 11 illustrates a one possible multi-TG configuration with feedback. SUBSTITUTE SHEET Implementation of neural devices based on the holographic proces described herein could potentially yield control systems wit capabilities beyond current technologies. Two applications of th neural device within the realm of robotic control are described i the following. Robotic Arm The neural control system may be utilized within a robotic assembl device, possessing 10 rotational axis as well as visual input. Th feedback mechanism is via visual stimulus and axial joint position rate of movement sensors. One possible conceptual design for robotic application may consist of two neuron transformatio groups, TGI and TG2. Transformation group (TGI) would receive stimulus inputs indicatin axial position (10 elements) and rates of movement (10 elements) This transformation group could employ generation of higher orde statistics (see section entitled Enhancements of Invention) on th stimulus field to increase the pattern storage capacity. B expanding to 6th, 7th and 8th order statistics, the stimulus inpu field could be increased to 250,000 elements. This expande stimulus field could generate input to the second transformatio group (TG2) receiving secondary stimulus from a visual fiel (i.e. 64 by 64 pixels). Expanding the visual field to 250,00 elements in second order statistics, the above model provide SUBSTITUTE SHEET approximately 500,000 elements within the stimulus field of TG2 (i.e. 250,000 visual and 250,000 axial position/rate). One may assume the number of pattern associations encoded is given by N/8 where N is the number of elements within the stimulus field, this establishes a 3% absolute level of deterministic "error" in generated response for the ideal symmetric data. The number of separate stimulus-response patterns that may be learned by the robotic control system may potentially exceed 60,000. It should be noted that the above describes an elementary model of a cybernetic control system with very limited numbers of neuron cells. In addition, it is expected that signal feedbacks applied within a majority of control systems, as well as larger and more comple arrays of holographic elements will be required to facilitate a practicable robotic control system. A method of encoding or learning time dynamic motions for th robotic arm is illustrated simply as follows. The complex movemen would be determined as a series of patterns representing visua input, axial position and rates of movement. These patterns woul correspond to each incremental movement of the process over a give time frame illustrated rather coarsely in Figure 12. Thes stimulus pattern frames could be encoded into the network with th output response pattern corresponding to the next (time) incremental axial position or movement for the robotic device. It is expected that this relatively simplistic mechanism fo SUBSTITUTE SHEET encoding robotic * .ove*,ents or training the syste- would yield a ro b otic centre! paradi*-*. with capabilities of a sophisication beyond those obtainable employing current control devices or technologies. in order to illustrate an example of a more complicated control system the application of a neural device for vehicular navigation is considered. A ve h icle is not a robot in t h e strict sense of the word however may represent a readily visualized example. The neural device would serve as inputs the following: 1. Human operator voice 2. Visual input 3 . Radar tracking or navigation 4 . V ehicle control parameters ( ie. speed, acceleration, steering, transport drive indications , etc ) 5 . Longitude, latitu d e and altitude for navigational purposes . SUBSTITUTE SHEET 112 The output response field may consist of the following: 1. Voice output 2. Acceleration 3. Steering An application of this type is ideally suited to the holograph neural device because there are a very large number of inp stimulus elements and relatively few output response elements. would be expected that a task of this complexity would requi several transformation groups. For example, one TG may be encod to respond to voice input, a second for visual stimulus and a thi for position sensors or radar. These transformation groups wou feed into subsequent layers of TGs as illustrated in Figure 11 wi the output neuron layer issuing the control action (i.e. acceler tion or steering) . Due to the large volume of stimulus data (i.e. visual, rada voice) the number of input elements could be expected to exce 200,000. Again assuming an N/8 rule for a low deterministic erro the number of stimulus/response patterns that could be encod would be approximately 25,000. If second order statistics we generated over the entire stimulus field, the pattern stora capacity could exceed several billion. It is expected that th storage capacity could encode sufficient control response actio to substantially respond to any potential accident situation *■ * --. a>*-L SUB-3 \ ii i ' i r ;EET defense manoeuvre, bringing this range of applications into realm of feasibility. Expert systems (Automated Reasonin g Device The current mainstream of artificial intelligence applications a based on the Heuristic technique. Heuristics is a term used define the concept of rule based programming. • In general, t approach involves applying multiple decision rules against inp states in order to issue a seemingly intelligent respons Heuristics was initially employed within the field of game playi (ie. chess) and displayed particularly impressive results. Rule based programming has become the mainstream of Al research a has found more practical applications within the field of expe systems. A large degree of research in this field centres abo the development of more efficient searching and parsing mechanis for traversing the rule based decision tree. The princip drawback within the conventional heuristic approach is th decision rules must be applied and tested in a sequential fashi prior to arriving at a given response or outcome. For expe systems operating within domains involving some degree complexity, the number of rules and thus search time requir increases dramatically, thus limiting the capabilities of the rul based approach. A simple, however, direct analogy between t holographic neural process and functional aspects of the heurist SUBSTITUTE SHEET technique shall be made. The general concept of the decision tree within the heuristic approach is presented below. The form of the decision tree is represented in Figure 13. The top event is defined as one possible output and the branching network below describes the boolean relationship which arrives at this top event. The boolean tree describes all conditioning inputs leading to the top decision event in the form of AND and OR relationships (in the simplest case) . Multiple decision trees are employed within any expert system. In the example given here: Event A is true IF [B + (CODOE) ] + [G O (B + H) ]+ ... eq. 74 [F + K + (IOJ)] Applying boolean cutset reduction to the decision trees given in the above example yields the following result: 1. BOGOHOF+ 2. C0DOEOG0HOF+ 3 . BOGOIOF+ . . . eq. 75 4. C0DOE0G0IOF+ 5 BOGOHOL+ II II II II su r-. *- > *- i u yi c - SHEET II II II It 12. CODOEOGOIOJOK Each of the above product terms (1 to 12) consists of a series "anded" conditions, in other words, states that occ simultaneously in time. The above minimal cutsets or "inp patterns" may be directly encoded into a correlation matrix with holographic neural device in the form of discreet stimulus-respon associations, the response or decision being the top event in t logic tree. Each of the above product terms in fact represents separate stimulus-response pattern and all patterns sequential encoded into the neural system. The holographic neural devi described herein provides an enormous capacity for storage stimulus-response patterns and facilitates a mechanism f construction of extremely large and complex heuristic rule bas systems. Again, information is stored within the holographic neural devi network via the superposition of data and the highest correlat response to an input stimulus is arrived at in a massively parall fashion. It is expected that this inherently parallel techniq will yield significant benefits over current heuristic methods terms of both processing speed and information storage capacity It is believed that a significant advantage over the Heurist technique may also be realized in that the holographic operation SUBSTITUTE SHEET characteristics are not of a logical binary (pass/fail) nature bu analog and defined with a continuous range. In addition, each o the encoded scenarios or pattern frames may be completely distinc or independent from all other encoded pattern frames withou adversely affecting computational efficiency. This property ma potentially facilitate large and complex expert systems which ar not amenable to boolean reductionist techniques or solution vi Heuristic methods. The following simple example is used to illustrate the abov concept. Consider an expert rule base system consisting of 1,00 input parameters. These inputs would supply information regardin "observables" to induce the expert system based decision or output Expanding to second order terms, the generated input field yield a neural device responding to an input stimulus field of 500,00 elements. Using an N/4 relation corresponding to an average rea valued "error" of 5\ absolute, the number of complet stimulus/response associations or scenarios that may be encoded b this system could exceed 125,000. This neural based expert system would therefore be capable storing an associated response for 125,000 scenarios, ea consisting of 1000 input parameters. In this example a number base system shall be used for generation of the output respons therefore, 9 digits (log 4 125,000) are required to identify 250,0 distinct scenarios. The number of elements (ie. transformatio SUBS n i υ i c oπεtT. required) within the vector correlation matrix [X] is given by: number of stimulus elements x number of neurons 5 X 10 5 x log 4 [M] = 4.5 X 10 6 ... eq. 7 where M = number of possible outcomes (ie. 125,000) One could assume that the fundamental decoding transformation i performed within the neural processor at a rate of 1 millio transformations per second. (A computational speed of 20 millio instructions per second is within the capacity of present da microprocessors) . It is therefore conceivable that the exper system based on the holographic neural process using one micro processor would arrive at the highest correlated output decision, based on 125,000 independent input scenarios each comprised of 1000 variables, in approximately one second. This application of such a neural device is expected to greatly exceed the performance capabilities of expert systems employing conventional neuristic methods. y-ml Proftti c peyjces The field of prosthetic control could benefit greatly from the application of the neural device described herein. It is reiterated that the purpose and intent of this device is to provide SU more efficient information storage and processing capabilities through emulation of the fundamental mechanism by which the biological neural system stores and processes information. The specific neural process described herein, appears to emulate the form of the information processing characteristics within the neuron in many respects, these similarities are outlined below: i) frequency modulated pulse or waveform, similar in for to biologically generated nerve impulses; ii) information representation in the form of stimulus response associations; iii) holographic properties exhibiting vast informatio storage densities; iv) near instantaneous single pass transformation for bot learning and expression operations; v) functional similarities to isomorphic characteristic of various classes of biological neurons; vi) asynchronous transmission and processing of stimulus response signals; vii) variable memory profile. SUBSTITUTE SHEET A synthetic system which closely mimics the above biologica characteristics would inevitably provide significant advances i the area of interfacing prosthetic device control t neurobiological circuits. This holographic neural device could yield significant advances i the area of control for artificial limbs, and it is expected, woul inevitably advance towards neural prosthetics for higher neuro logical functions. Supplementary Disclosure: DESCRIPTION OF THE PREFERRED EMBODIMENTS . WΦ r * n " nn * τ - ^Tflr a g 17 AND ιa ) This example of a hardware embodiment forms a conceptual basis fo a possible future generation computer prototype using th holographic process described herein . This advanced embodimen device shall be referred to as a neurocomputer. The neurocompute is intended to he general purpose in its operationa characteristics as facilitated by a programming utility. Th programming methodology will be significantly different fro conventional programming languages and techniques . Some of the basic categories of modifiable or programmable features required within the neurocomputer programming utility are listed below: 1) Specification of the synaptic interconnections or SUBSTITUTE SHEE 120 interconnection matrix between neural analogues . 2) specification of preprocessing of input data to the neural elements (i .e . sigmoidal preprocessing, generation of higher order terms, non-linear filtering characteristics) . 3) specification of the excitory / nhibitory states for the synaptic interconnections . 4) Specification of knowledge or encoded data within the correlation matrix [X] (analogous to synaptically encoded information) . 5) Specification of decay coefficients or rate of decay of vector elements within correlation matrix [X] . This programmable feature establishes the memory profile (i . e . short terms vs . long term memory) . 6) Specification of rate of encoding. This programmable feature effectively modifies the rate of learning. 7) Specification of Input /Output to external environment . Modifies the mapping of external stimulus input (88 in Figure 17) onto the analogous synaptic inputs as well as mapping of the response outputs (90 in Figure 17) SUBSTITUTE SHEET onto external devices . The above forms a basis set of programmable features required the general purpose neurocomputer device and may be expan conceptually to permit further enhanced capabilities . In this example, two principle hardware components are indicat that is the single chip microcomputer 70 and the memory stor unit 72. The single chip microcomputer is representative o component currently available in the marketplace and contains following features: 1) processor unit 2) multiple serial data transfer links 3) memory interface unit. These above functional blocks may interact in any manner; howe the illustration provided within Figure 17 shows only the data f paths required and related to the prescribed neural process. processor unit 84 has been subdivided into 3 functional blocks illustrative purposes; these functional blocks are listed follows and are described in further detail below: 1) Decoding 74 2) Encoding 76 3) Other functions 78 SUBSTITUTE SHEET 122 Jn this example, the elements of the input stimulus field [S] and the output response field [R] are transmitted via their real and imaginary parts in a Jbinary representation . This concept is illustrated below in a representative case for an element s^ within the stimulus field [S] : iθ. s. •= λ.e ... eg. 77 For example if θ - ^-Z and X = 74 then 3 S, = -36 + i 64 It is assumed an 8 bit resolution is used for each of the above real and imaginary parts . The elements of the stimulus and the response fields may be transmitted either via the serial data links 80 and 82 or mapped onto the- external memory devices (88 and 90) . Figure 17 illustrates the transmission of one element of a stimulus pattern [S] via the serial data link 82. gnr-yyfJr rκ_t_ _1. mar.. . _ TPi enjT- 771 During an encoding operation the elements of the stimulus pattern (S ) are read in either via one of the four serial input links, or via the external memory device (88) providing memory mapped input . Similarly, the element or elements of the response pattern may be read into the encoding unit 76 either via the serial links or via the external memory device 88. Note again that for each of the SUBSTITUTE SHEET stimulus and response elements, a real and imaginary component derived from the phase and magnitude components of the complex element or vector are read into the encoding unit (76) . The real and imaginary components of the corresponding element (x.) for the correlation matrix [X] is read in from the external memory unit 86. The encoding unit 76 performs the encoding transformation as defined, in canonical form, by the following vector matrix transformation : T [X] - [S] ■ [R] . . . same as eq. 13 The above operation superimposes the learned stimulus-response patterns onto the correlation matrix [X] . The encoding operation is defined in further detail herein under the section entitled Summary of the Invention . Note that the hardware configuration presented, and the operational characteristics of a general purpose processor, requires that the above matrix transformation be performed in a sequential manner. The encoded element or elements of the correlation matrix [X] are stored back into memory storage unit 86 which performs an analogous function to the axo-ύendritic synaptic connections . 4_-t-_Hτ, 7 fftfpfji'ffa in Figure 17) During a decoding operation the elements of the stimulus field (s-.) SUBSTITUTE SHEET are read in either via the four serial input links 82 or via t external memory device 88 for memory mapped input . For the stimul elements, a real and imaginary component derived from the phase a magnitude component of the complex element or vector (s*Vj are re into the decoding unit 74 . The real and imaginary components of t corresponding vector element within the correlation matrix [X] a read from the external memory unit 86. The decoding unit performs the decoding transformation as defined, in canonical for by the following vector matrix transformation: [R] = [S] * • [X] . .same as eq. c Note again that the hardware configuration presented and t operation of general purpose processors requires that the abo matrix transformation be performed in a sequential manner. decoding operation is defined in further detail herein under heading entitled Summary of the Invention . The generated response [R] may be output either via the ser output links 80 or via the external memory device 90 for mem mapped output . Note again that the response output signal represented by a real and imaginary component as illustrated equation 77 previously. Other Functions I igure 17) SUBSTITUTE SHEET 125 A third functional block defined within the processor block 78 related to other functions or enhancements of the process . Th functional block 78 has data access to both the serial input a output links 80 and 82 and external memory 72 . The embodiment the neural process within a general purpose processor provides significant advantage in that a wide range of enhancements variations of the fundamental neural process may be easi accommodated. A subset of possible enhancements consists Hermitian or sigmoidal preprocessing of the stimulus input fiel [S]- as described in the section pertaining to .Enhancements o Invention, and all of the programmable functions listed under t heading Physical Embodiment of Device - Advanced Model. Several of the processing nodes, may be connected together in a configuration to form an array of neural elements operating in a asychronous and parallel fashion . One possible paralle configuration is illustrated in Figure 18 and consists of 1 processing nodes . Each processing node 92 consists of the hardwa configuration presented in Figure 17. The interconnectio arrangement presented is generally referred to as a Boolea hypercube . In this arrangement each processing node accesses it own local memory and communicates with the four nearest nodes vi high speed bidirectional serial communication. In illustrating the likely computational capabilities of the abov device employing the prescribed holographic neural process, SUBST1TU U -4 SHEET system (as presented in Figure 17) is evaluated using operational specifications for existing and available hardware components . Th operational specifications for the constituent hardware are a follows: local memory / node - 2 Megabytes transmission rate / link = 20 Megabits / second Processing speed / node - 20 Million Instructions / second Each processing node may be configured internally to represen several distinct and separate neuron cells . For this example i will be assumed that each neural cell receives 8000 vector element within its stimulus field (ie. [S] - fs,, s-, ... -Sg-g- and produce one response output. The information stored within each of the 800 synaptic input analogues, are again represented by a vector elemen within the correlation matrix [X] . The memory requirements for eac element of [X] for this example is 4 bytes . A 16-bit resolution fo the real and imaginary elements within the correlation matrix [X is assumed . The number of neural cells that may be containe within each processing node (N is therefore given by: N y - 2 x 10* bvtes I node ... eg. 7 4 bytes / synapse x 8000 synapse / neuron - 64 neurons / node f *rrττ r ^ _7itγ rw?flfiτffnft i Fi g ure ιs» SUBSTITUTE πcfcT As discussed herein stimulus-response patterns may be superimposed onto the same memory medium. As the number of patterns increases, the average magnitude of the deterministic "error" within the decoded output response increases in a non-linear fashion. The storage capacity for this example is assumed to be N/4 to provide low response error, where N is the number of elements within the stimulus field [S] (ie . number of stimulus elements N - 8000 and the capacity for encoded stimulus -response associations is N/4 or 2000) . The above encoded set of stimulus - response patterns within a single neural analogue based on the assumptions outlined herein corresponds to the following information content (ϊl) : n = 2000 patterns x 8000 elements /pattern . .. eg. 79 - 16 Million pattern elements (bytes) The above information content will be referred to as the virtual information storage capacity. Each processing node 90 contains 64 neuron analogues, therefore the virtual information capacity, being proportional to the number of neural elements, is given by: - 16 x 10* elements x 64 neurons / node - 1.0 Billion elements (bytes) / node For the described neural system comprising 16 processing nodes, the virtual information storage capacity corresponds to 16 Billion bytes. SUBSTITUTE SHEET Processing Speed (J ry jjm__ . in Figure 14 ) To provide an illustration of the effective processing capabilities for this embodiment, a comparative description is presented for the neural process described herein in relation to conventional processing methodologies . Within the domain of pattern identification and encompassing large sets of independent and nonlinear patterns, the technique of pattern matching or linear search is most widely applicable. The pattern matching technique involves a comparison of each element of the stimulus field against the corresponding element of each of the stored reference patterns. These patterns may represent any form of data in non-compressed form or, if amenable, in a compressed form (i .e . converted to a frequency domain) . To illustrate the increase in computational efficiency, a conventional pattern matching technique will be described in general and compared operationally to the holographic neural process. Within the general linear search technique, a variance (σ may be generated for each reference pattern p as follows: where a., - element j of stimulus field SUBSTITUTE SHEET b . - element j of reference pattern p 3 rP A set of pattern variance terms are then generated over the set of prototypes as follows: (σ i 1 ' °2 1 ' σ 3 1 ' ' ' ' °p l) " Bq 81 and these values employed in some manner to determine or produce the output response. For this illustration, in which the number of elements in the stimulus field for each neural analogue is 8000, the assumed number of patterns encoded is 2000. The pattern matching process requires the following number of comparisons be performed: 8000 elements / pattern X 2000 patterns . . . eq. 80 = 16 Million comparisons Each comparison consists of evaluating the difference between an element in the input stimulus pattern and the corresponding element in a stored reference pattern and adjusting a correlation value (i .e . evaluation of a pattern variance or standard deviation value) . The series of steps for the fundamental comparison operations as described above will be referred to as a virtual __________ The neural process described herein performs a roughly similar function, however, the operational characteristics are SHEET significantly more sophisticated and computationally efficient. As stated within the section pertaining to Summary of the Invention, the output response is derived directly from the decoding transformation, and is a function of the entire set of encoded associations as defined by: is the set of response magnitude values for patterns encoded over t - 1 to T is the set of generated output response values encoded over t=2 to T Inherent to the above holographic neural process, the output response is issued directly as a vector quantity with phase angle representing the scalar response information and the magnitude statistically proportional to the degree of correspondence between input stimulus and prior encoded stimulus patterns . A single transformation as performed by the holographic neural decoding process is given by: 2000 s-^ • Xj equivalent to Σ e" ζ> e p - eJ;l .. eg. 82 J J p=l One may apply a conservatism that the above operation is similar to that performed by 2000 virtual operations within the conventional SUBSTITUTE SHEET pattern matching or linear search process in evaluating a desire response output . A single transformation as described by equation 66, transforms on element within the stimulus field through the corresponding elemen for the entire set of encoded associations (2000 in this example superimposed in abstract form within correlation matrix [X]. Th number of mechanical steps therefore required in issuance of response decision is reduced by a proportional amount (i .e. in thi case reduced by a factor of 1/2000) . To illustrate the effective processing speed for the neura embodiment in Figure 18 one may assume that the rate o encoding /decoding transformation is limited by the neural processo speed. For a processor speed of 20 MIPS and conservatively assuming 4 instruction cycles are required for one encoding or decodin transformation (as could be the case for non-hardware multiples) the number of transformation that could be performed within eac processing node is therefore 500, 000 per second. As note previously, a single decoding transformation (equation 27) perform a decoding operation simultaneously through the enfolded 200 stimulus-response associations . For a comparative study, applyin the virtual operation definition within the linear search method the effective processing rate for one processing node employing th SUBS T ITUTE holographic method is evaluated by: 500 , 000 transformations X 2000 virtual operations second transformation = 1.0 Billion virtual operations / second It is believed that the effective rate of processing for the described system consisting of 16 processing nodes in Figure 18 could attain 16 Billion virtual operations / second. The hardware embodiment described herein therefore yields a capacity to store 16 Billion virtual elements (bytes) of informa¬ tion in the form of encoded stimulus-response associations, and to process input sensory stimulus through the above accumulated information at a rate of 16 Billion virtual operations / second. It is expected that a system of this type, receiving stimulus from various forms of sensory modalities (i .e . vision, sound, touch) , and employing characteristics of memory, learning and expression may potentially provide a suitable information processing substrate to facilitate and evoke the emergent characteristics of a form of intelligence such as that exhibited by the most primitive insect neurobiological system. The described hardware embodiment is indicative of one possible example and may be expanded in any area including hardware configuration, memory capacity, number of processing nodes, number of data links per node, rate of data link transmission method of SUBS 2 ϋ i U i E orn, »er"*" " τ 133 data transmission (i .e . serial / parallel modes) , and processing r per node . These increased capabilities may be used to constr devices emulating potentially higher levels of intelligence . Although the preferred embodiment as well as the operation and u has been specifically described in relation to the drawings, should be understood that variation in the preferred embodimen could easily be achieved by a skilled man in the trade witho departing from the spirit of the invention. Accordingly, t invention should not be understood to be limited to the exact fo revealed in the drawings . SUBSTITUTE SHEET

Claims: The emoodiments of the invention in wnich exclusive property or privilege is claimed are defined as follows: 1. An artificial neural device comprising; oata storage and processing means for encoding data in an abstract form of stimulus-response patterns onto said data storage and processing means whereoy each said stimulus-response pattern is superimposed onto said data storage and processing means; and means for decoding a response associateα with a stimulus wnen said stimulus-response patterns encoαed in saiα data storage and processing means is stimulated by said stimulus. 2. In a method of enhancing the storage and computing capacity of artificial neural devices comprising of the steps: (a) encoding data in an abstract form of stimulus response patterns onto data storage and processing means whereby each said stimulus-response pattern is superimposed on the same data storage -means; (b) decoding a response associated with a stimulus by applying said stimulus onto said stimulus-response patterns encoded in said data storage means so as to generate said response associated with said stimulus. SUBSTITUTE SHEET 2. An artificial neural device comprising: (a) means for storing and processing data; (b) means for encoding data onto said data storage and processing means by translating sets of associated stimulus and response signals into complex numbers represented by a vector phase angl and generating a matrix representing stimulus-response patterns for each set of associated stimulus and response signals, where each said stimulus-»*esoonse pattern is superimposed onto said d storage means; (c) means for decoding a response associated with a stimulus signal when said matrix of stimulus-response patterns encoded in said data storage means is stimulated by said stimulus signal. 4. In a method of enhancing the storage and computing capacity of artificial neural devices comprising the steps of: (a) encoding data by translating sets of associated stimulus and response signals into complex numbers represented by a vector phase angle; (b) generating a matrix representing stimulus-response patterns for each set of associated stimulus-response signals whereby each s SUBSTITUTE SHEET stimulus-response i s superimposed onto data storage and processing means ; (c ) decoding a response signal associated with a stimulus si gnal by applying said stimulus signal to said stimulus-response patterns encoded in said data storage means so as to generate said response signal associ ated with said stimulus signal . 5. In a pattern recogniti on device for generating a response signal in response to a stimulus si gnal compri sing: (a) means for producing a stimulus signal ; (b) means for transl ating said stimulus signal into complex nuαbers represented by vector phase angles; (c) means for storing said translated stimulus signals; (d) means for generating a response signal associated with a stimulus si nal ; (e) means for transl ating said response signal into complex numbers represented by vector phase angles; SUBSTITUTE SHEET (f) means for storing said translated response signals; (g) means for generating and storing a matrix representing stimulus- response patterns for each set of translated, associated stimulus and response signals and storing each said stimulus-response patterns onto said storage means; (h) means for generating a response signal when said matrix of stimulus-response patterns is stimulated by said stimulus signa associated with said response signal. 6. In a method of enhancing stimulus pattern recognition in an artificial neural device comprising the steps of: (a) producing a stimulus signal; (b) translating said stimulus signal by processing means into compl numbers represented by vector phase angles; (c) storing said translated stimulus signal into storage means; (d) generating a response signal associated with a stimulus signal processing means into complex numbers represented by vector pha angles; SUBSTITUTE SHEET e) transl ating said response signals by processing means and storing said transl ated response si gnals onto said storage means; (f) generating a matrix representing stimulus-response patterns for each set of associ ated stimulus and response si gnals and storing each said stimulus-response patterns onto said storage means; (g) generating a response signal when sai d matrix of stimulus-response patterns is stimul ated by said stimulus signal associated with said response si gnal . 7. In a vision recognition device for generating an auditory response signal in response to a visual stimulus signal comprising: (a) video camera means for generating a stimulus signal when operably activitated; (b) processor means for processing data; (c) storage means for storing data; (d) means for translating said visual stimulus signal into complex numbers represented by vector phase angles and storing said translated visual stimulus signals onto said storage means; bub 11 1 ϋ . h c 1 (e) means for generating an auditory response signal associated with a visual stimulus signal; (f) means for translating said auditory response signals into complex numbers represented by vector phase angles and storing said translated auditory response signals onto said storage means; (g) means for generating and storing a matrix representing stimulus- response patterns fcr each set of associated visual stimulus and auditory response signals and storing each said stimulus-response patterns onto said storage means; (h) means for generating an auditory response signal when said matrix of stimulus-response patterns is stimulated by said visual stimulus signal associated with said auditory response signal. 8. In a method of generating an auditory response by an artificial neural device in response to a visual stimulus signal comprising the steps of: (a) producing a visual stimulus signal through video camera means, then; (b) translating said visual stimulus signal into complex numbers represented by vector phase angles and storing said translated visual stimulus signal onto storage means; SUBSTI (c) means for generating an auditory response signal associated with said visual stimulus signal; (d) means for translating said auditory response signal into complex numbers represented by the vector phase angles and storing said translated auditory response signal onto storage means; (e) means for generating and storing a matrix representing stimulus- response patterns fcr each set cf associated visual stimulus signals ana auditory response signals and storing said stimulus- response patterns onto said storage means; (f) generating an auditory response when said matrix of stimulus- response patterns is stimulated by said visual stimulus signal associated with said auditory response signal. 9. It is also an aspect of this invention for enhancing the storage and caoacity of the artificial neural device based on the process described herein employing any of the following methods: (a) employing Hermittian preprocessing of the stimulus-response patterns prior to encoding said stimulus-response patterns onto the data and processing unit and prior to decoding a response from the data and processing unit. SUBSTITUTE SHEET (b) Combining groups of neural elements to form a system co orised of transformation groups wnerein said transformation group encodes and decodes one or more elements within the response field associated with eacn input stimulus pattern. The transformation group may oe configured into a single modular ANS device, electro- echanically based, micro-electronic based, optically based, biologically based or otherwise. (c) Combining grouos cf said transformation groups in a parallel arrangement sucn that input stimulus patterns are fed into several transformation groups and distinct responses are thus issued from each transformation group in accordance with that input stimulus pattern. (d) Combining groups of said transformation groups into a layered arrangement such that the output response element of lower layers are fed into input the input stimulus field of higher layers. (e) Combining groups of layered and parallel networks together in any configuration. (f) Employing signal feedback mechanisms such that output response elements from transformation groups in higher layers is fed back, either directly or via the environment, to input stimulus fields of transformation groups in lower layers. SUBSTITUTE SHEET ( g) Ξ Dloyinσ methods to vary magnitudes within both the stimulus fi elds and resonse fi elds in order to assi gn effective weighting factors to the stimulus or response el ements. ( n : Employing sparse matrix techniques within the encoded information representative of the synaptic connections and presented in an abstract *orm by the matrix [X], This technique reduces computational time and the number of required storage elements at the exDense cf increasing the output response accuracy. (i) Employing dynamic time variable decay of the encoded information representative of the synaptic connections and presented in an abstract form by said matrix [X]. The purpose of this technique is to establish a memory profile that determines the predominance of encoded information over any range extending from permanent or long term memory to very short term memory. 10. It is also an aspect of this invention that the artificial neural system described herein has innumerable applications including: (a) Incorporation of the artificial neural system into any system or subsystem whose function is to recognize or respond to visual input stimulus. SUBSTITUTE SHEET (b) Incorporation of the artificial neural system into any system or subsystem wnose function is to recognize or respond to auditory input stimulus. (c) Incorporation of the artificial neural system into any system or subsystem wnose function is to recognize or respond to input stimulus that represents any form of sensory modality or abstract representation thereof. (d) Incorporation of the artificial neural system into any system or subsystem whose function is to recognize or respond to input stimulus that represents any physical parameter or abstract representation thereof. (e) Incorporation of the artificial neural system into any control system or control subsystem. This application encompasses but is not limited to any form of process control, mechanical control, electrical control, biological control, vehicular control, robotic control. (f) Incorporation of the artificial neural system into any system that employs artificial intelligence concepts. This application encompasses but it not limited to expert systems and automated reasoning systems. SUBSTITUTE SHEET (g) IncorDoration of the artificial neural process or device into any computational device to increase or enchaπce computational efficiency. (h) Incorporation of the artificial neural system into any neurobiological or biological prosthesis device. This application encomoasses but is not limited to artificial limbs, hearing aids, pacemakers. SUB; a i π ϋϊE SHEET CLAIMS SUPPORTED BY a_-VT.-_l_r_X_- DIBCT-OSTOE Cl aim 11 An artificial neural device simulating synaptic connections comprising; data storage and processing means for encoding data in an abstract from of stimulus-response patterns onto said storage and processing means whereby each said stimulus-response pattern is superimposed onto said data storage and processing means; and means for decoding a response associated with a stimulus when said stimulus-response patterns encoded in said data storage and processing means is stimulated by said stimulus. Clai 12 An apparatus for associating an input stimulus with prior learned stimulus-response associations whereby a plurality of stimulus- response associations are superimposed upon a set of vectors represented within a complex or Riemann (phase) plane. Said apparatus possessing both means for encoding or learning said stimulus-response associations and decoding or expression of a response when subsequently exposed to any stimulus. Each of said stimulus elements and response elements within above stimulus- response associations is represented by a vector possessing both phase angle orientation and magnitude oriented within a two dimensional or complex or Riemann (phase) plane. The learning function operates in a manner that scalar elements of the stimulus-response associations as represented within a real number domain are converted into vectors represented within the a b ove phase plane. A plurality of these stimulus-response mappings are encoded onto that which is referred in subsequent claims as the correlation set. Said correlation set again consists of a set of vectors oriented about a two dimensional or complex or Riemann (phase) plane. On a decoding operation, the stimulus pattern once converted into the phase representation is transformed through the neural element or correlation set. Said decoding transformation operates in a manner that the stimulus pattern is transformed simultaneously through all encoded stimulus-response mappings enfolded within the correlation set to generate an associated response. Claim l? An apparatus as defined in Claim 12 further comprising means for encoding multiple stimulus-response associations onto a set of correlation elements [X]. Each of said correlation elements represented by a vector possessing both phase orientation and magnitude within a two dimensional or complex or Riemann (phase) plane. Said encoding means operating in the following fashion that encoded stimulus-response associations are superimposed upon the same correlation set. Said encoding method represented in an elementary form by the following operation on the stimulus set [S] and response vector R, the stimulus set comprised of an array of vectors as set out in Claim 12: [XI = Jε ■ R SUBSTITUTE SHEET Encoding method operates within a single transformation to encode a mapping of the input stimulus [S] onto an output response R. Again a vector within a two dimensional or complex or Riemann (phase) plane. Said encoding operation permits mappings of multiple stimulus-response sets whose elements are defined within an analog range. The vector phase angle orientation for elements within both the stimulus and response sets represent a value of information within an analog or continuous scale. Said analog value of information may represent any parameter or abstract representation thereof. Vector magnitude for elements within both stimulus and response sets on encoding produce a measure of dominance or weighting for that component of the mapped stimulus- response association. claim 14 An apparatus as defined in Claim 12 further comprising means for decoding a response from the correlation set [X] when subsequently exposed to a stimulus set. Again elements within both stimulus and response sets represented by two dimensional or complex or Riemann (phase) plane. Said decoding operation operates in such a manner that,for a stimulus pattern input similar to prior learned stimulus pattern, the associated response vector is produced. "Similar" in this context refers to any prior learned stimulus that may have undergone a signi icant degree of distortion or a partial set of a prior learned stimulus or a combination of the above. Said decoding method represented in an elementary form by the following operation on the SHEET correlation set [X] and stimulus set [S] ' , each comprised of an array of complex vectors: Decoding method operates within a single transformation to generate an output response R from the input stimulus set [S] . Vector phase angle orientation for both stimulus and response sets represents an analog value of information as stated in Claim 13 above. Vector magnitude for the generated or expressed response vector is proportional, to the degree of recognition,or correspondence between stimulus set [S] ' and any stimulus pattern prior encoded or enfolded within the correlation set [X]. Claim 15 An apparatus as defined in Claim 12 further comprising means for translating sets of external associated stimulus and response signals into the required representation consisting of sets of vectors defined within a two dimensional or complex or Riemann (phase) plane. Said transformation is performed to optimally achieve a property of symmetry. Said property of symmetry corresponds to a symmetric distribution of the set of translated vectors oriented about the origin in the complex or Riemann (phase) plane. Said property of symmetry enhances the operational characteristics of holographic neural elements by facilitating a such increased capacity for storage of stimulus- response associations and minimizing error on subsequent S expression of a learned response when exposed to associated stimulus. Clajm \6 A method of transforming sets of inputs into a symmetrical distribution as defined in Claim 15 comprising the steps of: 1. Determining the statistical distribution of scalar values for the general class of inputs which represent either the sets of stimulus or response patterns. For instance visual stimulus as well as most naturally occurring distributions following a normal or Gaussian distribution characteristic. 2. Processing the input sets of stimulus or response values through a function which thereby transforms that initial input distribution into a form characterized by a symmetrical distribution of vector phase angles oriented about an origin in complex or Riemann (phase) plane. For instance, a sigmoidal preprocessing operation employed to transform a Gaussian distribution into the ideal symmetrical form as described above. 2. Assigning a magnitude to each of the translated stimulus vector elements. The assigned vector magnitude components determine the dominance for that element in assigning the stimulus-response association. SUBSTITUTE SHEET Claim 17 An apparatus as defined in Claim 12 further comprising means for generation of higher order statistics from a given stimulus set. Said generation of higher order statistics permits very large and greatly increased sets of stimulus-response associations, displaying a large degree of overlap within the stimulus field state space, to be encoded onto the same correlation set within the holographic neural element. Generation of higher order statistics is performed by apparatus whose function is to expand the number of input elements within the stimulus field to all or any subset of unique combinatorial products of any subset of the raw or unexpanded input stimulus field. Said higher order statistics are represented in the following general form by: J λ (n) e f(n)iθ k(n) n=ι where N - order of statistic k(n) - defines the nth product element of the N order statistic * n) . magnitude component of nth product element g K n ) _ phase component of nth product element f(n) - operation for forming conjugate of the complex vector as any function of n The stimulus input field may be expanded to any subset of the higher order statistics to permit explicit control of the stimulus-response state mapping characteristics. SUBSTITUTE SHEET Claim 18 An apparatus as defined in Claim 12 further comprising means for applying a non-linear transforma ion the generated response output. Said non-linear transformation may be performed by either a discontinuous step, ramp or sigmoidal function to establish a recognition threshold about which the response magnitude is either amplified or attenuated. Such apparatus permits the neural element to operate in a switching mode whereby the response output is turned off or attenuated (generating low magnitude) for stimulus outside of the recognition field domain and conversely response output is turned on or amplified (generating large magnitude) for stimulus within the field domain of recognition. Clftin 19 An apparatus as defined in Claim 12 further comprising means for employing any fixed rate or dynamic time variable decay on the magnitude components of the vector elements within the correlation set [X] . This magnitude decay process establishes a memory profile over encoded stimulus-response associations which directly establishes the predominance of encoded information over any range extended from permanent or long term memory to very short term memory. Long term memory is characterized by slow decay rates and short term memory characterized by proportionately fast decay rates. SUBSTITUTE SHEET Claim 20 152 An apparatus as defined in Claim 12 further comprising means for establishing an inhibitory/excitory structure for the synaptic connections representative of stimulus inputs to the neural element. Said inhibitory/excitory structure is established by performing vector translation operations on a subset of vectors within either the stimulus or response fields. Said vector translation operation enhances the symmetry property as defined in Claim 15 thus permitting the neural element to optimally encode a greater number of stimulus-response associations. Claim 21 An apparatus as described in Claim 12 further comprising means for summing the response outputs over a plurality of neuron cells. Said vector summation properties operate within the process in such a manner as to greatly increase information storage density, providing each element within all stimulus fields are largely unique for the group of neuron cells over the response vector summation. Uniqueness defines a set of elements comprised of first or higher order statistics in which no two elements are comprised of a product of the same identical stimulus set. This response vector summation creates what is referred to as a "superneuron" possessing characteristics similar to one neuron containing a number of elements within its stimulus field equivalent to the sum of all stimulus fields over the said plurality of neuron cells. SUBSTITUTE SHEET Claim 22 An apparatus as defined in Claims 12 to 21 further comprising means for interconnection of a plurality of holographic neural elements within any definable configuration. This includes an apparatus to facilitate or modify the interconnection of neural elements for any arbitrary configuration. Interconnection of neural elements may follow any of the group of configurations or arrangements listed below: (a) Configuring a plurality of neural elements to form a system comprised of transformation groups wherein said transformation group encodes and/or decodes or generates any number of elements within a response field associated with the stimulus field. Said transformation group may be configured as a modular holographic neural device whether software based, micro-electronic based, electro- mechanically based, optically based, biologically based or otherwise. (b) Arranging a plurality of said holographic neural elements into a parallel configuration such that input stimulus patterns are fed into serial neural elements in parallel and separate response vectors are thus issued from each neural element in accordance with that input stimulus patter . (c) Arranging a plurality of said neural elements or parallel SUBSTIT arrays of neural elements into a layered or serial configuration such that the output response vectors from lower layers of neural elements are fed into the stimulus field of higher layers of neural elements. (d) Interconnecting groups of parallel neural elements as defined in point 2 and/or layered neural elements as defined in point 3 into any configuration or interconnection arrangement. (e) Employing feedback mechanisms within a configuration of parallel and/or layered neural elements such that output response vectors generated from neural elements in higher layers are fed back to stimulus fields of neural elements in the same or lower layers. This feedback mechanism may be implemented internally by direct connection from the response field of one set of neural elements to the stimulus field of a second set of neural elements or indirectly via effector responses to the external environment. Claim 23 An apparatus as described in Claims 12 to 21 further comprise a method for a general operating system environment, permitting a plurality of neuron elements to be modified and interconnected in any definable configuration. Said operating system environment would typically be embodied within a general purpose SUBST device referred to by the generic name of neurocomputer. Said neurocomputer would permit programmability of neuron cell types including any of the following general types: 1. Neuron cell type producing higher order statistics from a given stimulus set. This cell type believed to emulate the information processing functionality of certain spinal neurons. 2. Neuron type performing encoding/decoding or learning/expression operations. This cell type believed to emulate the information processing functionality of stellate and Martinotti cells located within the cortex and stellate cells within the cerebellum. 3. Neuron type performing response vector summation over a plurality of encode/decode neurons. This cell believed to emulate the information processing functionality of pyramidal cells within cortex and Purkinje cells within the cerebellum. In addition to the above, said operating system may permit modification of parameters within the cellular level, related to memory profile, rate of learning, non-linear response characteristics, properties of generated higher order statistics, inhibitory/excitory designations, properties of preprocessing operations for enhancement of symmetry characteristics (i.e. sigmoidal preprocessing) . The operating system shall also permit programmability of signal pathways or interconnections between neuron cells. This rogrammability shall permit the user to interconnect a plurality of neuron cells in a flexible manner for construction of parallel, serial, feedback interconnection configurations or any combination of the above. ciajm. 2 A method of simplifying the operation of the holographic neural system comprising the steps of limiting the phase angle orientations within the stimulus field [S] , the response field [R] , and the correlation set [X] to 0 and π phase locations or correspondingly -1/+1 or 0/1 or any other binary designation. This simplification reduces the operation of the process form an analog to a binary information system, however, simplifies the encoding/decoding transformations to non-trigonometric calculations or transformations performedwithin a simpler scalar number domain. All further means and enhancements described in Claims 12 to 21 apply considering now that the vector phase angle orientations are limited effectively to the 0/τr phase angle positions. ain 25 An apparatus for holographic neural device as defined in Claim 12 to 10 further comprising: (a) means for storing and processing data; SUBSTITUTE SHEET (b) means for encoding data onto said data storage and processing means by translating sets of associated stimulus and response signals into complex numbers represented by a vector phase angle and generating a matrix representing stimulus-response patterns for each set of associated stimulus and response signals, whereby each said stimulus- response pattern is superimposed onto said data storage means; (c) means for decoding a response associated with a stimulus signal when said matrix of stimulus-response patterns encoded in said data storage means is stimulated by said stimulus signal. claim 26 An apparatus for holographic neural device as claimed in Claim 25 wherein said data storing means comprise memory means and said device further includes: (a) means of inputting a set of stimulus signals into said device; (b) means for inputting and generating a response signal associated with a set of stimulus signals; (c) memory means for storing data and/or sets of complex vectors; SUBSTITUT (d) said processing means including: ( i ) data input means for communicating data from said set of stimulus signals to said processing means; (ii) data output means for communicating a response signal from said processing means in response to an associated set of stimulus signals; (iii) said encoding means reading the vector elements of said set of stimulus signals from said data input means and reading the vector component of said response signal associated with said stimulus signals and generating a correlation set comprised of vector elements, said correlation set containing the stimulus-response association mappings for each set of associated stimulus-response patterns whereby each said stimulus-response pattern is superimposed onto said memory means; (iv) said decoding means reading the vector components of said set of stimulus signals from said data input means and reading the vector components of said correlation set from said memory means and generating a response signal of vector components through said processing and data output means; and (v) memory interface means for interfacing said SUBSTITUTE SHEET processing means with said memory means. Clajm 27 An apparatus for holographic neural device as claimed in Claim 25 further including: (a) visual recording means for producing a stimulus signal representative of a visual image; (b) means for generating an auditory response signal associated with a stimulus signal representative of said visual image; (c) said means for encoding data onto said data and processing means include: (i) means for translating said visual stimulus signal into set of complex numbers possessing vector phase angles and magnitude and storing said translated visual stimulus signals onto said data storage means; (ii) means for translating said auditory response signals into complex numbers possessing vector phase angle and magnitude and storing said translated auditory response signals onto said data storage means; (iii) means for generating and storing a correlation set SUBSTITUTE SHEET containing the stimulus-response association mappings for each set of associated visual stimulus and auditory response signals and storing each said stimulus-response patterns onto said data storage means; (d) said means for decoding a response associated with a stimulus signal including means for generating an auditory response signal when said matrix of stimulus-response patterns is stimulated by said visual stimulus signal associated with said auditory response signal; whereby said device generates an auditory response in response to an associated visual stimulus signal. Claim 28 An apparatus for a holographic neural device as defined in Claims 12 to 21 embodied within a computing node comprising: (a) local memory storage means for storing mapped stimulus- response associations onto said memory storage means; (b) an electronic or micro-electronic means including: (i) processor means; (ii) a plurality of data input means for receiving input SUBSTITUTE SHEET. stimulus signals; (iii) a plurality of data output means for transmitting response signals; (iv) memory interface means for interfacing said processor means with said local memory storage means; (c) said processing means including: (i) means for encoding stimulus-response associations onto local memory storage means by translating sets of associated stimulus and response signals; received by said data input means or mapped onto said local memory storage means; into complex numbers represented by a vector phase angle and a magnitude, and generating a correlation set containing the stimulus-response mappings for each set of associated stimulus and response signals, whereby each said stimulus-response pattern is superimposed onto said correlation set contained within local memory storage means; (ii) means for decoding a response associated with a stimulus signal received by said data input means or mapped onto said local memory means when said correlation set containing said stimulus-response SUBSTITUTE SHEET mappings encoded on said local memory storage means is stimulated by said stimulus signal so as to generate a response signal associated with said stimulus signal through said data output means or to said local memory storage means. Claim 29 An apparatus for a holographic neural device embodied by a plurality of computing nodes as claimed in Claim 28 whereby each said computing node accesses its own local memory storage means and communicates with a plurality of other computing nodes as claimed in Claim 28 by means of bidirectional communication means. Claim 30 In a method of enhancing the storage and computing capacity of artificial neural systems comprising any or all of the following process steps: (a) Translating stimulus sets indicating external parameters or field intensities as defined by a set's scalar values to phase angle orientations on a two dimensional or complex or Riemann (phase) plane as defined in Claim 15. Said translations are performed to optimally achieve a property of symmetry, again as defined within Claim 15. SUBSTITUTE SHEET (b) Expanding the set of input stimulus values to higher order terms as defined within Claim ' 17. Resultant increase in number of elements within the stimulus field permits greatly increased numbers of stimulus-response associations to be encoded within the neural elements. (c) Encoding multiple stimulus-response associations onto the holographic neural element by performing encoding transformation as defined in Claim 13. Said transformation operates in manner such that mappings are encoded in one non-iterative transformation and these mappings are enfolded onto the same correlation set. (d) Decoding a response by processing a stimulus input through the correlation set as defined in Claim 14. Said transformation operates in such a manner that stimulus is transformed in a parallel manner through all stimulus- response associations enfolded within the correlation set to issue a response vector. In the event that the stimulus state is close to a prior encoded stimulus state, the dominant portion of the response vector corresponds to the associated response vector for the encoded stimulus- response mapping. (e) processing the generated response vector through a non¬ linear function to either amplify or attenuate the response magnitude about a defined recognition threshold as defined within Claim 18. Processing of response output through SUBSTITUTE SHEET said non-linear function provides the neural element with the ability to switch on for recognized stimulus and conversely switch off for unrecognized stimulus. (f) Implement a constant or time variable decay of the magnitude components for the vector elements within the correlation set as defined in Claim 19. Decay of said magnitude components is performed to establish a memory profile extending from short tern to long term and permanent memory. (g) Implement an inhibitory/excitory designation for stimulus input elements or response outputs by performing vector translation operations as defined within Claim 20. Said inhibitory/excitory transformation is performed to enhance symmetry characteristics. (h) Interconnecting a plurality of neural elements in any definable parallel or serial configuration such that response output vectors are fed into stimulus input fields as setout in Claim 21. Also, interconnecting a plurality of neural elements in any feedback configuration as setout in Claim 21. Claim 31 A method of content addressable memory whereby the encoding transformation of Claim 13 permits multiple content addressable associations to be superimposed upon on neural element. Said contend addressable system operates in a f shion that the memory of a learned event is expressed by addressing the neuron with an associated stimulus input. Within a multineuronal system configured in a layered or feedback arrangement, the content addressable characteristic will permit associations to propagate along the network or iterate within a neuronal loop. claim 32 An apparatus as described in Claims 11 to 21 further comprising apparatus for input or visual stimulus data and input of response data associated with said visual stimulus. Apparatus for converting visual stimulus data and associated response data into sets of vectors oriented within a complex or Riemann (phase) plane. Said response data may be comprised of data representing any form of mechanical actuation, classification, process control response, or abstraction thereof. claim 3? An apparatus as described in Claims 11 to 21 further comprising apparatus for input of auditory stimulus data and input of response data associated with said auditory stimulus. Apparatus for converting auditory stimulus. Apparatus for converting auditory stimulus data and associated response data into sets of vectors oriented within a complex or Riemann (phase) plane. Said response data may be comprised of data representing any form of SUBSTITUTE SHEET mechanical actuation, classification, process control response, or abstraction thereof. Cla m 34 An apparatus as described in Claims 11 to 21 further comprising apparatus for input of stimulus data originating from any form of sensory modality (i.e. olfactory, touch or pressure, etc.) and input of response data associated with said stimulus. Apparatus for converting said stimulus data and associated response data into sets of vectors oriented within a complex or Riemann (phase) plane. Said response data may be comprised of data representing any form of mechanical actuation, classification, process control response, or abstraction thereof. claim ?■? An apparatus as described in Claims 11 to 21 further comprising apparatus for input of stimulus data originating from any form of sensory modality (i.e. olfactory, touch or pressure, etc.) and input of response data associated with said stimulus. Apparatus for converting said stimulus data and associated response data into sets of vectors oriented within a complex or Riemann (phase) plane. Said response data may be comprised of data representin any form of mechanical actuation, classification, process control response, or abstraction thereof. SUBSTITUTE SHEET Claim 36 An apparatus as described in Claims 11 to 21 further comprising apparatus for input of stimulus data originating from any form of physical measurement, physical quantity, external field intensity, or abstract representation thereof. Apparatus for input of response data associated with said stimulus. Apparatus for converting said stimulus data and associated response data into sets of vectors oriented within a complex or Riemann (phase) plane. Said response data may be comprised of data representing any form of mechanical actuation, classification, process control response, or abstraction thereof. Claim 37 An apparatus as described in Claims 11 to 21 further comprising apparatus for incorporation into any control system or control subsystem. This application encompasses but is not limited to any form of process control, mechanical control, electrical control, biological control, vehicular control, and robotic device control. Claim 38 An apparatus as described in Claims 11 to 21 further comprising apparatus for input of heuristic rules whereby said heuristic rules are encoded in the form of stimulus-response associations and superimposed upon the same correlation set or matrix. Said SUBSTITUTE SHEET heuristic system functions in a manner as an expert system whereby a given input scenario causes the generated output to associate to the nearest learned output. Said heuristic system also functions to discriminate between recognized input scenarios and unrecognized input scenarios by producing response vectors whose magnitude are proportional to the degree of recognition. Claim 39 An apparatus as described in Claims 11 to 21 further comprising apparatus for interface to processing means to enhance numeric or simulation related processing capabilities. This enhancement of processing capabilities may be realized for problems sets in which the analysis or simulation may be restructured within the domain of a stimulus-response action or association. For instance a finite mesh analysis whereby the values of parameters or variables adjacent to a given mesh node form elements within the stimulus field, and the internal parameters or conditions form elements of the response field. All relations between parameters external to the mesh node and resulting conditions internal to the mesh node may be constructed as discrete stimulus-response associations. Again all of these physical or abstract associations are superimposed upon the same correlation set or matrix. Claim 40 An apparatus as described in Claims 11 to 21 further comprising SUBSTITUTE SHEET apparatus for interfacing the holographic neural system to oiological neural systems whereby electrical impulses generated hy the biological systems are relayed via electrical transducers into stimulus field receptors within the artificial neura! system. This operation permitting stimulus or response fields to be mapped from biological to artificial neural systems. Similarly stimulus or response fields generated or transmitted b y the artificial neural system -ay be mapped into biological neural systems via any form of electrical or electrochemical transduction. In this manner the artificial and biological neural systems may operate in conjunction whereby associations and/or data or information fields communicate or transfer in a bidirectional manner between biological and artificial neural syst«s. said association or data fields -ay repr i nt information generated from any form of sensory modality (i.e. vision, hearing, touch, radar, sonar, etc.) or abstraction thereof. Similarly data fields may also comprise control signals to effector re .s-p-o-n..s.e < s ((ii.ee. iinnt * -e-.r-n"a-.l visceral organs, muscle extension/flexure, etc.).

Inventors: SUTHERLAND JOHN, SUTHERLAND, JOHN
Applicants: SUTHERLAND JOHN, SUTHERLAND, JOHN
Application year: 1991
Main classification: G06F15
IPC codes: G06F15, G06G7, G06N1, G06N3