From: pvad@ekoram.msk.su (Vadim I. Potapov)
Subject: (2/3)REPORT: Neuroenergetic concept of intelligence
Reply-To: pvad@ekoram.msk.su
Organization: Financy Investment Corporation ECORAMBURS
Date: Sat, 22 Aug 92 09:45:40 +0300


8 Decision making
     The activation excitation U is formed mainly by the
receptor systems, when the automaton sees or hears the just
expected. Sometimes it is enough simply to wait the expected
(e.g. at the sonic perception of known texts), nevertheless in
other cases the expected must be found or made by means of some
actions. An actions may be the responsible or irresponsible
ones. Irresponsible actions do not vary the external
environment. The main irresponsible actions are: to look at any
place of visual scene for the search of object needed and to
speak without voice. The responsible actions are irreversible or
involve a penalty in the case of wrong action. Decision making
mechanism diminishes the probability of wrong responsible
actions. To make a responsible action, the automaton should
overcome a certain action threshold: the confidence of success
should overcome the level of caution. An action takes place when
the corresponding motor element of memory, i.e. a special
ensemble "action", starts. The motor elements for irresponsible
action can work at small emotional (and, respectively, motor)
tones, whereas for the responsible actions one needs a high
tone, which is created when thetac does not retreat before
batch, but stays motionless or even moves towards the batch.
While ensemble "action" is not turned on, thetac retreats,
restraining the growth of tone; otherwise thetac does not
retreat, and tone grows. The turning on of the ensemble "action"
means that automaton has made a decision. The ensemble "action"
is controlled by two special memory ensembles: "necessarily" and
"carefully", while its main source of excitation is formed from
the evaluation of paragraph, from the growth rate of "well"
Q'(t), which reflects a degree of confidence that solution found
is right or, at least, the best from possible. The value of
excitation for the ensemble "action" should exceed the
inhibition one from the ensemble "carefully". To the excitation
due to Q'(t) action the excitation from ensemble "necessarily"
is added, which hastens the automaton, compels it to make action
quicker. Great values of excitation from "necessarily" reduce
the demands to the decision quality: the satisfactory one
becomes sufficient instead of the best one.
     A paragraph is characterized by its Q'(t) value, which
depends on the composition of HE's {S[i]} at the moment t3, i.e.
on the outlining variant of decision and on the degree of its
conformity to the current conditions of the external
environment. An action is preceded by a lot of
paragraphs-variants, which are being compared by their Q'(t).
Consecutive paragraphs have a succession in their {S[i]} at the
moment t2, therefore they should provide a convergence to the
good paragraphs: physiological process of emotional optimization
should prove to be a process of heuristic selection of behavior
variants in the terms of external environment description
language, tending to converge to the best (at the given
conditions) variants. Succession and convergence are provided by
a number of properties:
     1. EW, was acting in the HF-generation mode, initially goes
out of game due to the rise of its neurons Ps, but then, in some
paragraphs, it increases its excitability because of negative
values of Ps owing to the postanodal exaltation. Hence, this EW
will come into the group {S[i]} at the moment t2 in one of the
succeeding paragraphs.
     2. In the EW's, which worked in the LF-generation mode and
couldn't overcome the refractoriness threshold, the
conductivities of internal links will increase, that will
increase these EW's excitability in the next paragraphs.
     3. Non-working EW's, which have received great excitatory
potentials due to associative links from EW's, which were
active, have a good chance to enter the next paragraph group
{S[i]} at the moment t2.
     4. Non-working EW's, which have received a sufficient
excitation from the receptor systems during the active phase of
paragraph (seen, heard), also will have chance in the next
paragraph.
     5. The final formation of wish takes place at the interval
[t2,t3]. A possibility for various EW's to come into the group
{S[i]} at the moment t2 due to enumerated properties is great
enough, but as the size of {S[i]} at the moment t3 is much less
than the size of {S[i]} at the moment t2, so EW's have a few
chances to enter the wish. At the interval [t2,t3] a hard
struggle takes place between EW's, resulted in the victory of
the EW's group, having the greatest mutual aid due to
associative links. This struggle is hidden from conscience,
however just it is the main kitchen of automaton's brain.

9 Emotional tint of memory
     At the selection of wish in the paragraphs the variation of
links in and between the ensembles plays an important part.
Conductivities of excitatory links vary due to their dynamic
components, which increase in the active state and gradually
decrease in the rest. It was mentioned above, that conductivity
variation algorithm submits to the problem of generation
frequency optimization, however the rate of conductivity
variation depends also on an emotional state: the better is
emotional state, the greater is rate. As it was shown, an
emotional state is defined by the age distribution of EC neurons
and depends on the thetac movements and on the accords. The
automaton has one more possibility to influence strongly on the
emotional state: the direct influence on the quantity of
external EC feed. This possibility is realized by means of an EC
feed valve, which can regulate the feed throughput depending on
the emotional tint of working ensembles in memory. The feed
valve is controlled also by two channels of external education:
the channel of penalties, closing the valve, and the channel of
encouragements, opening the valve. Emotional tints of memory
ensembles are formed in the process of accumulation of
experience by interaction with environment (and with teachers)
by the automaton. If, for example, while learning chess the loss
of a figure is accompanied by a penalty, variable for the
various figures, then ensembles, corresponding to the notions of
"lose my knight", "lose my queen" and so on, acquire a negative
tints, i.e. the inhibitory links to the feed valve with the
conductivity values, proportionate to the values of penalties.
Thus, at the choosing of the best variant of behavior by Q'(t)
value the selection toward variants with positively tinted EW's
will take place.

10 Memory's own life
     The automaton's memory is the union of various neuronal
ensembles. The main volume of memory is occupied by EW's and by
ensembles-phrases, which correspond to the objects and
situations in the outer world, and also to the concrete and
abstract notions about the properties of the world. The main
property of the automaton, leading to the intellectuality, is
the limitation of memory capacity. The outer world in its
concretizations is infinitely diverse, consequently the
automaton is unable to remember all concretizations and correct
reactions to them, therefore it must pass from the remembering
of concretizations to the discovering and remembering of
regularities, to the generalized ideas and abstractions. The
generalization problem in the neuroenergetic concept is solved
as a problem of necessity of memory capacity (number of
ensembles) minimization by the following logic:
     1. The conductivities of excitatory links in the absence of
generation gradually decrease, consequently, the condition for
existence of ensembles is their periodic activity, preventing
the conductivities from decrease below some minimal ones.
Minimal conductivities are such that still permit the ensemble
to bootstrap by LF-generation of small part of its neurons, i.e.
to realize the event R[i]->S[i]. There is a certain time
interval T, during which the conductivities decrease from normal
values to the minimal ones in the marked sense; consequently, to
exist, the ensembles must work not more rarely, than with the
interval T. Overall memory capacity, its vocabulary, is divided
into two parts: active and passive. Active vocabulary EW's work
more often, than with the interval T, while passive vocabulary
EW's in the given period of the automaton's life do not get in
the groups {S[i]} at the moment t2 and do not recover their
internal links. Hence the automaton has a problem of passive
vocabulary saving.
     2. Excitability of the ensemble, i.e. probability of the
event R[i]->S[i], depends on many factors, and also on the age
theta of the ensemble's neurons. The increase of theta for the
passive vocabulary EW's may be the cause of their activity and
recovery of links, if their neurons will not generate due to
some other reasons. As it was marked, the automaton has two main
modes - sleep and awaking. During the awaking phase there is no
significant decrease of theta for the passive vocabulary EW's,
because they are permanently blocked by the functioning of
active vocabulary EW's. In the sleep phase the passive
vocabulary EW's neurons (at least, their HF-generations) are
blocked by activity of MAG's. The cause of this is that neurons,
not participating in associative memory, compose the greater
part of neural network and therefore form a lot of inhibitory
links to the neurons of memory ensembles.
     3. The automaton must have a special state, providing
regeneration of the passive vocabulary. i.e. neither sleep nor
awaking; in this state neurons should be excited mainly owing to
the great theta values. This third state (subconscience) in the
automaton is provided by separation of initial neural network
onto the weakly interconnected parts - "semi-nets", so that one
semi-net can awake while another still sleeps. Subconscience
appears in the awaked semi-net - this is a memory's "own life"
mode, i.e. the mode of autonomous living, without modulating
influences from EC and without U from receptor systems, because
EC, motor and receptor systems are blocked by strong rhythmic
generation, produced by MAG's queue of sleeping semi-net.
Subconscience occupies a small time and may be compared with the
state of fast (paradoxal) human sleep. Just in the state of
subconscience the queue of passive vocabulary EW's for
recovering moves. During one period of subconscience only small
part of the queue has time to work. The whole queue must have
acted for time, less T - just this requirement restricts the
automaton's memory capacity.
     4. Recovering of EW's in subconscience takes place at HF-
generations, that is possible only at strong associative aid
from many EW's. Memory's own life is the formation and struggle
of various groups of ensembles, the search for the allies and
the supplanting of opponents, which are outlined by the
automaton's experience, reflected in the mosaic of associative
links. As a result of active memory's own life, a new
associative links and a new ensembles are formed in the
subconscience, and just that is the real introduction into the
intelligence. The appearance of new associative links and new
ensembles is the alteration of a world model, appearing as a
result of accumulated experience processing, not as a result of
direct experience. Physiological optimization of relations in
memory during the subconscience state has a tendency to turn
into the logical optimization of knowledges structures, leading
to their universalization. When automaton will awake, it will
search in the external environment for the confirmation of its
new ideas, and either will confirm and fix them, or will reject
them. New ideas, appearing "from within", are the intuitive
ideas, and the mechanism of corresponding memory structures
formation is the intuition mechanism.
     5. Priorities of ensembles in the subconscience are defined
not only by the age queue, but also by dominants, i.e. by active
vocabulary EW's, corresponding to hard tasks, which weren't
solved by the automaton in the nearest past. This means, that
these dominants with a great probability will be centers of
mutual aid unions in the subconscience state, and in
subconscience the automaton will continue to solve its problems.
In this state the influences from environment don't disturb the
automaton, and at the same time a very distant and indirect
analogies from various areas of experience are accessible for
the automaton.
     6. In subconscience the automaton searches new, more simple
and general solutions of various external problems and, if finds
such a solutions, forms a new memory structures for them.
Activity of new structures blocks the activity of old ones,
solving the same problems, both in awaking and in subconscience.
A new one does not permit to renew for an old one, and supplants
it from memory, releasing space for the next knowledges. This is
the mechanism of solution of the automaton's memory minimization
problem.

11 Speech, awaking, thinking
     In the awaking phase the automaton's work is expressed in
the HF-generations of ensembles and is provided by adjusting
automaton's wishes {S[i]} at the moment t3 with its operative
abilities to satisfy these wishes by means of U for HE's. The
work must be relatively continuous and intensive enough in order
to form the noisy excitation flow near the optimal value. This
is no other than requirement of high degree of adequacy of
wished and achievable. High and stable adequacy can be provided
by the speech in the monologue mode: automaton speaks to itself
just it wants to hear, i.e. an external one is being formed
directly from the wished internal one. The speech in the
energetic sense is the liberation from external informational
dependence by means of creation of internal informational loop,
in which a wished information turns into the real external one.
At this comprehension of the speech role one may state, that
monologue is primary, and dialogue is secondary. Naturally, the
automaton can start to speak only if it already has the verbal
vocabulary, that needs socium or certain special education.
     An important peculiarity of speech mechanism is that the
work of speech motor phonemes relates to the irresponsible
actions, i.e. the speech phonemes starts by states S[i] (not
A[i]) of their pre-motor memory elements on the interval
[t3,t4]. As a result, hearing phonemes receive U (S[i]->A[i])
and the automaton hears, what it wanted to hear. A verbal word
is a name (label) of an object; an ensemble-name and ensemble -
visual image of the same object are strongly associatively
interlinked, and state A[i] of ensemble-name creates sufficient
U for the ensemble-image: in the automaton's memory the image of
object flushes. Wanted internal situations {S[i]} at the moment
t3 become "hearable" and "visible" and pass one into another
from paragraph to paragraph with a good logical and emotional
succession - automaton fancies. If the memory has a strong
dominants, then the process of fancying submits to them and
turns into the process of thinking, i.e. the fancying, directed
to the extinguishing of definite dominants.
     The speech is based on the formation in memory of a special
vocabulary of names, correlated with the objects, situations,
notions, initially presented by their ensembles in the various
zones of memory, corresponding to various modalities and various
hierarchical levels. The names of some objects, situations,
notions belong to the same hierarchical level of EW's and are
situated in the same memory zone, so that they can easily form
associative links. As a result, EW's from the weakly connected
memory zones can, if it corresponds to the external realities,
connect through their names (e.g. notions "blue" - "cold",
"sharp" - "iron"), that expands the prospects of associations.
It is important also, that due to names the hierarchical level
of complex notions decreases.

Conclusions
     The neuroenergetic concept of intelligence may be of
special interest in two senses: applied, as one of directions in
AI problem, and conceptual, i.e. in the sense of theoretical
biology.
     In AI the basic direction of investigations is the info-
logical one, the main lack of which is absence of active memory
and inductive procedures. The above-considered direction of AI
investigations one may define as biological (or, more exactly,
bio-logical or the biologic), and the main feature of it is the
internal activity of the system and presence of induction. In
the outlook both the directions may complete each other.
     The intelligent automaton in the conceptual sense supposes
the relation to itself as to the model of biological system,
i.e. one should evaluate the capacity for work, constructivity
and sufficiency of model hypotheses by comparison of complete
properties of biological system (in particular, of man) and of
the automaton.
     The neuroenergetic concept is being developed for more than
30 years. During this time many hypotheses have been confirmed
experimentally, confirmation of others is expected in the near
future, that is promoted by the fast development of computers.
We are sure that the creation of independent really intelligent
automata is quite possible. This means, that the solution of
ethic problems, which will appear tomorrow, must be started
already now.

Acknowledgements
     We would like to thank Prof. Ya.V.Shevelyov (Kurchatov's
Inst. of Atomic Energy) for useful criticism and friendly
support. Thanks also to Ecoramburs Corp. for partial financing
this work during last year.

References
1. Emelyanov-Yaroslavsky LB, Potapov VI (1992a) "Live" neuron
and optimal learning rule. Biol. Cybern., 67/1 (May 1992),
p.67-72
2. Emelyanov-Yaroslavsky LB, Potapov VI (1992b) Self-
organization of day cycle and hierarchical associative memory in
"live" neural network. Biol. Cybern., 67/1 (May 1992), p.73-81


(C) L.B.Emelyanov-Yaroslavsky, V.I.Potapov, 1992

---------------
   About figures.
Figures are prepared as bit images for HP LaserJet printers and should be
copied to printer directly after UUDECODEing and unARJing by the command:
    copy/b file prn
---------------
   Why we've decided to submit this concept to teleconference?
After publishing our papers, which are the background of this concept,
in Biol.Cybern., we've received a great heap of "request-a-print", but
we are not so reach to pay 30-40 roubles for every answer (hyperinflation :-( )
>From the other hand, the stability of life in former USSR is small enough,
and we can't guarantee that we'll can do our research in half of year, that's
why we can't wait about year (or more due to our post) to publish this
concept in magazin. Moreover, it seems that there are no finances for science
in our country today, therefore any proposals are welcome.

     Vad.



Newsgroups: comp.ai