# Neural Network Dynamics without Minimizing Energy

Authors: Mau-Hsiang Shih; Feng-Sheng Tsai
Journal: Abstract and Applied Analysis
 (2013)

---

## Abstract

Content-addressable memory (CAM) has been described by collective dynamics of neural networks and computing with attractors (equilibrium states). Studies of such neural network systems are typically based on the aspect of energy minimization. However, when the complexity and the dimension of neural network systems go up, the use of energy functions might have its own limitations to study CAM. Recently, we have proposed the decirculation process in neural network dynamics, suggesting a step toward the reshaping of network structure and the control of neural
dynamics without minimizing energy. Armed with the decirculation process, a sort of decirculating maps and its structural properties are built here, dedicated to showing that circulation breaking taking place in the connections among many assemblies of neurons can collaborate harmoniously toward the completion of network structure that generates CAM.


---

## Body

## 1. Introduction

Hopfield in 1982 proposed a neural network model using a global energy function to provide absolute stability of global pattern formation [1]. Since then, the concept of content-addressable memory (CAM) has been widely developed, showing that neural networks are capable of yielding an entire memory item on the basis of sufficient partial information [2–6]. However, related lines of research in switched linear networked systems have shown that networked systems can be asymptotically stable, but no common quadratic Lyapunov function exists through the use of a theoretical result of optimal joint spectral radius range for the simultaneous contractibility of coupled matrices [7] (see also [8, 9]). This implies a limitation of the use of global energy functions to explain the formation of CAM when the complexity and the dimension of networked systems go up.The above limitation motivates us to search for another logical strategy to study neural network dynamics. More recently, we have proposed the decirculation process in neural network dynamics [10], in which a criterion that describes and quantifies perturbations of network structure and neural updating is given. The decirculation process is stated as “the occurrence of a loop of neuronal active states leads to a change in neural connections, which feeds back to reinforce neurons to tend to break the circulation of neuronal active states in this loop.” Furthermore, in the study of operator control underlying the decirculation process [11], we have introduced the decirculating maps of loops of neuronal active states, with each measuring the effects of connection changes and displaying the threshold of circulation breaking. The study of the decirculation process suggests an initial but critical step toward the reshaping of network structure and the control of neural dynamics without minimizing energy.Here we wish to use the decirculating maps to show that circulation breaking taking place in the connections among many assemblies of neurons can collaborate harmoniously toward the completion of network structure that generates CAM. Thus, in contrast with the explicit construction of global energy functions, the theoretical framework of local decirculating maps reflects, in a neural ensemble sense, that CAM can be derived from the cooperation of connection changes in neural assemblies.In Section2 we introduce the decirculating maps and show the structural properties of the symmetric part of the decirculating maps. In Section 3 we describe the neural network dynamics and determine the network structure for circulation breaking. In Section 4 we prove that circulation breaking taking place in the connections among many assemblies of neurons can collaborate harmoniously toward the completion of network structure that generates CAM.


## 2. Decirculating Maps

We introduce the decirculating maps defined in [11] and show that the symmetric part of the decirculating maps has nonzero entries relative to some symmetric difference sets and is positive semidefinite.For this, let{0,1}n denote the binary code consisting of all 01-strings of fixed-length n. Denote by Ω=[x0,x1,…,xp] a loop of states in {0,1}n, meaning that p>1, x0,x1,…,xp∈{0,1}n, x0=xp, and xi≠xj for some i,j∈{1,2,…,p}. For every i,j=1,2,…,n, we assign an integer, denoted cij(Ω), according to the rule
(1)cij(Ω)=xj0(xi0-xi1)+xj1(xi1-xi2)+⋯+xjp-1(xip-1-xip).We refer to the resulting matrixC(Ω)=(cij(Ω)) as the decirculating map of Ω. For example, let Ω = [1111100000, 0011111000, 0000111110, 0111110000, 0001111100, 1111100000]. Then
(2)C(Ω)=(11100-1-1-10012210-1-2-2-10012100-1-2-100011000-1-100000000000-1-1-10011100-1-2-2-10122100-1-2-100121000-1-10001100000000000).Denote byCSY(Ω)=(1/2)(C(Ω)+C(Ω)T) and CSK(Ω)=(1/2)(C(Ω)-C(Ω)T) the symmetric part and the skew-symmetric part of C(Ω), respectively.Consider the Hilbert spaceMn(ℝ) of all real n×n matrices endowed with the Hilbert-Schmidt inner product 〈·,·〉, that is, if A=(aij) and B=(bij)∈Mn(ℝ), then 〈A,B〉=tr(ABT)=∑i,j‍aijbij. Let us recall that the symmetric difference of two sets U and V is the set U▵V, each of whose elements belongs to U but not to V, or belongs to V but not to U. For any 01-string x=x1x2⋯xn we define
(3)1(x)={i;xi=1,1≤i≤n},0(x)={i;xi=0,1≤i≤n}.Theorem 1.
LetΩ=[x0,x1,…,xp] be a loop of states in {0,1}n. Then  (i)
CSY(Ω)ij=0 if (i,j)∉⋃0≤m<p‍((1(xm)▵1(xm+1))×(1(xm)▵1(xm+1)));(ii)
CSY(Ω) is positive semidefinite.Proof.
According to [11, Lemma 1] with A=0, the assertion of part (i) follows, so we need to prove part (ii). Let  A=(aij)∈Mn(ℝ). Then
(4)〈A,C(Ω)〉=∑i,jaij(∑0≤m<pxjmxim-∑0≤m<pxjmxim+1)=∑0≤m<p(∑i,jaijxjmxim-∑i,jaijxjmxim+1)=∑0≤m<p(〈Axm,xm〉-〈Axm,xm+1〉).
Suppose A is positive semidefinite. Then we have
(5)∑0≤m<p(〈Axm,xm〉-〈Axm,xm+1〉)=12(∑0≤m<p(〈Axm,xm〉+〈Axm+1,xm+1〉)-∑0≤m<p(〈Axm,xm+1〉-〈Axm+1,xm〉))=12∑0≤m<p〈A(xm-xm+1),xm-xm+1〉≥0.
Combining (4) and (5) shows that if A is positive semidefinite, then
(6)〈A,CSK(Ω)〉=〈A,CSK(Ω)+CSY(Ω)〉=〈A,C(Ω)〉≥0.
Let y∈ℝn. Then (yiyj)∈Mn(ℝ) is positive semidefinite and, by (6), we have
(7)〈CSK(Ω)y,y〉=∑ijyiyjCSK(Ω)ij=〈(yiyj),CSK(Ω)〉≥0,
showing that CSY(Ω) is positive semidefinite.


## 3. Network Structure for Circulation Breaking

For network description, name the neurons1,2,…,n. The dynamical system of the n coupled neurons is modeled by the nonlinear equation [10, 12]
(8)x(t+1)=HA(x(t),s(t)),t=0,1,…,
where x(t)=(x1(t),x2(t),…,xn(t))∈{0,1}n is a vector of neuronal active states denoting the population response of neurons at time t, A=(aij)∈Mn(ℝ) is the coupling matrix of the network, s(t)⊂{1,2,…,n} denotes the neurons that adjust their activity at time t, and HA(·,s(t)) is a function whose ith component is defined by
(9)[HA(x,s(t))]i=1(∑j=1naijxj-bi)ifi∈s(t),
otherwise [HA(x,s(t))]i=xi, where bi∈ℝ is the threshold of neuron i and the function 1 is the Heaviside function: 1(u)=1 for u≥0, otherwise 0, which describes an instantaneous unit pulse. On each subsequent time t=0,1,…, the network generates a vector of neuronal active states according to (8), resulting in the dynamic flow x(t), t=0,1,….Theorem 2.
LetΩ=[x0,x1,…,xp] be a loop of states in {0,1}n. If A∈Mn(ℝ) satisfies
(10)〈A,C(Ω)〉≥0,
then for any threshold b∈ℝn, any initial neural active state x(0)∈{0,1}n, and any updating s(t)⊂{1,2,…,n}, t=0,1,…, the resulting dynamic flow x(t) of (8) cannot behave in
(11)x(T)=x0,x(T+1)=x1,…,x(T+p)=xp
for each T=0,1,….Proof.
Suppose, by contradiction, that there existb∈ℝn, x(0)∈{0,1}n, s(t)⊂{1,2,…,n}, t=0,1,…, and T≥0 such that x(T)=x0, x(T+1)=x1,…,x(T+p)=xp. Let
(12)Λ+={t;0(x(t))∩1(x(t+1))≠∅,T≤t<T+p},Λ-={t;1(x(t))∩0(x(t+1))≠∅,T≤t<T+p}.
Then Λ+≠∅ and Λ-≠∅. Indeed, if Λ+=∅ or Λ-=∅, then
(13)x(T)=x(T+1)=⋯=x(T+p),
contradicting the loop assumption x(T+i)≠x(T+j) for some i,j∈{1,2,…,p}. Since 0(x(t))∩1(x(t+1))⊂s(t) and 1(x(t))∩0(x(t+1))⊂s(t) for each t=0,1,…, we conclude from (4) and (8) that
(14)〈A,C(Ω)〉=∑0≤m<p(〈Ax(T+m),x(T+m)〉-〈Ax(T+m),x(T+m+1)〉)=∑0≤m<p〈Ax(T+m),x(T+m)-x(T+m+1)〉<-∑t∈Λ+∑j∈0(x(t))∩1(x(t+1))bj+∑t∈Λ-∑j∈1(x(t))∩0(x(t+1))‍bj=∑0≤m<p〈b,x(T+m)-x(T+m+1)〉=0,
contradicting (10), and that completes the proof.


## 4. Harmonious Collaboration for CAM

We now proceed to the proof that circulation breaking taking place in the connections among many assemblies of neurons can collaborate harmoniously toward the completion of network structure that generates CAM.We shall first introduce the Schur product theorem.IfA=(aij) and B=(bij)∈Mn(ℝ), then the Schur product of A and B is the matrix A∘B=(aijbij)∈Mn(ℝ). We have the following well-known theorem.Theorem 3 (Schur product theorem).
IfA,B∈Mn(ℝ) are positive semidefinite, then A∘B is also positive semidefinite.LetA∈Mn(ℝ) and I⊂{1,2,…,n}. Denote by A(I) the principal submatrix of A relative to I.Theorem 4.
LetI1,I2,…,Iq be mutually disjoint subsets of {1,2,…,n}. If A∈Mn(ℝ) is symmetric and A(Ik) is positive semidefinite for each k=1,2,…,q, then(i)
〈A,C(Ω)〉≥0 for each loop Ω=[x0,x1,…,xp] satisfying for m=0,1,…,p-1,
(15)1(xm)▵1(xm+1)⊂Ikforsomek∈{1,2,…,q};(ii)
for any thresholdb∈ℝn, any initial neural active state x(0)∈{0,1}n, and any updating s(t)⊂{1,2,…,n}, t=0,1,…, satisfying
(16)s(t)⊂Ikforsomek∈{1,2,…,q},
the resulting dynamic flow x(t) of the network modeled by (8) will converge to an equilibrium state.Proof.
To prove (i), letΩ=[x0,x1,…,xp] be a loop satisfying (15). Then, by Theorem 1(i), we have CSY(Ω)ij=0 if (i,j)∈⋃1≤k≤q‍(Ik×Ik). Furthermore, since A is symmetric, it follows that
(17)〈A,C(Ω)〉=〈A,CSY(Ω)+CSK(Ω)〉=〈A,CSY(Ω)〉=∑1≤k≤q〈A(Ik),CSY(Ω)〉.
Since CSY(Ω) is positive semidefinite by Theorem 1(ii) and A(Ik) is positive semidefinite for each k=1,2,…,q, we conclude from the Schur product theorem that A(Ik)∘CSY(Ω) is positive semidefinite. Let y∈ℝn be a vector with all components equal to 1. Then for each k=1,2,…,q,
(18)〈A(Ik),CSY(Ω)〉=〈(A(Ik)∘CSY(Ω))y,y〉≥0,
implying that 〈A,C(Ω)〉≥0.
To prove (ii), letb∈ℝn, x(0)∈{0,1}n, s(t) satisfying (16), and x(t) be the resulting dynamic flow of the network modeled by (8). Suppose, by contradiction, that there exist p>1 and T≥0 such that Ω(T,p)=[x(T),x(T+1),…,x(T+p)] forms a loop of states in {0,1}n. Since s(t) satisfies (16), it follows that for each m=0,1,…,p-1,
(19)1(x(T+m))▵1(x(T+m+1))⊂Ikfor    somek∈{1,2,…,q}.
Thus, by Theorem4(i), we have 〈A,C(Ω(T,p))〉≥0. By Theorem 2, we see that the dynamic flow x(t) cannot form the loop Ω(T,p) of states in the period of time t=T,T+1,…,T+p, which is a contradiction, and that completes the proof.LetIk={k} for k=1,2,…,n. If A∈Mn(ℝ) is symmetric with nonnegative diagonal entries, then A(Ik) is positive semidefinite for each k=1,2,…,n. Thus, by Theorem 4(ii), we obtain the following basic theorem for CAM, showing that a network structure can be harmoniously collaborated by taking circulation breaking in all the loops Ω=[x0,x1,…,xp] satisfying ♯(1(xm)▵1(xm+1))≤1 for each m=0,1,…,p-1.Theorem 5 (Hopfield [1]).
IfA∈Mn(ℝ) is symmetric with nonnegative diagonal entries, then each dynamic flow x(t) of the network modeled by (8), with each neuron adjusting randomly and asynchronously (i.e., ♯s(t)=1 for each t=0,1,…), will converge to an equilibrium state.



---

*Source: 496217-2013-03-07.xml*