spike timing dependent plasticity the relationship to rate based learning for models with weight dynamics determined by a stable fixed point experimental evidence indicates that synaptic modification depends on the timing relationship between the presynaptic inputs and the output spikes that they generate in this letter results are presented for models of spike timing dependent plasticity stdp whose weight dynamics is determined by a stable fixed point four classes of stdp are identified on the basis of the time extent of their input output interactions the effect on the potentiation of synapses with different rates of input is investigated to elucidate the relationship of stdp with classical studies of long term potentiation and depression and rate based hebbian learning the selective potentiation of higher rate synaptic inputs is found only for models where the time extent of the input output interactions is input restricted i e restricted to time domains delimited by adjacent synaptic inputs and that have a time asymmetric learning window with a longer time constant for depression than for potentiation the analysis provides an account of learning dynamics determined by an input selective stable fixed point the effect of suppressive interspike interactions on stdp is also analyzed and shown to modify the synaptic dynamics

global stability of an age structured population model we consider a nonlinear discrete time population model for the dynamics of an age structured species this model has the form of a lure feedback system well known in control theory and is a particular case of the system studied by townley et al in townley et al 2012 the main objective is to show that in this case the range of nonlinearities for which the existence of globally asymptotically stable non zero equilibrium can be guaranteed is considerably larger than that in the main result in townley et al 2012 we illustrate our results with several biologically meaningful examples

necessary and sufficient conditions for the local solvability in hyperfunctions of a class of systems of complex vector fields a necessary and sufficient condition is proved for the validity of the poincare lemma in degreeq 1 in the differential complex attached to a locally integrable structure of codimension one in spaces of hyperfunctions the base manifold is only assumed to be smooth the hyperfunctions are defined in the hypo analytic structure associated to a smooth first integral z the condition is that the singular homology of the fibres of the map z be trivial in dimensionq 1 by the approximation formula of bt the germ of this fibration at a point is independent of the choice of the first integral z

fixed point attractor analysis for a class of neurodynamics nearly all models in neural networks start from the assumption that the input output characteristic is a sigmoidal function on parameter space we present a systematic and feasible method for analyzing the whole spectrum of attractors all saturated all but one saturated all but twosaturated and so on of a neurodynamical system with a saturated sigmoidal function as its input output characteristic we present an argument that claims under a mild condition that only all saturated or all but one saturated attractors are observable for the neurodynamics for any given all saturated configuration all but one saturated configuration the article shows how to construct an exact parameter region r such that if and only if the parameters fall within r then is an attractor a fixed point of the dynamics the parameter region for an all saturated fixed point attractor is independent of the specific choice of a saturated sigmoidal function whereas for an all but one saturated fixed point it

local integrability of mizohata structures in this work we study the local integrability of strongly pseudoconvex mizohata structures of rank n 2 and co rank 1 these structures are locally generated in an appropriate coordinate system t 1 t n x by flat perturbations of mizohata vector fields m j t j it j x j 1 n for this we first prove the global integrability of small perturbations of the structure generated by z 1 z n 1 j z j 2 n defined over a manifold c s where s is simply connected

feedback control systems analysis of density dependent population dynamics abstract we use feedback control methods to prove a trichotomy of stability for nonlinear density dependent discrete time population dynamics defined on a natural state space of non negative vectors specifically using comparison results and small gain techniques we obtain a computable formula for parameter ranges when one of the following must hold there is a positive globally asymptotically stable equilibrium zero is globally asymptotically stable or all solutions with non zero initial conditions diverge we apply our results to a model for chinook salmon

semi global persistence and stability for a class of forced discrete time population models abstract we consider persistence and stability properties for a class of forced discrete time difference equations with three defining properties the solution is constrained to evolve in the non negative orthant the forcing acts multiplicatively and the dynamics are described by so called lur e systems containing both linear and non linear terms many discrete time biological models encountered in the literature may be expressed in the form of a lur e system and in this context the multiplicative forcing may correspond to harvesting culling or time varying such as seasonal vital rates or environmental conditions drawing upon techniques from systems and control theory and assuming that the forcing is bounded we provide conditions under which persistence occurs and further that a unique non zero equilibrium is stable with respect to the forcing in a sense which is reminiscent of input to state stability a concept well known in nonlinear control theory the theoretical results are illustrated with several examples in particular we discuss how our results relate to previous literature on stabilization of chaotic systems by so called proportional feedback control

an analysis of synaptic normalization in a general class of hebbian models in standard hebbian models of developmental synaptic plasticity synaptic normalization must be introduced in order to constrain synaptic growth and ensure the presence of activity dependent competitive dynamics in such models multiplicative normalization cannot segregate afferents whose patterns of electrical activity are positively correlated while subtractive normalization can it is now widely believed that multiplicative normalization cannot segregate positively correlated afferents in any hebbian model however we recently provided a counterexample to this belief by demonstrating that our own neurotrophic model of synaptic plasticity which can segregate positively correlated afferents can be reformulated as a nonlinear hebbian model with competition implemented through multiplicative normalization we now perform an analysis of a general class of hebbian models under general forms of synaptic normalization in particular we extract conditions on the forms of these rules that guarantee that such models possess a fixed point structure permitting the segregation of all but perfectly correlated afferents we find that the failure of multiplicative normalization to segregate positively correlated afferents in a standard hebbian model is quite atypical

hebbian learning of recurrent connections a geometrical perspective we show how a hopfield network with modifiable recurrent connections undergoing slow hebbian learning can extract the underlying geometry of an input space first we use a slow and fast analysis to derive an averaged system whose dynamics derives from an energy function and therefore always converges to equilibrium points the equilibria reflect the correlation structure of the inputs a global object extracted through local recurrent interactions only second we use numerical methods to illustrate how learning extracts the hidden geometrical structure of the inputs indeed multidimensional scaling methods make it possible to project the final connectivity matrix onto a euclidean distance matrix in a high dimensional space with the neurons labeled by spatial position within this space the resulting network structure turns out to be roughly convolutional the residual of the projection defines the nonconvolutional part of the connectivity which is minimized in the process finally we show how restricting the dimension of the space where the neurons live gives rise to patterns similar to cortical maps we motivate this using an energy efficiency argument based on wire length minimization finally we show how this approach leads to the emergence of ocular dominance or orientation columns in primary visual cortex via the self organization of recurrent rather than feedforward connections in addition we establish that the nonconvolutional or long range connectivity is patchy and is co aligned in the case of orientation learning

real analytic solvability for differential complexes associated to locally integrable structures abstract inspired by the work of suzuki 12 on the concept of real analytic solvability for first order analytic linear partial differential operators we extend his results for the differential complexes associated to analytic locally integrable structures of corank one we prove that such notion of solvability is related to the smooth solvability condition introduced by f treves 13 in 1983 in our arguments the natural extension to closed forms of the well known baouendi treves approximation formula the so called approximate poincare lemma cf 1 14 plays a key role

on local solvability of a class of abstract underdetermined systems abstract in this work we present a necessary and sufficient condition for a class of abstract underdetermined systems to be solvable we develop j f treves ideas presenting the so called condition and its connection with the study of the solvability in consideration we also prove the existence of finite order regularity solutions

global properties of a class of vector fields in the plane on etudie l existence des solutions globales au probleme lu o du o sur r 2 ou l est un champ vectoriel sans singularite on se restreint au cas d operateurs localement integrables et satisfaisant certaines proprietes

on neurodynamics with limiter function and linsker s developmental model the limiter function is used in many learning and retrieval models as the constraint controlling the magnitude of the weight or state vectors in this paper we developed a new method to relate the set of saturated fixed points to the set of system parameters of the models that use the limiter function and then as a case study applied this method to linsker s hebbian learning network we derived a necessary and sufficient condition to test whether a given saturated weight or state vector is stable or not for any given set of system parameters and used this condition to determine the whole regime in the parameter space over which the given state is stable this approach allows us to investigate the relative stability of the major receptive fields reported in linsker s simulations and to demonstrate the crucial role played by the synaptic density functions

hebbian learning and spiking neurons a correlation based hebbian learning rule at a spike level with millisecond resolution is formulated mathematically analyzed and compared with learning in a firing rate description the relative timing of presynaptic and postsynaptic spikes influences synaptic weights via an asymmetric learning window a differential equation for the learning dynamics is derived under the assumption that the time scales of learning and neuronal spike dynamics can be separated the differential equation is solved for a poissonian neuron model with stochastic spike arrival it is shown that correlations between input and output spikes tend to stabilize structure formation with an appropriate choice of parameters learning leads to an intrinsic normalization of the average weight and the output firing rate noise generates diffusion like spreading of synaptic weights s1063 651x 99 02804 4

local solvability for top degree forms in a class of systems of vector fields we study the local exactness at the top degree level in the differential complex defined by a smooth locally integrable structure of rank n in inline graphic xmlns xlink http www w3 org 1999 xlink xlink href 01i if z denotes a local first integral of the structure it is proved that the vanishing of the local cohomology in degree n is implied by the absence of compact connected components of the fibers z const this adds one more result towards the verification of a conjecture due to f treves regarding the vanishing of the local cohomology of such complexes of differential operators

stability switches and hopf bifurcations of an isolated population model with delay dependent parameters the dynamical behaviors of an isolated population model involving delay dependent parameters are investigated it is shown that the positive equilibrium switches from being stable to unstable and then back to stable as the delay increases and the hopf bifurcation occurs finite times between the two critical values of stability changes which can be analytically determined moreover the bifurcating periodic solutions are expressed analytically in an approximate form by the perturbation approach and floquet technique the direction and stability of the bifurcating periodic solutions are also determined finally the validity of the results is shown by the consistency with the numerical simulations

hebb type dynamics is sufficient to account for the inverse magnification rule in cortical somatotopy the inverse magnification rule in cortical somatotopy is the experimentally derived inverse relationship between cortical magnification area of somatotopic map representing a unit area of skin surface and receptive field size area of restricted skin surface driving a cortical neuron we show by computer simulation of a simple multilayer model that hebb type synaptic modification subject to competitive constraints is sufficient to account for the inverse magnification rule

simple modification of oja rule limits l1 norm of weight vector and leads to sparse connectivity this letter describes a simple modification of the oja learning rule which asymptotically constrains the l1 norm of an input weight vector instead of the l2 norm as in the original rule this constraining is local as opposed to commonly used instant normalizations which require the knowledge of all input weights of a neuron to update each one of them individually the proposed rule converges to a weight vector that is sparser has more zero weights than the vector learned by the original oja rule with or without the zero bound which could explain the developmental synaptic pruning

a property of the functions and distributions annihilated by a locally integrable system of complex vector fields page introduction 387 1 basic notation and ingredients 389 2 approximation and constancy on the fibers of the classical solutions of the homogeneous equations 393 3 first consequences and interpretation of the fundamental theorem 398 4 distribution solutions of the homogeneous equations 402 5 regularity of the solutions of the homogeneous equations 409 6 example of a system that is analytic hypo elliptic but not co hypo elliptic 413 references 420

axonal processes and neural plasticity a reply we examine the claim that a class of sprouting and retraction models is mathematically equivalent to a fixed anatomy model we accept subject to important caveats a narrow mathematical equivalence of the energy functions in both classes of model we argue that this narrow equivalence of energy functions does not however entail equivalence of the models indeed the claim of complete model equivalence hides significant dynamical differences between the approaches which we discuss we also disagree that our work demonstrates that subtractive constraint enforcement is natural in fixed anatomy models

reduced representation by neural networks with restricted receptive fields model neural networks can perform dimensional reductions of input data sets using correlation based learning rules to adjust their weights simple hebbian learning rules lead to an optimal reduction at the single unit level but result in highly redundant network representations more complex rules designed to reduce or remove this redundancy can develop optimal principal component representations but they are not very compelling from a biological perspective neurons in biological networks have restricted receptive fields limiting their access to the input data space we find that within this restricted receptive field architecture simple correlation based learning rules can produce surprisingly efficient reduced representations when noise is present the size of the receptive fields can be optimally tuned to maximize the accuracy of reconstructions of input data from a reduced representation

the role of weight normalization in competitive learning the effect of different kinds of weight normalization on the outcome of a simple competitive learning rule is analyzed it is shown that there are important differences in the representation formed depending on whether the constraint is enforced by dividing each weight by the same amount divisive enforcement or subtracting a fixed amount from each weight subtractive enforcement for the divisive cases weight vectors spread out over the space so as to evenly represent typical inputs whereas for the subtractive cases the weight vectors tend to the axes of the space so as to represent extreme inputs the consequences of these differences are examined

global solvability of real analytic involutive systems on compact manifolds the focus of this work is the smooth global solvability of a linear partial differential operator mathbb l associated to a real analytic closed non exact 1 form b defined on a real analytic closed n manifold that may be naturally regarded as the first operator of the complex induced by a locally integrable structure of tube type and co rank one we define an appropriate covering projection widetilde m rightarrow m such that the pullback of b has a primitive widetilde b and prove that the operator is globally solvable if and only if the superlevel and sublevel sets of widetilde b are connected as a byproduct we obtain a new geometric characterization for the global hypoellipticity of the operator when m is orientable we prove a connection between the global solvability of mathbb l and that of mathbb l n 1 which is the last non trivial operator of the complex in particular we prove that mathbb l is globally solvable if and only if mathbb l n 1 is globally solvable in the smooth category we are able to provide analogous geometric characterizations of the global solvability and the global hypoellipticity when b is a morse 1 form i e when the structure is of mizohata type

the role of constraints in hebbian learning models of unsupervised correlation based hebbian synaptic plasticity are typically unstable either all synapses grow until each reaches the maximum allowed strength or all synapses decay to zero strength a common method of avoiding these outcomes is to use a constraint that conserves or limits the total synaptic strength over a cell we study the dynamic effects of such constraints two methods of enforcing a constraint are distinguished multiplicative and subtractive for otherwise linear learning rules multiplicative enforcement of a constraint results in dynamics that converge to the principal eigenvector of the operator determining unconstrained synaptic development subtractive enforcement in contrast typically leads to a final state in which almost all synaptic strengths reach either the maximum or minimum allowed value this final state is often dominated by weight configurations other than the principal eigenvector of the unconstrained operator multiplicative enforcement yields a graded receptive field in which most mutually correlated inputs are represented whereas subtractive enforcement yields a receptive field that is sharpened to a subset of maximally correlated inputs if two equivalent input populations e g two eyes innervate a common target multiplicative enforcement prevents their segregation ocular dominance segregation when the two populations are weakly correlated whereas subtractive enforcement allows segregation under these circumstances these results may be used to understand constraints both over output cells and over input cells a variety of rules that can implement constrained dynamics are discussed

removing time variation with the anti hebbian differential synapse i describe a local synaptic learning rule that can be used to remove the effects of certain types of systematic temporal variation in the inputs to a unit according to this rule changes in synaptic weight result from a conjunction of short term temporal changes in the inputs and the output formally this is like the differential rule proposed by klopf 1986 and kosko 1986 except for a change of sign which gives it an anti hebbian character by itself this rule is insufficient a weight conservation condition is needed to prevent the weights from collapsing to zero and some further constraint implemented here by a biasing term to select particular sets of weights from the subspace of those which give minimal variation as an example i show that this rule will generate center surround receptive fields that remove temporally varying linear gradients from the inputs

constrained optimization for neural map formation a unifying framework for weight growth and normalization computational models of neural map formation can be considered on at least three different levels of abstraction detailed models including neural activity dynamics weight dynamics that abstract from the neural activity dynamics by an adiabatic approximation and constrained optimization from which equations governing weight dynamics can be derived constrained optimization uses an objective function from which a weight growth rule can be derived as a gradient flow and some constraints from which normalization rules are derived in this article we present an example of how an optimization problem can be derived from detailed nonlinear neural dynamics a systematic investigation reveals how different weight dynamics introduced previously can be derived from two types of objective function terms and two types of constraints this includes dynamic link matching as a special case of neural map formation we focus in particular on the role of coordinate transformations to derive different weight dynamics from the same optimization problem several examples illustrate how the constrained optimization framework can help in understanding generating and comparing different models of neural map formation the techniques used in this analysis may also be useful in investigating other types of neural dynamics