Pattern recognition: neural networks in perspective
Invariant pattern recognition will be a problem facing neural networks for some time, and the challenge is to overcome the limitation of Hamming distance generalization. Four representative architectures that are able to generalize are reviewed. The architectures are the backpropagation network, the ART architecture, the dynamic link architecture, and associate memories. Image representation, segmentation, and invariance are discussed.<<ETX>>

title: Intrinsic generalization analysis of low dimensional representations
abstract: Low dimensional representations of images impose equivalence relations in the image space; the induced equivalence class of an image is named as its intrinsic generalization. The intrinsic generalization of a representation provides a novel way to measure its generalization and leads to more fundamental insights than the commonly used recognition performance, which is heavily influenced by the choice of training and test data. We demonstrate the limitations of linear subspace representations by sampling their intrinsic generalization, and propose a nonlinear representation that overcomes these limitations. The proposed representation projects images nonlinearly into the marginal densities of their filter responses, followed by linear projections of the marginals. We use experiments on large datasets to show that the representations that have better intrinsic generalization also lead to better recognition performance.

title: On Connectedness: A Solution Based on Oscillatory Correlation
abstract: A long-standing problem in neural computation has been the problem of connectedness, first identified by Minsky and Papert (1969). This problem served as the cornerstone for them to establish analytically that perceptrons are fundamentally limited in computing geometrical (topological) properties. A solution to this problem is offered by a different class of neural networks: oscillator networks. To solve the problem, the representation of oscillatory correlation is employed, whereby one pattern is represented as a synchronized block of oscillators and different patterns are represented by distinct blocks that desynchronize from each other. Oscillatory correlation emerges from LEGION (locally excitatory globally inhibitory oscillator network), whose architecture consists of local excitation and global inhibition among neural oscillators. It is further shown that these oscillator networks exhibit sensitivity to topological structure, which may lay a neurocomputational foundation for explaining the psychophysical phenomenon of topological perception.

title: Image Segmentation Based on Oscillatory Correlation
abstract: We study image segmentation on the basis of locally excitatory, globally inhibitory oscillator networks (LEGION), whereby the phases of oscillators encode the binding of pixels. We introduce a lateral potential for each oscillator so that only oscillators with strong connections from their neighborhood can develop high potentials. Based on the concept of the lateral potential, a solution to remove noisy regions in an image is proposed for LEGION, so that it suppresses the oscillators corresponding to noisy regions but without affecting those corresponding to major regions. We show that the resulting oscillator network separates an image into several major regions, plus a background consisting of all noisy regions, and we illustrate network properties by computer simulation. The network exhibits a natural capacity in segmenting images. The oscillatory dynamics leads to a computer algorithm, which is applied successfully to segmenting real gray-level images. A number of issues regarding biological plausibility and perceptual organization are discussed. We argue that LEGION provides a novel and effective framework for image segmentation and figure-ground segregation.

title: Texture classification using spectral histograms
abstract: Based on a local spatial/frequency representation,we employ a spectral histogram as a feature statistic for texture classification. The spectral histogram consists of marginal distributions of responses of a bank of filters and encodes implicitly the local structure of images through the filtering stage and the global appearance through the histogram stage. The distance between two spectral histograms is measured using chi(2)-statistic. The spectral histogram with the associated distance measure exhibits several properties that are necessary for texture classification. A filter selection algorithm is proposed to maximize classification performance of a given dataset. Our classification experiments using natural texture images reveal that the spectral histogram representation provides a robust feature statistic for textures and generalizes well. Comparisons show that our method produces a marked improvement in classification performance. Finally we point out the relationships between existing texture features and the spectral histogram, suggesting that the latter may provide a unified texture feature.

title: A schema-based model for phonemic restoration
abstract: Phonemic restoration is the perceptual synthesis of phonemes when masked by appropriate replacement sounds by utilizing linguistic context. Current models attempting to accomplish acoustic restoration of phonemes, however, use only temporal continuity and produce poor restoration of unvoiced phonemes, and are also limited in their ability to restore voiced phonemes. We present a schema-based model for phonemic restoration. The model employs a missing data speech recognition system to decode speech based on intact portions and activates word templates corresponding to the words containing the masked phonemes. An activated template is dynamically time warped to the noisy word and is then used to restore the speech frames corresponding to the masked phoneme, thereby synthesizing it. The model is able to restore both voiced and unvoiced phonemes with a high degree of naturalness. Systematic testing shows that this model outperforms a Kalman-filter based model.

title: E-Coli Promoter Recognition Using Neural Networks with Feature Selection
abstract: This paper investigates the effects on neural classification performance of biological data by features selection. Where the Relief-F and Symmetrical Tau feature selection algorithms were employed on a set of high level features of DNA and structural profiles. It was observed that even with a small percentage of the features used in neural classifiers, the recognition rate of E.coli promoters was not degraded significantly.

title: Geometry Machines: From AI to SMC
abstract: The existing techniques and software tools for automated geometry theorem proving (GTP) are examined and reviewed. The underlying ideas of various approaches are explained with a set of selected examples. Comments and analyses are provided to illustrate the encouraging success of GTP which interrelates AI and SMC. We also present some technological applications of GTP and discuss its challenges ahead.

title: Enhancing the estimation of plant Jacobian for adaptive neural inverse control
abstract: To implement the specialized learning of the inverse dynamic neuro-controller for controlling nonlinear plants with noise, it is strongly desirable that an on-line trained neural plant emluator may provide a reasonably good estimation of the plant Jacobian under noise environments. This paper presents an approach for enhancing the estimation of the plant Jacobian which is on-line used in direct adaptive neural inverse control schemes. The estimated teaching signals are obtained by using the input–output data available at each time step, and then they are used to train the neural plant emluator by a new cost function introduced in this work for training the plant emluator. Convergence theorem for the adaptive back-propagation algorithm and stability of the closed-loop control system are established by using the Lyapunov theory. Simulations are conducted for demonstrating the effectiveness of the proposed strategy.

title: An Elimination Method for Polynomial Systems
abstract: We present an elimination method for polynomial systems, in the form of three main algorithms. For any given system P,Q] of two sets of multivariate polynomials, one of the algorithms computes a sequence of triangular forms T1,?,Te and polynomial sets U1,?,Ue such that Zero(P/Q) = ?ei=1 Zero(Ti/Ui), where Zero(P/Q) denotes the set of common zeros of the polynomials in P which are not zeros of any polynomial in Q, and similarly for Zero(Ti/Ui). The two other algorithms compute the same zero decomposition but with nicer properties such as Zero(Ti/Ui) ? &0slash; for each i. One of them, for which the computed triangular systems Ti, Ui] possess the projection property, provides a quantifier elimination procedure for algebraically closed fields. For the other, the computed triangular forms Ti are irreducible. The relationship between our method and some existing elimination methods is explained. Experimental data for a set of test examples by a draft implementation of the method are provided, and show that the efficiency of our method is comparable with that of some well-known methods. A few encouraging examples are given in detail for illustration.

title: Learning Semantic Concepts from Visual Data Using Neural Networks
abstract: For content-based image retrieval techniques, query image is used to pick up and rank some relevant images from a database using some certain similarity metric. If semantic features are not involved in the modeling of visual data, the resulting system may demonstrate a disability of retrieving images likely associated with interesting semantic concepts of objects in the images. Therefore, issues on semantics representation, automatic extraction of semantic concepts from visual data, and effects of window size on the concepts recogni- tion are needed to study. This paper describes an approach towards these prob- lems. We first define a set of semantic concepts characterizing the outdoor im- ages. Then, a neural network is employed to memory the semantic concepts through pattern learning techniques. Lastly, the well-trained neural networks will perform as a classifier to identify the predefined semantics within an image. Empirical studies and comparison with decision tree techniques are carried out.