Theoretical Foundation for Nonlinear Edge-Preserving Regularized Learning Image Restoration
Image restoration is an important issue in image processing, which helps recovering of degraded images caused by various factors in different circumstances. Neural networks models have been successfully applied in handling image restoration problems and some progress and promising results have been reported in the past. A popular neural networks model for image restoration is the Hopfield network due to its ability on dealing with optimization problems. A degraded image may have multiple corresponding solutions, i.e., the restored images, and the obtained solution can be sub-optimal which is related to a local minimum point in the weight space of the Hopfield network. This paper gives an algebraic characterization on images and shows that images with lower complexity can be restored uniquely from their degraded images and edge information. The obtained result in this paper establishes a mathematical basis for employing the mapping neural networks to realize a learning based image restoration scheme. The linear image restoration model is firstly generalized to a nonlinear one to broaden the scope of application. Secondly, we view the image restoration task as a set of approximation problems in a high dimensional space, and a mapping relationship between the degraded images with edge information and the source images is then built using feed-forward neural networks and the well trained neural network can be used to restore the degraded images in realtime. Computer simulations demonstrate the effectiveness of the learning image restoration techniques proposed in this paper.

title: A Hybird Image Retrieval System with User's Relevance Feedback Using Neurocomputing
abstract: This paper aims at developing a hybrid scheme for intelligent image retrieval using neural nets. Each item in an image database is indexed by a visual feature vector, which is extracted using color moments and discrete cosine transform coefficients. Query is characterized by a set of semantic labels, which are predefined by system designers and associated with domain concerns. The proposed hybrid image retrieval (HIR) system utilizes the image content features as the system input, and the semantic labels as its output. To compensate the deficiency of semantics modelling, an on-line user’s relevance feedback is applied to improve the retrieval performance of the HIR system. The neural net acts like a pattern association memory bank that maps the low-level feature vectors to their corresponding semantic labels. During the retrieval process, the weights of the neural net are updated by an interactive user’s relevance feedback technique, where the feedback signal comprise the neural net actual output, semantic labels provided by users and the given query. A prototype HIR system is implemented and evaluated using an artificial image database. Experimental results demonstrate that our proposed techniques are promising.

title: E-Coli Promoter Recognition Using Neural Networks with Feature Selection
abstract: This paper investigates the effects on neural classification performance of biological data by features selection. Where the Relief-F and Symmetrical Tau feature selection algorithms were employed on a set of high level features of DNA and structural profiles. It was observed that even with a small percentage of the features used in neural classifiers, the recognition rate of E.coli promoters was not degraded significantly.

title: Protein Sequences Classification Using Modular RBF Neural Networks
abstract: A protein super-family consists of proteins which share amino acid sequence homology and which may therefore be functionally and structurally related. One of the benefits from this category grouping is that some hint of function may be deduced for individual members from information on other members of the family. Traditionally, two protein sequences are classified into the same class if they have high homology in terms of feature patterns extracted through sequence alignment algorithms. These algorithms compare an unseen protein sequence with all the identified protein sequences and returned the higher scored protein sequences. As the sizes of the protein sequence databases are very large, it is a very time consuming job to perform exhaustive comparison of existing protein sequence. Therefore, there is a need to build an improved classification system for effectively identifying protein sequences. This paper presents a modular neural classifier for protein sequences with improved classification criteria. The intelligent classification techniques described in this paper aims to enhance the performance of single neural classifiers based on a centralized information structure in terms of recognition rate, generalization and reliability. The architecture of the proposed model is a modular RBF neural network with a compensational combination at the transition output layer. The connection weights between the final output layer and the transition output layer are optimized by delta rule, which serve as an integrator of the local neural classifiers. To enhance the classification reliability, we present two heuristic rules to apply to decision-making. Two sets of protein sequences with ten classes of superfamilies downloaded from a public domain database, Protein Information Resources (PIR), are used in our simulation study. Experimental results with performance comparisons are carried out between single neural classifiers and the proposed modular neural classifier.

title: Learning Based Neural Similarity Metrics for Multimedia Data Mining
abstract: Multimedia data mining refers to pattern discovery, rule extraction and knowledge acquisition from multimedia database. Two typical tasks in multimedia data mining are of visual data classification and clustering in terms of semantics. Usually performance of such classification or clustering systems may not be favorable due to the use of low-level features for image representation, and also some improper similarity metrics for measuring the closeness between multimedia objects as well. This paper considers a problem of modeling similarity for semantic image clustering. A collection of semantic images and feed-forward neural networks are used to approximate a characteristic function of equivalence classes, which is termed as a learning pseudo metric (LPM). Empirical criteria on evaluating the goodness of the LPM are established. A LPM based k-Mean rule is then employed for the semantic image clustering practice, where two impurity indices, classification performance and robustness are used for performance evaluation. An artificial image database with 11 semantics is employed for our simulation studies. Results demonstrate the merits and usefulness of our proposed techniques for multimedia data mining.

title: Wavelet transform-based frequency tuning ILC
abstract: A discrete wavelet transform-based cutoff frequency tuning method is proposed and experimental investigation is reported. In the method, discrete wavelet packet algorithm, as a time-frequency analysis tool, is employed to decompose the tracking error into different frequency regions so that the maximal error component can be identified at any time step. At each time step, the passband of the filter is from zero to the upper limit of frequency region where the maximal error component resides. Hence, the filter is a function of time as well as index of cycle. The experimental results show that this method can suppress higher frequency error components at proper time steps. While at the time steps where the major tracking error falls into lower frequency range, the cutoff frequency of the filter is set lower to reduce the influence of noises and uncertainties. This way, learning transient and long-term stability can be improved.

title: Nonlinear quantification scheduling in image computation
abstract: Computing the set of states reachable in one step from a given set of states, i.e. image computation, is a crucial step in several symbolic verification algorithms, including model checking and reachability analysis. So far, the best methods for quantification scheduling in image computation, with a conjunctively partitioned transition relation, have been restricted to a linear schedule. This results in a loss of flexibility during image computation. We view image computation as a problem of constructing an optimal parse tree for the image set. The optimality of a parse tree is defined by the largest BDD that is encountered during the computation of the tree. We present dynamic and static versions of a new algorithm, VarScore, which exploits the flexibility offered by the parse tree approach to the image computation. We show by extensive experimentation that our techniques outperform the best known techniques so far.

title: Primitive Auditory Segregation Based on Oscillatory Correlation
abstract: Auditory scene analysis is critical for complex auditory processing. We study ouditory segregation from the neurol network perspective, and develop o fromework for primitive ouditory scene analysis. The architecture is a laterally coupled two-dimensional network of relaxation oscillators with a global inhibitor. One dimension represents time and another one represents frequency. We show that this architecture, plus systematic delay lines, can in real time group auditory features into a stream by phase synchrony and segregate different streams by desynchronization. The network demonstrates a set of psychological phenomena regarding primitive auditory scene onalysis, including dependency on frequency proximity and the rate of presentation, sequential capturing, and competition among different perceptual organizations. We offer a neurocomputotional theory-shifting synchronization theory-for explaining how auditory segregation might be achieved in the brain, and the psychological phenomenon of streom segregation. Possible extensions of the model are discussed.

title: Synchrony and Desynchrony in Neural Oscillator Networks
abstract: An novel class of locally excitatory, globally inhibitory oscillator networks is proposed. The model of each oscillator corresponds to a standard relaxation oscillator with two time scales. The network exhibits a mechanism of selective gating, whereby an oscillator jumping up to its active phase rapidly recruits the oscillators stimulated by the same pattern, while preventing others from jumping up. We show analytically that with the selective gating mechanism the network rapidly achieves both synchronization within blocks of oscillators that are stimulated by connected regions and desynchronization between different blocks. Computer simulations demonstrate the network's promising ability for segmenting multiple input patterns in real time. This model lays a physical foundation for the oscillatory correlation theory of feature binding, and may provide an effective computational framework for scene segmentation and figure/ground segregation.

title: An Elimination Method for Polynomial Systems
abstract: We present an elimination method for polynomial systems, in the form of three main algorithms. For any given system P,Q] of two sets of multivariate polynomials, one of the algorithms computes a sequence of triangular forms T1,?,Te and polynomial sets U1,?,Ue such that Zero(P/Q) = ?ei=1 Zero(Ti/Ui), where Zero(P/Q) denotes the set of common zeros of the polynomials in P which are not zeros of any polynomial in Q, and similarly for Zero(Ti/Ui). The two other algorithms compute the same zero decomposition but with nicer properties such as Zero(Ti/Ui) ? &0slash; for each i. One of them, for which the computed triangular systems Ti, Ui] possess the projection property, provides a quantifier elimination procedure for algebraically closed fields. For the other, the computed triangular forms Ti are irreducible. The relationship between our method and some existing elimination methods is explained. Experimental data for a set of test examples by a draft implementation of the method are provided, and show that the efficiency of our method is comparable with that of some well-known methods. A few encouraging examples are given in detail for illustration.