pairwise sparsity preserving embedding for unsupervised subspace learning and classification two novel unsupervised dimensionality reduction techniques termed sparse distance preserving embedding sdpe and sparse proximity preserving embedding sppe are proposed for feature extraction and classification sdpe and sppe perform in the clean data space recovered by sparse representation and enhanced euclidean distances over noise removed data are employed to measure pairwise similarities of points in extracting informative features sdpe and sppe aim at preserving pairwise similarities between data points in addition to preserving the sparse characteristics this paper calculates the sparsest representation of all vectors jointly by a convex optimization the sparsest codes enable certain local information of data to be preserved and can endow sdpe and sppe a natural discriminating power adaptive neighborhood and robust characteristic against noise and errors in delivering low dimensional embeddings we also mathematically show sdpe and sppe can be effectively extended for discriminant learning in a supervised manner the validity of sdpe and sppe is examined by extensive simulations comparison with other related state of the art unsupervised algorithms show that promising results are delivered by our techniques

manifold constraint transfer for visual structure driven optimization abstract in this paper we leverage the manifold structure of visual data in order to improve performance in general optimization problems subject to linear constraints as the main theoretical result we show that manifold constraints can be transferred from the data to the optimized variables if these are linearly correlated we also show that the resulting optimization problem can be solved with an efficient alternating direction method of multipliers that can consistently integrate the manifold constraints during the optimization process this leads to a simplification of the approach which instead of directly optimizing on the manifold we can iteratively recast the problem as the projection over the manifold via an embedding method the proposed method is extremely versatile since it can be applied to different problems including kernel ridge regression krr and sparse coding which have numerous applications in machine learning and computer vision in particular we apply the methods to different problems such as tracking object recognition and categorization showing a consistent increase of performance with respect to the state of the art

a construction of a nonparametric quantum information manifold abstract we present a construction of a banach manifold structure on the set of faithful normal states of a von neumann algebra where the underlying banach space is a quantum analogue of an orlicz space on the manifold we introduce the exponential and mixture connections as dual pair of affine connections

eigenfaces vs fisherfaces recognition using class specific linear projection we develop a face recognition algorithm which is insensitive to large variation in lighting direction and facial expression taking a pattern classification approach we consider each pixel in an image as a coordinate in a high dimensional space we take advantage of the observation that the images of a particular face under varying illumination but fixed pose lie in a 3d linear subspace of the high dimensional image space if the face is a lambertian surface without shadowing however since faces are not truly lambertian surfaces and do indeed produce self shadowing images will deviate from this linear subspace rather than explicitly modeling this deviation we linearly project the image into a subspace in a manner which discounts those regions of the face with large deviation our projection method is based on fisher s linear discriminant and produces well separated classes in a low dimensional subspace even under severe variation in lighting and facial expressions the eigenface technique another method based on linearly projecting the image space to a low dimensional subspace has similar computational requirements yet extensive experimental results demonstrate that the proposed fisherface method has error rates that are lower than those of the eigenface technique for tests on the harvard and yale face databases

discriminative sparsity preserving projections for image recognition previous works have demonstrated that image classification performance can be significantly improved by manifold learning however performance of manifold learning heavily depends on the manual selection of parameters resulting in bad adaptability in real world applications in this paper we propose a new dimensionality reduction method called discriminative sparsity preserving projections dspp different from the existing sparse subspace algorithms which manually construct a penalty adjacency graph dspp employs sparse representation model to adaptively build both intrinsic adjacency graph and penalty graph with weight matrix and then integrates global within class structure into the discriminant manifold learning objective function for dimensionality reduction extensive experimental results on four image databases demonstrate the effectiveness of the proposed approach we analyzed the vertex points of penalty graph using sparse representation we adaptively constructed both penalty adjacency graph and intrinsic graph our method simultaneously considered the global and local geometric structure of data

simultaneous structure and texture image inpainting an algorithm for the simultaneous filling in of texture and structure in regions of missing image information is presented in this paper the basic idea is to first decompose the image into the sum of two functions with different basic characteristics and then reconstruct each one of these functions separately with structure and texture filling in algorithms the first function used in the decomposition is of bounded variation representing the underlying image structure while the second function captures the texture and possible noise the region of missing information in the bounded variation image is reconstructed using image inpainting algorithms while the same region in the texture image is filled in with texture synthesis techniques the original image is then reconstructed adding back these two sub images the novel contribution of this paper is then in the combination of these three previously developed components image decomposition with inpainting and texture synthesis which permits the simultaneous use of filling in algorithms that are suited for different image characteristics examples on real images show the advantages of this proposed approach

regularized coplanar discriminant analysis for dimensionality reduction abstract the dimensionality reduction methods based on linear embedding such as neighborhood preserving embedding npe sparsity preserving projections spp and collaborative representation based projections crp try to preserve a certain kind of linear representation for each sample after projection however in the transformed low dimensional space the linear relationship between the samples may be changed which cannot make the linear representation based classifiers such as sparse representation based classifier src to achieve higher recognition accuracy in this paper we propose a new linear dimensionality reduction algorithm called regularized coplanar discriminant analysis rcda to address this problem it simultaneously seeks a linear projection matrix and some linear representation coefficients that make the samples from the same class coplanar and the samples from different classes not coplanar the proposed regularization term balances the bias from the optimal linear representation and that from the class mean to avoid overfitting the training data and overcomes the matrix singularity in solving the linear representation coefficients an alternative optimization approach is proposed to solve the rcda model experiments are done on several benchmark face databases and hyperspectral image databases and results show that rcda can obtain better performance than other dimensionality reduction methods

kernelized multiview projection for robust action recognition conventional action recognition algorithms adopt a single type of feature or a simple concatenation of multiple features in this paper we propose to better fuse and embed different feature representations for action recognition using a novel spectral coding algorithm called kernelized multiview projection kmp computing the kernel matrices from different features views via time sequential distance learning kmp can encode different features with different weights to achieve a low dimensional and semantically meaningful subspace where the distribution of each view is sufficiently smooth and discriminative more crucially kmp is linear for the reproducing kernel hilbert space which allows it to be competent for various practical applications we demonstrate kmp s performance for action recognition on five popular action datasets and the results are consistently superior to state of the art techniques

random subspace based ensemble sparse representation a new random subspace based joint sparse representation model is proposed the sparse representations in multiple subspaces are integrated into an ensemble sparse representation the spectral clustering algorithm with random subspace based ensemble sparse representation is shown the semi supervised classification method with random subspace based ensemble sparse representation is described in this paper a new random subspace based ensemble sparse representation rs esr algorithm is proposed where the random subspace is introduced into sparse representation model for high dimensional data the random subspace method can not only reduce dimension of data but also make full use of effective information of data it is not like traditional dimensionality reduction methods that may lose some information of original data additionally a joint sparse representation model is emloyed to obtain the sparse representation of a sample set in the low dimensional random subspace then the sparse representations in multiple random subspaces are integrated as an ensemble sparse representation moreover the obtained rs esr is applied in classical clustering and semi supervised classification the experimental results on different real world data sets show the superiority of rs esr over traditional methods

low rank matrix factorization with adaptive graph regularizer in this paper we present a novel low rank matrix factorization algorithm with adaptive graph regularizer lmfagr we extend the recently proposed low rank matrix with manifold regularization mmf method with an adaptive regularizer different from mmf which constructs an affinity graph in advance lmfagr can simultaneously seek graph weight matrix and low dimensional representations of data that is graph construction and low rank matrix factorization are incorporated into a unified framework which results in an automatically updated graph rather than a predefined one the experimental results on some data sets demonstrate that the proposed algorithm outperforms the state of the art low rank matrix factorization methods

robust and low rank representation for fast face identification with occlusions in this paper we propose an iterative method to address the face identification problem with block occlusions our approach utilizes a robust representation based on two characteristics in order to model contiguous errors e g block occlusion effectively the first fits to the errors a distribution described by a tailored loss function the second describes the error image as having a specific structure resulting in low rank in comparison with image size we will show that this joint characterization is effective for describing errors with spatial continuity our approach is computationally efficient due to the utilization of the alternating direction method of multipliers a special case of our fast iterative algorithm leads to the robust representation method which is normally used to handle non contiguous errors e g pixel corruption extensive results on representative face databases in constrained and unconstrained environments document the effectiveness of our method over existing robust representation methods with respect to both identification rates and computational time

local rademacher complexity for multi label learning we analyze the local rademacher complexity of empirical risk minimization based multi label learning algorithms and in doing so propose a new algorithm for multi label learning rather than using the trace norm to regularize the multi label predictor we instead minimize the tail sum of the singular values of the predictor in multi label learning benefiting from the use of the local rademacher complexity our algorithm therefore has a sharper generalization error bound compared with methods that minimize over all singular values concentrating on the tail singular values results in better recovery of the low rank structure of the multi label predictor which plays an important role in exploiting label correlations we propose a new conditional singular value thresholding algorithm to solve the resulting objective function moreover a variance control strategy is employed to reduce the variance of variables in optimization empirical studies on real world data sets validate our theoretical results and demonstrate the effectiveness of the proposed algorithm for multi label learning

robust nonnegative patch alignment for dimensionality reduction dimensionality reduction is an important method to analyze high dimensional data and has many applications in pattern recognition and computer vision in this paper we propose a robust nonnegative patch alignment for dimensionality reduction which includes a reconstruction error term and a whole alignment term we use correntropy induced metric to measure the reconstruction error in which the weight is learned adaptively for each entry for the whole alignment we propose locality preserving robust nonnegative patch alignment lp rna and sparsity preserviing robust nonnegative patch alignment sp rna which are unsupervised and supervised respectively in the lp rna we propose a locally sparse graph to encode the local geometric structure of the manifold embedded in high dimensional space in particular we select large p nearest neighbors for each sample then obtain the sparse representation with respect to these neighbors the sparse representation is used to build a graph which simultaneously enjoys locality sparseness and robustness in the sp rna we simultaneously use local geometric structure and discriminative information in which the sparse reconstruction coefficient is used to characterize the local geometric structure and weighted distance is used to measure the separability of different classes for the induced nonconvex objective function we formulate it into a weighted nonnegative matrix factorization based on half quadratic optimization we propose a multiplicative update rule to solve this function and show that the objective function converges to a local optimum several experimental results on synthetic and real data sets demonstrate that the learned representation is more discriminative and robust than most existing dimensionality reduction methods

normalized cuts and image segmentation we propose a novel approach for solving the perceptual grouping problem in vision rather than focusing on local features and their consistencies in the image data our approach aims at extracting the global impression of an image we treat image segmentation as a graph partitioning problem and propose a novel global criterion the normalized cut for segmenting the graph the normalized cut criterion measures both the total dissimilarity between the different groups as well as the total similarity within the groups we show that an efficient computational technique based on a generalized eigenvalue problem can be used to optimize this criterion we applied this approach to segmenting static images as well as motion sequences and found the results to be very encouraging

a fast optimization transfer algorithm for image inpainting in wavelet domains a wavelet inpainting problem refers to the problem of filling in missing wavelet coefficients in an image a variational approach was used by chan et al the resulting functional was minimized by the gradient descent method in this paper we use an optimization transfer technique which involves replacing their univariate functional by a bivariate functional by adding an auxiliary variable our bivariate functional can be minimized easily by alternating minimization for the auxiliary variable the minimum has a closed form solution and for the original variable the minimization problem can be formulated as a classical total variation tv denoising problem and hence can be solved efficiently using a dual formulation we show that our bivariate functional is equivalent to the original univariate functional we also show that our alternating minimization is convergent numerical results show that the proposed algorithm is very efficient and outperforms that of chan et al

deblurring saturated night image with function form kernel deblurring saturated night images are a challenging problem because such images have low contrast combined with heavy noise and saturated regions unlike the deblurring schemes that discard saturated regions when estimating blur kernels this paper proposes a novel scheme to deduce blur kernels from saturated regions via a novel kernel representation and advanced algorithms our key technical contribution is the proposed function form representation of blur kernels which regularizes existing matrix form kernels using three functional components 1 trajectory 2 intensity and 3 expansion from automatically detected saturated regions their skeleton brightness and width are fitted into the corresponding three functional components of blur kernels such regularization significantly improves the quality of kernels deduced from saturated regions second we propose an energy minimizing algorithm to select and assign the deduced function form kernels to partitioned image regions as the initialization for non uniform deblurring finally we convert the assigned function form kernels into matrix form for more detailed estimation in a multi scale deconvolution experimental results show that our scheme outperforms existing schemes on challenging real examples

learning a nonnegative sparse graph for linear regression previous graph based semisupervised learning g ssl methods have the following drawbacks 1 they usually predefine the graph structure and then use it to perform label prediction which cannot guarantee an overall optimum and 2 they only focus on the label prediction or the graph structure construction but are not competent in handling new samples to this end a novel nonnegative sparse graph nnsg learning method was first proposed then both the label prediction and projection learning were integrated into linear regression finally the linear regression and graph structure learning were unified within the same framework to overcome these two drawbacks therefore a novel method named learning a nnsg for linear regression was presented in which the linear regression and graph learning were simultaneously performed to guarantee an overall optimum in the learning process the label information can be accurately propagated via the graph structure so that the linear regression can learn a discriminative projection to better fit sample labels and accurately classify new samples an effective algorithm was designed to solve the corresponding optimization problem with fast convergence furthermore nnsg provides a unified perceptiveness for a number of graph based learning methods and linear regression methods the experimental results showed that nnsg can obtain very high classification accuracy and greatly outperforms conventional g ssl methods especially some conventional graph construction methods

supervised neighborhood graph construction for semi supervised classification graph based methods are among the most active and applicable approaches studied in semi supervised learning the problem of neighborhood graph construction for these methods is addressed in this paper neighborhood graph construction plays a key role in the quality of the classification in graph based methods several unsupervised graph construction methods have been proposed that have addressed issues such as data noise geometrical properties of the underlying manifold and graph hyper parameters selection in contrast in order to adapt the graph construction to the given classification task many of the recent graph construction methods take advantage of the data labels however these methods are not efficient since the hypothesis space of their possible neighborhood graphs is limited in this paper we first prove that the optimal neighborhood graph is a subgraph of a k nn graph for a large enough k which is much smaller than the total number of data points therefore we propose to use all the subgraphs of k nns graph as the hypothesis space in addition we show that most of the previous supervised graph construction methods are implicitly optimizing the smoothness functional with respect to the neighborhood graph parameters finally we provide an algorithm to optimize the smoothness functional with respect to the neighborhood graph in the proposed hypothesis space experimental results on various data sets show that the proposed graph construction algorithm mostly outperforms the popular k nn based construction and other state of the art methods

realistic action recognition via sparsely constructed gaussian processes realistic action recognition has been one of the most challenging research topics in computer vision the existing methods are commonly based on non probabilistic classification predicting category labels but not providing an estimation of uncertainty in this paper we propose a probabilistic framework using gaussian processes gps which can tackle regression problems with explicit uncertain models for action recognition a major challenge for gps when applied to large scale realistic data is that a large covariance matrix needs to be inverted during inference additionally from the manifold perspective the intrinsic structure of the data space is only constrained by a local neighborhood and data relationships with far distance usually can be ignored thus we design our gps covariance matrix via the proposed l1 construction and a local approximation la covariance weight updating method which are demonstrated to be robust to data noise automatically sparse and adaptive to the neighborhood extensive experiments on four realistic datasets i e ucf youtube ucf sports hollywood2 and hmdb51 show the competitive results of l1 gps compared with state of the art methods on action recognition tasks

subspace learning by l0 induced sparsity subspace clustering methods partition the data that lie in or close to a union of subspaces in accordance with the subspace structure such methods with sparsity prior such as sparse subspace clustering ssc elhamifar and vidal in ieee trans pattern anal mach intell 35 11 2765 2781 2013 with the sparsity induced by the ell 1 norm are demonstrated to be effective in subspace clustering most of those methods require certain assumptions e g independence or disjointness on the subspaces however these assumptions are not guaranteed to hold in practice and they limit the application of existing sparse subspace clustering methods in this paper we propose ell 0 induced sparse subspace clustering ell 0 ssc in contrast to the required assumptions such as independence or disjointness on subspaces for most existing sparse subspace clustering methods we prove that ell 0 ssc guarantees the subspace sparse representation a key element in subspace clustering for arbitrary distinct underlying subspaces almost surely under the mild i i d assumption on the data generation we also present the no free lunch theorem which shows that obtaining the subspace representation under our general assumptions can not be much computationally cheaper than solving the corresponding ell 0 sparse representation problem of ell 0 ssc a novel approximate algorithm named approximate ell 0 ssc a ell 0 ssc is developed which employs proximal gradient descent to obtain a sub optimal solution to the optimization problem of ell 0 ssc with theoretical guarantee the sub optimal solution is used to build a sparse similarity matrix upon which spectral clustering is performed for the final clustering results extensive experimental results on various data sets demonstrate the superiority of a ell 0 ssc compared to other competing clustering methods furthermore we extend ell 0 ssc to semi supervised learning by performing label propagation on the sparse similarity matrix learnt by a ell 0 ssc and demonstrate the effectiveness of the resultant semi supervised learning method termed ell 0 sparse subspace label propagation ell 0 sslp

deformed exponentials and logarithms in generalized thermostatistics abstract criteria are given that deformed logarithmic and exponential functions should satisfy with a pair of such functions one can associate another function called the deduced logarithmic function it is shown that generalized thermostatistics can be formulated in terms of deformed exponential functions together with the associated deduced logarithmic functions

image inpainting by patch propagation using patch sparsity this paper introduces a novel examplar based inpainting algorithm through investigating the sparsity of natural image patches two novel concepts of sparsity at the patch level are proposed for modeling the patch priority and patch representation which are two crucial steps for patch propagation in the examplar based inpainting approach first patch structure sparsity is designed to measure the confidence of a patch located at the image structure e g the edge or corner by the sparseness of its nonzero similarities to the neighboring patches the patch with larger structure sparsity will be assigned higher priority for further inpainting second it is assumed that the patch to be filled can be represented by the sparse linear combination of candidate patches under the local patch consistency constraint in a framework of sparse representation compared with the traditional examplar based inpainting approach structure sparsity enables better discrimination of structure and texture and the patch sparse representation forces the newly inpainted regions to be sharp and consistent with the surrounding textures experiments on synthetic and natural images show the advantages of the proposed approach

label information guided graph construction for semi supervised learning in the literature most existing graph based semi supervised learning methods only use the label information of observed samples in the label propagation stage while ignoring such valuable information when learning the graph in this paper we argue that it is beneficial to consider the label information in the graph learning stage specifically by enforcing the weight of edges between labeled samples of different classes to be zero we explicitly incorporate the label information into the state of the art graph learning methods such as the low rank representation lrr and propose a novel semi supervised graph learning method called semi supervised low rank representation this results in a convex optimization problem with linear constraints which can be solved by the linearized alternating direction method though we take lrr as an example our proposed method is in fact very general and can be applied to any self representation graph learning methods experiment results on both synthetic and real data sets demonstrate that the proposed graph learning method can better capture the global geometric structure of the data and therefore is more effective for semi supervised learning tasks

graph embedding and extensions a general framework for dimensionality reduction a large family of algorithms supervised or unsupervised stemming from statistics or geometry theory has been designed to provide different solutions to the problem of dimensionality reduction despite the different motivations of these algorithms we present in this paper a general formulation known as graph embedding to unify them within a common framework in graph embedding each algorithm can be considered as the direct graph embedding or its linear kernel tensor extension of a specific intrinsic graph that describes certain desired statistical or geometric properties of a data set with constraints from scale normalization or a penalty graph that characterizes a statistical or geometric property that should be avoided furthermore the graph embedding framework can be used as a general platform for developing new dimensionality reduction algorithms by utilizing this framework as a tool we propose a new supervised dimensionality reduction algorithm called marginal fisher analysis in which the intrinsic graph characterizes the intraclass compactness and connects each data point with its neighboring points of the same class while the penalty graph connects the marginal points and characterizes the interclass separability we show that mfa effectively overcomes the limitations of the traditional linear discriminant analysis algorithm due to data distribution assumptions and available projection directions real face recognition experiments show the superiority of our proposed mfa in comparison to lda also for corresponding kernel and tensor extensions

adaptive maximum margin analysis for image recognition abstract most existing discriminant manifold learning methods aim to maximize the margin among nearby data which is determined in the high dimensional original space as such they do not necessarily best maximize the margin between different classes in the low dimensional space which is a critically important property for image classification to handle this problem we propose an adaptive maximum margin analysis amma for feature extraction amma aims to seek a projection matrix that best maximize the margin which is calculated in the low dimensional space it uses sparse representation to adaptively construct the intrinsic and penalty graphs finally an iterative algorithm is developed to solve the projection matrix extensive experimental results on several image databases illustrate the effectiveness of the proposed approach

derf distinctive efficient robust features from the biological modeling of the p ganglion cells studies in neuroscience and biological vision have shown that the human retina has strong computational power and its information representation supports vision tasks on both ventral and dorsal pathways in this paper a new local image descriptor termed distinctive efficient robust features derf is derived by modeling the response and distribution properties of the parvocellular projecting ganglion cells in the primate retina derf features exponential scale distribution exponential grid structure and circularly symmetric function difference of gaussian dog used as a convolution kernel all of which are consistent with the characteristics of the ganglion cell array found in neurophysiology anatomy and biophysics in addition a new explanation for local descriptor design is presented from the perspective of wavelet tight frames dog is naturally a wavelet and the structure of the grid points array in our descriptor is closely related to the spatial sampling of wavelets the dog wavelet itself forms a frame and when we modulate the parameters of our descriptor to make the frame tighter the performance of the derf descriptor improves accordingly this is verified by designing a tight frame dog which leads to much better performance extensive experiments conducted in the image matching task on the multiview stereo correspondence data set demonstrate that derf outperforms state of the art methods for both hand crafted and learned descriptors while remaining robust and being much faster to compute

adaptive graph construction using data self representativeness for pattern classification graph construction from data constitutes a pre stage in many machine learning and computer vision tasks like semi supervised learning manifold learning and spectral clustering the influence of graph construction procedures on learning tasks and their related applications has only received limited study despite its critical impact on accuracy state of the art graphs are built via sparse coding adopting 1 regularization those graphs exhibit good performance in many computer vision applications however the locality and similarity among instances are not explicitly used in the coding scheme furthermore due to the use of 1 regularization these construction approaches can be computationally expensive in this paper we investigate graph construction using the data self representativeness property by incorporating a variant of locality constrained linear coding llc we introduce and derive four variants for graph construction these variants adopt a two phase llc tpllc compared with the recent 1 graphs our proposed objective function associated with three variants has an analytical solution and thus is more efficient a key element of the proposed methods is the second phase of coding that allows data closeness or locality to be naturally incorporated it performs a coding over some selected relevant samples and reinforces the individual regularization terms by exploiting the coefficients estimated in the first phase comprehensive experimental results using several benchmark datasets show that it can achieve or outperform existing state of the art results furthermore it is shown to be more efficient than the robust 1 graph construction schemes

lagrangian relaxation graph matching abstract graph matching is a fundamental problem in computer vision area graph matching problem that incorporates pair wise constraints can be formulated as an integer quadratic programming iqp problem with affine mapping constraint since it is known to be np hard approximate relaxation methods are usually required to find approximate solutions in this paper we present a new effective graph matching relaxation method called lagrangian relaxation graph matching lrgm which aims to generate a relaxation model by incorporating the affine mapping constraint into the matching objective optimization there are three main benefits of the proposed lrgm method 1 the nonnegative affine mapping constraint encoding one to one mapping is naturally incorporated in lrgm relaxation via lagrangian regularization 2 by further adding a l 1 norm constraint lrgm can generate a sparse solution empirically and thus returns a desired discrete solution for original iqp matching problem 3 an effective update algorithm is derived to solve the proposed lrgm model theoretically the converged solution can be proven to be karush kuhn tucker kkt optimal experimental results on both synthetic data and real world image datasets show the effectiveness and benefits of the proposed lrgm method

view invariant analysis of cyclic motion this paper presents a general framework for image based analysis of 3d repeating motions that addresses two limitations in the state of the art first the assumption that a motion be perfectly even from one cycle to the next is relaxed real repeating motions tend not to be perfectly even i e the length of a cycle varies through time because of physically important changes in the scene a generalization of period is defined for repeating motions that makes this temporal variation explicit this representation called the period trace is compact and purely temporal describing the evolution of an object or scene without reference to spatial quantities such as position or velocity second the requirement that the observer be stationary is removed observer motion complicates image analysis because an object that undergoes a 3d repeating motion will generally not produce a repeating sequence of images using principles of affine invariance we derive necessary and sufficient conditions for an image sequence to be the projection of a 3d repeating motion accounting for changes in viewpoint and other camera parameters unlike previous work in visual invariance however our approach is applicable to objects and scenes whose motion is highly non rigid experiments on real image sequences demonstrate how the approach may be used to detect several types of purely temporal motion features relating to motion trends and irregularities applications to athletic and medical motion analysis are discussed

subspace clustering using a low rank constrained autoencoder the performance of subspace clustering is affected by data representation data representation for subspace clustering maps data from the original space into another space with the property of better separability many data representation methods have been developed in recent years typical among them are low rank representation lrr and an autoencoder lrr is a linear representation method that captures the global structure of data with low rank constraint alternatively an autoencoder nonlinearly maps data into a latent space using a neural network by minimizing the difference between the reconstruction and input to combine the advantages of an lrr globality and autoencoder self supervision based locality we propose a novel data representation method for subspace clustering the proposed method called low rank constrained autoencoder lrae forces the latent representation of the neural network to be of low rank and the low rank constraint is computed as a prior from the input space one major advantage of the lrae is that the learned data representation not only maintains the local features of the data but also preserves the underlying low rank global structure extensive experiments on several datasets for subspace clustering were conducted they demonstrated that the proposed lrae substantially outperformed state of the art subspace clustering methods

harmonic radius and concentration of energy hyperbolic radius and liouville s equations d u e u and d u u n 2 n 2 the conformal radius of a simply connected planar domain omega is defined as r x 1 f x where f denotes a riemann map from omega to the unit disk mapping the given point x to the origin beyond geometric function theory the conformal radius has various applications in partial differential equations therefore it is desirable to extend it to multiply connected and higher dimensional domains we discuss two natural extensions 1 the harmonic radius is defined in terms of the green s function its maximum points the harmonic centers play an important role in variational problems involving concentration of energy they are of the following form sup left int limits omega f u u in h 0 1 omega int omega nabla u 2 leqslant varepsilon 2 right as varepsilon to 0 the solutions concentrate at a harmonic center our examples include bernoulli s free boundary problem the plasma problem and the elastic membrane with a movable obstacle an efficient method

noise robust semi supervised learning via fast sparse coding this paper presents a novel noise robust graph based semi supervised learning algorithm to deal with the challenging problem of semi supervised learning with noisy initial labels inspired by the successful use of sparse coding for noise reduction we choose to give new l1 norm formulation of laplacian regularization for graph based semi supervised learning since our l1 norm laplacian regularization is explicitly defined over the eigenvectors of the normalized laplacian matrix we formulate graph based semi supervised learning as an l1 norm linear reconstruction problem which can be efficiently solved by sparse coding furthermore by working with only a small subset of eigenvectors we develop a fast sparse coding algorithm for our l1 norm semi supervised learning finally we evaluate the proposed algorithm in noise robust image classification the experimental results on several benchmark datasets demonstrate the promising performance of the proposed algorithm highlightswe propose novel semi supervised learning based on fast sparse coding our algorithm achieves promising results in noise robust image classification our algorithm can readily be extended to many other challenging problems

prime discriminant simplicial complex the structure representation of data distribution plays an important role in understanding the underlying mechanism of generating data in this paper we propose the prime discriminant simplicial complex pdsc by utilizing persistent homology to capture such structures assuming that each class is represented with a prime simplicial complex we classify unlabeled samples based on the nearest projection distances from the samples to the simplicial complexes we also extend the extrapolation ability of these complexes with a projection constraint term experiments in simulated and practical datasets indicate that compared with several published algorithms the proposed pdsc approaches achieve promising performance without losing structure representation

multi view intact space learning it is practical to assume that an individual view is unlikely to be sufficient for effective multi view learning therefore integration of multi view information is both valuable and necessary in this paper we propose the multi view intact space learning misl algorithm which integrates the encoded complementary information in multiple views to discover a latent intact representation of the data even though each view on its own is insufficient we show theoretically that by combing multiple views we can obtain abundant information for latent intact space learning employing the cauchy loss a technique used in statistical learning as the error measurement strengthens robustness to outliers we propose a new definition of multi view stability and then derive the generalization error bound based on multi view stability and rademacher complexity and show that the complementarity between multiple views is beneficial for the stability and generalization misl is efficiently optimized using a novel iteratively reweight residuals irr technique whose convergence is theoretically analyzed experiments on synthetic data and real world datasets demonstrate that misl is an effective and promising algorithm for practical applications

learning with ell 1 graph for image analysis the graph construction procedure essentially determines the potentials of those graph oriented learning algorithms for image analysis in this paper we propose a process to build the so called directed 1 graph in which the vertices involve all the samples and the ingoing edge weights to each vertex describe its 1 norm driven reconstruction from the remaining samples and the noise then a series of new algorithms for various machine learning tasks e g data clustering subspace learning and semi supervised learning are derived upon the 1 graphs compared with the conventional k nearest neighbor graph and ball graph the 1 graph possesses the advantages 1 greater robustness to data noise 2 automatic sparsity and 3 adaptive neighborhood for individual datum extensive experiments on three real world datasets show the consistent superiority of 1 graph over those classic graphs in data clustering subspace learning and semi supervised learning tasks

possible generalization of boltzmann gibbs statistics with the use of a quantity normally scaled in multifractals a generalized form is postulated for entropy namelys q k 1 i 1 w p i q q 1 whereq characterizes the generalization andp i are the probabilities associated withw microscopic configurations w the main properties associated with this entropy are established particularly those corresponding to the microcanonical and canonical ensembles the boltzmann gibbs statistics is recovered as theq 1 limit

convex sparse spectral clustering single view to multi view spectral clustering sc is one of the most widely used methods for data clustering it first finds a low dimensional embedding u of data by computing the eigenvectors of the normalized laplacian matrix and then performs k means on text u top to get the final clustering result in this paper we observe that in the ideal case text u text u top should be block diagonal and thus sparse therefore we propose the sparse sc ssc method that extends the sc with sparse regularization on text u text u top to address the computational issue of the nonconvex ssc model we propose a novel convex relaxation of ssc based on the convex hull of the fixed rank projection matrices then the convex ssc model can be efficiently solved by the alternating direction method of multipliers furthermore we propose the pairwise ssc that extends ssc to boost the clustering performance by using the multi view information of data experimental comparisons with several baselines on real world datasets testify to the efficacy of our proposed methods

mtc a fast and robust graph based transductive learning method despite the great success of graph based transductive learning methods most of them have serious problems in scalability and robustness in this paper we propose an efficient and robust graph based transductive classification method called minimum tree cut mtc which is suitable for large scale data motivated from the sparse representation of graph we approximate a graph by a spanning tree exploiting the simple structure we develop a linear time algorithm to label the tree such that the cut size of the tree is minimized this significantly improves graph based methods which typically have a polynomial time complexity moreover we theoretically and empirically show that the performance of mtc is robust to the graph construction overcoming another big problem of traditional graph based methods extensive experiments on public data sets and applications on web spam detection and interactive image segmentation demonstrate our method s advantages in aspect of accuracy speed and robustness

an infinite dimensional geometric structure on the space of all the probability measures equivalent to a given one let m be the set of all probability densities equivalent to a given reference probability measure this set is thought of as the maximal regular i e with strictly positive densities dominated statistical model for each f m we define 1 a banach space l f with unit ball v f and 2 a mapping s f from a subset u f of m onto v f in such a way that the system s f u f f m is an affine atlas on m moreover each parametric exponential model dominated by is a finite dimensional affine submanifold and each parametric statistical model dominated by with a suitable regularity is a submanifold the global geometric framework given by the manifold structure adds some insight to the so called geometric theory of statistical models in particular the present paper gives some of the developments connected with the fisher information metrics rao and the hilbert bundle introduced by amari

latent semantic learning with structured sparse representation for human action recognition this paper proposes a novel latent semantic learning method for extracting high level latent semantics from a large vocabulary of abundant mid level features i e visual keywords with structured sparse representation which can help to bridge the semantic gap in the challenging task of human action recognition to discover the manifold structure of mid level features we develop a graph based spectral embedding approach to latent semantic learning with the graph over mid level features being constructed using sparse representation moreover we define new l 1 norm hypergraph regularization to induce extra structured sparsity into sparse representation for graph construction due to the nice properties sparsity and noise robustness of such structured sparse representation our graph construction can capture dominant and robust relationships among mid level features which are crucial for the success of latent semantic learning in action recognition unlike the traditional latent semantic analysis based on topic models our latent semantic learning method can explore the manifold structure of mid level features in both graph construction and spectral embedding which results in compact but discriminative high level features the experimental results on the commonly used kth action dataset and unconstrained youtube action dataset show the promising performance of our method

fundamental properties of tsallis relative entropy fundamental properties for the tsallis relative entropy in both classical and quantum systems are studied as one of our main results we give the parametric extension of the trace inequality between the quantum relative entropy and the minus of the trace of the relative operator entropy given by hiai and petz the monotonicity of the quantum tsallis relative entropy for the trace preserving completely positive linear map is also shown without the assumption that the density operators are invertible the generalized tsallis relative entropy is defined and its subadditivity is shown by its joint convexity moreover the generalized peierls bogoliubov inequality is also proven

laplacian regularized low rank representation and its applications low rank representation lrr has recently attracted a great deal of attention due to its pleasing efficacy in exploring low dimensional subspace structures embedded in data for a given set of observed data corrupted with sparse errors lrr aims at learning a lowest rank representation of all data jointly lrr has broad applications in pattern recognition computer vision and signal processing in the real world data often reside on low dimensional manifolds embedded in a high dimensional ambient space however the lrr method does not take into account the non linear geometric structures within data thus the locality and similarity information among data may be missing in the learning process to improve lrr in this regard we propose a general laplacian regularized low rank representation framework for data representation where a hypergraph laplacian regularizer can be readily introduced into i e a non negative sparse hyper laplacian regularized lrr model nshlrr by taking advantage of the graph regularizer our proposed method not only can represent the global low dimensional structures but also capture the intrinsic non linear geometric information in data the extensive experimental results on image clustering semi supervised image classification and dimensionality reduction tasks demonstrate the effectiveness of the proposed method

on alternative q weibull and q extreme value distributions properties and applications abstract tsallis statistics and tsallis distributions have been attracting a significant amount of research work in recent years importantly the tsallis statistics q distributions have been applied in different disciplines yet a relationship between some existing q weibull distributions and q extreme value distributions that is parallel to the well established relationship between the conventional weibull and extreme value distributions through a logarithmic transformation has not be established in this paper we proposed an alternative q weibull distribution that leads to a q extreme value distribution via the q logarithm transformation some important properties of the proposed q weibull and q extreme value distributions are studied maximum likelihood and least squares estimation methods are used to estimate the parameters of q weibull distribution and their performances are investigated through a monte carlo simulation study the methodologies and the usefulness of the proposed distributions are illustrated by fitting the 2014 traffic fatalities data from the national highway traffic safety administration

a collaborative representation based projections method for feature extraction in graph embedding based methods we usually need to manually choose the nearest neighbors and then compute the edge weights using the nearest neighbors via l2 norm e g lle it is difficult and unstable to manually choose the nearest neighbors in high dimensional space so how to automatically construct a graph is very important in this paper first we give a l2 graph like l1 graph l2 graph calculates the edge weights using the total samples avoiding manually choosing the nearest neighbors second a l2 graph based feature extraction method is presented called collaborative representation based projections crp like spp crp aims to preserve the collaborative representation based reconstruction relationship of data crp utilizes a l2 norm graph to characterize the local compactness information crp maximizes the ratio between the total separability information and the local compactness information to seek the optimal projection matrix crp is much faster than spp since crp calculates the objective function with l2 norm while spp calculate the objective function with l1 norm experimental results on feret ar yale face databases and the polyu finger knuckle print database demonstrate that crp works well in feature extraction and leads to a good recognition performance we give a l2 norm graph based on collaborative representation we propose a collaborative representation based projections crp for feature extraction crp is a rayleigh quotient form and can be calculated via generalized eigenvalue decomposition

nonparametric bayesian dictionary learning for analysis of noisy and incomplete images nonparametric bayesian methods are considered for recovery of imagery based upon compressive incomplete and or noisy measurements a truncated beta bernoulli process is employed to infer an appropriate dictionary for the data under test and also for image recovery in the context of compressive sensing significant improvements in image recovery are manifested using learned dictionaries relative to using standard orthonormal image expansions the compressive measurement projections are also optimized for the learned dictionary additionally we consider simpler incomplete measurements defined by measuring a subset of image pixels uniformly selected at random spatial interrelationships within imagery are exploited through use of the dirichlet and probit stick breaking processes several example results are presented with comparisons to other methods in the literature

numerical and analytical estimates of existence regions for semi linear elliptic equations with critical sobolev exponents in cuboid and cylindrical domains we use a variety of careful numerical and semi analytical methods to investigate two outstanding conjectures on the solutions of the parametrised semi linear elliptic equation u u u5 0 u 0 where u is defined to be zero on the boundary of a three dimensional domain this equation is important in analysis and in studies of combustion and polytropic gases it is known that there is a value 0 0 such that no solutions exist for 0 mcleod and schoen and bandle and flucher have given different estimates for 0 both of which have been conjectured to be exact we perform a semi analytic study of solutions on cylindrical domains and construct numerical approximations on cuboid domains using the finite element method combined with a careful post processing step to reduce the otherwise significant errors we compute these estimates for cylindrical and cuboid domains and show that on these domains the estimates do not agree we conclude that the conjecture of bandle and flucher is false our numerical computations on cuboid domains are consistent with mcleod s conjecture being true

robust subspace segmentation via nonconvex low rank representation a nonconvex formulation to determine the low rank representation from contaminated data is proposed we provide a proximal iteratively reweighed algorithm for solving the nonconvex model the proposed nonconvex model can recover the underlying low rank structure of subspaces in spite of noisy corruptions recently low rank representation lrr has been successfully applied to explore subspace segmentation of data in this paper we propose a nonconvex formulation to determine the lrr from contaminated data unlike in traditional methods which directly utilize the nuclear norm to approximate the rank function and penalize noise using the 2 1 norm our method introduces the ky fan p k norm and the 2 q norm to better approximate the rank minimization problem and enhance the robustness against noise an efficient algorithm is derived for solving the novel objective function and this is followed by a rigorous theoretical proof of the convergence extensive experiments on face datasets clearly demonstrate that the proposed methods are more robust to illumination variations corruptions and occlusions

the finite element approximation of semilinear elliptic partial differential equations with critical exponents in the cube we consider the finite element solution of the parameterized semilinear elliptic equation delta u lambda u u 5 0 u 0 where u is defined in the unit cube and is 0 on the boundary of the cube this equation is important in analysis and it is known that there is a value lambda 0 0 such that no solutions exist for lambda lambda 0 and for the form of the spurious numerical solutions which are known to exist when lambda lambda 0 these estimates are then used to post process the numerical results to obtain a sharp estimate for lambda 0 which agrees with the conjectured value

approximate orthogonal sparse embedding for dimensionality reduction locally linear embedding lle is one of the most well known manifold learning methods as the representative linear extension of lle orthogonal neighborhood preserving projection onpp has attracted widespread attention in the field of dimensionality reduction in this paper a unified sparse learning framework is proposed by introducing the sparsity or l 1 norm learning which further extends the lle based methods to sparse cases theoretical connections between the onpp and the proposed sparse linear embedding are discovered the optimal sparse embeddings derived from the proposed framework can be computed by iterating the modified elastic net and singular value decomposition we also show that the proposed model can be viewed as a general model for sparse linear and nonlinear kernel subspace learning based on this general model sparse kernel embedding is also proposed for nonlinear sparse feature extraction extensive experiments on five databases demonstrate that the proposed sparse learning framework performs better than the existing subspace learning algorithm particularly in the cases of small sample sizes

a unified framework for representation based subspace clustering of out of sample and large scale data under the framework of spectral clustering the key of subspace clustering is building a similarity graph which describes the neighborhood relations among data points some recent works build the graph using sparse low rank and ell 2 norm based representation and have achieved the state of the art performance however these methods have suffered from the following two limitations first the time complexities of these methods are at least proportional to the cube of the data size which make those methods inefficient for solving the large scale problems second they cannot cope with the out of sample data that are not used to construct the similarity graph to cluster each out of sample datum the methods have to recalculate the similarity graph and the cluster membership of the whole data set in this paper we propose a unified framework that makes the representation based subspace clustering algorithms feasible to cluster both the out of sample and the large scale data under our framework the large scale problem is tackled by converting it as the out of sample problem in the manner of sampling clustering coding and classifying furthermore we give an estimation for the error bounds by treating each subspace as a point in a hyperspace extensive experimental results on various benchmark data sets show that our methods outperform several recently proposed scalable methods in clustering a large scale data set

human action recognition with graph based multiple instance learning a new approach to human action recognition from realistic videos is presented in this paper first an affine motion model is utilized to compensate background motion for the purpose of extracting dense foreground trajectories then a trajectory spectral embedding is introduced to split up foreground action into multiple spatio temporal action parts for constructing a mid level representation to deal with over segmentation a novel density discontinuity detector is proposed for the sake of generating semantically salient action parts finally to handle the ambiguity in the training set action classification is formulated within the multiple instance learning framework which a spatio temporal graph model is incorporated into extensive experiments show that the proposed approach achieves competitive results to state of the art on ucf sports kisses slaps youtube and hollywood datasets a motion compensation approach based on affine model is introduced a density discontinuity detector is proposed to deal with over segmentation the bag of histograms is presented to develop the bag of features a graph based multiple instance learning method is proposed to handle ambiguity

principal graph and structure learning based on reversed graph embedding many scientific datasets are of high dimension and the analysis usually requires retaining the most important structures of data principal curve is a widely used approach for this purpose however many existing methods work only for data with structures that are mathematically formulated by curves which is quite restrictive for real applications a few methods can overcome the above problem but they either require complicated human made rules for a specific task with lack of adaption flexibility to different tasks or cannot obtain explicit structures of data to address these issues we develop a novel principal graph and structure learning framework that captures the local information of the underlying graph structure based on reversed graph embedding as showcases models that can learn a spanning tree or a weighted undirected ell 1 graph are proposed and a new learning algorithm is developed that learns a set of principal points and a graph structure from data simultaneously the new algorithm is simple with guaranteed convergence we then extend the proposed framework to deal with large scale data experimental results on various synthetic and six real world datasets show that the proposed method compares favorably with baselines and can uncover the underlying structure correctly

a q exponential statistical banach manifold abstract let be a given probability measure and m the set of equivalent strictly positive probability densities in this paper we construct a banach manifold on m modeled on the space l p where p is a reference density for the non parametric q exponential statistical models tsallis s deformed exponential where 0 q 1 is any real number this family is characterized by the fact that when q 1 then the non parametric exponential models are obtained and the manifold constructed by pistone and sempi is recovered up to continuous embeddings on the modeling space the coordinate mappings of the manifold are given in terms of csiszar s divergences the tangent vectors are identified with the one dimensional q exponential models and q deformations of the score function

rearrangement inequalities in the discrete setting and some applications abstract we prove extended hardy littlewood riesz and polya szeg inequalities in the discrete case we also establish cases of equality in these inqualities and give some applications of our result

laplacian eigenmaps for dimensionality reduction and data representation one of the central problems in machine learning and pattern recognition is to develop appropriate representations for complex data we consider the problem of constructing a representation for data lying on a low dimensional manifold embedded in a high dimensional space drawing on the correspondence between the graph laplacian the laplace beltrami operator on the manifold and the connections to the heat equation we propose a geometrically motivated algorithm for representing the high dimensional data the algorithm provides a computationally efficient approach to nonlinear dimensionality reduction that has locality preserving properties and a natural connection to clustering some potential applications and illustrative examples are discussed

dual diversified dynamical gaussian process latent variable model for video repairing in this paper we propose a dual diversified dynamical gaussian process latent variable model text d 3 gplvm to tackle the video repairing issue for preservation purposes videos have to be conserved on media however storing on media such as films and hard disks can suffer from unexpected data loss for instance physical damage so repairing of missing or damaged pixels is essential for better video maintenance most methods seek to fill in missing holes by synthesizing similar textures from local patches the neighboring pixels consecutive frames or the whole video however these can introduce incorrect contexts especially when the missing hole or number of damaged frames is large furthermore simple texture synthesis can introduce artifacts in undamaged and recovered areas to address aforementioned problems we introduce two diversity encouraging priors to both of inducing points and latent variables for considering the variety in existing videos in text d 3 gplvm the inducing points constitute a smaller subset of observed data while latent variables are a low dimensional representation of observed data since they have a strong correlation with the observed data it is essential that both of them can capture distinct aspects of and fully represent the observed data the dual diversity encouraging priors ensure that the trained inducing points and latent variables are more diverse and resistant for context aware and artifacts free based video repairing the defined objective function in our proposed model is initially not analytically tractable and must be solved by variational inference finally experimental testing results illustrate the robustness and effectiveness of our method for damaged video repairing

unsupervised multi class co segmentation via joint cut over l_ 1 manifold hyper graph of discriminative image regions this paper systematically advocates a robust and efficient unsupervised multi class co segmentation approach by leveraging underlying subspace manifold propagation to exploit the cross image coherency it can combat certain image co segmentation difficulties due to viewpoint change partial occlusion complex background transient illumination and cluttering texture patterns our key idea is to construct a powerful hyper graph joint cut framework which incorporates mid level image regions based intra image feature representation and l 1 manifold graph based inter image coherency exploration for local image region generation we propose a bi harmonic distance distribution difference metric to govern the super pixel clustering in a bottom up way it not only affords drastic data reduction but also gives rise to discriminative and structure meaningful feature representation as for the inter image coherency we leverage multi type features involved l 1 graph to detect the underlying local manifold from cross image regions as a result the implicit supervising information could be encoded into the unsupervised hyper graph joint cut framework we conduct extensive experiments and make comprehensive evaluations with other state of the art methods over various benchmarks including icoseg msrc and oxford flower all the results demonstrate the superiorities of our method in terms of accuracy robustness efficiency and versatility

multiple kernel sparse representations for supervised and unsupervised learning in complex visual recognition tasks it is typical to adopt multiple descriptors which describe different aspects of the images for obtaining an improved recognition performance descriptors that have diverse forms can be fused into a unified feature space in a principled manner using kernel methods sparse models that generalize well to the test data can be learned in the unified kernel space and appropriate constraints can be incorporated for application in supervised and unsupervised learning in this paper we propose to perform sparse coding and dictionary learning in the multiple kernel space where the weights of the ensemble kernel are tuned based on graph embedding principles such that class discrimination is maximized in our proposed algorithm dictionaries are inferred using multiple levels of 1d subspace clustering in the kernel space and the sparse codes are obtained using a simple levelwise pursuit scheme empirical results for object recognition and image clustering show that our algorithm outperforms existing sparse coding based approaches and compares favorably to other state of the art methods

from local similarities to global coding a framework for coding applications feature coding has received great attention in recent years as a building block of many image processing algorithms in particular the importance of the locality assumption in coding approaches has been studied in many previous works we review this assumption and claim that using the similarity of data points to a more global set of anchor points does not necessarily weaken the coding method as long as the underlying structure of the anchor points is considered we propose to capture the underlying structure by assuming a random walker over the anchor points we also show that our method is a fast approximation to the diffusion map kernel experiments on various data sets show that with a knowledge of the underlying structure of anchor points different state of the art coding algorithms may boost their performance in different learning tasks by utilizing the proposed method

semi supervised double sparse graphs based discriminant analysis for dimensionality reduction abstract discriminant analysis da is a well known dimensionality reduction tool in pattern classification with enough efficient labeled samples the optimal projections could be found by maximizing the between class scatter variance meanwhile minimizing the within class scatter variance however the acquisition of label information is difficult in practice so semi supervised discriminant analysis has attracted much attention in recent years where both few labeled samples and many unlabeled samples are utilized during learning process sparse graph learned by sparse representation contains local structure information about data and is widely employed in dimensionality reduction in this paper semi supervised double sparse graphs sdsg based dimensionality reduction is proposed which considers both the positive and negative structure relationship of data points by using double sparse graphs aiming to explore the discriminant information among unlabeled samples joint k nearest neighbor selection strategy is proposed to select pseudo labeled samples which contain some precise discriminant information in the following procedures the data subset consisting of labeled samples and pseudo labeled samples are used instead of the original data based on two different criterions two sdsg based discriminant analysis methods are designed and denoted by sdsg dda distance based da and sdsg rda reconstruction based da which also use different strategies to reduce the effect of pseudo labels inaccuracy finally the experimental results both on uci datasets and hyperspectral images validate the effectiveness and advantage of the proposed methods compared with some classical dimensionality reduction methods

acquiring linear subspaces for face recognition under variable lighting previous work has demonstrated that the image variation of many objects human faces in particular under variable lighting can be effectively modeled by low dimensional linear spaces even when there are multiple light sources and shadowing basis images spanning this space are usually obtained in one of three ways a large set of images of the object under different lighting conditions is acquired and principal component analysis pca is used to estimate a subspace alternatively synthetic images are rendered from a 3d model perhaps reconstructed from images under point sources and again pca is used to estimate a subspace finally images rendered from a 3d model under diffuse lighting based on spherical harmonics are directly used as basis images in this paper we show how to arrange physical lighting so that the acquired images of each object can be directly used as the basis vectors of a low dimensional linear space and that this subspace is close to those acquired by the other methods more specifically there exist configurations of k point light source directions with k typically ranging from 5 to 9 such that by taking k images of an object under these single sources the resulting subspace is an effective representation for recognition under a wide range of lighting conditions since the subspace is generated directly from real images potentially complex and or brittle intermediate steps such as 3d reconstruction can be completely avoided nor is it necessary to acquire large numbers of training images or to physically construct complex diffuse harmonic light fields we validate the use of subspaces constructed in this fashion within the context of face recognition

structure preserving binary representations for rgb d action recognition in this paper we propose a novel binary local representation for rgb d video data fusion with a structure preserving projection our contribution consists of two aspects toacquire a general feature for the video data we convert the problem to describing the gradient fields of rgb and depth information of video sequences with the local fluxes of the gradient fields which include the orientation and the magnitude of the neighborhood of each point a new kind of continuous local descriptor called local flux feature lff is obtained then the lffs from rgb and depth channels are fused into a hamming space via the structure preserving projection spp specifically an orthogonal projection matrix is applied to preserve the pairwise structure with a shape constraint to avoid the collapse of data structure in the projected space furthermore a bipartite graph structure of data is taken into consideration which is regarded as a higher level connection between samples and classes than the pairwise structure of local features theextensive experiments show not only the high efficiency of binary codes and the effectiveness of combining lffs from rgb d channels via spp on various action recognition benchmarks of rgb d data but also the potential power of lff for general action recognition

structure constrained low rank representation benefiting from its effectiveness in subspace segmentation low rank representation lrr and its variations have many applications in computer vision and pattern recognition such as motion segmentation image segmentation saliency detection and semisupervised learning it is known that the standard lrr can only work well under the assumption that all the subspaces are independent however this assumption cannot be guaranteed in real world problems this paper addresses this problem and provides an extension of lrr named structure constrained lrr sc lrr to analyze the structure of multiple disjoint subspaces which is more general for real vision data we prove that the relationship of multiple linear disjoint subspaces can be exactly revealed by sc lrr with a predefined weight matrix as a nontrivial byproduct we also illustrate that sc lrr can be applied for semisupervised learning the experimental results on different types of vision problems demonstrate the effectiveness of our proposed method

low rank embedding for robust image feature extraction robustness to noises outliers and corruptions is an important issue in linear dimensionality reduction since the sample specific corruptions and outliers exist the class special structure or the local geometric structure is destroyed and thus many existing methods including the popular manifold learning based linear dimensionality methods fail to achieve good performance in recognition tasks in this paper we focus on the unsupervised robust linear dimensionality reduction on corrupted data by introducing the robust low rank representation lrr thus a robust linear dimensionality reduction technique termed low rank embedding lre is proposed in this paper which provides a robust image representation to uncover the potential relationship among the images to reduce the negative influence from the occlusion and corruption so as to enhance the algorithm s robustness in image feature extraction lre searches the optimal lrr and optimal subspace simultaneously the model of lre can be solved by alternatively iterating the argument lagrangian multiplier method and the eigendecomposition the theoretical analysis including convergence analysis and computational complexity of the algorithms is presented experiments on some well known databases with different corruptions show that lre is superior to the previous methods of feature extraction and therefore it indicates the robustness of the proposed method the code of this paper can be downloaded from http www scholat com laizhihui

elastic net hypergraph learning for image clustering and semi supervised classification graph model is emerging as a very effective tool for learning the complex structures and relationships hidden in data in general the critical purpose of graph oriented learning algorithms is to construct an informative graph for image clustering and classification tasks in addition to the classical k nearest neighbor and r neighborhood methods for graph construction l 1 graph and its variants are emerging methods for finding the neighboring samples of a center datum where the corresponding ingoing edge weights are simultaneously derived by the sparse reconstruction coefficients of the remaining samples however the pairwise links of l 1 graph are not capable of capturing the high order relationships between the center datum and its prominent data in sparse reconstruction meanwhile from the perspective of variable selection the l 1 norm sparse constraint regarded as a lasso model tends to select only one datum from a group of data that are highly correlated and ignore the others to simultaneously cope with these drawbacks we propose a new elastic net hypergraph learning model which consists of two steps in the first step the robust matrix elastic net model is constructed to find the canonically related samples in a somewhat greedy way achieving the grouping effect by adding the l 2 penalty to the l 1 constraint in the second step hypergraph is used to represent the high order relationships between each datum and its prominent samples by regarding them as a hyperedge subsequently hypergraph laplacian matrix is constructed for further analysis new hypergraph learning algorithms including unsupervised clustering and multi class semi supervised classification are then derived extensive experiments on face and handwriting databases demonstrate the effectiveness of the proposed method

low rank preserving embedding abstract in this paper we consider the problem of linear dimensionality reduction with the novel technique of low rank representation which is a promising tool of discovering subspace structures of given data existing approaches based on graph embedding usually capture structure of data via stacking the local structure of each datum such as neighborhood graph l1 graph and l2 graph yet they lack explicit discrimination between those local structures and suffer from corrupted samples to this end we propose a new linear dimensionality reduction method by virtue of the lowest rank representation lrr of data which is dubbed low rank preserving embedding lrpe different from the traditional routes lrpe achieves all data self representations jointly and can thus extract the global structure of a data set as a whole the global low rank constraint explicitly enforces the lrr matrix to be block diagonal form so that the samples with a similar intrinsic structure which are more likely to be from the same class are described by a similar set of bases hence lrpe is discriminative even if no class labels are provided benefiting from the robust lrr lrpe is also robust to various noises and errors in data besides we rewritten all related methods into a unified formulation followed by a detailed solution and clear comparisons finally we conduct extensive experiments on publicly available data sets for data visualization and classification the inspiring experimental results show the effectiveness the cheap computation and the robustness of the proposed method

joint sparse representation and embedding propagation learning a framework for graph based semisupervised learning in this paper we propose a novel graph based semisupervised learning framework called joint sparse representation and embedding propagation learning jsrepl the idea of jsrepl is to join epl with sparse representation to perform label propagation like most of graph based semisupervised propagation learning algorithms jsrepl also constructs weights graph matrix from given data different from classical approaches which build weights graph matrix and estimate the labels of unlabeled data in sequence jsrepl simultaneously builds weights graph matrix and estimates the labels of unlabeled data we also propose an efficient algorithm to solve the proposed problem the proposed method is applied to the problem of semisupervised image clustering using the orl yale pie and yaleb data sets our experiments demonstrate the effectiveness of our proposed algorithm

sparse on line gaussian processes we develop an approach for sparse representations of gaussian process gp models which are bayesian types of kernel machines in order to overcome their limitations for large data sets the method is based on a combination of a bayesian on line algorithm together with a sequential construction of a relevant subsample of the data that fully specifies the prediction of the gp model by using an appealing parameterization and projection techniques in a reproducing kernel hilbert space recursions for the effective parameters and a sparse gaussian approximation of the posterior process are obtained this allows for both a propagation of predictions and bayesian error measures the significance and robustness of our approach are demonstrated on a variety of experiments

an image segmentation method based on network clustering model abstract network clustering phenomena are ubiquitous in nature and human society in this paper a method involving a network clustering model is proposed for mass segmentation in mammograms first the watershed transform is used to divide an image into regions and features of the image are computed then a graph is constructed from the obtained regions and features the network clustering model is applied to realize clustering of nodes in the graph compared with two classic methods the algorithm based on the network clustering model performs more effectively in experiments

a unifying view of sparse approximate gaussian process regression we provide a new unifying view including all existing proper probabilistic sparse approximations for gaussian process regression our approach relies on expressing the effective prior which the methods are using this allows new insights to be gained and highlights the relationship between existing methods it also allows for a clear theoretically justified ranking of the closeness of the known approximations to the corresponding full gps finally we point directly to designs of new better sparse approximations combining the best of the existing strategies within attractive computational constraints

learning locality constrained collaborative representation for robust face recognition abstract the models of low dimensional manifold and sparse representation are two well known concise models that suggest that each data can be described by a few characteristics manifold learning is usually investigated for dimension reduction by preserving some expected local geometric structures from the original space into a low dimensional one the structures are generally determined by using pairwise distance e g euclidean distance alternatively sparse representation denotes a data point as a linear combination of the points from the same subspace in practical applications however the nearby points in terms of pairwise distance may not belong to the same subspace and vice versa consequently it is interesting and important to explore how to get a better representation by integrating these two models together to this end this paper proposes a novel coding algorithm called locality constrained collaborative representation lccr which introduce a kind of local consistency into coding scheme to improve the discrimination of the representation the locality term derives from a biologic observation that the similar inputs have similar codes the objective function of lccr has an analytical solution and it does not involve local minima the empirical studies based on several popular facial databases show that lccr is promising in recognizing human faces with varying pose expression and illumination as well as various corruptions and occlusions