analysing images of curved surfaces a reflectance map makes the relationship between image intensity and surface orientation explicit trade offs between image intensity and surface orientation emerge which cannot be resolved locally in a single view existing methods for determining surface orientation from a single view embody assumptions about surface curvature the hessian matrix is introduced to represent surface curvature properties of surface curvature are expressed as properties of the hessian matrix for several classes of surface image analysis simplifies this result has already been established for planar surfaces forming trihedral corners similar simplification is demonstrated for developable surfaces and for the subclass of surfaces known as generalized cones these studies help to delineate shape information that can be determined from geometric measurements at object boundaries and shape information that can be determined from intensity measurements over sections of smoothly curved surface a novel technique called photometric stereo is discussed the idea of stereo is to obtain multiple images in order to determine the underlying scene precisely in photometric stereo the viewing direction is constant multiple images are obtained by varying the incident illumination it is shown that this provides sufficient information to determine surface orientation at each image point

worst case linear discriminant analysis as scalable semidefinite feasibility problems in this paper we propose an efficient semidefinite programming sdp approach to worst case linear discriminant analysis wlda compared with the traditional lda wlda considers the dimensionality reduction problem from the worst case viewpoint which is in general more robust for classification however the original problem of wlda is non convex and difficult to optimize in this paper we reformulate the optimization problem of wlda into a sequence of semidefinite feasibility problems to efficiently solve the semidefinite feasibility problems we design a new scalable optimization method with a quasi newton method and eigen decomposition being the core components the proposed method is orders of magnitude faster than standard interior point sdp solvers experiments on a variety of classification problems demonstrate that our approach achieves better performance than standard lda our method is also much faster and more scalable than standard interior point sdp solvers based wlda the computational complexity for an sdp with m constraints and matrices of size d by d is roughly reduced from mathcal o m 3 md 3 m 2 d 2 to mathcal o d 3 m d in our case

modified principal component analysis an integration of multiple similarity subspace models we modify the conventional principal component analysis pca and propose a novel subspace learning framework modified pca mpca using multiple similarity measurements mpca computes three similarity matrices exploiting the similarity measurements 1 mutual information 2 angle information and 3 gaussian kernel similarity we employ the eigenvectors of similarity matrices to produce new subspaces referred to as similarity subspaces a new integrated similarity subspace is then generated using a novel feature selection approach this approach needs to construct a kind of vector set termed weak machine cell wmc which contains an appropriate number of the eigenvectors spanning the similarity subspaces combining the wrapper method and the forward selection scheme mpca selects a wmc at a time that has a powerful discriminative capability to classify samples mpca is very suitable for the application scenarios in which the number of the training samples is less than the data dimensionality mpca outperforms the other state of the art pca based methods in terms of both classification accuracy and clustering result in addition mpca can be applied to face image reconstruction mpca can use other types of similarity measurements extensive experiments on many popular real world data sets such as face databases show that mpca achieves desirable classification results as well as has a powerful capability to represent data

clutter invariant atr one of the central problems in automated target recognition is to accommodate the infinite variety of clutter in real military environments the principle focus of our paper is on the construction of metric spaces where the metric measures the distance between objects of interest invariant to the infinite variety of clutter such metrics are formulated using second order random field models our results indicate that this approach significantly improves detection classification rates of targets in clutter

eigenfaces vs fisherfaces recognition using class specific linear projection we develop a face recognition algorithm which is insensitive to large variation in lighting direction and facial expression taking a pattern classification approach we consider each pixel in an image as a coordinate in a high dimensional space we take advantage of the observation that the images of a particular face under varying illumination but fixed pose lie in a 3d linear subspace of the high dimensional image space if the face is a lambertian surface without shadowing however since faces are not truly lambertian surfaces and do indeed produce self shadowing images will deviate from this linear subspace rather than explicitly modeling this deviation we linearly project the image into a subspace in a manner which discounts those regions of the face with large deviation our projection method is based on fisher s linear discriminant and produces well separated classes in a low dimensional subspace even under severe variation in lighting and facial expressions the eigenface technique another method based on linearly projecting the image space to a low dimensional subspace has similar computational requirements yet extensive experimental results demonstrate that the proposed fisherface method has error rates that are lower than those of the eigenface technique for tests on the harvard and yale face databases

discriminant subspace analysis a fukunaga koontz approach the fisher linear discriminant fld is commonly used in pattern recognition it finds a linear subspace that maximally separates class patterns according to the fisher criterion several methods of computing the fld have been proposed in the literature most of which require the calculation of the so called scatter matrices in this paper we bring a fresh perspective to fld via the fukunaga koontz transform fkt we do this by decomposing the whole data space into four subspaces with different discriminabilities as measured by eigenvalue ratios by connecting the eigenvalue ratio with the generalized eigenvalue we show where the fisher criterion is maximally satisfied we prove the relationship between fld and fkt analytically and propose a unified framework to understanding some existing work furthermore we extend our theory to the multiple discriminant analysis mda this is done by transforming the data into intraclass and extraclass spaces followed by maximizing the bhattacharyya distance based on our fkt analysis we identify the discriminant subspaces of mda fkt and propose an efficient algorithm which works even when the scatter matrices are singular or too large to be formed our method is general and may be applied to different pattern recognition problems we validate our method by experimenting on synthetic and real data

improved discriminate analysis for high dimensional data and its application to face recognition many pattern recognition applications involve the treatment of high dimensional data and the small sample size problem principal component analysis pca is a common used dimension reduction technique linear discriminate analysis lda is often employed for classification pca plus lda is a famous framework for discriminant analysis in high dimensional space and singular cases in this paper we examine the theory of this framework and find out that even if there is no small sample size problem the pca dimension reduction cannot guarantee the subsequent successful application of lda we thus develop an improved discriminate analysis method by introducing an inverse fisher criterion and adding a constrain in pca procedure so that the singularity phenomenon will not occur experiment results on face recognition suggest that this new approach works well and can be applied even when the number of training samples is one per class

comments on globally maximizing locally minimizing unsupervised discriminant projection with application to face and palm biometrics this paper develops an unsupervised discriminant projection udp technique for dimensionality reduction of high dimensional data in small sample size cases udp can be seen as a linear approximation of a multimanifolds based learning framework which takes into account both the local and nonlocal quantities udp characterizes the local scatter as well as the nonlocal scatter seeking to find a projection that simultaneously maximizes the nonlocal scatter and minimizes the local scatter this characteristic makes udp more intuitive and more powerful than the most up to date method locality preserving projection lpp which considers only the local scatter for clustering or classification tasks the proposed method is applied to face and palm biometrics and is examined using the yale feret and ar face image databases and the polyu palmprint database the experimental results show that udp consistently outperforms lpp and pca and outperforms lda when the training sample size per class is small this demonstrates that udp is a good choice for real world biometrics applications

robust regression for face recognition in this paper we address the problem of robust face recognition by formulating the pattern recognition task as a problem of robust estimation using a fundamental concept that in general patterns from a single object class lie on a linear subspace barsi and jacobs 2003 1 we develop a linear model representing a probe image as a linear combination of class specific galleries in the presence of noise the well conditioned inverse problem is solved using the robust huber estimation and the decision is ruled in favor of the class with the minimum reconstruction error the proposed robust linear regression classification rlrc algorithm is extensively evaluated for two important cases of robustness i e illumination variations and random pixel corruption illumination invariant face recognition is demonstrated on three standard databases under exemplary evaluation protocols reported in the literature comprehensive comparative analysis with the state of art illumination tolerant approaches indicates a comparable performance index for the proposed rlrc algorithm the efficiency of the proposed approach in the presence of severe random noise is validated under several exemplary noise models such as dead pixel problem salt and pepper noise speckle noise and additive white gaussian noise awgn the rlrc algorithm is found to be favorable compared with the benchmark generative approaches

linear regression for face recognition in this paper we present a novel approach of face identification by formulating the pattern recognition problem in terms of linear regression using a fundamental concept that patterns from a single object class lie on a linear subspace we develop a linear model representing a probe image as a linear combination of class specific galleries the inverse problem is solved using the least squares method and the decision is ruled in favor of the class with the minimum reconstruction error the proposed linear regression classification lrc algorithm falls in the category of nearest subspace classification the algorithm is extensively evaluated on several standard databases under a number of exemplary evaluation protocols reported in the face recognition literature a comparative study with state of the art algorithms clearly reflects the efficacy of the proposed approach for the problem of contiguous occlusion we propose a modular lrc approach introducing a novel distance based evidence fusion def algorithm the proposed methodology achieves the best results ever reported for the challenging problem of scarf occlusion

maximal likelihood correspondence estimation for face recognition across pose due to the misalignment of image features the performance of many conventional face recognition methods degrades considerably in across pose scenario to address this problem many image matching based methods are proposed to estimate semantic correspondence between faces in different poses in this paper we aim to solve two critical problems in previous image matching based correspondence learning methods 1 fail to fully exploit face specific structure information in correspondence estimation and 2 fail to learn personalized correspondence for each probe image to this end we first build a model termed as morphable displacement field mdf to encode face specific structure information of semantic correspondence from a set of real samples of correspondences calculated from 3d face models then we propose a maximal likelihood correspondence estimation mlce method to learn personalized correspondence based on maximal likelihood frontal face assumption after obtaining the semantic correspondence encoded in the learned displacement we can synthesize virtual frontal images of the profile faces for subsequent recognition using linear discriminant analysis method with pixel intensity features state of the art performance is achieved on three multipose benchmarks i e cmu pie feret and multipie databases owe to the rational mdf regularization and the usage of novel maximal likelihood objective the proposed mlce method can reliably learn correspondence between faces in different poses even in complex wild environment i e labeled face in the wild database

compound rank k projections for bilinear analysis in many real world applications data are represented by matrices or high order tensors despite the promising performance the existing 2 d discriminant analysis algorithms employ a single projection model to exploit the discriminant information for projection making the model less flexible in this paper we propose a novel compound rank k projection crp algorithm for bilinear analysis the crp deals with matrices directly without transforming them into vectors and it therefore preserves the correlations within the matrix and decreases the computation complexity different from the existing 2 d discriminant analysis algorithms objective function values of crp increase monotonically in addition the crp utilizes multiple rank k projection models to enable a larger search space in which the optimal solution can be found in this way the discriminant ability is enhanced we have tested our approach on five data sets including uuim cvl pointing 04 usps and coil20 experimental results show that the performance of our proposed crp performs better than other algorithms in terms of classification accuracy

relations among some low rank subspace recovery models recovering intrinsic low dimensional subspaces from data distributed on them is a key preprocessing step to many applications in recent years a lot of work has modeled subspace recovery as low rank minimization problems we find that some representative models such as robust principal component analysis r pca robust low rank representation r lrr and robust latent low rank representation r latlrr are actually deeply connected more specifically we discover that once a solution to one of the models is obtained we can obtain the solutions to other models in closed form formulations since r pca is the simplest our discovery makes it the center of low rank subspace recovery models our work has two important implications first r pca has a solid theoretical foundation under certain conditions we could find globally optimal solutions to these low rank models at an overwhelming probability although these models are nonconvex second we can obtain significantly faster algorithms for these models by solving r pca first the computation cost can be further cut by applying low complexity randomized algorithms for example our novel filtering algorithm to r pca although for the moment the formal proof of our filtering algorithm is not yet available experiments verify the advantages of our algorithm over other state of the art methods based on the alternating direction method

fast computation of low rank matrix approximations given a matrix a it is often desirable to find a good approximation to a that has low rank we introduce a simple technique for accelerating the computation of such approximations when a has strong spectral features that is when the singular values of interest are significantly greater than those of a random matrix with size and entries similar to a our technique amounts to independently sampling and or quantizing the entries of a thus speeding up computation by reducing the number of nonzero entries and or the length of their representation our analysis is based on observing that the acts of sampling and quantization can be viewed as adding a random matrix n to a whose entries are independent random variables with zero mean and bounded variance since with high probability n has very weak spectral features we can prove that the effect of sampling and quantization nearly vanishes when a low rank approximation to a p n is computed we give high probability bounds on the quality of our approximation both in the frobenius and the 2 norm

constructing bach flat manifolds of signature 2 2 using the modified riemannian extension we use the modified riemannian extension of an affine surface to construct bach flat manifolds as all these examples have vanishing scalar invariants we shall construct scalar invariants which are not of weyl type to distinguish them we illustrate these phenomena in the context of homogeneous affine surfaces we use the modified riemannian extension of an affine surface to construct bach flat manifolds as all these examples have vanishing scalar invariants we shall construct scalar invariants which are not of weyl type to distinguish them we illustrate these phenomena in the context of homogeneous affine surfaces

a new discriminant subspace analysis approach for multi class problems fukunaga koontz transform fkt is a famous feature extraction method in statistical pattern recognition which aims to find a set of vectors that have the best representative power for one class while the poorest representative power for the other class li and savvides 1 propose a one against all strategy to deal with multi class problems in which the two class fkt method can be directly applied to find the presentative vectors of each class motivated by the fkt method in this paper we propose a new discriminant subspace analysis dsa method for the multi class feature extraction problems to solve dsa we propose an iterative algorithm for the joint diagonalization jd problem finally we generalize the linear dsa method to handle nonlinear feature extraction problems via the kernel trick to demonstrate the effectiveness of the proposed method for pattern recognition problems we conduct extensive experiments on real data sets and show that the proposed method outperforms most commonly used feature extraction methods

recovery guarantees for exemplar based clustering for a certain class of distributions we prove that the linear programming relaxation of k medoids clustering a variant of k means clustering where means are replaced by exemplars from within the dataset distinguishes points drawn from nonoverlapping balls with high probability once the number of points drawn and the separation distance between any two balls are sufficiently large our results hold in the nontrivial regime where the separation distance is small enough that points drawn from different balls may be closer to each other than points drawn from the same ball in this case clustering by thresholding pairwise distances between points can fail we also exhibit numerical evidence of high probability recovery in a substantially more permissive regime

semantic preserving distance metric learning and applications how do we accurately browse a large set of images or efficiently annotate the images from an image library image clustering methods are invaluable tools for applications such as content based image retrieval and image annotation to perform these tasks it is critical to have proper features to describe the visual and semantic content of images and to define an accurate distance metric to measure the dissimilarity between any two images however existing methods which adopt the features of color histograms edge direction histograms and shape context lack the ability to describe semantic content to solve this problem we propose a new approach that utilizes user provided pairwise constraints to describe the semantic relationship between two images a semantic preserving distance metric learning sp dml algorithm is developed to explore the complementary characteristics of the visual features and pairwise constraints in a unified feature space in this space the learned distance metric can be used to measure the dissimilarity between two images specifically the manifold structure adopted in sp dml is revealed by the image s visual features to integrate semantic contents in distance metric learning sp dml utilizes pairwise constraints to build semantic patches and align these patches to obtain the optimal distance metric for the new feature space experimental results in image clustering demonstrate that the performance of sp dml is appealing

towards robust discriminative projections learning via non greedy l2 1 norm minmax linear discriminant analysis lda is one of the most successful supervised dimensionality reduction methods and has been widely used in many real world applications however the l 2 norm is employed as the distance measure in objective of lda which is sensitive to outliers many previous works improve the robustness of lda by using l1 norm distance however the robustness against outliers is limited and the solver of l1 norm are mostly based on greedy search strategy which is time consuming and easy to get stuck in a local optimum in this paper we propose a novel robust lda measured by l 2 1 norm to learn robust discriminative projections since the proposed model needs to minimize and maximize minmax l 2 1 norm terms simultaneously it is challenging to solve as a result we first systematically derive an efficient iterative optimization algorithm to solve a general ratio minimization problem and rigorously prove its convergence more importantly an efficient non greedy iterative re weighted optimization algorithm is developed based on preceding approach for solving proposed l 2 1 norm minmax problem besides an optimal weighted mean mechanism is driven according to designed objective and solver which can be applied to other approach for robustness improvement extensive experimental results on several real world datasets show the effectiveness of proposed method

recognizing imprecisely localized partially occluded and expression variant faces from a single sample per class the classical way of attempting to solve the face or object recognition problem is by using large and representative data sets in many applications though only one sample per class is available to the system in this contribution we describe a probabilistic approach that is able to compensate for imprecisely localized partially occluded and expression variant faces even when only one single training sample per class is available to the system to solve the localization problem we find the subspace within the feature space e g eigenspace that represents this error for each of the training images to resolve the occlusion problem each face is divided into k local regions which are analyzed in isolation in contrast with other approaches where a simple voting space is used we present a probabilistic method that analyzes how good a local match is to make the recognition system less sensitive to the differences between the facial expression displayed on the training and the testing images we weight the results obtained on each local area on the basis of how much of this local area is affected by the expression displayed on the current test image

a least squares framework for component analysis over the last century component analysis ca methods such as principal component analysis pca linear discriminant analysis lda canonical correlation analysis cca locality preserving projections lpp and spectral clustering sc have been extensively used as a feature extraction step for modeling classification visualization and clustering ca techniques are appealing because many can be formulated as eigen problems offering great potential for learning linear and nonlinear representations of data in closed form however the eigen formulation often conceals important analytic and computational drawbacks of ca techniques such as solving generalized eigen problems with rank deficient matrices e g small sample size problem lacking intuitive interpretation of normalization factors and understanding commonalities and differences between ca methods this paper proposes a unified least squares framework to formulate many ca methods we show how pca lda cca lpp sc and its kernel and regularized extensions correspond to a particular instance of least squares weighted kernel reduced rank regression ls wkrrr the ls wkrrr formulation of ca methods has several benefits 1 provides a clean connection between many ca techniques and an intuitive framework to understand normalization factors 2 yields efficient numerical schemes to solve ca techniques 3 overcomes the small sample size problem 4 provides a framework to easily extend ca methods we derive weighted generalizations of pca lda sc and cca and several new ca techniques

face recognition using elasticfaces though principle component analysis pca and locality preserving projections lpps are two of the most popular linear methods for face recognition pca can only see the euclidean structure of the training set and lpp preserves the nonlinear submanifold structure hidden in the training set in this paper we propose the elastic preserving projections epps which by incorporating the merits of the local geometry and the global information of the training set epp outputs a sample subspace which simultaneously preserves the local geometrical structure and exploits the global information of the training set different from some other linear dimensionality reduction methods epp can be deemed as learning both the coordinates and the affinities between sample points furthermore the effectiveness of our proposed algorithm is analyzed theoretically and confirmed by some experiments on several well known face databases the obtained results indicate that epp significantly outperforms its other rival algorithms

approximate orthogonal sparse embedding for dimensionality reduction locally linear embedding lle is one of the most well known manifold learning methods as the representative linear extension of lle orthogonal neighborhood preserving projection onpp has attracted widespread attention in the field of dimensionality reduction in this paper a unified sparse learning framework is proposed by introducing the sparsity or l 1 norm learning which further extends the lle based methods to sparse cases theoretical connections between the onpp and the proposed sparse linear embedding are discovered the optimal sparse embeddings derived from the proposed framework can be computed by iterating the modified elastic net and singular value decomposition we also show that the proposed model can be viewed as a general model for sparse linear and nonlinear kernel subspace learning based on this general model sparse kernel embedding is also proposed for nonlinear sparse feature extraction extensive experiments on five databases demonstrate that the proposed sparse learning framework performs better than the existing subspace learning algorithm particularly in the cases of small sample sizes

gender classification from unaligned facial images using support subspaces rough face alignments result in suboptimal performance of face identification in this study we present an approach for identifying the gender based on facial images without proper face alignments instead of just using only the detected face patch for identification a set of patches is randomly cropped around the face detection region each patch set is represented by a linear subspace and compared with other linear subspaces by measuring their canonical correlations a similarity matrix comprised of the canonical correlations is then incorporated into an indefinite kernel support vector machine svm formulation the number of support vectors which we call support subspaces can be decided automatically hence we can avoid the dimension selection problem observed in our previous work our experimental results demonstrate that the proposed approach outperforms state of the art methods

novel fisher discriminant classifiers at the present several applications need to classify high dimensional points belonging to highly unbalanced classes unfortunately when the training set cardinality is small compared to the data dimensionality small sample size problem the classification performance of several well known classifiers strongly decreases similarly the classification accuracy of several discriminative methods decreases when non linearly separable and unbalanced classes are treated in this paper we firstly survey state of the art methods that employ improved versions of linear discriminant analysis lda to deal with the above mentioned problems secondly we propose a family of classifiers based on the fisher subspace estimation which efficiently deal with the small sample size problem non linearly separable classes and unbalanced classes the promising results obtained by the proposed techniques on benchmark datasets and the comparison with state of the art predictors show the efficacy of the proposed techniques

efficient and robust feature extraction by maximum margin criterion in pattern recognition feature extraction techniques are widely employed to reduce the dimensionality of data and to enhance the discriminatory information principal component analysis pca and linear discriminant analysis lda are the two most popular linear dimensionality reduction methods however pca is not very effective for the extraction of the most discriminant features and lda is not stable due to the small sample size problem in this paper we propose some new linear and nonlinear feature extractors based on maximum margin criterion mmc geometrically feature extractors based on mmc maximize the average margin between classes after dimensionality reduction it is shown that mmc can represent class separability better than pca as a connection to lda we may also derive lda from mmc by incorporating some constraints by using some other constraints we establish a new linear feature extractor that does not suffer from the small sample size problem which is known to cause serious stability problems for lda the kernelized nonlinear counterpart of this linear feature extractor is also established in the paper our extensive experiments demonstrate that the new feature extractors are effective stable and efficient

rapid and brief communication generalizing relevance weighted lda in this paper a new variant on linear discriminant analysis lda that we refer to as generalizing relevance weighted lda or grw lda is proposed grw lda extends the applicability to cases that lda cannot handle by combining the advantages of two recent lda enhancements namely generalized singular value decomposition based lda and relevance weighted lda experimental results on feret face database demonstrate the effectiveness of the proposed method

gender discriminating models from facial surface normals in this paper we show how to use facial shape information to construct discriminating models for gender classification we represent facial shapes using 2 5d fields of facial surface normals and investigate three different methods to improve the gender discriminating capacity of the model constructed using the standard eigenspace method the three methods are novel variants of principal geodesic analysis pga namely a weighted pga b supervised weighted pga and c supervised pga our starting point is to define a weight map over the facial surface that indicates the importance of different locations in discriminating gender we show how to compute the relevant weights and how to incorporate the weights into the 2 5d model construction we evaluate the performance of the alternative methods using facial surface normals extracted from 3d range images or recovered from brightness images experimental results demonstrate the effectiveness of our methods moreover the classification accuracy which is as high as 97 demonstrates the effectiveness of using facial shape information for gender classification

kernel quadratic discriminant analysis for small sample size problem it is generally believed that quadratic discriminant analysis qda can better fit the data in practical pattern recognition applications compared to linear discriminant analysis lda method this is due to the fact that qda relaxes the assumption made by lda based methods that the covariance matrix for each class is identical however it still assumes that the class conditional distribution is gaussian which is usually not the case in many real world applications in this paper a novel kernel based qda method is proposed to further relax the gaussian assumption by using the kernel machine technique the proposed method solves the complex pattern recognition problem by combining the qda solution and the kernel machine technique and at the same time tackles the so called small sample size problem through a regularized estimation of the covariance matrix extensive experimental results indicate that the proposed method is a more sophisticated solution outperforming many traditional kernel based learning algorithms

kernel self optimization learning for kernel based feature extraction and recognition kernel learning is becoming an important research topic in the area of machine learning and it has wide applications in pattern recognition computer vision image and signal processing kernel learning provides a promising solution to nonlinear problems including nonlinear feature extraction classification and clustering however in kernel based systems the problem of the kernel function and its parameters remains to be solved methods of choosing parameters from a discrete set of values have been presented in previous studies but these methods do not change the data distribution structure in the kernel based mapping space accordingly performance is not improved because the current kernel optimization does not change the data distribution based on this problem this paper presents a uniform framework for kernel self optimization with the ability to adjust the data structure the data dependent kernel is extended and applied to kernel learning and optimization equations with two criteria for measuring data discrimination are used to solve the optimal parameter values some experiments are performed to evaluate the performance in popular kernel learning methods including kernel principal components analysis kpca kernel discriminant analysis kda and kernel locality preserving projection klpp these evaluations show that the framework of kernel self optimization is feasible for enhancing kernel based learning methods

face recognition using ipca ica algorithm in this paper a fast incremental principal non gaussian directions analysis algorithm called ipca ica is introduced this algorithm computes the principal components of a sequence of image vectors incrementally without estimating the covariance matrix so covariance free and at the same time transforming these principal components to the independent directions that maximize the non gaussianity of the source two major techniques are used sequentially in a real time fashion in order to obtain the most efficient and independent components that describe a whole set of human faces database this procedure is done by merging the runs of two algorithms based on principal component analysis pca and independent component analysis ica running sequentially this algorithm is applied to face recognition problem simulation results on different databases showed high average success rate of this algorithm compared to others

face recognition using an enhanced independent component analysis approach this paper is concerned with an enhanced independent component analysis ica and its application to face recognition typically face representations obtained by ica involve unsupervised learning and high order statistics in this paper we develop an enhancement of the generic ica by augmenting this method by the fisher linear discriminant analysis lda hence its abbreviation fica the fica is systematically developed and presented along with its underlying architecture a comparative analysis explores four distance metrics as well as classification with support vector machines svms we demonstrate that the fica approach leads to the formation of well separated classes in low dimension subspace and is endowed with a great deal of insensitivity to large variation in illumination and facial expression the comprehensive experiments are completed for the facial recognition technology feret face database a comparative analysis demonstrates that fica comes with improved classification rates when compared with some other conventional approaches such as eigenface fisherface and the ica itself

formulating robust linear regression estimation as a one class lda criterion discriminative hat matrix linear discriminant analysis such as fisher s criterion is a statistical learning tool traditionally devoted to separating a training dataset into two or even several classes by the way of linear decision boundaries in this paper we show that this tool can formalize the robust linear regression problem as a robust estimator will do more precisely we develop a one class fischer s criterion in which the maximization provides both the regression parameters and the separation of the data in two classes typical data and atypical data or outliers this new criterion is built on the statistical properties of the subspace decomposition of the hat matrix from this angle we improve the discriminative properties of the hat matrix which is traditionally used as outlier diagnostic measure in linear regression naturally we call this new approach discriminative hat matrix the proposed algorithm is fully nonsupervised and needs only the initialization of one parameter synthetic and real datasets are used to study the performance both in terms of regression and classification of the proposed approach we also illustrate its potential application to image recognition and fundamental matrix estimation in computer vision

enhanced fisher discriminant criterion for image recognition many previous studies have shown that image recognition can be significantly improved by fisher linear discriminant analysis flda technique however flda ignores the variation of data points from the same class which characterizes the most important modes of variability of patterns and helps to improve the generalization capability of flda thus the performance of flda on testing data is not good enough in this paper we propose an enhanced fisher discriminant criterion efdc efdc explicitly considers the intra class variation and incorporates the intra class variation into the fisher discriminant criterion to build a robust and efficient dimensionality reduction function efdc obtains a subspace which best detects the discriminant structure and simultaneously preserves the modes of variability of patterns which will result in stable intraclass representation experimental results on four image database show a clear improvement over the results of flda based methods

mode kn factor analysis for image ensembles in this corespondence we study the extra factor estimation problem with the assumption that the training image ensemble is expressed as an nth order tensor with the nth dimension characterizing all features for an image and other dimensions for different extra factors such as illuminations poses and identities to overcome the local minimum issue of conventional algorithms designed for this problem we present a novel statistical learning framework called mode kn factor analysis for obtaining a closed form solution to estimating the extra factors of any test image in the learning stage for the kth k ne n dimension of the data tensor the mode kn patterns are constructed by concatenating the feature dimension and the kth extra factor dimension and then a mode kn factor analysis model is learnt based on the mode kn patterns unfolded from the original data tensor in the inference stage for a test image the mode classification of the kth dimension is performed within a probabilistic framework the advantages of mode kn factor analysis over conventional tensor analysis algorithms are twofold 1 a closed form solution instead of iterative sub optimal solution as conventionally is derived for estimating the extra factor mode of any test image and 2 the classification capability is enhanced by interacting with the process of synthesizing data of all other modes in the k th dimension experiments on the pointing 04 and cmu pie databases for pose and illumination estimation both validate the superiority of the proposed algorithm over conventional algorithms for extra factor estimation

detection and segmentation of generic shapes based on affine modeling of energy in eigenspace this paper presents a novel approach for detection and segmentation of man made generic shapes in cluttered images the set of shapes to be detected are members of affine transformed versions of basic geometric shapes such as rectangles circles etc the shape set is represented by its vectorial edge map transformed over a wide range of affine parameters we use vectorial boundary instead of regular boundary to improve the robustness to noise background clutter and partial occlusion our approach consists of a detection stage and a verification stage in the detection stage we first derive the energy from the principal eigenvectors of the set next an a posteriori probability map of energy distribution is computed from the projection of the edge map representation in a vectorial eigen space local peaks of the posterior probability map are located and indicate candidate detections we use energy probability based detection since we find that the underlying distribution is not gaussian and resembles a hypertoroid in the verification stage each candidate is verified using a fast search algorithm based on a novel representation in angle space and the corresponding pose information of the detected shape is obtained the angular representation used in the verification stage yields better results than a euclidean distance representation experiments are performed in various interfering distortions and robust detection and segmentation are achieved

quadratic projection based feature extraction with its application to biometric recognition this paper presents a novel quadratic projection based feature extraction framework where a set of quadratic matrices is learned to distinguish each class from all other classes we formulate quadratic matrix learning qml as a standard semidefinite programming sdp problem however the conventional interior point sdp solvers do not scale well to the problem of qml for high dimensional data to solve the scalability of qml we develop an efficient algorithm termed dualqml based on the lagrange duality theory to extract nonlinear features to evaluate the feasibility and effectiveness of the proposed framework we conduct extensive experiments on biometric recognition experimental results on three representative biometric recognition tasks including face palmprint and ear recognition demonstrate the superiority of the dualqml based feature extraction algorithm compared to the current state of the art algorithms highlightsa novel quadratic projection based feature extraction framework is developed a set of quadratic matrices is learnt to distinguish each class from other classes quadratic matrix learning qml is formulated as an sdp problem an efficient algorithm is developed to solve qml based on lagrange duality theory experiments on biometric recognition show the effectiveness of our algorithm