10673582
Automatic 3D reconstruction for face recognition
An analysis-by-synthesis framework for face recognition with variant pose, illumination and expression (PIE) is proposed in this paper. First, an efficient 2D-to-3D integrated face reconstruction approach is introduced to reconstruct a personalized 3D face model from a single frontal face image with neutral expression and normal illumination. Then, realistic virtual faces with different PIE are synthesized based on the personalized 3D face to characterize the face subspace. Finally, face recognition is conducted based on these representative virtual faces. Compared with other related works, this framework has the following advantages: 1) only one single frontal face is required for face recognition, which avoids the burdensome enrollment work; 2) the synthesized face samples provide the capability to conduct recognition under difficult conditions like complex PIE; and 3) the proposed 2D-to-3D integrated face reconstruction approach is fully automatic and more efficient. The extensive experimental results show that the synthesized virtual faces significantly improve the accuracy of face recognition with variant PIE.
206501510
Head pose estimation using Fisher Manifold learning
Here, we propose a new learning strategy for head pose estimation. Our approach uses nonlinear interpolation to estimate the head pose using the learning result from face images of two head poses. Advantage of our method to regression method is that it only requires training images of two head poses and better generalization ability. It outperforms existed methods, such as regression and multiclass classification method, on both synthesis and real face images. Average head pose estimation error of yaw rotation is about 4/sup 0/, which proves that our method is effective in head pose estimation.
1857778
Boosting image orientation detection with indoor vs. outdoor classification
Automatic detection of image orientation is a very important operation in photo image management. In this paper, we propose an automated method based on the boosting algorithm to estimate image orientations. The proposed method has the capability of rejecting images based on the confidence score of the orientation detection. Also, images are classified into indoor and outdoor, and this classification result is used to further refine the orientation detection. To select features more sensitive to the rotation, we combine the features by subtraction operation and select the most useful features by boosting algorithm. The proposed method has several advantages: small model size, fast classification speed, and effective rejection scheme.
6781663
Parallel Image Matrix Compression for Face Recognition
The canonical face recognition algorithm Eigenface and Fisherface are both based on one dimensional vector representation. However, with the high feature dimensions and the small training data, face recognition often suffers from the curse of dimension and the small sample problem. Recent research [4] shows that face recognition based on direct 2D matrix representation, i.e. 2DPCA, obtains better performance than that based on traditional vector representation. However, there are three questions left unresolved in the 2DPCA algorithm: I ) what is the meaning of the eigenvalue and eigenvector of the covariance matrix in 2DPCA; 2) why 2DPCA can outperform Eigenface; and 3) how to reduce the dimension after 2DPCA directly. In this paper, we analyze 2DPCA in a different view and proof that is 2DPCA actually a "localized" PCA with each row vector of an image as object. With this explanation, we discover the intrinsic reason that 2DPCA can outperform Eigenface is because fewer feature dimensions and more samples are used in 2DPCA when compared with Eigenface. To further reduce the dimension after 2DPCA, a two-stage strategy, namely parallel image matrix compression (PIMC), is proposed to compress the image matrix redundancy, which exists among row vectors and column vectors. The exhaustive experiment results demonstrate that PIMC is superior to 2DPCA and Eigenface, and PIMC+LDA outperforms 2DPC+LDA and Fisherface.
2157887
Concurrent subspaces analysis
A representative subspace is significant for image analysis, while the corresponding techniques often suffer from the curse of dimensionality dilemma. In this paper, we propose a new algorithm, called concurrent subspaces analysis (CSA), to derive representative subspaces by encoding image objects as 2/sup nd/ or even higher order tensors. In CSA, an original higher dimensional tensor is transformed into a lower dimensional one using multiple concurrent subspaces that characterize the most representative information of different dimensions, respectively. Moreover, an efficient procedure is provided to learn these subspaces in an iterative manner. As analyzed in this paper, each sub-step of CSA takes the column vectors of the matrices, which are acquired from the k-mode unfolding of the tensors, as the new objects to be analyzed, thus the curse of dimensionality dilemma can be effectively avoided. The extensive experiments on the 3/sup rd/ order tensor data, simulated video sequences and Gabor filtered digital number image database show that CSA outperforms principal component analysis in terms of both reconstruction and classification capability.
4535096
Coupled kernel-based subspace learning
It was prescriptive that an image matrix was transformed into a vector before the kernel-based subspace learning. In this paper, we take the kernel discriminant analysis (KDA) algorithm as an example to perform kernel analysis on 2D image matrices directly. First, each image matrix is decomposed as the product of two orthogonal matrices and a diagonal one by using singular value decomposition; then an image matrix is expanded to be of higher or even infinite dimensions by applying the kernel trick on the column vectors of the two orthogonal matrices; finally, two coupled discriminative kernel subspaces are iteratively learned for dimensionality reduction by optimizing the Fisher criterion measured by Frobenius norm. The derived algorithm, called coupled kernel discriminant analysis (CKDA), effectively utilizes the underlying spatial structure of objects and the discriminating information is encoded in two coupled kernel subspaces respectively. The experiments on real face databases compared with KDA and Fisherface validate the effectiveness of CKDA.
16979558
Region-based relevance feedback in image retrieval
Relevance feedback and region-based representation of images are two effective ways to improve accuracy in content-based image retrieval. We propose a novel relevance feedback approach based on region representation. It can be considered as a special case of the query point movement method in region-based image retrieval. By assembling all the segmented regions of positive examples together and resizing the regions to emphasize the latest positive examples, we form a composite image as the optimal query. A region-based image similarity measure is used to calculate the distance between the optimal query and an image in the database. An incremental clustering technique is also considered to improve the retrieval efficiency. Experimental results show that the proposed approach is effective in improving the performance of content-based image retrieval systems.
8107037
Forward Shadow Mapping
Forward shadow mapping is a new approach to real-time shadow generation. The traditional shadow map algorithm maps the pixels in the eye’s view backward into the depth buffers of light sources (i.e. shadow maps), which is similiar to and often implemented as an extension to texture mapping. Our algorithm reverses this process by using 3-D image warping techniques to transform shadow map pixels forward into the eye’s view to directly indicate which pixels are lit; it does not interfere with normal texture mapping and easily supports antialiased shadow edges and projective textures. Access to shadow maps and projective textures is in pixel-sequential order. This algorithm has advantages when speed of texture mapping becomes the performance bottleneck, which is often the case in visual simulation and game applications.
2491447
Unsupervised image segmentation using local homogeneity analysis
In this paper, a novel method is presented for unsupervised image segmentation based on local homogeneity analysis. First, a criterion for homogeneity of a certain pattern is proposed. Applying the criterion to local windows in the original image results in the "H-image". The high and low values of the H-image correspond to possible region boundaries and region interiors respectively. Then, a region growing method is used to segment the image based on the H-image. Finally, visually similar regions are merged together to avoid over-segmentation. Experimental results on real images show the effectiveness and robustness of the method.
13620764
Multi-level differential surface representation based on local transformations
One crucial issue of multi-resolution surface representations is how to effectively record and reconstruct geometric details among surface levels. Standard multi-resolution techniques encode details directly as local displacements in the vertices, and may produce unplausible results when the base level endures large deformations. In this paper we propose an alternative detail representation and reconstruction scheme, based on local transformations on a per-triangle basis. While more storage is required, recording details as local transformations favors global coupling of geometric details and allows for large-scale surface manipulations. By modeling the scale components of the surface modifications as a set of deforming factors, we achieved detail-preserving reconstruction results naturally under very large deformations. Comprehensive experimental results verify the efficiency and robustness of our approach.
15756415
Assembly Sequence Planning
The sequence of mating operations that can be carried out to assemble a group of parts is constrained by the geometric and mechanical properties of the parts, their assembled configuration, and the stability of the resulting subassemblies. An approach to representation and reasoning about these sequences is described here and leads to several alternative explicit and implicit plan representations. The Pleiades system will provide an interactive software environment for designers to evaluate alternative systems and product designs through their impact on the feasibility and complexity of the resulting assembly sequences.