3869848
Modelling Facial Behaviours
We consider the problem of learning how a person’ s face behaves in a long video sequence, with the aim of synthesising convincing sequences demonstrating the same behaviours. We describe a novel approach to segment a sequence into short sections, each representing a distinct action (or a part of an action). These sections are grouped and a model of the variability of the action learnt. A variable length Markov model is trained on the sequence of such actions to learn the temporal relationships. The result is a system that can generate realistic sequences of an individual face.
18409496
Building optimal 2D statistical shape models
Statistical shape models are used widely as a basis for segmenting and interpreting images. A major drawback of the approach is the need, during training, to establish a dense correspondence across a training set of segmented shapes. We show that model construction can be treated as an optimisation problem, automating the process and guaranteeing the effectiveness of the resulting models. This is achieved by optimising an objective function with respect to the correspondence. We use an information theoretic objective function that directly promotes desirable features of the model. This is coupled with an effective method of manipulating correspondence, based on reparameterising each training shape, to build optimal statistical shape models. The method is evaluated on several training sets of shapes, showing that it constructs better models than alternative approaches. q 2003 Elsevier B.V. All rights reserved.
117576
Transforming pixel signatures into an improved metric space
Abstract We address the problem of using scale-orientation pixel signatures to characterise local structure in X-ray mammograms, though the method we report is of general application. When signatures are treated as vectors for statistical analysis, the Euclidean metric is not well behaved. We have previously described a Best Partial Match (BPM) metric that measures signature similarity more naturally, but at high computational cost. We present a method for transforming signatures into a new space in which Euclidean distance approximates BPM distance, allowing BPM distance to be estimated at low computational cost. The new space is constructed using multi-dimensional scaling. The nonlinear transformation between the old and new spaces is learned using support vector regression. We present experimental results for mammographic data.
35191926
Automatic Extraction of the Face Identity-Subspace
Facial variation divides into a number of functional subspaces, and ensemblespecific variation. An improved method of measuring these is presented, within the space defined by an Appearance Model. Initial estimates of the subspaces (lighting, pose, identity and expression) are obtained by Principal Components Analysis on appropriate groups of faces. An expectationmaximization algorithm is applied to image codings to maximise the probability of coding across these non-orthogonal subspaces. Ensemble specific variation is then removed by measuring the spatial predictability of the eigenvectors excluding those which are less predictable than the ensemble. These procedures significantly enhance identity recognition for a disjoint test set.
17273589
Developing a Measure of Similarity between Pixel Signatures
Our previous work in computer-aided mammography has used scaleorientation pixel signatures that provide a rich description of local structure. We describe work using the transportation (`earth mover') algorithm to de ne a measure of similarity between two signatures that recognises similar structures whilst remaining robust to background variability and the presence of other structures. Speci cally, we investigate an un-normalised, normalised and novel best-partialmatching (BPM) approach to measuring this transportation distance and compare it with Euclidean distance. Receiver operating characteristic (ROC) methodology is used to compare performance and an example of clinical application is given. The BPM approach outperforms the other methods.
9944487
Constrained Active Appearance Models
Active Appearance Models (AAMs) have been shown to be useful for interpreting images of deformable objects. Here we place the AAM matching algorithm in a statistical framework, allowing extra constraints to be applied. This enables the models to be combined with other methods of object location. We demonstrate how user interaction can be used to guide the search and give results of experiments showing the effect of constraints on the performance of model matching.
1277199
Modeling and minimization of interconnect energy dissipation in nanometer technologies
As the technology sizes of semiconductor devices continue to decrease, the effect of nanometer technologies on interconnects, such as crosstalk glitches and timing variations, become more significant. In this paper, we study the effect of nanometer technologies on energy dissipation in interconnects. We propose a new power estimation technique which considers DSM effects, resulting in significantly more accurate energy dissipation estimates than transition-count based methods for on-chip interconnects. We also introduce an energy minimization technique which attempts to minimize large voltage swings across the cross-coupling capacitances between interconnects. Even though the number of transitions may increase, our method yields a decrease in power consumption of up to 50%.
3100813
Robust visual servoing based on relative orientation
In this paper the problem of controlling the spatial position and orientation of a robotic platform based on the image data obtained from a video camera mounted on that platform is considered. More specifically, we propose control laws that generate translational and angular velocities that will cause the robot to achieve and maintain a fixed position and orientation with respect to a set of feature points in the scene. The proposed control schemes make use of well established techniques for computing estimates for the relative orientation of two camera positions from a set of feature correspondences. An important advantage of these control schemes is that it is possible to demonstrate analytically that they are globally convergent even in the presence of large calibration errors in both the intrinsic parameters of the camera and in the extrinsic parameters which relate the frame of reference of the camera to the body frame of the robot platform which is being controlled. Furthermore no a priori knowledge about the structure of the scene is assumed.
1646981
Reconstruction of Linearly Parameterized Models from Single Images with a Camera of Unknown Focal Length
This paper deals with the problem of recovering the dimensions of an object and its pose from a single image acquired with a camera of unknown focal length. It is assumed that the object in question can be modeled as a polyhedron where the coordinates of the vertices can be expressed as a linear function of a dimension vector. The reconstruction program takes as input, a set of correspondences between features in the model and features in the image. From this information, the program determines an appropriate projection model for the camera, the dimensions of the object, its pose relative to the camera and, in the case of perspective projection, the focal length of the camera. This paper describes how the reconstruction problem can be framed as an optimization over a compact set with low dimension (no more than four). This optimization problem can be solved efficiently by coupling standard nonlinear optimization techniques with a multistart method. The result is an efficient, reliable solution system that does not require initial estimates for any of the parameters being estimated.
3172134
VideoPlus: A Method for Capturing the Structure and Appearance of Immersive Environments
This paper describes an approach to capturing the appearance and structure of immersive environments based on the video imagery obtained with an omnidirectional camera system. The scheme proceeds by recovering the 3D positions of a set of point and line features in the world from image correspondences in a small set of key frames in the image sequence. Once the locations of these features have been recovered the position of the camera during every frame in the sequence can be determined by using these recovered features as fiducials and estimating camera pose based on the location of corresponding image features in each frame. The end result of the procedure is an omnidirectional video sequence where every frame is augmented with its pose with respect to an absolute reference frame and a 3D model of the environment composed of point and line features in the scene.By augmenting the video clip with pose information we provide the viewer with the ability to navigate the image sequence in new and interesting ways. More specifically the user can use the pose information to travel through the video sequence with a trajectory different from the one taken by the original camera operator. This freedom presents the end user with an opportunity to immerse themselves within a remote environment.
6301159
The Image Fidelity Assessor
In this paper we describe the Image Fidelity Assessor (IFA), a model of the human visual system designed to evaluate perceived fidelity. In particular, we describe the structure of the model, present results from a contrast discrimination experiment used within the model, and demonstrate preliminary results of the model. The IFA is designed to be both physiologically and psychophysically plausible. It consists of a multichannel Gabor pyramid decomposition. The fidelity at each spatial location within each channel is evaluated based on psychometric functions. The psychometric functions were determined experimentally and describe the discrimination ability of the visual system as a function of spatial frequency, orientation, and adaptation level. Limited memory probability summation across the visual channels is used to obtain a measure of perceived image fidelity. Preliminary results of the IFA are consistent with human evaluation of image fidelity.