14993996
3D Statistical Shape Models Using Direct Optimisation of Description Length
We describe an automatic method for building optimal 3D statistical shape models from sets of training shapes. Although shape models show considerable promise as a basis for segmenting and interpreting images, a major drawback of the approach is the need to establish a dense correspondence across a training set of example shapes. It is important to establish the correct correspondence, otherwise poor models can result. In 2D, this can be achieved using manual 'landmarks', but in 3D this becomes impractical. We show it is possible to establish correspondences automatically, by casting the correspondence problem as one of finding the 'optimal' parameterisation of each shape in the training set. We describe an explicit representation of surface parameterisation, that ensures the resulting correspondences are legal, and show how this representation can be manipulated to minimise the description length of the training set using the model. This results in compact models with good generalisation properties. Results are reported for two sets of biomedical shapes, showing significant improvement in model properties compared to those obtained using a uniform surface parameterisation.
626048
Corresponding Articular Cartilage Thickness Measurements in the Knee Joint by Modelling the Underlying Bone
We present a method for corresponding and combining cartilage thickness readings from a population of patients using the underlying bone structure as a reference. Knee joint femoral bone and cartilage surfaces are constructed from a set of parallel slice segmentations of MR scans. Correspondence points across a population of bone surfaces are defined and refined by minimising an objective function based on the Minimum Description Length of the resulting statistical shape model. The optimised bone model defines a set of corresponding locations from which 3D measurements of the cartilage thickness can be taken and combined for a population of patients. Results are presented for a small group of patients demonstrating the feasibility and potential of the approach as a means of detecting sub-millimetre cartilage thickness changes due to disease progression.
29977859
Measuring similarity between pixel signatures
33520001
Active Appearance Models
We describe a new method of matching statistical models of appearance to images. A set of model parameters control modes of shape and gray-level variation learned from a training set. We construct an efficient iterative matching algorithm by learning the relationship between perturbations in the model parameters and the induced image errors.
6527681
The use of kernel principal component analysis to model data distributions
Abstract We describe the use of kernel principal component analysis (KPCA) to model data distributions in high-dimensional spaces. We show that a previous approach to representing non-linear data constraints using KPCA is not generally valid, and introduce a new ‘proximity to data’ measure that behaves correctly. We investigate the relation between this measure and the actual density for various low-dimensional data distributions. We demonstrate the effectiveness of the method by applying it to the higher-dimensional case of modelling an ensemble of images of handwritten digits, showing how it can be used to extract the digit information from noisy input images.
13018667
Transforming Pixel Signatures into an Improved Metric Space
1646981
Reconstruction of Linearly Parameterized Models from Single Images with a Camera of Unknown Focal Length
This paper deals with the problem of recovering the dimensions of an object and its pose from a single image acquired with a camera of unknown focal length. It is assumed that the object in question can be modeled as a polyhedron where the coordinates of the vertices can be expressed as a linear function of a dimension vector. The reconstruction program takes as input, a set of correspondences between features in the model and features in the image. From this information, the program determines an appropriate projection model for the camera, the dimensions of the object, its pose relative to the camera and, in the case of perspective projection, the focal length of the camera. This paper describes how the reconstruction problem can be framed as an optimization over a compact set with low dimension (no more than four). This optimization problem can be solved efficiently by coupling standard nonlinear optimization techniques with a multistart method. The result is an efficient, reliable solution system that does not require initial estimates for any of the parameters being estimated.
2609415
Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach
We present a new approach for modeling and rendering existing architectural scenes from a sparse set of still photographs. Our modeling approach, which combines both geometry-based and imagebased techniques, has two components. The first component is a photogrammetricmodeling method which facilitates the recovery of the basic geometry of the photographed scene. Our photogrammetric modeling approach is effective, convenient, and robust because it exploits the constraints that are characteristic of architectural scenes. The second component is a model-based stereo algorithm, which recovers how the real scene deviates from the basic model. By making use of the model, our stereo technique robustly recovers accurate depth from widely-spaced image pairs. Consequently, our approach can model large architectural environments with far fewer photographs than current image-based modeling approaches. For producing renderings, we present view-dependent texture mapping, a method of compositing multiple views of a scene that better simulates geometric detail on basic models. Our approach can be used to recover models for use in either geometry-based or image-based rendering systems. We present results that demonstrate our approach’s ability to create realistic renderings of architectural scenes from viewpoints far from the original photographs. CR Descriptors: I.2.10 [Artificial Intelligence]: Vision and Scene Understanding Modeling and recovery of physical attributes; I.3.7 [Computer Graphics]: Three-Dimensional Graphics and Realism Color, shading, shadowing, and texture I.4.8 [Image Processing]: Scene Analysis Stereo; J.6 [Computer-Aided Engineering]: Computer-aided design (CAD).
14456844
Exploration strategies for mobile robots
The problem of programming a robot to carry out a systematic exploration of its environment using realistic sensors is considered. The robot is modeled as a single point moving in a two-dimensional configuration space populated with visually opaque and transparent obstacles. The robot is equipped with proximity sensors, a vision-based recognition system, and a method of odometry, all of which have some uncertainty associated with their measurements. By using visually distinctive configurations of features in the world as natural landmarks, a series of local maps is constructed. The geometrical relationships between mutually visible landmarks are used to build a relational map from this collection of local maps. This representation forms the basis for a systematic exploration algorithm. The approach is implemented in simulation, and results are presented.<<ETX>>
3172134
VideoPlus: A Method for Capturing the Structure and Appearance of Immersive Environments
This paper describes an approach to capturing the appearance and structure of immersive environments based on the video imagery obtained with an omnidirectional camera system. The scheme proceeds by recovering the 3D positions of a set of point and line features in the world from image correspondences in a small set of key frames in the image sequence. Once the locations of these features have been recovered the position of the camera during every frame in the sequence can be determined by using these recovered features as fiducials and estimating camera pose based on the location of corresponding image features in each frame. The end result of the procedure is an omnidirectional video sequence where every frame is augmented with its pose with respect to an absolute reference frame and a 3D model of the environment composed of point and line features in the scene.By augmenting the video clip with pose information we provide the viewer with the ability to navigate the image sequence in new and interesting ways. More specifically the user can use the pose information to travel through the video sequence with a trajectory different from the one taken by the original camera operator. This freedom presents the end user with an opportunity to immerse themselves within a remote environment.
207655806
Environmental time series analysis and forecasting with the Captain toolbox
The Data-Based Mechanistic (DBM) modelling philosophy emphasises the importance of parametrically efficient, low order, 'dominant mode' models, as well as the development of stochastic methods and the associated statistical analysis required for their identification and estimation. Furthermore, it stresses the importance of explicitly acknowledging the basic uncertainty in the process, which is particularly important for the characterisation and forecasting of environmental and other poorly defined systems. The paper focuses on a Matlab^(R) compatible toolbox that has evolved from this DBM modelling research. Based around a state space and transfer function estimation framework, Captain extends Matlab^(R) to allow, in the most general case, for the identification and estimation of a wide range of unobserved components models. Uniquely, however, Captain focuses on models with both time variable and state dependent parameters and has recently been implemented with the latest methodological developments in this regard. Here, the main innovations are: the automatic optimisation of the hyper-parameters, which define the statistical properties of the time variable parameters; the provision of smoothed as well as filtered parameter estimates; the robust and statistically efficient identification and estimation of both discrete and continuous time transfer function models; and the availability of various special model structures that have wide application potential in the environmental sciences.