15498523
A framework for sensor planning and control with applications to vision guided multi-robot systems
The paper presents an approach to the problem of controlling the configuration of a team of mobile agents equipped with cameras so as to optimize the quality of the estimates derived from their measurements. The issue of optimizing the robots' configuration is particularly important in the context of teams equipped with vision sensors since most estimation schemes of interest will involve some form of triangulation. We provide a theoretical framework for tackling the sensor planning problem and a practical computational strategy, inspired by work on particle filtering, for implementing the approach. The ideas have been demonstrated both in simulation and on actual robotic platforms. The results indicate that the framework is able to solve fairly difficult sensor planning problems online without requiring excessive amounts of computational resources.
8867506
Robust vision-based pose control
The problem of controlling the spatial position and orientation of a robotic platform based on the image data obtained from a video camera mounted on that platform is considered. More specifically, we propose control laws that will cause the robot to achieve and maintain a fixed position and orientation with respect to a set of feature points in the scene. We demonstrate analytically that the proposed control scheme is globally convergent even in the presence of large calibration errors in both the intrinsic parameters of the camera and in the extrinsic parameters which relate the frame of reference of the camera to the body frame of the robot platform which is being controlled. Furthermore, no a priori knowledge about the structure of the scene is assumed.
3172134
VideoPlus: A Method for Capturing the Structure and Appearance of Immersive Environments
This paper describes an approach to capturing the appearance and structure of immersive environments based on the video imagery obtained with an omnidirectional camera system. The scheme proceeds by recovering the 3D positions of a set of point and line features in the world from image correspondences in a small set of key frames in the image sequence. Once the locations of these features have been recovered the position of the camera during every frame in the sequence can be determined by using these recovered features as fiducials and estimating camera pose based on the location of corresponding image features in each frame. The end result of the procedure is an omnidirectional video sequence where every frame is augmented with its pose with respect to an absolute reference frame and a 3D model of the environment composed of point and line features in the scene.By augmenting the video clip with pose information we provide the viewer with the ability to navigate the image sequence in new and interesting ways. More specifically the user can use the pose information to travel through the video sequence with a trajectory different from the one taken by the original camera operator. This freedom presents the end user with an opportunity to immerse themselves within a remote environment.
1646981
Reconstruction of Linearly Parameterized Models from Single Images with a Camera of Unknown Focal Length
This paper deals with the problem of recovering the dimensions of an object and its pose from a single image acquired with a camera of unknown focal length. It is assumed that the object in question can be modeled as a polyhedron where the coordinates of the vertices can be expressed as a linear function of a dimension vector. The reconstruction program takes as input, a set of correspondences between features in the model and features in the image. From this information, the program determines an appropriate projection model for the camera, the dimensions of the object, its pose relative to the camera and, in the case of perspective projection, the focal length of the camera. This paper describes how the reconstruction problem can be framed as an optimization over a compact set with low dimension (no more than four). This optimization problem can be solved efficiently by coupling standard nonlinear optimization techniques with a multistart method. The result is an efficient, reliable solution system that does not require initial estimates for any of the parameters being estimated.
21050185
A Framework and Architecture for Multirobot Coordination
In this paper, we present a framework and the software architecture for the deployment of multiple autonomous robots in an unstructured and unknown environment with applications ranging from scouting and reconnaissance, to search and rescue and manipulation tasks. Our software framework provides the methodology and the tools that enable robots to exhibit deliberative and reactive behaviors in autonomous operation, to be reprogrammed by a human operator at run-time, and to learn and adapt to unstructured, dynamic environments and new tasks, while providing performance guarantees. We demonstrate the algorithms and software on an experimental testbed that involves a team of car-like robots using a single omnidirectional camera as a sensor without explicit use of odometry.
2609415
Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach
We present a new approach for modeling and rendering existing architectural scenes from a sparse set of still photographs. Our modeling approach, which combines both geometry-based and imagebased techniques, has two components. The first component is a photogrammetricmodeling method which facilitates the recovery of the basic geometry of the photographed scene. Our photogrammetric modeling approach is effective, convenient, and robust because it exploits the constraints that are characteristic of architectural scenes. The second component is a model-based stereo algorithm, which recovers how the real scene deviates from the basic model. By making use of the model, our stereo technique robustly recovers accurate depth from widely-spaced image pairs. Consequently, our approach can model large architectural environments with far fewer photographs than current image-based modeling approaches. For producing renderings, we present view-dependent texture mapping, a method of compositing multiple views of a scene that better simulates geometric detail on basic models. Our approach can be used to recover models for use in either geometry-based or image-based rendering systems. We present results that demonstrate our approach’s ability to create realistic renderings of architectural scenes from viewpoints far from the original photographs. CR Descriptors: I.2.10 [Artificial Intelligence]: Vision and Scene Understanding Modeling and recovery of physical attributes; I.3.7 [Computer Graphics]: Three-Dimensional Graphics and Realism Color, shading, shadowing, and texture I.4.8 [Image Processing]: Scene Analysis Stereo; J.6 [Computer-Aided Engineering]: Computer-aided design (CAD).
207655806
Environmental time series analysis and forecasting with the Captain toolbox
The Data-Based Mechanistic (DBM) modelling philosophy emphasises the importance of parametrically efficient, low order, 'dominant mode' models, as well as the development of stochastic methods and the associated statistical analysis required for their identification and estimation. Furthermore, it stresses the importance of explicitly acknowledging the basic uncertainty in the process, which is particularly important for the characterisation and forecasting of environmental and other poorly defined systems. The paper focuses on a Matlab^(R) compatible toolbox that has evolved from this DBM modelling research. Based around a state space and transfer function estimation framework, Captain extends Matlab^(R) to allow, in the most general case, for the identification and estimation of a wide range of unobserved components models. Uniquely, however, Captain focuses on models with both time variable and state dependent parameters and has recently been implemented with the latest methodological developments in this regard. Here, the main innovations are: the automatic optimisation of the hyper-parameters, which define the statistical properties of the time variable parameters; the provision of smoothed as well as filtered parameter estimates; the robust and statistically efficient identification and estimation of both discrete and continuous time transfer function models; and the availability of various special model structures that have wide application potential in the environmental sciences.
5410377
Measuring Geodesic Distances on the Space of Bounded Diffeomorphisms
This paper considers the problem of measuring the differences between deformations. It is intended to be applied in the context of applications such as the analysis of sets of non-rigidly registered medical images, where diffeomorphic warps between pairs of images establish a dense pixel-to-pixel correspondence. We introduce a new spline with explicit boundary conditions, and show how this can be used to generate general flows of bounded diffeomorphisms. Techniques are developed to describe an arbitrary continuous diffeomorphism and to invert and interpolate between such diffeomorphisms. We show how these constructions and the geodesic distance can be used in the analysis of training sets of general diffeomorphic warps.
3993976
A Software Framework for Creating Patient Specific Geometric Models from Medical Imaging Data for Simulation Based Medical Planning of Vascular Surgery
The primary purpose of vascular surgery is to restore blood flow to organs and tissues. Current methods of vascular treatment planning rely solely on diagnostic and empirical data to guide the decision-making process. This paper details a simulation-based medical planning system for cardiovascular disease that use computational methods to evaluate alternative surgical options prior to treatment using patient-specific models of the vascular system. A software framework, called Geodesic, is mtroduced that reduces the time required to build patient-specific models from medical imaging data from several weeks to less than one day.
29977859
Measuring similarity between pixel signatures
45401944
An Efficient Method for Constructing Optimal Statistical Shape Models
Statistical shape models show considerable promise as a basis for segmenting and interpreting images. A major drawback of the approach is the need to establish a dense correspondence across a training set of segmented shapes. By posing the problem as one of minimising the description length of the model, we develop an efficient method that automatically defines a correspondence across a set of shapes. As the correspondence does not use an explicit ordering constraint, it generalises to 3D shapes. Results are given for several different training sets of 2D boundaries, showing the automatic method constructs better models than ones built by hand.