2609415
Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach
We present a new approach for modeling and rendering existing architectural scenes from a sparse set of still photographs. Our modeling approach, which combines both geometry-based and imagebased techniques, has two components. The first component is a photogrammetricmodeling method which facilitates the recovery of the basic geometry of the photographed scene. Our photogrammetric modeling approach is effective, convenient, and robust because it exploits the constraints that are characteristic of architectural scenes. The second component is a model-based stereo algorithm, which recovers how the real scene deviates from the basic model. By making use of the model, our stereo technique robustly recovers accurate depth from widely-spaced image pairs. Consequently, our approach can model large architectural environments with far fewer photographs than current image-based modeling approaches. For producing renderings, we present view-dependent texture mapping, a method of compositing multiple views of a scene that better simulates geometric detail on basic models. Our approach can be used to recover models for use in either geometry-based or image-based rendering systems. We present results that demonstrate our approach’s ability to create realistic renderings of architectural scenes from viewpoints far from the original photographs. CR Descriptors: I.2.10 [Artificial Intelligence]: Vision and Scene Understanding Modeling and recovery of physical attributes; I.3.7 [Computer Graphics]: Three-Dimensional Graphics and Realism Color, shading, shadowing, and texture I.4.8 [Image Processing]: Scene Analysis Stereo; J.6 [Computer-Aided Engineering]: Computer-aided design (CAD).
8867506
Robust vision-based pose control
The problem of controlling the spatial position and orientation of a robotic platform based on the image data obtained from a video camera mounted on that platform is considered. More specifically, we propose control laws that will cause the robot to achieve and maintain a fixed position and orientation with respect to a set of feature points in the scene. We demonstrate analytically that the proposed control scheme is globally convergent even in the presence of large calibration errors in both the intrinsic parameters of the camera and in the extrinsic parameters which relate the frame of reference of the camera to the body frame of the robot platform which is being controlled. Furthermore, no a priori knowledge about the structure of the scene is assumed.
1926044
Real-time vision-based control of a nonholonomic mobile robot
This paper considers the problem of vision-based control of a nonholonomic mobile robot. We describe the design and implementation of real-time estimation and control algorithms on a car-like robot platform using a single omni-directional camera as a sensor without explicit use of odometry. We provide experimental results for each of these vision-based control objects. The algorithms are packaged as control modes and can be combined hierarchically to perform higher level tasks involving multiple robots.
3172134
VideoPlus: A Method for Capturing the Structure and Appearance of Immersive Environments
This paper describes an approach to capturing the appearance and structure of immersive environments based on the video imagery obtained with an omnidirectional camera system. The scheme proceeds by recovering the 3D positions of a set of point and line features in the world from image correspondences in a small set of key frames in the image sequence. Once the locations of these features have been recovered the position of the camera during every frame in the sequence can be determined by using these recovered features as fiducials and estimating camera pose based on the location of corresponding image features in each frame. The end result of the procedure is an omnidirectional video sequence where every frame is augmented with its pose with respect to an absolute reference frame and a 3D model of the environment composed of point and line features in the scene.By augmenting the video clip with pose information we provide the viewer with the ability to navigate the image sequence in new and interesting ways. More specifically the user can use the pose information to travel through the video sequence with a trajectory different from the one taken by the original camera operator. This freedom presents the end user with an opportunity to immerse themselves within a remote environment.
1646981
Reconstruction of Linearly Parameterized Models from Single Images with a Camera of Unknown Focal Length
This paper deals with the problem of recovering the dimensions of an object and its pose from a single image acquired with a camera of unknown focal length. It is assumed that the object in question can be modeled as a polyhedron where the coordinates of the vertices can be expressed as a linear function of a dimension vector. The reconstruction program takes as input, a set of correspondences between features in the model and features in the image. From this information, the program determines an appropriate projection model for the camera, the dimensions of the object, its pose relative to the camera and, in the case of perspective projection, the focal length of the camera. This paper describes how the reconstruction problem can be framed as an optimization over a compact set with low dimension (no more than four). This optimization problem can be solved efficiently by coupling standard nonlinear optimization techniques with a multistart method. The result is an efficient, reliable solution system that does not require initial estimates for any of the parameters being estimated.
14456844
Exploration strategies for mobile robots
The problem of programming a robot to carry out a systematic exploration of its environment using realistic sensors is considered. The robot is modeled as a single point moving in a two-dimensional configuration space populated with visually opaque and transparent obstacles. The robot is equipped with proximity sensors, a vision-based recognition system, and a method of odometry, all of which have some uncertainty associated with their measurements. By using visually distinctive configurations of features in the world as natural landmarks, a series of local maps is constructed. The geometrical relationships between mutually visible landmarks are used to build a relational map from this collection of local maps. This representation forms the basis for a systematic exploration algorithm. The approach is implemented in simulation, and results are presented.<<ETX>>
1277199
Modeling and minimization of interconnect energy dissipation in nanometer technologies
As the technology sizes of semiconductor devices continue to decrease, the effect of nanometer technologies on interconnects, such as crosstalk glitches and timing variations, become more significant. In this paper, we study the effect of nanometer technologies on energy dissipation in interconnects. We propose a new power estimation technique which considers DSM effects, resulting in significantly more accurate energy dissipation estimates than transition-count based methods for on-chip interconnects. We also introduce an energy minimization technique which attempts to minimize large voltage swings across the cross-coupling capacitances between interconnects. Even though the number of transitions may increase, our method yields a decrease in power consumption of up to 50%.
3881938
A Comparison of Face Verification Algorithms using Appearance Models
Statistical models of shape and appearance have been successfully used in face modeling, tracking and synthesis. In this paper we describe experiments using appearance models for face verification. We compare a variety of different algorithms on a standard face database (XM2VTS). We demonstrate that simple methods of correction for head pose and face expression can significantly improve results.
29392800
Performance assessment of face-verification based access control system
In recent years there has been much progress in the development of facial recognition systems. The FERET series of tests reported the black box performance of several such systems working on stored face images. Much less effort has been spent in studying the behaviour of systems under realistic conditions of use. We describe and analyse the result of a trial of a door access control system based on a model-based approach. The trial consisted of 10 registered users making over 200 accesses during a 2 week period. We describe the internal failure modes and the performance characteristics of the system, identify inter- and intra-person dependencies and make recommendations for future work.
16065751
Improving Appearance Model Matching Using Local Image Structure
We show how non-linear representations of local image structure can be used to improve the performance of model matching algorithms in medical image analysis tasks. Rather than represent the image structure using intensity values or gradients, we use measures that indicate the reliability of a set of local image feature detector outputs. These features are image edges, corners, and gradients. Feature detector outputs in flat, noisy regions tend to be ignored whereas those near strong structure are favoured. We demonstrate that combinations of these features give more accurate and reliable matching between models and new images than modelling image intensity alone. We also show that the approach is robust to non-linear changes in contrast, such as those found in multi-modal imaging.
45401944
An Efficient Method for Constructing Optimal Statistical Shape Models
Statistical shape models show considerable promise as a basis for segmenting and interpreting images. A major drawback of the approach is the need to establish a dense correspondence across a training set of segmented shapes. By posing the problem as one of minimising the description length of the model, we develop an efficient method that automatically defines a correspondence across a set of shapes. As the correspondence does not use an explicit ordering constraint, it generalises to 3D shapes. Results are given for several different training sets of 2D boundaries, showing the automatic method constructs better models than ones built by hand.