7180811
Calibrating pan-tilt cameras in wide-area surveillance networks
Pan-tilt cameras are often used as components of wide-area surveillance systems. It is necessary to calibrate these cameras in relation to one another in order to obtain a consistent representation of the entire space. Existing methods for calibrating pan-tilt cameras have assumed an idealized model of camera mechanics. In addition, most methods have been calibrated using only a small range of camera motion. We present a method for calibrating pan-tilt cameras that introduces a more complete model of camera motion. Pan and tilt rotations are modeled as occurring around arbitrary axes in space. In addition, the wide area surveillance system itself is used to build a large virtual calibration object, resulting in better calibration than would be possible with a single small calibration target. Finally, the proposed enhancements are validated experimentally, with comparisons showing the improvement provided over more traditional methods.
12006498
Computing depth under ambient illumination using multi-shuttered light
Range imaging has become a critical component of many computer vision applications. The quality of the depth data is of critical importance, but so is the need for speed. Shuttered light-pulse (SLP) imaging uses active illumination hardware to provide high quality depth maps at video frame rates. Unfortunately, current analytical models for deriving depth from SLP imagers are specific to the number of shutters and have a number of deficiencies. As a result, depth estimation often suffers from bias due to object reflectivity, incorrect shutter settings, or strong ambient illumination such as that encountered outdoors. These limitations make SLP imaging unsuitable for many applications requiring stable depth readings. This paper introduces a method that is general to any number of shutters. Using three shutters, the new method produces invariant estimates under changes in ambient illumination, producing high quality depth maps in a wider range of situations.
16145112
Mosaics of scenes with moving objects
Image mosaics are useful for a variety of tasks in vision and computer graphics. A particularly convenient way to generate mosaics is by 'stitching' together many ordinary photographs. Existing algorithms focus on capturing static scenes. This paper presents a complete system for creating visually pleasing mosaics in the presence of moving objects. There are three primary contributions. The first component of our system is a registration method that remains unbiased by movement-the Mellin transform is extended to register images related by a projective transform. Second an efficient method for finding a globally consistent registration of all images is developed. By solving a linear system of equations, derived from many pairwise registration matrices, we find an optimal global registration. Lastly, a new method of compositing images is presented. Blurred areas due to moving objects are avoided by segmenting the mosaic into disjoint regions and sampling pixels in each region from a single source image.
147709
Spacetime stereo: a unifying framework for depth from triangulation
Depth from triangulation has traditionally been investigated in a number of independent threads of research, with methods such as stereo, laser scanning, and coded structured light considered separately. We propose a common framework called spacetime stereo that unifies and generalizes many of these previous methods. To show the practical utility of the framework, we develop two new algorithms for depth estimation: depth from unstructured illumination change and depth estimation in dynamic scenes. Based on our analysis, we show that methods derived from the spacetime stereo framework can be used to recover depth in situations in which existing methods perform poorly.
15670831
An expressive three-mode principal components model of human action style
We present a three-mode expressive-feature model for representing and recognizing performance styles of human actions. A set of style variations for an action are initially arranged into a three-mode data representation (body pose, time, style) and factored into its three-mode principal components to reduce the data dimensionality. We next embed tunable weights on trajectories within the sub-space model to enable different context-based style estimations. We outline physical and perceptual parameterization methods for choosing style labels for the training data, from which we automatically learn the necessary expressive weights using a gradient descent procedure. Experiments are presented examining several motion-capture walking variations corresponding to carrying load, gender, and pace. Results demonstrate a greater flexibility of the expressive three-mode model, over standard squared-error style estimation, to adapt to different style matching criteria.
10444578
A reliable-inference framework for recognition of human actions
We present an action recognition method based on the concept of reliable inference. Our approach is formulated in a probabilistic framework using posterior class ratios to verify the saliency of an input before committing to any action classification. The framework is evaluated in the context of walking, running, and standing at multiple viewpoints and compared to ML and MAP approaches. Results examining individual silhouette images with the framework demonstrate that these actions can be reliably discriminated while discounting confusing images.
16142452
Differential video coding of face and gesture events in presentation videos
Currently, bandwidth limitations pose a major challenge for delivering high-quality multimedia information over the Internet to users. In this research, we aim to provide a better compression of presentation videos (e.g., lectures). The approach is based on the idea that people tend to pay more attention to the face and gesturing hands, and therefore these regions are given more resolution than the remaining image. Our method first detects and tracks the face and hand regions using color-based segmentation and Kalman filtering. Next, different classes of natural hand gesture are recognized from the hand trajectories by identifying gesture holds, position/velocity changes, and repetitive movements. The detected face/ hand regions and gesture events in the video are then encoded at higher resolution than the remaining lower-resolution background. We present results of the tracking and gesture recognition approach, and evaluate and compare videos compressed with the proposed method to uniform compression.
62531827
Robust detection of people in thermal imagery
We present a new contour analysis technique to detect people in thermal imagery. Background-subtraction is first used to identify local regions-of-interest. Gradient information within each region is then combined into a contour saliency map. To extract contour fragments, a watershed-based selection algorithm is used. A path-constrained A* search is employed to complete any broken contours, from which silhouettes are formed. Results using thermal video sequences demonstrate the capability of the approach to robustly detect people across a wider range of environmental conditions than is possible with standard approaches.
14802063
Minimal-latency human action recognition using reliable-inference
We present a probabilistic reliable-inference framework to address the issue of rapid detection of human actions with low error rates. The approach determines the shortest video exposures needed for low-latency recognition by sequentially evaluating a series of posterior ratios for different action classes. If a subsequence is deemed unreliable or confusing, additional video frames are incorporated until a reliable classification to a particular action can be made. Results are presented for multiple action classes and subsequence durations, and are compared to alternative probabilistic approaches. The framework provides a means to accurately classify human actions using the least amount of temporal information.