9676949
Automatic recognition of eye blinking in spontaneously occurring behavior
Previous research in automatic facial expression recognition has been limited to recognition of gross expression categories (e.g., joy or anger) in posed facial behavior under well-controlled conditions (e.g., frontal pose and minimal out-of-plane head motion). We developed a system that detects discrete and important facial actions, (e.g., eye blinking), in spontaneously occurring facial behavior with non-frontal pose, moderate out-of-plane head motion, and occlusion. The system recovers 3D motion parameters, stabilizes facial regions, extracts motion and appearance information, and recognizes discrete facial actions in spontaneous facial behavior. We tested the system in video data from a 2-person interview. Subjects were ethnically diverse, action units occurred during speech, and out-of-plane motion and occlusion from head motion and glasses were common. The video data were originally collected to answer substantive questions in psychology, and represent a substantial challenge to automated AU recognition. In the analysis of 335 single and multiple blinks and non-blinks, the system achieved 98% accuracy.
3016958
Multiple frame motion inference using belief propagation
We present an algorithm for automatic inference of human upper body motion. A graph model is proposed for inferring human motion, and motion inference is posed as a mapping problem between state nodes in the graph model and features in image patches. Belief propagation is utilized for Bayesian inference in this graph. A multiple-frame inference model/algorithm is proposed to combine both structural and temporal constraints in human motion. We also present a method for capturing constraints of human body configuration under different view angles. The algorithm is applied in a prototype system that can automatically label upper body motion from videos, without manual initialization of body parts.
16214442
An adaptive algorithm for text detection from natural scenes
We present a new adaptive algorithm for automatic detection of text from a natural scene. The initial cues of text regions are first detected from the captured image/video. An adaptive color modeling and searching algorithm is then utilized near the initial text cues, to discriminate text/non-text regions. EM optimization algorithm is used for color modeling, under the constraint of text layout relations for a specific language. The proposed algorithm combines the advantages of several previous approaches for text detection, and utilizes a focus-of-attention approach for text finding. The whole algorithm is applied in a prototype system that can automatically detect and recognize sign input from a video camera, and translate the signs into English text or voice streams. We present evaluation results of our algorithm on this system.
40124869
Image Pattern Recognition Based on Examples - A Combined Statistical and Structural-Syntactic Approach
An application of combined statistical and structural-syntactic approach in Chinese character recognition is presented. The algorithm adopts a structural representation for Chinese characters, but in the classification and training process, the structural matching and parameter adjustment is conducted in a statistical way. Different from the conventional structural approaches, in this system, only a few predefined "knowledge" is required. In most cases, knowledge acquisition is simplified to "memorization" of examples, and the parameters for classification can be refined using statistical training. In this way it avoids the main difficulties inherent in the implementation of classification systems based on structural features. Compared with conventional statistical algorithms, the algorithm is based on a structural model of image patterns, so it has approximately all the advantages of structural pattern recognition algorithms. A prototype system has been realized based on this strategy, and the effectiveness of the method is verified by the experimental results.
12564805
A multi-Kalman filtering approach for video tracking of human-delineated objects in cluttered environments
In this paper, we propose a new approach that uses a motion-estimation based framework for video tracking of objects in cluttered environments. Our approach is semi-automatic, in the sense that a human is called upon to delineate the boundary of the object to be tracked in the first frame of the image sequence. The approach presented requires no camera calibration; therefore it is not necessary that the camera be stationary. The heart of the approach lies in extracting features and estimating motion through multiple applications of Kalman filtering. The estimated motion is used to place constraints on where to seek feature correspondences; successful correspondences are subsequently used for Kalman-based recursive updating of the motion parameters. Associated with each feature is the frame number in which the feature makes its first appearance in an image sequence. All features that make first-time appearances in the same frame are grouped together for Kalman-based updating of motion parameters. Finally, in order to make the tracked object look visually familiar to the human observer, the system also makes its best attempt at extracting the boundary contour of the object-a difficult problem in its own right since self-occlusion created by any rotational motion of the tracked object would cause large sections of the boundary contour in the previous frame to disappear in the current frame. Boundary contour is estimated by projecting the previous-frame contour into the current frame for the purpose of creating neighborhoods in which to search for the true boundary in the current frame. Our approach has been tested on a wide variety of video sequences, some of which are shown in this paper.
15355925
Customizable virtual private network service with QoS
Abstract In this paper, we propose and implement Virtual Network Service (VNS), a value-added network service for deploying virtual private networks (VPNs) in a managed wide-area IP network. The key feature of VNS is its capability of providing a customer with a VPN that is customizable with management capabilities and performance properties comparable to a dedicated physical network. In addition, VNS ensures confidentiality of data and principals through the use of IPSEC. The main technique underlying VNS is the virtualization of routers in both control and data planes. Virtualization of the control plane enables customizable routing and signaling per VPN. On the data plane, packet forwarding and link bandwidth are virtualized. Virtualization of the forwarding mechanism on the data plane enables forwarding of traffic according to each VPN's topology and policies. Virtualization of the link bandwidth enables each VPN to have guaranteed quality of service (QoS) and customized resource management policies. We have developed a VNS prototype for deployment on the CAIRN network. The VNS prototype implements several resource management mechanisms including packet scheduling, signaling and runtime monitoring. A graphical user interface enables service providers to manage, configure and deploy VPNs remotely.
9243283
Self-occlusion immune video tracking of objects in cluttered environments
We propose a new approach that uses a motion-estimation based framework for video tracking of objects in the presence of self-occlusion in cluttered environments. What makes our work different from others is that, instead of carrying out the motion estimation between two adjacent frames, we tackle the self-occlusion problem from the view of multiple frames. The heart of our approach lies in extracting features appearing in different time frames, genesis frames, and setting up a motion estimation scheme through multiple applications of Kalman filtering based on the different genesis indices. To make the tracked object look visually familiar to the human observer, the system also makes its best attempt at extracting the boundary contour of the object - a difficult problem in its own right, since self-occlusion created by any rotational motion of the tracked object would cause large sections of the boundary contour in the previous frame to disappear in the current frame. Our approach has been tested on a wide variety of video sequences, some of which are presented.
11678491
X-ray computed tomography methods for in vivo evaluation of local drug release systems
Recent advances in drug delivery techniques have necessitated the development of tools for in vivo monitoring of drug distributions. Gamma emission imaging and magnetic resonance imaging suffer from problems of resolution and sensitivity, respectively. We propose that the combination of X-ray CT imaging and image analysis techniques provides an excellent method for the evaluation of the transport of platinum-containing drugs from a localized, controlled release source. We correlated local carboplatin concentration with CT intensity, producing a linear relationship with a sensitivity of 62.6 /spl mu/g/mL per Hounsfield unit. As an example application, we evaluated the differences in drug transport properties between normal and ablated rabbit liver from implanted polymer millirods. The use of three-dimensional visualization provided a method of evaluating the placement of the drug delivery device in relation to the surrounding anatomy, and registration and reformatting allowed the accurate comparison of the sequence of temporal CT volumes acquired over a period of 24 h. Taking averages over radial lines extending away from the center of the implanted millirods and integrating over clinically appropriate regions, yielded information about drug release from the millirod and transport in biological tissues. Comparing implants in normal and ablated tissues, we found that ablation prior to millirod implantation greatly decreased the loss of drug from the immediate area, resulting in a higher average dose to the surrounding tissue. This work shows that X-ray CT imaging is a useful technique for the in vivo evaluation of the pharmacokinetics of platinated agents.
18339723
Automatic video object shape extraction and its classification with camera in motion
In this paper, we present an automatic moving object extraction and classification system. For automatic extraction of object taken by a moving camera, a novel technique is proposed, in which optical flow handles the background modeling and camera motion estimation, and frame difference information yields the exact object shape. We also use forward region boundary based change detection approach for frame difference. This approach assures change detection for uniform intensity regions. For classification, weighted likelihood discriminant based shape classifier is designed. Unlike maximum likelihood (ML) methods, our proposed method utilizes information from all classes to design the classifier. In the description phase of the classifier, curvature features are extracted from the shape and are utilized to build a hidden Markov model (HMM). The HMM provides a robust ML description of the shape. In the discrimination phase, a weighted likelihood discriminant function is introduced, which weights the likelihoods of curvature at individual points of the shape to minimize the classification error. The weights are estimated by generalized probabilistic descent (GPD) method. To demonstrate the performance of the proposed method, we present results achieved for car shapes extraction and classification.