18125681
A Speaker Tracking Algorithm Based on Audio and Visual Information Fusion Using Particle Filter
Object tracking by sensor fusion has become an active research area in recent years, but how to fuse various information in an efficient and robust way is still an open problem. This paper presents a new algorithm for tracking speaker based on audio and visual information fusion using particle filter. A closed-loop architecture with reliability of each individual tracker is adopted, and a new method for data fusion and reliability adjustment is proposed. Experiments show the new algorithm is efficient in fusing information and robust to noise.
2461655
Building the Software Infrastructure for Smart Classroom: From Open Agent Architecture (OAA) to Smart Platform
Smart Classroom is a Smart Space developed to enhance tele-education practice. This paper describes the considerations of bringing forward Smart Platform as the software infrastructure of Smart Classroom system, abandoning the former implementation based on OAA. As a multi-agent system for Smart Space, Smart Platform encompasses following features: spontaneous discovery of runtime environment, automatic management and resolving of agent dependencies, combination of delegated communication and peer-to-peer communication, etc. In addition, a surrogate agent on Smart Platform and Metaglue from MIT is now being developed to inter-connect Smart Classroom with MIT's Intelligent Room to extend their functionality.
349681
Smart Remote Classroom: Creating a Revolutionary Real-Time Interactive Distance Learning System
Real-time interactive virtual classroom is an important type of distance learning. However currently available systems are insufficient in the support of large-scale user access, and neither can they accommodate accessing with heterogeneous devices and networks. Furthermore, these systems are usually desktop-based, which results that the teachers' experience is completely different from teaching in a real classroom. The Smart Remote Classroom project tackles these difficulties through the development of the following technologies: 1) A hybrid application-layer Multicast protocol called TORM and an Adaptive Content Delivery scheme called AMTM. Together they enable large-scale users to access a virtual classroom with different devices and networks at the same time. 2) A dedicated software called SameView, which take use of the proposed TORM and AMTM technology and provide a rich set of functions for teachers and students to efficiently carry out the real-time interactive distance learning. Moreover, SameView can record the whole process of a class into a compound multimedia document for later retrieval and review of the class. 3) An augmented classroom called Smart Classroom, where the user interface of the SameView for the teacher are distributed in and fused with the room space. Thus the teacher can instruct the remote students just like teaching face-to-face in a conventional classroom. All these technologies has been successfully integrated and demonstrated in the prototype system.
118840994
Learning-Based Tracking of Complex Non-Rigid Motion
This paper describes a novel method for tracking complex non-rigid motions by learning the intrinsic object structure.The approach builds on and extends the studies on non-linear dimensionality reduction for object representation,object dynamics modeling and particle filter style tracking.First,the dimensionality reduction and density estimation algorithm is derived for unsupervised learning of object intrinsic representation,and the obtained non-rigid part of object state reduces even to 2-3 dimensions.Secondly the dynamical model is derived and trained based on this intrinsic representation.Thirdly the learned intrinsic object structure is integrated into a particle filter style tracker.It is shown that this intrinsic object representation has some interesting properties and based on which the newly derived dynamical model makes particle filter style tracker more robust and reliable.Extensive experiments are done on the tracking of challenging non-rigid motions such as fish twisting with selfocclusion,large inter-frame lip motion and facial expressions with global head rotation.Quantitative results are given to make comparisons between the newly proposed tracker and the existing tracker.The proposed method also has the potential to solve other type of tracking problems.
34660993
Three-dimensional animated face modeling from stereo video
3D modeling of human face has been an active research topic in computer vision and computer graphics communities. In this paper we develop a face-modeling system from calibrated stereo video input. The stereo configuration is chosen according to the characteristics of the face structure. For data capturing the subject sits in front of the calibrated stereo video cameras and rotates his/her head from front view to side view. Then we can create his/her 3D face model with realistic texture mapped, which is ready for MPEG-4 compatible facial animation, by adapting a generic wireframe model to the input. In deciding 3D face geometry we utilize two kinds of 2D information. One is the correspondence between stereo pair; the other is self-occluded contour. After some 3D points in the specific face are obtained from both image clues in different frames, RBF (Radius Basis Function) data interpolation is performed to decide its shape. Afterwards texture image is generated from the face geometry and video. Experiments show that satisfactory results can be reached with our system.
2259255
Error analysis of pure rotation-based self-calibration
Self-calibration using pure rotation is a well-known technique and has been shown to be a reliable means for recovering intrinsic camera parameters. However, in practice, it is virtually impossible to ensure that the camera motion for this type of self-calibration is a pure rotation. In this paper, we present an error analysis of recovered intrinsic camera parameters due to the presence of translation. We derived closed-form error expressions for a single pair of images with nondegenerate motion; for multiple rotations for which there are no closed-form solutions, analysis was done through repeated experiments. Among others, we show that translation-independent solutions do exist under certain practical conditions. Our analysis can be used to help choose the least error-prone approach (if multiple approaches exist) for a given set of conditions.
10302711
Fast evaluation of the improved Loop's subdivision surfaces
For obtaining better curvature distributions of subdivision surfaces, various improvements for Loop's subdivision scheme (C. Loop, 1987) on triangular surface meshes have been made. A careful analysis shows that the fast evaluation technique of the subdivision surface proposed by Stam is no longer usable to these improved schemes. This paper describes a fast evaluating algorithm for improved Loop's subdivision surfaces. The algorithm is applicable to a vast class of subdivision schemes for triangular surface meshes. Using the proposed algorithm, one can evaluate the subdivision surface at any domain point for any set of input subdivision masks and a control mesh.
11706299
An Efficient Algorithm for Determining 3-D Bi-plane Imaging Geometry
Biplane projection imaging is one of the primary methods for imaging and visualizing the cardiovascular systems in medicine. A key problem in such a technique is to determine the imaging geometry (i.e., the rotation and translation) of two projections so that the 3-D structure can be accurately reconstructed. Based on interesting observations and efficient geometric techniques, we present in this paper a new algorithmic solution for this problem. Comparing with existing optimization-based approaches, our technique yields better accuracy, has bounded execution time, and thus is more suitable for on-line applications. Our technique can easily deal with outliers for further improving the accuracy.
207188596
Efficient Algorithms for Determining 3-D Bi-Plane Imaging Geometry
Biplane projection imaging is one of the primary methods for imaging and visualizing the cardiovascular system in medicine. A key problem in such a technique is to determine the imaging geometry (i.e., the relative rotation and translation) of two projections so that the 3-D structure can be accurately reconstructed. Based on interesting observations and efficient geometric techniques, we present in this paper new algorithmic solutions for this problem. Comparing with existing optimization-based approaches, our techniques yield better accuracy and have bounded execution time, thus is more suitable for on-line applications. Our techniques can easily detect outliers to further improve the accuracy.
9063634
Hierarchical multiresolution reconstruction of shell surfaces
We present an adaptive, hierarchical Hh-multiresolution reconstruction algorithm to model shell surface objects from a matched pair of triangulated surfaces. Shell surfaces are an interval of contours of trivariate functions with prismatic support. In the H-direction, a hierarchical representation of the scaffold is constructed. For any adaptively extracted scaffold from the hierarchy, a sequence of functions in the h-direction (regularly subdivided mesh) is constructed so that their contours approximate the input shell to within a given error e. The shell surfaces can be made to capture sharp curve creases on the shell while being C1 smooth everywhere else. Using an interval of iso-contours of smooth trivariate spline functions, rather than a pair of inner and outer surface splines, one avoids the need for interference checks between the inner and outer surface boundaries.
8459751
Low voltage test in place of fast clock in DDSI delay test
By testing the CUT at lower supply voltages, the CUT slows down and thus slow, low-cost testers can be used to perform DDSI (defect detection within slack intervals) tests. Apart from this, because the delay fault size is known in a DDSI test, this information can be further used to diagnose the causing mechanism behind the delay faults. Experimental results are presented to investigate the potential of the method.