18263167
Efficient Fourier-Based Approach for Detecting Orientations and Occlusions in Epipolar Plane Images for 3D Scene Modeling
This paper presents a Fourier-based approach for automatically constructing a 3D panoramic model of a natural scene from a video sequence. The video sequences could be captured by an unstabilized camera mounted on a moving platform on a common road surface. As the input of the algorithms, “seamles” panoramic view images (PVIs) and epipolar plane images (EPIs) are generated after image stabilization if the camera is unstabilized. A novel panoramic EPI analysis method is proposed that combines the advantages of both PVIs and EPIs efficiently in three important steps: locus orientation detection in the Fourier frequency domain, motion boundary localization in the spatio-temporal domain, and occlusion/resolution recovery only at motion boundaries. The Fourier energy-based approaches in literature were usually for low-level local motion analysis and are therefore not accurate for 3D reconstruction and are also computationally expensive. Our panoramic EPI analysis approach is both accurate and efficient for 3D reconstruction. Examples of layered panoramic representations for large-scale 3D scenes from real world video sequences are given.
118840994
Learning-Based Tracking of Complex Non-Rigid Motion
This paper describes a novel method for tracking complex non-rigid motions by learning the intrinsic object structure.The approach builds on and extends the studies on non-linear dimensionality reduction for object representation,object dynamics modeling and particle filter style tracking.First,the dimensionality reduction and density estimation algorithm is derived for unsupervised learning of object intrinsic representation,and the obtained non-rigid part of object state reduces even to 2-3 dimensions.Secondly the dynamical model is derived and trained based on this intrinsic representation.Thirdly the learned intrinsic object structure is integrated into a particle filter style tracker.It is shown that this intrinsic object representation has some interesting properties and based on which the newly derived dynamical model makes particle filter style tracker more robust and reliable.Extensive experiments are done on the tracking of challenging non-rigid motions such as fish twisting with selfocclusion,large inter-frame lip motion and facial expressions with global head rotation.Quantitative results are given to make comparisons between the newly proposed tracker and the existing tracker.The proposed method also has the potential to solve other type of tracking problems.
349681
Smart Remote Classroom: Creating a Revolutionary Real-Time Interactive Distance Learning System
Real-time interactive virtual classroom is an important type of distance learning. However currently available systems are insufficient in the support of large-scale user access, and neither can they accommodate accessing with heterogeneous devices and networks. Furthermore, these systems are usually desktop-based, which results that the teachers' experience is completely different from teaching in a real classroom. The Smart Remote Classroom project tackles these difficulties through the development of the following technologies: 1) A hybrid application-layer Multicast protocol called TORM and an Adaptive Content Delivery scheme called AMTM. Together they enable large-scale users to access a virtual classroom with different devices and networks at the same time. 2) A dedicated software called SameView, which take use of the proposed TORM and AMTM technology and provide a rich set of functions for teachers and students to efficiently carry out the real-time interactive distance learning. Moreover, SameView can record the whole process of a class into a compound multimedia document for later retrieval and review of the class. 3) An augmented classroom called Smart Classroom, where the user interface of the SameView for the teacher are distributed in and fused with the room space. Thus the teacher can instruct the remote students just like teaching face-to-face in a conventional classroom. All these technologies has been successfully integrated and demonstrated in the prototype system.
2461655
Building the Software Infrastructure for Smart Classroom: From Open Agent Architecture (OAA) to Smart Platform
Smart Classroom is a Smart Space developed to enhance tele-education practice. This paper describes the considerations of bringing forward Smart Platform as the software infrastructure of Smart Classroom system, abandoning the former implementation based on OAA. As a multi-agent system for Smart Space, Smart Platform encompasses following features: spontaneous discovery of runtime environment, automatic management and resolving of agent dependencies, combination of delegated communication and peer-to-peer communication, etc. In addition, a surrogate agent on Smart Platform and Metaglue from MIT is now being developed to inter-connect Smart Classroom with MIT's Intelligent Room to extend their functionality.
16605844
VISATRAM: a real-time vision system for automatic traffic monitoring
Abstract This paper presents a novel approach to automatic traffic monitoring using 2D spatio-temporal images. A TV camera is mounted above a highway to monitor the traffic through two slice windows, and a panoramic view image and an epipolar plane image are formed for each lane. Our real-time vision system for automatic traffic monitoring, VISATRAM, is an inexpensive system with a PC486 and a frame grabber. The system cannot only count vehicles and estimate their speeds but also classify them using 3D measurements. The system has been tested with real road images under various light conditions, including shadows in daytime and lights at night.
18125681
A Speaker Tracking Algorithm Based on Audio and Visual Information Fusion Using Particle Filter
Object tracking by sensor fusion has become an active research area in recent years, but how to fuse various information in an efficient and robust way is still an open problem. This paper presents a new algorithm for tracking speaker based on audio and visual information fusion using particle filter. A closed-loop architecture with reliability of each individual tracker is adopted, and a new method for data fusion and reliability adjustment is proposed. Experiments show the new algorithm is efficient in fusing information and robust to noise.
10302711
Fast evaluation of the improved Loop's subdivision surfaces
For obtaining better curvature distributions of subdivision surfaces, various improvements for Loop's subdivision scheme (C. Loop, 1987) on triangular surface meshes have been made. A careful analysis shows that the fast evaluation technique of the subdivision surface proposed by Stam is no longer usable to these improved schemes. This paper describes a fast evaluating algorithm for improved Loop's subdivision surfaces. The algorithm is applicable to a vast class of subdivision schemes for triangular surface meshes. Using the proposed algorithm, one can evaluate the subdivision surface at any domain point for any set of input subdivision masks and a control mesh.
14317717
Directional smoothing of triangular meshes
In this paper, we propose a so-called directional smoothing method based mean curvature flow. The selection of the diffusion direction is based on the descent of some energy functional. We show that the directional diffusion flow is volume-preserving. Based on the local directional diffusion flow, we present a feature-preserving smoothing method. Finally, we provide a series of examples to graphically demonstrate the quality of our results.
5553082
Smooth Shell Construction with Mixed Prism Fat Surfaces
Several naturally occurring as well as manufactured objects have shell like structures, that is their boundaries consist of surfaces with thickness. In an earlier paper, we have provided a reconstruction algorithm for such shell structures using smooth fat surfaces within three-sided prisms. In this paper, we extend the approach to a scaffolding consisting of three and four-sided prisms. Within each prism the constructed function is converted to a spline representation. In addition to the adaptive feature of our earlier scheme, the new scheme has the following extensions: (a) four sided fat patches are employed; (b) the size of individual fat patches are bigger; (c) fairing techniques are combined to obtain nicely shaped fat surfaces.
840004
Discrete Laplace-Beltrami operators and their convergence
The convergence property of the discrete Laplace-Beltrami operators is the foundation of convergence analysis of the numerical simulation process of some geometric partial differential equations which involve the operator. In this paper we propose several simple discretization schemes of Laplace-Beltrami operators over triangulated surfaces. Convergence results for these discrete Laplace-Beltrami operators are established under various conditions. Numerical results that support the theoretical analysis are given. Application examples of the proposed discrete Laplace-Beltrami operators in surface processing and modelling are also presented.
30893886
Delay Defect Characterization Using Low Voltage Test
For nanometer designs, many subtle defects lead to excessive delays in signal paths that cause reliability concerns. Traditional test-based diagnosis methods can only identify the failing nodes without the capability to tell the defect nature behind the observed delay faults. This differentiation is important for gathering accurate defect statistics for process improvement during yield ramp-up. In this paper we presented an effective delay defect analysis methodology that can quickly categorize the delay defects into either transistor related defects or resistive interconnect defects. The new delay defect/failure characterization method is based on low voltage test and delay defect detection in slack interval (DDSI) method. Experimental results were presented to validate the effectiveness of the new method. Practical considerations were also addressed for adoption of the methodology.