17966080
User Concept Pattern Discovery Using Relevance Feedback And Multiple Instance Learning For Content-Based Image Retrieval
Understanding and learning the subjective aspect of humans in Content-Based Image Retrieval has been an active research field during the past few years. However, how to effectively discover users' concept patterns when there are multiple visual features existing in the retrieval system still remains a big issue. In this paper, we propose a multimedia data mining framework that incorporates Multiple Instance Learning into the user relevance feedback in a seamless way to discover the concept patterns of users, especially where the user's most interested region and how to map the local feature vector of that region to the high-level concept pattern of users. This underlying mapping can be progressively discovered through the feedback and learning procedure. The role user plays in the retrieval system is to guide the system mining process to his/her own focus of attention. The retrieval performance is tested under a couple of conditions.
5598037
Supporting Information Reuse for Video Data Indexing by Using Color Information
In this paper, an object tracking framework assisted by image segmentation and color indexing techniques to support information reuse for video data is proposed. In order to obtain more accurate results of object tracking, a color indexing method called Color Label Criteria (CLC) is adopted to relax some of the restrictions and assumptions in object tracking in our previous work with low additional cost. Our experiment results on a real video sequence show that the CLC color indexing method is very helpful to achieve more robust object tracking.
1252952
Information reuse and system integration in the development of a hurricane simulation system
This paper presents our effort in designing and implementing an advanced hurricane simulation system on the platform of the World Wide Web for the purpose of supporting decisional processes and hazard mitigation. The development of the system is based on amalgamated methodologies which come from diverse disciplines and is an integration of a variety of techniques. Superior to other similar systems in hurricane study, our system assembles and utilizes information and techniques in a more flexible and robust manner by taking advantage of system layering technique, component modeling strategy and database technologies. Preliminary experiments have been conducted to demonstrate the performance of the system.
11885669
A decision tree-based multimodal data mining framework for soccer goal detection
We propose a new multimedia data mining framework for the extraction of soccer goal events in soccer videos by using combined multimodal analysis and decision tree logic. The extracted events can be used to index the soccer videos. We first adopt an advanced video shot detection method to produce shot boundaries and some important visual features. Then, the visual/audio features are extracted for each shot at different granularities. This rich multimodal feature set is filtered by a pre-filtering step to clean the noise as well as to reduce the irrelevant data. A decision tree model is built upon the cleaned data set and is used to classify the goal shots. Finally, the experimental results demonstrate the effectiveness of our framework for soccer goal extraction.
5113927
An unsupervised segmentation framework for texture image queries
In this paper a novel unsupervised segmentation framework for texture image queries is presented. The proposed framework consists of an unsupervised segmentation method for texture images, and a multi-filter query strategy. By applying the unsupervised segmentation method on each texture image, a set of texture feature parameters for that texture image can be extracted automatically. Based upon these parameters, an effective multi-filter query strategy which allows the users to issue texture-based image queries is developed The test results of the proposed framework on 318 texture images obtained from the MIT VisTex and Brodatz database are presented to show its effectiveness.
9847925
A multimedia semantic model for RTSP-based multimedia presentation systems
An abstract multimedia semantic model called the multimedia augmented transition network (MATN) model is proposed to model the RTSP-based (real-time streaming protocol) multimedia presentation systems. RTSP provides a set of methods to support the functionality of "VCR-like" remote control on the client side so that users are allowed to control playback of the streaming media. The MATN model is used to model RTSP actions as well as temporal relations and synchronization control of the media streams. The advantages of using the MATN model are its simplicity, effectiveness, and ease of modification. Furthermore, a formal definition of the MATN model and modeling of RTSP actions using the MATN model are presented in detail.
34951978
A Top-Down Fingerprint Image Enhancement Method Based on Fourier Analysis
We present a top-down fingerprint image enhancement method which is based on Fourier analysis Our method takes advantage of two filtering methods in Fourier domain proposed previously and employs a top-down iteration filtering technique, which enables the enhancement procedure not to rely severely on an accurate estimation of ridge frequency and orientation and also enables us to make use of more than the local information in local fingerprint filtering Consequently, our method is robust to handle low quality fingerprint images Results of enhancement are presented for some representative fingerprint images.
30275744
Robust Active Shape Model Construction and Fitting for Facial Feature Localization
Active Shape Model (ASM) has proved to be a powerful tool for interpreting face images. However, it may fail in the presence of non-Gaussian noise, or outliers. In this paper, we present a framework for both automatic model construction and efficient model fitting with outliers. In model construction, the training face samples are automatically labeled by local image search using Gabor wavelet features. Then robust principle component analysis (RPCA) is applied to capture the statistics of shape variations. In model fitting, an error function is introduced to deal with the outlier problem, which provides a connection to robust M-estimation. Gauss-Newton algorithm is adopted to efficiently optimize the robust energy function. Extensive experiments demonstrate the efficiency and robustness of our approach over previous methods.
1297870
An active learning framework for content-based information retrieval
We propose a general active learning framework for content-based information retrieval. We use this framework to guide hidden annotations in order to improve the retrieval performance. For each object in the database, we maintain a list of probabilities, each indicating the probability of this object having one of the attributes. During training, the learning algorithm samples objects in the database and presents them to the annotator to assign attributes. For each sampled object, each probability is set to be one or zero depending on whether or not the corresponding attribute is assigned by the annotator. For objects that have not been annotated, the learning algorithm estimates their probabilities with biased kernel regression. Knowledge gain is then defined to determine, among the objects that have not been annotated, which one the system is the most uncertain. The system then presents it as the next sample to the annotator to which it is assigned attributes. During retrieval, the list of probabilities works as a feature vector for us to calculate the semantic distance between two objects, or between the user query and an object in the database. The overall distance between two objects is determined by a weighted sum of the semantic distance and the low-level feature distance. The algorithm is tested on both synthetic databases and real databases of 3D models. In both cases, the retrieval performance of the system improves rapidly with the number of annotated samples. Furthermore, we show that active learning outperforms learning based on random sampling.
15648497
Interactive browsing of 3D environment over the Internet
In this paper, we describe a system for wandering in a realistic environment over the Internet. The environment is captured by the concentric mosaic, compressed via the reference block coder (RBC), and accessed and delivered over the Internet through the virtual media (Vmedia) access protocol. Capturing the environment through the concentric mosaic is easy. We mount a camera at the end of a level beam, and shoot images as the beam rotates. The huge dataset of the concentric mosaic is then compressed through the RBC, which is specifically designed for both high compression efficiency and just-in-time (JIT) rendering. Through the JIT rendering function, only a portion of the RBC bitstream is accessed, decoded and rendered for each virtual view. A multimedia communication protocol -- the Vmedia protocol, is then proposed to deliver the compressed concentric mosaic data over the Internet. Only the bitstream segments corresponding to the current view are streamed over the Internet. Moreover, the delivered bitstream segments are managed by a local Vmedia cache so that frequently used bitstream segments need not be streamed over the Internet repeatedly, and the Vmedia is able to handle a RBC bitstream larger than its memory capacity. A Vmedia concentric mosaic interactive browser is developed where the user can freely wander in a realistic environment, e.g., rotate around, walk forward/backward and sidestep, even under a tight bandwidth of 33.6 kbps.
9803776
Semantic propagation from relevance feedbacks
Relevance feedback has been a very useful tool to enhance the performance of content-based information retrieval (CBIR) systems. To fully make use of the precious user feedback provided to a system, we propose an approach named semantic propagation, which reveals the deep semantic relationships among objects in the database, given a set of relevance feedbacks between object pairs. In particular, we present two semantic propagation algorithms that are applicable to CIBR systems with a feature vector space model and a general metric space model, respectively. Experiments on a 3D model retrieval system and a logo image retrieval system are performed to show the effectiveness of the proposed methods.