10310546
Towards auto-documentary: tracking the evolution of news stories
News videos constitute an important source of information for tracking and documenting important events. In these videos, news stories are often accompanied by short video shots that tend to be repeated during the course of the event. Automatic detection of such repetitions is essential for creating auto-documentaries, for alleviating the limitation of traditional textual topic detection methods. In this paper, we propose novel methods for detecting and tracking the evolution of news over time. The proposed method exploits both visual cues and textual information to summarize evolving news stories. Experiments are carried on the TREC-VID data set consisting of 120 hours of news videos from two different channels.
2316797
MMSS: multi-modal story-oriented video summarization
We propose multi-modal story-oriented video summarization (MMSS) which, unlike previous works that use fine-tuned, domain-specific heuristics, provides a domain-independent, graph-based framework. MMSS uncovers correlation between information of different modalities which gives meaningful story-oriented news video summaries. MMSS can also be applied for video retrieval, giving performance that matches the best traditional retrieval techniques (OKAPI and LSI), with no fine-tuned heuristics such as tf/idf.
10479007
Segmenting Motion Capture Data into Distinct Behaviors
Much of the motion capture data used in animations, commercials, and video games is carefully segmented into distinct motions either at the time of capture or by hand after the capture session. As we move toward collecting more and longer motion sequences, however, automatic segmentation techniques will become important for processing the results in a reasonable time frame.We have found that straightforward, easy to implement segmentation techniques can be very effective for segmenting motion sequences into distinct behaviors. In this paper, we present three approaches for automatic segmentation. The first two approaches are online, meaning that the algorithm traverses the motion from beginning to end, creating the segmentation as it proceeds. The first assigns a cut when the intrinsic dimensionality of a local model of the motion suddenly increases. The second places a cut when the distribution of poses is observed to change. The third approach is a batch process and segments the sequence where consecutive frames belong to different elements of a Gaussian mixture model. We assess these three methods on fourteen motion sequences and compare the performance of the automatic methods to that of transitions selected manually.
6657323
"GeoPlot": spatial data mining on video libraries
Are "tornado" touchdowns related to "earthquakes"? How about to "floods", or to "hurricanes"? In Informedia [14], using a gazetteer on news video clips, we map news onto points on the globe and find correlations between sets of points. In this paper we show how to find answers to such questions, and how to look for patterns on the geo-spatial relationships of news events. The proposed tool is "GeoPlot", which is fast to compute and gives a lot of useful information which traditional text retrieval can not find.We describe our experiments on 2-year worth of video data (~ 20 Gbytes). There we found that GeoPlot can find unexpected correlations that text retrieval would never find, such as those between "earthquake" and "volcano", and "tourism" and "wine".In addition, GeoPlot provides a good visualization of a data set's characteristics. Characteristics at all scales are shown in one plot and a wealth of information is given, for example, geo-spatial clusters, characteristic scales, and intrinsic (fractal) dimensions of the events' locations.
10596767
Automatic mining of fruit fly embryo images
We present FEMine, an automatic system for image-based gene expression analysis. We perform experiments on the largest publicly available collection of Drosophila ISH (in situ hybridization) images, showing that our FEMine system achieves excellent performance in classification, clustering, and content-based image retrieval. The major innovation of FEMine is the use of automatically discovered latent spatial "themes" of gene expressions, LGEs, in the whole-embryo context, as opposed to patterns in nearly disjoint portions of an embryo proposed in previous methods.
7681917
ViVo: visual vocabulary construction for mining biomedical images
Given a large collection of medical images of several conditions and treatments, how can we succinctly describe the characteristics of each setting? For example, given a large collection of retinal images from several different experimental conditions (normal, detached, reattached, etc.), how can data mining help biologists focus on important regions in the images or on the differences between different experimental conditions? If the images were text documents, we could find the main terms and concepts for each condition by existing IR methods (e.g., tf/idf and LSI). We propose something analogous, but for the much more challenging case of an image collection: We propose to automatically develop a visual vocabulary by breaking images into n /spl times/ n tiles and deriving key tiles ("ViVos") for each image and condition. We experiment with numerous domain-independent ways of extracting features from tiles (color histograms, textures, etc.), and several ways of choosing characteristic tiles (PCA, ICA). We perform experiments on two disparate biomedical datasets. The quantitative measure of success is classification accuracy: Our "ViVos" achieve high classification accuracy (up to 83 %for a nine-class problem on feline retinal images). More importantly, qualitatively, our "ViVos" do an excellent job as "visual vocabulary terms": they have biological meaning, as corroborated by domain experts; they help spot characteristic regions of images, exactly like text vocabulary terms do for documents; and they highlight the differences between pairs of images.
2277870
A Flexible Ontology Reasoning Architecture for the Semantic Web
Knowledge-based systems in the semantic Web era can make use of the power of the semantic Web languages and technologies, in particular those related to ontologies. Recent research has shown that user-defined data types are very useful for semantic Web and ontology applications. The W3C semantic Web best practices and development working group has set up a task force to address this issue. Very recently, OWL-Eu and OWL-E, two decidable extensions of the W3C standard ontology language OWL DL, have been proposed to support customized data types and customized data type predicates, respectively. In this paper, we propose a flexible reasoning architecture for these two expressive semantic Web ontology languages and describe our prototype implementation of the reasoning architecture, based on the well-known FaCT DL reasoner, which witnesses the two key flexibility features of our proposed architecture: 1) It allows users to define their own data types and data type predicates based on built-in ones and 2) new data type reasoners can be added into the architecture without having to change the concept reasoner
33668284
f-SWRL: A Fuzzy Extension of SWRL
Although the combination of OWL and Horn rules results in the creation of a highly expressive language, i.e. SWRL, there are still many occasions where this language fails to accurately represent knowledge of our world. In particular, SWRL fails at representing vague and imprecise knowledge and information. Such type of information is apparent in many applications like multimedia processing and retrieval, information fusion, etc. In this paper, we propose f-SWRL, a fuzzy extension to SWRL to include fuzzy assertions (such as ‘Mary is tall in the degree of 0.9') and fuzzy rules (such as ‘being healthy is more important than being rich to determine if one is happy').
18411364
Uncertainty and RuleML Rulebases: A Preliminary Report
Uncertainty, like imprecision and vagueness, has gained considerable attention the last decade. To this extend we present a preliminary report on extending the Rule Markup Language (RuleML) with fuzzy set theory, in order to be able to represent and handle vague knowledge. We also provide semantics for the case of fuzzy FOL RuleML.
2109911
Serialized optimal relay schedules in two-tiered wireless sensor networks
In two-tiered wireless sensor networks (WSNs), sensor nodes (SNs) are scattered in clusters, and are responsible for collecting relevant information from designated areas and transmitting to an application node (AN) in the cluster. The AN then constructs a local-view for the cluster by exploring correlations among information received from nearby SNs, and sends the local-view toward a base-station that creates a global-view for the entire WSN. ANs can also relay local-views for other ANs, if the resultant network lifetime is longer. In this paper, we want to arrange inter-AN relaying optimally, which is an important process in topology control for maximizing the topological lifetime of a WSN with regard to a certain amount of initial energy provisioning. We first propose some criteria on relay candidates preselection, which can considerably reduce the overhead of obtaining an optimal relaying. We then design an algorithm to serialize the parallel relay allocation, so that each AN only needs to have one relaying AN at any time. Finally, we demonstrate the equivalency in network lifetime of the serialized inter-AN relay schedules.
6653256
Domain-constrained semi-supervised mining of tracking models in sensor networks
Accurate localization of mobile objects is a major research problem in sensor networks and an important data mining application. Specifically, the localization problem is to determine the location of a client device accurately given the radio signal strength values received at the client device from multiple beacon sensors or access points. Conventional data mining and machine learning methods can be applied to solve this problem. However, all of them require large amounts of labeled training data, which can be quite expensive. In this paper, we propose a probabilistic semi supervised learning approach to reduce the calibration effort and increase the tracking accuracy. Our method is based on semi-supervised conditional random fields which can enhance the learned model from a small set of training data with abundant unlabeled data effectively. To make our method more efficient, we exploit a Generalized EM algorithm coupled with domain constraints. We validate our method through extensive experiments in a real sensor network using Crossbow MICA2 sensors. The results demonstrate the advantages of methods compared to other state-of-the-art object-tracking algorithms.