7539391
Compressed-domain video indexing techniques using DCT and motion vector information in MPEG video
Development of various multimedia applications hinges on the availability of fast and efficient storage, browsing, indexing, and retrieval techniques. Given that video is typically stored efficiently in a compressed format, if we can analyze the compressed representation directly, we can avoid the costly overhead of decompressing and operating at the pixel level. Compressed domain parsing of video has been presented in earlier work where a video clip is divided into shots, subshots, and scenes. In this paper, we describe key frame selection, feature extraction, and indexing and retrieval techniques that are directly applicable to MPEG compressed video. We develop a frame-type independent representation of the various types of frames present in an MPEG video in which al frames can be considered equivalent. Features are derived from the available DCT, macroblock, and motion vector information and mapped to a low-dimensional space where they can be accessed with standard database techniques. The spatial information is used as primary index while the temporal information is used to enhance the robustness of the system during the retrieval process. The techniques presented enable fast archiving, indexing, and retrieval of video. Our operational prototype typically takes a fraction of a second to retrieve similar video scenes from our database, with over 95% success.
12237012
Discovering the Biomedical Deep Web
The rapid growth of biomedical information in the Deep Web has produced unprecedented challenges for traditional search engines. This paper describes a new Deep web resource discovery system for biomedical information. We designed two hypertext mining applications: a Focused Crawler that selectively seeks out relevant pages using a classifier that evaluates the relevance of the document with respect to biomedical information, and a Query Interface Extractor that extracts information from the page to detect the presence of a Deep Web database. Our anecdotes suggest that combining focused crawling with query interface extraction is very effective for building high-quality collections of Deep Web resources on biomedical topics.
5363634
Applying bulk insertion techniques for dynamic reverse nearest neighbor problems
Reverse nearest neighbors queries have emerged as an important class of queries for spatial and other types of databases. The Rdnn-tree is an R-tree based structure that has been shown to perform outstandingly for such kind of queries. However, one practical problem facing it (as well as other type of indexes) is how to effectively construct the index from stretch. In this case, the cost of constructing and maintaining a Rdnn-Tree is about twice the cost of an R-Tree. Normal insertion into a Rdnn-Tree is performed one point at a time, known as single point insertion. The question arises, can insertion be improved there by reducing the construction and maintenance cost. In this paper we propose a bulk-loading technique, which is capable of significantly, improve the performance of constructing the index from stretch, as well as insert a large amount of data. Experiments show that our method outperforms the single point insertion significantly.
16978334
Evaluating a class of distance-mapping algorithms for data mining and clustering
A distance-mapping algorithm takes a set of objects and a distance metric and then maps those objects to a Euclidean or pseudoEuclidean space in such a way that the distances among objects are approximately preserved. Distance mapping algorithms are a useful tool for clustering and visualization in data intensive applications, because they replace expensive distance calculations by sum-of-square calculations. This can make clustering in large databases with expensive distance metrics practical. In this paper we present five distance-mapping algorithms and conduct experiments to compare their performance in data clustering applications. These include two algorithms called FastMap and MetricMap, and three hybrid heuristics that combine the two algorithms in different ways. Experimental results on both synthetic and RNA data show the superiority of the hybrid algorithms. The results imply that FastMap and MetricMap capture complementary information about distance metrics and therefore can be used together to great benefit. The net effect is that multi-day computations may be done in minutes.
18594508
An index structure for efficient reverse nearest neighbor queries
The Reverse Nearest Neighbor (RNN) problem is to find all points in a given data set whose nearest neighbor is a given query point. Just like the Nearest Neighbor (NN) queries, the RNN queries appear in many practical situations such as marketing and resource management. Thus, efficient methods for the RNN queries in databases are required. The paper introduces a new index structure, the Rdnn-tree, that answers both RNN and NN queries efficiently. A single index structure is employed for a dynamic database, in contrast to the use of multiple indexes in previous work. This leads to significant savings in dynamically maintaining the index structure. The Rdnn-tree outperforms existing methods in various aspects. Experiments on both synthetic and real world data show that our index structure outperforms previous methods by a significant margin (more than 90% in terms of number of leaf nodes accessed) in RNN queries. It also shows improvement in NN queries over standard techniques. Furthermore, performance in insertion and deletion is significantly enhanced by the ability to combine multiple queries (NN and RNN) in one traversal of the tree. These facts make our index structure extremely preferable in both static and dynamic cases.
11135944
Fuzzy Clustering of Web Logs for User Classification
14104203
SM: real-time multicast protocols for simultaneous message delivery
Traditionally, a multicast message is sent once by a sender. All receivers will receive the same message but may receive it at different times. This may result in unfair advantage for some receivers. Simultaneous Multicast (SM) applications require that all receivers receive the same message at the same time. SM protocols therefore need to meet a strict deadline to ensure that each receiver will receive a message at the same time, regardless of the network conditions, heterogeneity of the environment and differences between the local clocks in the receivers. Such a real time SM protocol is proposed so that the coordinated deadline can be met by controlling the reserved bandwidth and without the overhead of clock synchronization. A sensing protocol is also proposed to continuously search for better levels of quality and to avoid the overhead of an external feedback protocol. The protocols are bandwidth conscious, enforce fairness and provide scalability.
11605665
Implementing a general real-time scheduling framework in the RED-Linux real-time kernel
Many scheduling paradigms have been studied for real-time applications and real-time communication network. Among them, the most commonly used paradigms include priority-driven, time-driven and share-driven paradigms. In this paper, we present a general scheduling framework which is designed to integrate these paradigms in one framework. The framework is implemented in our real-time extension of the Linux kernel, RED-Linux. Two scheduler components are used in the framework: Allocator and Dispatcher. For each job, the framework identifies four scheduling attributes: priority, start time, finish time and budget. We show that the framework can be used to efficiently implement many well-known scheduling algorithms. We also measure and analyze the performance of the framework implemented in RED-Linux.
15072976
The design and implementation of real-time schedulers in RED-linux
Researchers in the real-time system community have designed and studied many advanced scheduling algorithms. However, most of these algorithms have not been implemented since it is very difficult to support new scheduling algorithms on most operating systems. To address this problem, we enhance the scheduling mechanism in Linux to provide a flexible scheduling framework. In the real-time and embedded Linux (RED-Linux) project, we implement a general scheduling framework which divides the system scheduler into two components: dispatcher and allocator. The dispatcher provides the mechanism of system scheduling and resides in the kernel space. The allocator is used to define the scheduling policy and implemented as a user space function. This framework allows users to implement application-specific schedulers in the user space which is easy to program and to debug. The framework also relieves the deficiency from the stock Linux scheduler which is not designed for real-time applications. To further enhance its power, a hierarchical scheduling mechanism has been provided in RED-Linux to allow a system designer to integrate different real-time applications together. Using scheduling groups, real-time jobs can be managed and scheduled in a hierarchical manner. In this paper, we discuss how the group mechanism is implemented in RED-Linux.
13951248
A survey on evaluating and realizing IS/IT benefits in Taiwanese b2bec companies
A number of issues have emerged from the analysis of the data collected via a survey conducted in Taiwanese B2BEC companies. The results show relatively high usage of IS/IT investment evaluation and benefits realization methodologies, and yet, these methodologies were generally not used effectively within the responding organizations. Most of these organizations were not yet mature in terms of their IT. However, there was a clear association between level of IT maturity and both wide and effective use of methodologies for IS/IT investment evaluation and benefits management.
15828117
Enhancing external consistency in real-time transactions
Real-time computing brings two new requirements to database management. The first is the deadline constraint which requires better scheduling algorithms to meet transaction deadfines. The second requirement is the temporal validity, or external consistency[Lin89], requirement of data: a real-time database must prevent data from being corrupted not only by the executions of concurrent transactions but also by the delay from sharing computing resources and real-time scheduler decisions. In this paper, we study the external consistency requirement in real-time databases. We propose a semantic-based concurrency control scheme that prefers the external consistency to the traditional serializability. Two new concepts are introduced in our work. An update of a physical object value is considered to be compatible to those read operations that need to access the most recent data. Secondly, if a transaction depends strongly on the validity of the value of an object, a new update may cause the transaction to be aborted since continuing the transaction may be harmful to the appfication. A real-Life example is the stock market database. A trading program may be executed for a long time and its read operations should not block any new updates. Moreover, if there is a big sudden change in a particular stock price, it may be better to abort an on-going transaction rather than letting it make some invalid decisions.