154630
Dual Labeling: Answering Graph Reachability Queries in Constant Time
Graph reachability is fundamental to a wide range of applications, including XML indexing, geographic navigation, Internet routing, ontology queries based on RDF/OWL, etc. Many applications involve huge graphs and require fast answering of reachability queries. Several reachability labeling methods have been proposed for this purpose. They assign labels to the vertices, such that the reachability between any two vertices may be decided using their labels only. For sparse graphs, 2-hop based reachability labeling schemes answer reachability queries efficiently using relatively small label space. However, the labeling process itself is often too time consuming to be practical for large graphs. In this paper, we propose a novel labeling scheme for sparse graphs. Our scheme ensures that graph reachability queries can be answered in constant time. Furthermore, for sparse graphs, the complexity of the labeling process is almost linear, which makes our algorithm applicable to massive datasets. Analytical and experimental results show that our approach is much more efficient than stateof- the-art approaches. Furthermore, our labeling method also provides an alternative scheme to tradeoff query time for label space, which further benefits applications that use tree-like graphs.
14920261
BOXes: efficient maintenance of order-based labeling for dynamic XML data
Order-based element labeling for tree-structured XML data is an important technique in XML processing. It lies at the core of many fundamental XML operations such as containment join and twig matching. While labeling for static XML documents is well understood, less is known about how to maintain accurate labeling for dynamic XML documents, when elements and subtrees are inserted and deleted. Most existing approaches do not work well for arbitrary update patterns; they either produce unacceptably long labels or incur enormous relabeling costs. We present two novel I/O-efficient data structures, W-BOX and B-BOX that efficiently maintain labeling for large, dynamic XML documents. We show analytically and experimentally that both, despite consuming minimal amounts of storage, gracefully handle arbitrary update patterns without sacrificing lookup efficiency. The two structures together provide a nice tradeoff between update and lookup costs: W-BOX has logarithmic amortized update cost and constant worst-case lookup cost, while B-BOX has constant amortized update cost and logarithmic worst-case lookup cost. We further propose techniques to eliminate the lookup cost for read-heavy workloads.
7182462
On the database/network interface in large-scale publish/subscribe systems
The work performed by a publish/subscribe system can conceptually be divided into subscription processing and notification dissemination. Traditionally, research in the database and networking communities has focused on these aspects in isolation. The interface between the database server and the network is often overlooked by previous research. At one extreme, database servers are directly responsible for notifying individual subscribers; at the other extreme, updates are injected directly into the network, and the network is solely responsible for processing subscriptions and forwarding notifications. These extremes are unsuitable for complex and stateful subscription queries. A primary goal of this paper is to explore the design space between the two extremes, and to devise solutions that incorporate both database-side and network-side considerations in order to reduce the communication and server load and maintain system scalability. Our techniques apply to a broad range of stateful query types, and we present solutions for several of them. Our detailed experiments based on real and synthetic workloads with varying characteristics and link-level network simulation show that by exploiting the query semantics and building an appropriate interface between the database and the network, it is possible to achieve orders-of-magnitude savings in network traffic at low server-side processing cost.
2070842
Distributed Network Querying with Bounded Approximate Caching
As networks continue to grow in size and complexity, distributed network monitoring and resource querying are becoming increasingly difficult. Our aim is to design, build, and evaluate a scalable infrastructure for answering queries over distributed measurements, at reduced costs (in terms of both network traffic and query latency) while maintaining required precision. In this infrastructure, each network node owns a set of numerical measurements and actively maintains bounds on these values cached at other nodes. We can answer queries approximately, using bounds from nearby caches to avoid contacting the owners directly. We focus on developing efficient and scalable techniques to place, locate, and manage bounded approximate caches across a large network. We have developed two approaches: One uses a recursive partitioning of the network space to place caches in a static, controlled manner, while the other uses a locality-aware distributed hash table to place caches in a dynamic and decentralized manner. In this paper, we focus on the latter approach. Experiments over a large-scale emulated network show that our techniques are very effective in reducing query costs while generating an acceptable amount of background traffic; they are also able to exploit various forms of locality that are naturally present in queries, and adapt to volatility of measurements.
2510058
Constraint chaining: on energy-efficient continuous monitoring in sensor networks
Wireless sensor networks have created new opportunities for data collection in a variety of scenarios, such as environmental and industrial, where we expect data to be temporally and spatially correlated. Researchers may want to continuously collect all sensor data from the network for later analysis. Suppression, both temporal and spatial, provides opportunities for reducing the energy cost of sensor data collection. We demonstrate how both types can be combined for maximal benefit. We frame the problem as one of monitoring node and edge constraints. A monitored node triggers a report if its value changes. A monitored edge triggers a report if the difference between its nodes' values changes. The set of reports collected at the base station is used to derive all node values. We fully exploit the potential of this global inference in our algorithm, CONCH, short for constraint chaining. Constraint chaining builds a network of constraints that are maintained locally, but allow a global view of values to be maintained with minimal cost. Network failure complicates the use of suppression, since either causes an absence of reports. We add enhancements to CONCH to build in redundant constraints and provide a method to interpret the resulting reports in case of uncertainty. Using simulation we experimentally evaluate CONCH's effectiveness against competing schemes in a number of interesting scenarios.
14448318
On Suspending and Resuming Dataflows
Consider a long-running, resource-intensive query Q running on a database management system (DBMS). Suppose another task T with much higher priority arrives, and we need to process T as quickly as possible and with all available resources. Ideally, the system should suspend the execution of Q, quickly release all resources held by Q, and start T using all resources. Query Q can be resumed once T finishes execution, ideally without losing any significant fraction of the work that Q had done prior to suspend. Beyond supporting mixed-priority DBMS workloads, suspend/resume of queries, or dataflows in general, is important in many other settings: Utility and grid: Dataflows now run frequently on computational utilities and grids composed of autonomous resources. When the owner of resources wants to use them, dataflows running on these resources must release control quickly, and migrate to other resources. Software rejuvenation: Benefits of software rejuvenation, the practice of rebooting enterprise computing systems regularly, are now recognized widely. Reboot is critical when performance degrades due to resource exhaustion caused by resource leaks. Suspend and resume is important in this setting because (1) the challenge of predicting completion times accurately makes it difficult to schedule task completion to match a rejuvenation schedule; (2) when performance degrades, it may not be cost-effective to wait for all dataflows to complete before rebooting.
46223238
Environmental impact assessment using the evidential reasoning approach
Environmental impact assessment (EIA) problems are often characterised by a large number of identified environmental factors that are qualitative in nature and can only be assessed on the basis of human judgments, which inevitably involve various types of uncertainties such as ignorance and fuzziness. So, EIA problems need to be modelled and analysed using methods that can handle uncertainties. The evidential reasoning (ER) approach provides such a modelling framework and analysis method. In this paper the ER approach will be applied to conduct EIA analysis for the first time. The environmental impact consequences are characterized by a set of assessment grades that are assumed to be collectively exhaustive and mutually exclusive. All assessment information, quantitative or qualitative, complete or incomplete, and precise or imprecise, is modelled using a unified framework of a belief structure. The original ER approach with a recursive ER algorithm will be introduced and a new analytical ER algorithm will be investigated which provides a means for using the ER approach in decision situations where an explicit ER aggregation function is needed such as in optimisation problems. The ER approach will be used to aggregate multiple environmental factors, resulting in an aggregated distributed assessment for each alternative policy. A numerical example and its modified version are studied to illustrate the detailed implementation process of the ER approach and demonstrate its potential applications in EIA.
17739128
Modified Hough Transforms for Object Feature Extraction
In this paper, we propose the use of modified Hough transforms to efficiently extract object feature parameters, which are usually contaminated by heavily noisy corrugation and discontinuity. The modified HT (MHT) is developed by introducing spatial and parameter weighting functions to improve the detection performance for the traditional Hough transform (HT), which generally fails to robustly detect natural object parameters. Using designed test patterns and real images, simulations show that the proposed weighting functions are helpful in detecting noise-corrupted object features. Due to its robustness, the MHT can be easily figured with a coarse-to-fine adaptive search mechanism to reduce the huge amount of computation for feature parameters extraction.
19364030
The evidential reasoning approach for multiple attribute decision analysis using interval belief degrees
Abstract Multiple attribute decision analysis (MADA) problems having both quantitative and qualitative attributes under uncertainty can be modeled using the evidential reasoning (ER) approach. Several types of uncertainties such as ignorance and fuzziness can be modeled in the ER framework. In this paper, the ER approach will be extended to model new types of uncertainties including interval belief degrees and interval data that could be incurred in decision situations such as group decision making. The Dempster–Shafer (D–S) theory of evidence is first extended, which is one of the bases of the ER approach. The analytical ER algorithm is used to combine all evidence simultaneously. Two pairs of nonlinear optimization models are constructed to estimate the upper and lower bounds of the combined belief degrees and to compute the maximum and the minimum expected utilities of each alternative, respectively. Interval data are equivalently transformed to interval belief degrees and are incorporated into the nonlinear optimization models. A cargo ship selection problem is examined to show the implementation process of the proposed approach.
23948133
Building Domain Ontology Based on Web Data and Generic Ontology
The automatic or semi-automatic construction of ontology has become a research topic of interest in recent years. This paper describes a mechanism for constructing domain specific ontologies automatically based on web data and generic ontology. Firstly, we employ the hierarchical agglomerative clustering(HAC) algorithm, clustering web pages hierarchically and resulting in a binary tree. Then an algorithm is proposed, which selectd from the binary tree the significative nodes as topics implying concepts of domain interests. Lastly, the Chinese generic ontology, HowNet, is introduced to evolve the topics (together with their hierarchical structures) into domain ontology. We experiment our method in the field of computer hardware based on web pages collected from Chinese BtoC web sites. An in-depth discussion on the experiment results is also given.
7778729
A dynamic K-winners-take-all neural network
In this paper, a dynamic K-winners-take-all (KWTA) neural network, which can quickly identify the K-winning neurons whose activations are larger than the remaining ones, is proposed and analyzed. For N competitors, the proposed KWTA network is composed of N feedforward hardlimit neurons and three feedback neurons, which are used to determine the dynamic threshold. From theoretical analysis and simulation results, we found that the convergence of the proposed KWTA network, which requires Log(2)(N+1) iterations in average to complete a KWTA process, is independent of K, the number of the desired winners, and faster than that of the existing KWTA networks.