5801265
Reversibility and adiabatic computation: trading time and space for energy
Future miniaturization and mobilization of computing devices requires energy parsimonious ‘adiabatic’ computation. This is contingent on logical reversibility of computation. An example is the idea of quantum computations which are reversible except for the irreversible observation steps. We propose to study quantitatively the exchange of computational resources like time and space for irreversibility in computations. Reversible simulations of irreversible computations are memory intensive. Such (polynomial time) simulations are analysed here in terms of ‘reversible’ pebble games. We show that Bennett’s pebbling strategy uses least additional space for the greatest number of simulated steps. We derive a trade-off for storage space versus irreversible erasure. Next we consider reversible computation itself. An alternative proof is provided for the precise expression of the ultimate irreversibility cost of an otherwise reversible computation without restrictions on time and space use. A time-irreversibility trade-off hierarchy in the exponential time region is exhibited. Finally, extreme time-irreversibility trade-offs for reversible computations in the thoroughly unrealistic range of computable versus non-computable time-bounds are given.
2607374
Information distance
While Kolmogorov complexity is the accepted absolute measure of information content in an individual finite object, a similarly absolute notion is needed for the information distance between two individual objects, for example, two pictures. We give several natural definitions of a universal information metric, based on length of shortest programs for either ordinary computations or reversible (dissipationless) computations. It turns out that these definitions are equivalent up to an additive logarithmic term. We show that the information distance is a universal cognitive similarity distance. We investigate the maximal correlation of the shortest programs involved, the maximal uncorrelation of programs (a generalization of the Slepian–Wolf theorem of classical information theory), and the density properties of the discrete metric spaces induced by the information distances. A related distance measures the amount of nonreversibility of a computation. Using the physical theory of reversible computation, we give an appropriate (universal, antisymmetric, and transitive) measure of the thermodynamic work required to transform one object in another object by the most efficient process. Information distance between individual objects is needed in pattern recognition where one wants to express effective notions of “pattern similarity” or “cognitive similarity” between individual objects and in thermodynamics of computation where one wants to analyze the energy dissipation of a computation from a particular input to a particular output.
9397376
Inferring a DNA Sequence from Erroneous Copies
Abstract We suggest a novel approach for efficiently reconstructing an original DNA sequence from erroneous copies.
871253
Kolmogorov Complexity Arguments in Combinatorics
Abstract The utility of a Kolmogorov complexity method in combinatorial theory is demonstrated by several examples.
553776
Linear approximation of shortest superstrings
We consider the following problem: given a collection of strings s1, ••• ,sm, find the shortest string s such that each s; appears as a substring (a consecutive block) of s. Although this problem is known to be NP-hard, a simple greedy procedure appears to do quite well and is routinely used in DNA sequencing and data compression practice, namely: repeatedly merge the pair of (distinct) strings with maximum overlap until only one string remains. Let n denote the A. Blum was supported by a National Science Foundation (NSF) Graduate Fellowship. Part of this work was done while A. Blum was visiting AT & T Bell Labs. T. Jiang was supported in part by a grant from SERB, McMaster University and NSERC Operating Grant OGP0046613. M. Li was supported in part by the NSERC Operating Grants OGP0036747 and OGP0046506. J. Tromp was supported in part by NSERC Grant OGP0036747 while the author was visiting at the University of Waterloo. Authors' present addresses: A. Blum, School of Computer Science, Carnegie-Mellon University, 5000 Forbes Avenue, Pittsburgh, PA 15213. E-mail: avrim@theory.cs.cmu.edu; T. Jiang, Department of Computer Science, McMaster University, Hamilton, Ont., Canada L8S 4Kl. E-mail: jiang<Q•maccs. mcmaster.ca; M. Li, Department of Computer Science, University of Waterloo, Waterloo, Ont., Canada N3L 30 I. E-mail: mli@watmath.waterloo.edu; J. Tromp, CWI, P.O. Box 4079, 1009 AB Amsterdam, The Netherlands. E-mail: tromp@cwi.nl; M. Yannakakis, Room 2C-319, AT&T Bell Labs, 600 Mountain Avenue, Murray Hill, NJ 07974. E-mail: mihalis@research.att.com. Permission to copy without fee all or part of this material is granted provided that the copies arc not made or distributed for direct commercial advantage, the ACM copyright notice and the title of the publication and its date appear, and notice is given that copying is by permission of the Association for Computing Machinery. To copy otherwise, or to republish, requires a fee and/or specific permission. © 1994 ACM 0004-5411/94/0700-0630$03.50 Journal of the Association for Computing Machinery, Vol. 41, No. 4, July 1994, pages 630-647. Linear Approximation of Shortest Superstrings 631 length of the optimal superstring. A common conjecture states that the above greedy procedure produces a superstring of length O(n) (in fact, 2n), yet the only previous nontrivial bound known for any polynomial-time algorithm is a recent O(n log n) result. We show that the greedy algorithm does in fact achieve a constant factor approximation, proving an upper bound of 4n. Furthermore, we present a simple modified version of the greedy algorithm that we show produces a superstring of length at most 3n. We also show the superstring problem to be MAX SNP-hard, which implies that a polynomial-time approximation scheme for this problem is unlikely.
14168735
Inductive Reasoning and Kolmogorov Complexity
Abstract Reasoning to obtain the “truth” about reality, from external data, is an important, controversial, and complicated issue in man's effort to understand nature. (Yet, today, we try to make machines do this.) There have been old useful principles, new exciting models, and intricate theories scattered in vastly different areas including philosophy of science, statistics, computer science, and psychology. We focus on inductive reasoning in correspondence with ideas of R. J. Solomonoff. While his proposals result in perfect procedures, they involve the noncomputable notion of Kolmogorov complexity. In this paper we develop the thesis that Solomonoff's method is fundamental in the sense that many other induction principles can be viewed as particular ways to obtain computable approximations to it. We demonstrate this explicitly in the cases of Gold's paradigm for inductive inference, Rissanen's minimum description length (MDL) principle, Fisher's maximum likelihood principle, and Jaynes' maximum entropy principle. We present several new theorems and derivations to this effect. We also delimit what can be learned and what cannot be learned in terms of Kolmogorov complexity, and we describe an experiment in machine learning of handwritten characters. We also give an application of Kolmogorov complexity in Valiant style learning, where we want to learn a concept probably approximately correct in feasible time and examples.
41006390
Min-energy voltage allocation for tree-structured tasks
We study job scheduling on processors capable of running at variable voltage/speed to minimize energy consumption. Each job in a problem instance is specified by its arrival time and deadline, together with required number of CPU cycles. It is known that the minimum energy schedule for n jobs can be computed in O(n3) time, assuming a convex energy function. We investigate more efficient algorithms for computing the optimal schedule when the job sets have certain special structures. When the time intervals are structured as trees, the minimum energy schedule is shown to have a succinct characterization and is computable in time O(P) where P is the tree’s total path length. We also study an on-line average-rate heuristics AVR and prove that its energy consumption achieves a small constant competitive ratio for nested job sets and for job sets with limited overlap. Some simulation results are also given.
12850359
Recognition of operator motions for real-time assistance using virtual fixtures
Hidden Markov Models (HMMs) are used for automatic segmentation and recognition of user motions. A new algorithm for real-time HMM recognition was developed. The segmentation results are used to provide appropriate assistance in a combined curve following and object avoidance task. This assistance takes the form of a virtual fixture, whose compliance can be altered online. Recognition and assistance experiments were performed using force and position data recorded from a cooperative manipulation system, where a robot and a human operator hold an instrument simultaneously. Recognition accuracy exceeds 90%, even when the users training the HMMs differ from those executing the task. For a task consisting of both path following and avoidance motions, an HMM-based virtual fixture switches the compliance from low to high when the user is trying to move away from the path. The HMM method improves operator performance in comparison with a constant virtual fixture and no virtual fixture.
7419462
End-to-end framework for QoS guarantee in heterogeneous wired-cum-wireless networks
With information access becoming more and more ubiquitous, there is a need for providing QoS support for communication that spans wired and wireless networks. For the wired side, RSVP/SBM has been widely accepted as a flow reservation scheme in IEEE 802 style LANs. In this paper, we investigate the integration of RSVP and a RSVP-like flow reservation scheme in wireless LANs, as an end-to-end solution for QoS guarantee in wired-cum-wireless networks. We propose WRESV, an RSVP-like flow reservation and admission control scheme for IEEE 802.11 wireless LAN. Using WRESV, wired/wireless integration can be easily implemented by cross-layer interaction at the access point. Main components of the integration are RSVP-WRESV parameter mapping, and the initiation of new reservation messages, depending on where senders/receivers are located. In addition, we also propose various optimizations for supporting multicast session, mobility management, and admission control.
1558162
Monitoring Abnormal Patterns with Complex Semantics over ICU Data Streams
Monitoring abnormal patterns in data streams is an important research area for many applications. In this paper we present a new approach MAPS(Monitoring Abnormal Patterns over data Streams) to model and identify the abnormal patterns over the massive data streams. Compared with other data streams, ICU streaming data have their own features: pseudo-periodicity and polymorphism. MAPS first extracts patterns from the online arriving data streams and then normalizes them according to their pseudo-periodic semantics. Abnormal patterns will be detected if they are satisfied the predicates defined in the clinician-specifying normal patterns. At last, a real application demonstrates that MAPS is efficient and effective in several important aspects.
15017510
Min-Energy Voltage Allocation for Tree-Structured Tasks
We study job scheduling on processors capable of running at variable voltage/speed to minimize energy consumption. Each job in a problem instance is specified by its arrival time and deadline, together with required number of CPU cycles. It is known that the minimum energy schedule for n jobs can be computed in O(n3) time, assuming a convex energy function. We investigate more efficient algorithms for computing the optimal schedule when the job sets have certain special structures. When the time intervals are structured as trees, the minimum energy schedule is shown to have a succinct characterization and is computable in time O(P) where P is the tree’s total path length. We also study an on-line average-rate heuristics AVR and prove that its energy consumption achieves a small constant competitive ratio for nested job sets and for job sets with limited overlap. Some simulation results are also given.