14026338
The Asymmetric Traveling Salesman Problem: Algorithms, Instance Generators, and Tests
The purpose of this paper is to provide a preliminary report on the first broad-based experimental comparison of modern heuristics for the asymmetric traveling salesmen problem (ATSP). There are currently three general classes of such heuristics: classical tour construction heuristics such as Nearest Neighbor and the Greedy algorithm, local search algorithms based on re-arranging segments of the tour, as exemplified by the Kanellakis-Papadimitriou algorithm [KP80], and algorithms based on patching together the cycles in a minimum cycle cover, the best of which are variants on an algorithm proposed by Zhang [Zha93]. We test implementations of the main contenders from each class on a variety of instance types, introducing a variety of new random instance generators modeled on real-world applications of the ATSP. Among the many tentative conclusions we reach is that no single algorithm is dominant over all instance classes, although for each class the best tours are found either by Zhang's algorithm or an iterated variant on Kanellakis-Papadimitriou.
205692410
Average-case analysis of best-first search in two representative directed acyclic graphs
Many problems that arise in the real world have search spaces that are graphs rather than trees. Understanding the properties of search algorithms and analyzing their performance have been major objectives of research in AI. But most published work on the analysis of search algorithms has been focused on tree search, and comparatively little has been reported on graph search. One of the major obstacles in analyzing average-case complexity of graph search is that no single graph can serve as a suitable representative of graph search problems. In this paper we propose one possible approach to analyzing graph search. We take two problem domains for which the search graphs are directed acyclic graphs of similar structure, and determine the average case performance of the best-first search algorithm A* on these graphs. The first domain relates to one-machine job sequencing problems in which a set of jobs must be sequenced on a machine in such a way that a penalty function is minimized. The second domain concerns the Traveling Salesman Problem. Our mathematical formulation extends a technique that has been used previously for analyzing tree search. We demonstrate the existence of a gap in computational cost between two classes of problem instances. One class has exponential complexity and the other has polynomial complexity. For the job sequencing domain we provide supporting experimental evidence showing that problems exhibit a huge difference in computational cost under different conditions. For the Traveling Salesman Problem, our theoretical results reflect on the long-standing debate on the expected complexity of branch-and-bound algorithms for solving the problem, indicating that the complexity can be polynomial or exponential, depending on the accuracy of the heuristic function used.
3517573
A template-based and pattern-driven approach to situation awareness and assessment in virtual humans
Situation awareness and assessment are fundamental components of rational virtual humans. They are central parts of models of virtual humans and critical elements of efficient reasoning and planning systems. In this paper, we describe our efforts of developing the capability of situation awareness in autonomous, synthetic virtual pilots in a military domain. After briefly describing the motivations of this research, we present an agent architecture that integrates perception, reasoning with situation awareness, and actions. We describe a representation of situations, methods for situation assessment, and applications of situation awareness in information collection, and creating focused attention. The quantitative measure from our experiment shows that by using focused attention based on the ability of situation awareness, the perceptional load of virtual pilots is significantly reduced, reducing pilots’ response time by more than 50 percent.
2426741
An analysis and application of distributed constraint satisfaction and optimization algorithms in sensor networks
This research is motivated by a distributed scheduling problem in distributed sensor networks, in which computational resources are scarce. To cope with limited computational resources and restricted real-time requirement, it is imperative to apply distributed algorithms that have low overhead on resource requirement and high anytime performance. In this paper, We study distributed stochastic algorithm (DSA) and distributed breakout algorithm (DBA), two distributed algorithms developed earlier for distributed constraint satisfaction problems. We experimentally investigate their properties and compare their performance using our distributed scheduling problem as a benchmark. We first formulate the scheduling problem as a distributed multi-coloring problem. We then experimentally show that the solution quality and communication cost of DSA exhibit phase-transition or threshold behavior, in that the performance degenerates abruptly and dramatically when the degree of parallel executions of distributed agents increases beyond some critical value. The results show that when controlled properly, DSA is superior to DBA, having better or competitive solution quality and significantly smaller communication cost than DBA. Therefore, DSA is the algorithm of choice for our distributed scan scheduling problem.
12824361
Data Mining Methods for Modeling Gene Expression Regulation and Their Applications
This paper demonstrates machine learning and data mining methods that can be developed and applied to analyzing large quantities of genomic information and gene expression data for characterizing and modeling gene expression regulation. In particular, there will be a discussion on some of the methods that have been developed for modeling gene expression regulation underlying abiotic stress (e.g., drought, low temperature and salinity) tolerance, for identifying gene responsive to particular environmental stress conditions, and for characterizing the functions of microRNA genes for stress regulation in model plant Arabidopsis thaliana.
10248617
Towards flexible teamwork in persistent teams
Teamwork is a critical capability in multi-agent environments. Many such environments mandate that the agents and agent-teams mast be persistent i.e., exist over long periods of time. Agents in such persistent teams are bound together by their long-term common interests and goals. This paper focuses on flexible teamwork in such persistent teams. Unfortunately, while previous work has investigated flexible teamwork, persistent teams remain unexplored. For flexible teamwork, one promising approach that has emerged is model-based, i.e., providing agents with general models of teamwork that explicitly specify their commitments in teamwork. Such models enable agents to autonomously reason about coordination. Unfortunately, for persistent teams, such models may lead to coordination and communication actions that while locally optimal, are highly problematic for the team's long-term goals. We present a decision-theoretic technique to enable persistent teams to overcome such limitations of the model-based approach. In particular, agents reason about expected team utilities of future team states that are projected to result from actions recommended by the teamwork model, as well as lower-cost (or higher-cost) variations on these actions. To accommodate real-time constraints, this reasoning is done in an any-time fashion. Implemented examples from an analytic search tree and some real-world domains are presented.
28591822
Multicast Routing with Minimum Energy Cost and Minimum Delay in Wireless Sensor Networks
In this paper, we consider the multicast routing with minimum energy cost and minimum delay (MEMD) in wireless sensor networks under the access control scheme of Spatial Time Division Multiple Access (STDMA). We formulate and explore both MEMD multicast and ME multicast, and show that the latter is just the Maximum Leaf Spanning Tree (MLST) problem, which is NP-complete. A 2-approximation algorithm is proposed for the MLST problem through improving a known one. Based on this algorithm, an approximation algorithm is obtained for the MEMD multicast problem. To further improve the delay result, we provide another approximation algorithm for our main problem using a different approach. These algorithms are all near linear in the size of the network graph, and also are shown to have good performance by simulation results.
17059774
EM algorithms of Gaussian mixture model and hidden Markov model
The HMM (hidden Markov model) is a probabilistic model of the joint probability of a collection of random variables with both observations and states. The GMM (Gaussian mixture model) is a finite mixture probability distribution model. Although the two models have a close relationship, they are always discussed independently and separately. The EM (expectation-maximum) algorithm is a general method to improve the descent algorithm for finding the maximum likelihood estimation. The EM of HMM and the EM of GMM have similar formulae. Two points are proposed in this paper. One is that the EM of GMM can be regarded as a special EM of HMM. The other is that the EM algorithm of GMM based on symbols is faster in implementation than the EM algorithm of GMM based on samples (or on observation) traditionally.
29505226
Discriminant neighborhood embedding for classification
In this paper a novel subspace learning method called discriminant neighborhood embedding (DNE) is proposed for pattern classification. We suppose that multi-class data points in high-dimensional space tend to move due to local intra-class attraction or inter-class repulsion and the optimal embedding from the point of view of classification is discovered consequently. After being embedded into a low-dimensional subspace, data points in the same class form compact submanifod whereas the gaps between submanifolds corresponding to different classes become wider than before. Experiments on the UMIST and MNIST databases demonstrate the effectiveness of our method.
7781593
Kernel based 2D symmetrical principal component analysis for face classification
This paper presents a novel algorithm-kernel based 2D symmetrical principal component analysis (K2DSPCA), which takes full advantage of kernel method, the symmetrical property of facial image and the structural information of image (i.e., the advantage of two-dimensional PCA). Firstly, a facial image is decomposed into an even image and an odd image; Secondly, both the even image and the odd image are mapped to a high dimensional feature space (Reproducing Kernel Hilbert space, RKHS) by a nonlinear function; Thirdly, compute the eigenvectors and the eigenvectors of the even image and the odd image in RKHS, respectively; At last, select the eigenvectors with greater variance as the projection axis. We compare the performance of SPCA, 2DPCA, S2DPCA with K2DSPCA on CBCL database for binary classification, and on ORL face database for multi-category classification, respectively. The experimental results show the K2DSPCA is competitive with or superior to SPCA, 2DPCA and S2DPCA.
43211087
Simplify Decision Function of Reduced Support Vector Machines
Reduced Support Vector Machines (RSVM) was proposed as the alternate of standard support vector machines (SVM) in order to resolve the difficulty in the learning of nonlinear SVM for large data set problems. RSVM preselects a subset as support vectors and solves a smaller optimization problem, and it performs well with remarkable efficiency on training of SVM for large problem. All the training points of the subset will be support vectors, and more training points are selected into this subset results in high possibility to obtain RSVM with better generalization ability. So we first obtain the RSVM with more support vectors, and selects out training examples near classification hyper plane. Then only these training examples are used as training set to obtain a standard SVM with less support vector than that of RSVM. Computational results show that standard SVMs on the basis of RSVM have much less support vectors and perform equal generalization ability to that of RSVM.