206783748
Convex Hull Ensemble Machine
We propose a new ensemble algorithm called Convex Hull Ensemble Machine (CHEM). CHEM in Hilbert space is developed first and it is modified to regression and classification problems. Empirical studies show that in classification problems CHEM has similar prediction accuracy as AdaBoost, but CHEM is much more robust to output noise. In regression problems, CHEM works competitively with other ensemble methods such as Gradient Boost and Bagging.
7701199
Gradient LASSO for feature selection
LASSO (Least Absolute Shrinkage and Selection Operator) is a useful tool to achieve the shrinkage and variable selection simultaneously. Since LASSO uses the L1 penalty, the optimization should rely on the quadratic program (QP) or general non-linear program which is known to be computational intensive. In this paper, we propose a gradient descent algorithm for LASSO. Even though the final result is slightly less accurate, the proposed algorithm is computationally simpler than QP or non-linear program, and so can be applied to large size problems. We provide the convergence rate of the algorithm, and illustrate it with simulated models as well as real data sets.
27587473
Generalized cycle crossover for graph partitioning
We propose a new crossover that generalizes cycle crossover to permutations with repetitions and naturally suits partition problems. We tested it on graph partitioning problems obtaining excellent results.
344302
New topologies for genetic search space
We propose three distance measures for genetic search space. One is a distance measure in the population space that is useful for understanding the working mechanism of genetic algorithms. Another is a distance measure in the solution space for K-grouping problems. This can be used for normalization in crossover. The third is a level distance measure for genetic algorithms, which is useful for measuring problem difficulty with respect to genetic algorithms. We show that the proposed measures are metrics and the measures are efficiently computed.
33400437
Facial Expression Recognition Using Active Appearance Model
This paper describes a facial expression recognition system based upon Active Appearance Model (AAM), which has been typically used for the face recognition task. Given that AAM has been also used in tracking the moving object, we thought it could be effective in recognizing the facial expressions of humans. Our results show that the performance of the facial expression recognition using AAM is reliably high when it combined with an enhanced Fisher classification model.
10542004
Investigation of the Fitness Landscapes and Multi-parent Crossover for Graph Bipartitioning
An empirical study is performed on the local-optimum space of graph bipartitioning. We examine some statistical features of the fitness landscape. They include the cost-distance correlations and the properties around the central area of local optima. The study revealed some new notable results about the properties of the fitness landscape; e.g., the central area yielded fairly good quality in the local-optimum space. We performed an experiment on a spectrum of different exploitation strengths of the central areas. From the results, it seems attractive to exploit the central area, but excessive or insufficient exploitation is not desirable.
37111410
Performance Comparison Between Backpropagation, Neuro-Fuzzy Network, and SVM
In this study, we compare the performance of well-known neural networks, namely, back-propagation (BP) algorithm, Neuro-Fuzzy network and Support Vector Machine (SVM) using the standard three database sets: Wisconsin breast cancer, Iris and wine data. Since such database have been useful for evaluating performance of a group of machine learning algorithms, a series of experiments have been carried out for three algorithms using the cross validation method. Results suggest that SVM outperforms the others and the Neuro-Fuzzy network is better than the BP algorithm for this data set.