19821161
Molecular Dynamics Optimizer
Molecular system possesses two main characteristics that seem to be applicable for the contrary goals of proximity and diversity in multiobjective optimization, namely the converging pressure in potential fields as dictated by the Maxwell-Boltzmann distribution and the inherent drift to a homogenous and uniform equilibrium with maximum entropy, even without any prior knowledge on the geometry and state of the enclosure. Inspired by this association, this paper explores the notion of exploiting molecular motion to solve multiobjective problems. By adapting the algorithmic structure of molecular dynamics, which essentially represents a technique for the computer simulation of molecular motion, a molecular system that is relevant for multiobjective optimization is proposed, known as molecular dynamics optimizer (MDO). The performance of MDO was subsequently compared with other conventional multiobjective optimizers, specifically EA and PSO, and the experimental results demonstrated that MDO is indeed a viable and practical approach for multiobjective optimization.
39015345
FPGA-BASED AUTONOMOUS ROBOT NAVIGATION VIA INTRINSIC EVOLUTION
Artificial evolution has been applied in mobile robotics to achieve adaptive robotic behaviors in unstructured environments. Meanwhile, much attention has been paid to the evolvable hardware, which is a novel set of integrated circuits capable of reconfiguring its architectures using evolutionary computing techniques. This paper presents the design and implementation of an evolvable hardware-based autonomous robot navigation system using intrinsic evolution. Distinguished from traditional evolutionary approaches based on software simulation, an evolvable robot controller at the hardware gate-level that is capable of adapting to dynamic changes in the environments is implemented. In our approach, the concept of Boolean function is used to construct the evolvable controller implemented on an FPGA-based robot turret, and evolutionary computing is applied as a learning tool to guide the artificial evolution at the hardware level. The effectiveness of the proposed evolvable robotic system is confirmed with physical implementation of robot navigation behaviors on light source following and obstacle avoidance using a robot with traction fault.
12902312
Evolutionary computing for knowledge discovery in medical diagnosis
One of the major challenges in medical domain is the extraction of comprehensible knowledge from medical diagnosis data. In this paper, a two-phase hybrid evolutionary classification technique is proposed to extract classification rules that can be used in clinical practice for better understanding and prevention of unwanted medical events. In the first phase, a hybrid evolutionary algorithm (EA) is utilized to confine the search space by evolving a pool of good candidate rules, e.g. genetic programming (GP) is applied to evolve nominal attributes for free structured rules and genetic algorithm (GA) is used to optimize the numeric attributes for concise classification rules without the need of discretization. These candidate rules are then used in the second phase to optimize the order and number of rules in the evolution for forming accurate and comprehensible rule sets. The proposed evolutionary classifier (EvoC) is validated upon hepatitis and breast cancer datasets obtained from the UCI machine-learning repository. Simulation results show that the evolutionary classifier produces comprehensible rules and good classification accuracy for the medical datasets. Results obtained from t-tests further justify its robustness and invariance to random partition of datasets.
207726294
Evolving better population distribution and exploration in evolutionary multi-objective optimization
The aim of multi-objective evolutionary optimization is to minimize the distance between the solution set and the true Pareto front, to distribute the solutions evenly and to maximize the spread of solution set. This paper addresses these issues by presenting two features that enhance the optimization ability of multi-objective evolutionary algorithms. The first feature is a variant of the mutation operator that adapts the mutation rate along the evolution process to maintain a balance between the introduction of diversity and local fine-tuning. In addition, this adaptive mutation operator adopts a new approach to strike a compromise between the preservation and disruption of genetic information. The second feature is an enhanced exploration strategy that encourages the exploration towards less populated areas and hence achieves better discovery of gaps in the generated front. The strategy also preserves non-dominated solutions in the evolving population to achieve a good convergence for the optimization. Comparative studies of some well-known diversity operators, mutation operators and multi-objective evolutionary algorithms are performed on different benchmark problems, which illustrate the effectiveness and efficiency of the proposed features.
11136511
Learning the Search Range for Evolutionary Optimization in Dynamic Environments
Conventional evolutionary algorithms operate in a fixed search space with limiting parameter range, which is often predefined via a priori knowledge or trial and error in order to ‘guess’ a suitable region comprising the global optimal solution. This requirement is hard, if not impossible, to fulfil in many real-world optimization problems since there is often no clue of where the desired solutions are located in these problems. Thus, this paper proposes an inductive–deductive learning approach for single- and multi-objective evolutionary optimization. The method is capable of directing evolution towards more promising search regions even if these regions are outside the initial predefined space. For problems where the global optimum is included in the initial search space, it is capable of shrinking the search space dynamically for better resolution in genetic representation to facilitate the evolutionary search towards more accurate optimal solutions. Validation results based on benchmark optimization problems show that the proposed inductive–deductive learning is capable of handling different fitness landscapes as well as distributing nondominated solutions uniformly along the final trade-offs in multi-objective optimization, even if there exist many local optima in a high-dimensional search space or the global optimum is outside the predefined search region.
35739456
A Fast Learning Algorithm Based on Layered Hessian Approximations and the Pseudoinverse
In this article, we present a simple, effective method to learning for an MLP that is based on approximating the Hessian using only local information, specifically, the correlations of output activations from previous layers of hidden neurons. This approach of training the hidden layer weights with the Hessian approximation combined with the training of the final output layer of weights using the pseudoinverse [1] yields improved performance at a fraction of the computational and structural complexity of conventional learning algorithms.
6776829
Semi-supervised Kernel-Based Fuzzy C-Means
This paper presents a semi-supervised kernel-based fuzzy c-means algorithm called S 2 KFCM by introducing semi-supervised learning technique and the kernel method simultaneously into conventional fuzzy clustering algo- rithm. Through using labeled and unlabeled data together, S 2 KFCM can be ap- plied to both clustering and classification tasks. However, only the latter is con- cerned in this paper. Experimental results show that S 2 KFCM can improve classification accuracy significantly, compared with conventional classifiers trained with a small number of labeled data only. Also, it outperforms a similar approach S 2 FCM.
1118547
Appearance-based eye gaze estimation
We present a method for estimating eye gaze direction, which represents a departure from conventional eye gaze estimation methods, the majority of which are based on tracking specific optical phenomena like corneal reflection and the Purkinje images. We employ an appearance manifold model, but instead of using a densely sampled spline to perform the nearest manifold point query, we retain the original set of sparse appearance samples and use linear interpolation among a small subset of samples to approximate the nearest manifold point. The advantage of this approach is that since we are only storing a sparse set of samples, each sample can be a high dimensional vector that retains more representational accuracy than short vectors produced with dimensionality reduction methods. The algorithm was tested with a set of eye images labelled with ground truth point-of-regard coordinates. We have found that the algorithm is capable of estimating eye gaze with a mean angular error of 0.38 degrees, which is comparable to that obtained by commercially available eye trackers.
12986050
Improving the Robustness of ‘Online Agglomerative Clustering Method’ Based on Kernel-Induce Distance Measures
Recently, an online agglomerative clustering method called AddC (I. D. Guedalia et al. Neural Comput. {\bf 11} (1999), 521--540) was proposed for nonstationary data clustering. Although AddC possesses many good attributes, a vital problem of that method is its sensitivity to noises, which limits its use in real-word applications. In this paper, based on \hbox{kernel-induced} distance measures, a robust online clustering (ROC) algorithm is proposed to remedy the problem of AddC. Experimental results on artificial and benchmark data sets show that ROC has better clustering performances than AddC, while still inheriting advantages such as clustering data in a single pass and without knowing the exact number of clusters beforehand.
10451148
Discontinuity preserving stereo with small baseline multi-flash illumination
Currently, sharp discontinuities in depth and partial occlusions in multiview imaging systems pose serious challenges for many dense correspondence algorithms. However, it is important for 3D reconstruction methods to preserve depth edges as they correspond to important shape features like silhouettes which are critical for understanding the structure of a scene. In this paper, we show how active illumination algorithms can produce a rich set of feature maps that are useful in dense 3D reconstruction. We start by showing a method to compute a qualitative depth map from a single camera, which encodes object relative distances and can be used as a prior for stereo. In a multiview setup, we show that along with depth edges, binocular half-occluded pixels can also be explicitly and reliably labeled. To demonstrate the usefulness of these feature maps, we show how they can be used in two different algorithms for dense stereo correspondence. Our experimental results show that our enhanced stereo algorithms are able to extract high quality, discontinuity preserving correspondence maps from scenes that are extremely challenging for conventional stereo methods.
20194190
An Evaluation of Color-Spatial Retrieval Techniques for Large Image Databases
In a color-spatial retrieval technique, the color information is integrated with the knowledge of the colors' spatial distribution to facilitate content-based image retrieval. Several techniques have been proposed in the literature, but these works have been developed independently without much comparison. In this paper, we present an experimental evaluation of three color-spatial retrieval techniques—the signature-based technique, the partition-based algorithm and the cluster-based method. We implemented these techniques and compare them on their retrieval effectiveness and retrieval efficiency. The experimental study is performed on an image database consisting of 12,000 images. With the proliferation of image retrieval mechanisms and the lack of extensive performance study, the experimental results can serve as guidelines in selecting a suitable technique and designing a new technique.