7230571
Image Representation Using 2D Gabor Wavelets
This paper extends to two dimensions the frame criterion developed by Daubechies for one-dimensional wavelets, and it computes the frame bounds for the particular case of 2D Gabor wavelets. Completeness criteria for 2D Gabor image representations are important because of their increasing role in many computer vision applications and also in modeling biological vision, since recent neurophysiological evidence from the visual cortex of mammalian brains suggests that the filter response profiles of the main class of linearly-responding cortical neurons (called simple cells) are best modeled as a family of self-similar 2D Gabor wavelets. We therefore derive the conditions under which a set of continuous 2D Gabor wavelets will provide a complete representation of any image, and we also find self-similar wavelet parametrization which allow stable reconstruction by summation as though the wavelets formed an orthonormal basis. Approximating a "tight frame" generates redundancy which allows low-resolution neural responses to represent high-resolution images.
5832781
Adaptive contrast gain control and information maximization
Contrast gain control is an important mechanism underlying the visual system's adaptation to contrast of luminance in varying visual environments. Our previous work showed that the threshold and saturation determine the preferred contrast sensitivity as well as the maximum information coding capacity of the neuronal model. In this report, we investigated the design principles underlying adaptation behavior in contrast gain control by an adaptive linear-nonlinear model. We found that an adaptive rescaling mechanism predicted by information transmission maximization can explain a variety of observed contrast gain control phenomena in neurophysiological experiments, including the divisive input-output relations, and the inverse power-law relation between response gain and input contrast. Our results suggest that contrast gain control in visual systems might be designed for information maximization.
8163714
Scaling Laws in Natural Scenes and the Inference of 3D Shape
This paper explores the statistical relationship between natural images and their underlying range (depth) images. We look at how this relationship changes over scale, and how this information can be used to enhance low resolution range data using a full resolution intensity image. Based on our findings, we propose an extension to an existing technique known as shape recipes [3], and the success of the two methods are compared using images and laser scans of real scenes. Our extension is shown to provide a two-fold improvement over the current method. Furthermore, we demonstrate that ideal linear shape-from-shading filters, when learned from natural scenes, may derive even more strength from shadow cues than from the traditional linear-Lambertian shading cues.
44493552
Adaptation of the temporal receptive fields of macaque V1 neurons
Abstract Traditional view of macaque V1 neurons is that they are static spatiotemporal filters. This study shows that V1 neurons’ temporal receptive fields (kernels) are dynamic and adaptive. In order to study the adaptation of the kernels to a variety of stimuli, we developed a regression approach to recover kernels using naturalistic stimuli. Using this technique, we studied how the kernels of the V1 neurons in macaque monkeys adapt to the frequency bandwidth of naturalistic signals. We found that the temporal frequency tunings and the gains of the receptive fields of the neurons change according to the statistical context of the stimulus environment.
17578293
Representational strategy in the visual cortex
We generalized Daubechies' (see IEEE Transactions on Information Theory, vol.36, no.5, p.961-1004, 1990) results on 1D wavelets to 2D, and elucidated the conditions in which a family of Gabor wavelets will provide a complete representation of an image. We found that the phase space (scale, orientation, x, y) sampling density of the striate cortical simple cells is sufficiently dense to form a tight wavelet frame. This tight frame approximates the continuous wavelet transform, and its redundancy allows high resolution information to be represented in the low-resolution firings of the simple cells. We presented some experimental results to demonstrate this idea.<<ETX>>
323922
Decoding V1 Neuronal Activity using Particle Filtering with Volterra Kernels
Decoding is a strategy that allows us to assess the amount of information neurons can provide about certain aspects of the visual scene. In this study, we develop a method based on Bayesian sequential updating and the particle filtering algorithm to decode the activity of V1 neurons in awake monkeys. A distinction in our method is the use of Volterra kernels to filter the particles, which live in a high dimensional space. This parametric Bayesian decoding scheme is compared to the optimal linear decoder and is shown to work consistently better than the linear optimal decoder. Interestingly, our results suggest that for decoding in real time, spike trains of as few as 10 independent but similar neurons would be sufficient for decoding a critical scene variable in a particular class of visual stimuli. The reconstructed variable can predict the neural activity about as well as the actual signal with respect to the Volterra kernels.
35157
A cooperative coevolutionary algorithm for multiobjective optimization
This paper presents a kind of cooperative coevolutionary algorithm (CCEA) for multi-objective optimization (MOO). In this algorithm, solutions evolve in the form of cooperative subpopulations. An archive stores non-dominated solutions and helps to evaluate individuals in the subpopulations. The mechanism of niching is applied to maintain the diversity of solutions in the archive. Meanwhile, an extending operator is designed to mine information on solution distribution from the archive and guide the search to regions that are not explored enough. Extensive simulations are performed on different benchmark problems for various multi-objective evolutionary algorithms (MOEAs) and indicate that CCEA is strongly competitive with five recent well-known MOEAs in finding a good non-dominated solution set.
42876940
An HMM-based speech recognition IC
This paper presents the design, simulation and measurement results of a Hidden Markov Model (HMM) based isolated word recognizer IC with double mixtures. Table look-up technique is employed in this design. The chip operates at 20 MHz at 3.3 V. The recognition time is 0.5 s for a 50-word speech library. The speech IC has been verified with 467 test speech data and the recognition accuracy is 93.8%. A reference software recognizer using the same algorithm and speech library has a recognition accuracy of 94.2%. The new speech IC that uses a table look up to reduce the complexity of the circuit has approximately the same recognition accuracy as an ideal software recognizer.
866852
Unsupervised Classification with Non-Gaussian Mixture Models Using ICA
We present an unsupervised classification algorithm based on an ICA mixture model. The ICA mixture model assumes that the observed data can be categorized into several mutually exclusive data classes in which the components in each class are generated by a linear mixture of independent sources. The algorithm finds the independent sources, the mixing matrix for each class and also computes the class membership probability for each data point. This approach extends the Gaussian mixture model so that the classes can have non-Gaussian structure. We demonstrate that this method can learn efficient codes to represent images of natural scenes and text. The learned classes of basis functions yield a better approximation of the underlying distributions of the data, and thus can provide greater coding efficiency. We believe that this method is well suited to modeling structure in high-dimensional data and has many potential applications.
20836735
Kernel smoothing of periodograms under Kullback-Leibler discrepancy
Kernel smoothing on the periodogram is a popular nonparametric method for spectral density estimation. Most important in the implementation of this method is the choice of the bandwidth, or span, for smoothing. One idealized way of choosing the bandwidth is to choose it as the one that minimizes the Kullback-Leibler (KL) discrepancy between the smoothed estimate and the true spectrum. However, this method fails in practice, as the KL discrepancy is an unknown quantity. This paper introduces an estimator for this discrepancy, so that the bandwidth that minimizes the unknown discrepancy can be empirically approximated via the minimization of it. It is shown that this discrepancy estimator is consistent. Numerical results also suggest that this empirical choice of bandwidth often outperforms some other commonly used bandwidth choices. The same idea is also applied to choose the bandwidth for log-periodogram smoothing.
15979344
A multiobjective evolutionary algorithm toolbox for computer-aided multiobjective optimization
This paper presents an interactive graphical user interface (GUI) based multiobjective evolutionary algorithm (MOEA) toolbox for effective computer-aided multiobjective (MO) optimization. Without the need of aggregating multiple criteria into a compromise function, it incorporates the concept of Pareto's optimality to evolve a family of nondominated solutions distributing along the tradeoffs uniformly. The toolbox is also designed with many useful features such as the goal and priority settings to provide better support for decision-making in MO optimization, dynamic population size that is computed adaptively according to the online discovered Pareto-front, soft/hard goal settings for constraint handlings, multiple goals specification for logical "AND"/"OR" operation, adaptive niching scheme for uniform population distribution, and a useful convergence representation for MO optimization. The MOEA toolbox is freely available for download at http://vlab.ee.nus.edu.sg/-kctan/moea.htm which is ready for immediate use with minimal knowledge needed in evolutionary computing. To use the toolbox, the user merely needs to provide a simple "model" file that specifies the objective function corresponding to his/her particular optimization problem. Other aspects like decision variable settings, optimization process monitoring and graphical results analysis can be performed easily through the embedded GUIs in the toolbox. The effectiveness and applications of the toolbox are illustrated via the design optimization problem of a practical ill-conditioned distillation system. Performance of the algorithm in MOEA toolbox is also compared with other well-known evolutionary MO optimization methods upon a benchmark problem.