9400780
Bayesian image classification using Markov random fields
In this paper, we present three optimisation techniques, Deterministic Pseudo-Annealing (DPA), Game Strategy Approach (GSA), and Modified Metropolis Dynamics (MMD), in order to carry out image classification using a Markov random field model. For the first approach (DPA), the a posteriori probability of a tentative labelling is generalised to a continuous labelling. The merit function thus defined has the same maxima under constraints yielding probability vectors. Changing these constraints convexifies the merit function. The algorithm solves this unambiguous maximisation problem, and then tracks down the solution while the original constraints are restored yielding a good, even if suboptimal, solution to the original labelling assignment problem. In the second method (GSA), the maximisation problem of the a posteriori probability of the labelling is solved by an optimisation algorithm based on game theory. A non-cooperative n-person game with pure strategies is designed such that the set of Nash equilibrium points of the game is identical to the set of local maxima of the a posteriori probability of the labelling. The algorithm converges to a Nash equilibrium. The third method (MMD) is a modified version of the Metropolis algorithm: at each iteration the new state is chosen randomly, but the decision to accept it is purely deterministic. This is also a suboptimal technique but it is much faster than stochastic relaxation. These three methods have been implemented on a Connection Machine CM2. Experimental results are compared to those obtained by the Metropolis algorithm, the Gibbs sampler and ICM (Iterated Conditional Mode).
26537173
PET Studies of the Effects of ECT on Cerebral Physiology
ECT is a remarkably effective treatment for major depressive disorder [MDD]. Neuroimaging studies of rCBF and rCMR are helpful in addressing mechanisms of therapeutic effects. We have reported that reductions in rCBF in prefrontal regions are associated with positive response to ECT[1], and that a course of bilateral ECT is associated with marked reduction in prefrontal rCMR[2]. We now report on a new study of patients receiving ECT for MDD. This study provides the first comparison of the relative acute effects of seizures on both rCBF and rCMR.
329765
Unsupervised segmentation of color images
A novel technique for unsupervised learning in feature space is presented. The feature space is considered as composed of two distinct sources, "mode" and "valley", in the point of view of information theory. An entropy-based thresholding is taken to distinguish the discretized cells in the feature space. The cells labeled as "mode" are then chained to form mode areas. Thereafter a modified Akaike's information criterion is proposed to solve the cluster validity problem. After all the parameters are estimated, a labeling algorithm is developed based on the majority game theory. The method is applied to color image segmentation. The segmentation process is completely autonomous.
38593151
Performance Comparison of a Deterministic and a Stochastic Method for Image Classification
In this paper, we compare the performances of two methods that we proposed for image classification. The first method is a stochastic approach which uses a Markov random field modelization. An optimization technique based on the game theory is used for the maximization of the a posteriori probability of the classes. The second method is a deterministic one which uses a feed-forward neural network. A novel learning method called projection learning is employed to train the neural network. The performances of these two methods are compared through their applications to image classification. The advantages and disadvantages of both methods, as well as possibilities to improve them are discussed.
11104953
Multi-Output Regularized Feature Projection
Dimensionality reduction by feature projection is widely used in pattern recognition, information retrieval, and statistics. When there are some outputs available (e.g., regression values or classification results), it is often beneficial to consider supervised projection, which is based not only on the inputs, but also on the target values. While this applies to a single-output setting, we are more interested in applications with multiple outputs, where several tasks need to be learned simultaneously. In this paper, we introduce a novel projection approach called multi-output regularized feature projection (MORP), which preserves the information of input features and, meanwhile, captures the correlations between inputs/outputs and (if applicable) between multiple outputs. This is done by introducing a latent variable model on the joint input-output space and minimizing the reconstruction errors for both inputs and outputs. It turns out that the mappings can be found by solving a generalized eigenvalue problem and are ready to extend to nonlinear mappings. Prediction accuracy can be greatly improved by using the new features since the structure of outputs is explored. We validate our approach in two applications. In the first setting, we predict users' preferences for a set of paintings. The second is concerned with image and text categorization where each image (or document) may belong to multiple categories. The proposed algorithm produces very encouraging results in both settings
2196967
Multiclass spectral clustering
We propose a principled account on multiclass spectral clustering. Given a discrete clustering formulation, we first solve a relaxed continuous optimization problem by eigen-decomposition. We clarify the role of eigenvectors as a generator of all optimal solutions through orthonormal transforms. We then solve an optimal discretization problem, which seeks a discrete solution closest to the continuous optima. The discretization is efficiently computed in an iterative fashion using singular value decomposition and nonmaximum suppression. The resulting discrete solutions are nearly global-optimal. Our method is robust to random initialization and converges faster than other clustering methods. Experiments on real image segmentation are reported.
268086
Collaborative ordinal regression
Ordinal regression has become an effective way of learning user preferences, but most research focuses on single regression problems. In this paper we introduce collaborative ordinal regression, where multiple ordinal regression tasks are handled simultaneously. Rather than modeling each task individually, we explore the dependency between ranking functions through a hierarchical Bayesian model and assign a common Gaussian Process (GP) prior to all individual functions. Empirical studies show that our collaborative model outperforms the individual counterpart in preference learning applications.
10900126
Measures of Nondeterminism for Pushdown Automata
D. Vermeir and W. Savitch (Fund. Inform.4 (1981), 401-418) introduced two measures of nondeterminism for pushdown automata and showed interestingly that the second measure, which we refer to as the depth measure, yields an infinite hierarchy of language families between the deterministic context-free and general context-free languages. However, the proof given in op. cit. for this hierarchy theorem was incorrect. In this paper, using a pumping result for deterministic context-free languages we give a new proof for the strictness of the depth hierarchy. We introduce the monadic depth measure which is also shown to give rise to an infinite hierarchy of language families. Furthermore, we show that the monadic hierarchy is shifted by at most one level from the unrestricted depth hierarchy.
3164237
Multi-output regularized projection
Dimensionality reduction via feature projection has been widely used in pattern recognition and machine learning. It is often beneficial to derive the projections not only based on the inputs but also on the target values in the training data set. This is of particular importance in predicting multivariate or structured outputs which is an area of growing interest. In this paper we introduce a novel projection framework which is sensitive to both input features and outputs. Based on the derived features prediction accuracy can be greatly improved. We validate our approach in two applications. The first is to model users' preferences on a set of paintings. The second application is concerned with image categorization where each image may belong to multiple categories. The proposed algorithm produces very encouraging results in both settings.