14934450
Combining Statistical and Knowledge-Based Spoken Language Understanding in Conditional Models
Spoken Language Understanding (SLU) addresses the problem of extracting semantic meaning conveyed in an utterance. The traditional knowledge-based approach to this problem is very expensive --- it requires joint expertise in natural language processing and speech recognition, and best practices in language engineering for every new domain. On the other hand, a statistical learning approach needs a large amount of annotated data for model training, which is seldom available in practical applications outside of large research labs. A generative HMM/CFG composite model, which integrates easy-to-obtain domain knowledge into a data-driven statistical learning framework, has previously been introduced to reduce data requirement. The major contribution of this paper is the investigation of integrating prior knowledge and statistical learning in a conditional model framework. We also study and compare conditional random fields (CRFs) with perceptron learning for SLU. Experimental results show that the conditional models achieve more than 20% relative reduction in slot error rate over the HMM/CFG model, which had already achieved an SLU accuracy at the same level as the best results reported on the ATIS data.
10282937
Decoding Algorithm in Statistical Machine Translation
Decoding algorithm is a crucial part in statistical machine translation. We describe a stack decoding algorithm in this paper. We present the hypothesis scoring method and the heuristics used in our algorithm. We report several techniques deployed to improve the performance of the decoder. We also introduce a simplified model to moderate the sparse data problem and to speed up the decoding process. We evaluate and compare these techniques/models in our statistical machine translation system.
11122272
Modeling with Structures in Statistical Machine Translation
Most statistical machine translation systems employ a word-based alignment model. In this paper we demonstrate that word-based alignment is a major cause of translation errors. We propose a new alignment model based on shallow phrase structures, and the structures can be automatically acquired from parallel corpus. This new model achieved over 10% error reduction for our spoken language translation task.
2456151
Subdivision Schemes and Refinement Equations with Nonnegative Masks
We consider the two-scale refinement equation f(x)=@?^N"n"="0c"nf(2x-n) with @?"nc"2"n=@?"nc"2"n"+"1=1 where c"0, c"N 0 and the corresponding subdivision scheme. We study the convergence of the subdivision scheme and the cascade algorithm when all c"n>=0. It has long been conjectured that under such an assumption the subdivision algorithm converge, and the cascade algorithm converge uniformly to a continuous function, if and only if only if 00} is 1. We prove the conjecture for a large class of refinement equations.
21184887
The cognitive processes of abstraction and formal inferences
Theoretical research is predominately an inductive process; while applied research is mainly a deductive process. Both inference processes are based on the cognitive process and means of abstraction. This paper describes the cognitive processes of abstraction and formal inferences such as deduction, induction, abduction, and analogy. The hierarchy of abstraction and the descriptivity of abstract means at different levels are analyzed. A set of mathematical models of formal inference methodologies are developed. Formal descriptions of the five cognitive processes of abstraction and inferences are presented using real-time process algebra (RTPA). Applications of abstraction and formal inferences in dealing with complicated problems in large-scale software system development in software engineering are discussed.
13993519
Interval efficiency assessment using data envelopment analysis
This paper studies how to conduct efficiency assessment using data envelopment analysis (DEA) in interval and/or fuzzy input-output environments. A new pair of interval DEA models is constructed on the basis of interval arithmetic, which differs from the existing DEA models handling interval data in that the former is a linear CCR model without the need of extra variable alternations and uses a fixed and unified production frontier (i.e. the same constraint set) to measure the efficiencies of decision-making units (DMUs) with interval input and output data, while the latter is usually a nonlinear optimization problem with the need of extra variable alternations or scale transformations and utilizes variable production frontiers (i.e. different constraint sets) to measure interval efficiencies. Ordinal preference information and fuzzy data are converted into interval data through the estimation of permissible intervals and @a-level sets, respectively, and are incorporated into the interval DEA models. The proposed interval DEA models are developed for measuring the lower and upper bounds of the best relative efficiency of each DMU with interval input and output data, which are different from the interval formed by the worst and the best relative efficiencies of each DMU. A minimax regret-based approach (MRA) is introduced to compare and rank the efficiency intervals of DMUs. Two numerical examples are provided to show the applications of the proposed interval DEA models and the preference ranking approach.
9203132
Nonlinear Estimation and Modeling of fMRI Data Using Spatio-temporal Support Vector Regression
This paper presents a new and general nonlinear framework for fMRI data analysis based on statistical learning methodology: support vector machines. Unlike most current methods which assume a linear model for simplicity, the estimation and analysis of fMRI signal within the proposed framework is nonlinear, which matches recent findings on the dynamics underlying neural activity and hemodynamic physiology. The approach utilizes spatio-temporal support vector regression (SVR), within which the intrinsic spatio-temporal autocorrelations in fMRI data are reflected. The novel formulation of the problem allows merging model-driven with data-driven methods, and therefore unifies these two currently separate modes of fMRI analysis. In addition, multiresolution signal analysis is achieved and developed. Other advantages of the approach are: avoidance of interpolation after motion estimation, embedded removal of low-frequency noise components, and easy incorporation of multi-run, multi-subject, and multi-task studies into the framework.
14524485
Boundary finding with correspondence using statistical shape models
We propose an approach for boundary finding where the correspondence of a subset of boundary points to a model is simultaneously determined. Global shape parameters derived from the statistical variation of object boundary points in a training set are used to model the object. A Bayesian formulation, based on this prior knowledge and the edge information of the input image, is employed to find the object boundary with its subset points in correspondence with boundaries in the training set or the mean boundary. We compared the use of a generic smoothness prior and a uniform independent prior with the training set prior in order to demonstrate the power of this statistical information. A number of experiments were performed on both synthetic and real medical images of the brain and heart to evaluate the approach, including the validation of the dependence of the method on image quality, different initialization and prior information.