14546839
Discriminative Learning for Label Sequences via Boosting
This paper investigates a boosting approach to discriminative learning of label sequences based on a sequence rank loss function. The proposed method combines many of the advantages of boosting schemes with the efficiency of dynamic programming methods and is attractive both, conceptually and computationally. In addition, we also discuss alternative approaches based on the Hamming loss for label sequences. The sequence boosting algorithm offers an interesting alternative to methods based on HMMs and the more recently proposed Conditional Random Fields. Applications areas for the presented technique range from natural language processing and information extraction to computational biology. We include experiments on named entity recognition and part-of-speech tagging which demonstrate the validity and competitiveness of our approach.
5925726
A Resource Sensitive Interpretation of Lexical Functional Grammar
This paper investigates whether the fundamental linguistic insights and intuitions of Lexical Functional Grammar (LFG), which is usually presented as a “constraint-based” linguistic theory, can be reformulated in a “resource sensitive” framework using a substructural modal logic. In the approach investigated here, LFG's f-descriptions are replaced with expressions from a multi-modal propositional logic (with permutation and possibly limited contraction). In effect, the feature structure “unification” basis of LFG's f-structures is replaced with a very different resource based mechanism. It turns out that some linguistic analyses that required non-monotonic devices in LFG (such as the “constraint equations” in the Andrews (1982) analysis of Icelandic) can be straightforwardly expressed in the framework presented here. Moreover, a Curry–Howard correspondence between proofs in this logic and λ-terms provides a semantic interpretation as a by-product of the process of showing syntactic well-formedness.
2965282
Exploiting auxiliary distributions in stochastic unification-based grammars
This paper describes a method for estimating conditional probability distributions over the parses of "unification-based" grammars which can utilize auxiliary distributions that are estimated by other means. We show how this can be used to incorporate information about lexical selectional preferences gathered from other sources into Stochastic "Unification-based" Grammars (SUBGs). While we apply this estimator to a Stochastic Lexical-Functional Grammar, the method is general, and should be applicable to stochastic versions of HPSGs, categorial grammars and transformational grammars.
2234445
Attention Shifting for Parsing Speech
We present a technique that improves the efficiency of word-lattice parsing as used in speech recognition language modeling. Our technique applies a probabilistic parser iteratively where on each iteration it focuses on a different subset of the word-lattice. The parser's attention is shifted towards word-lattice subsets for which there are few or no syntactic analyses posited. This attention-shifting technique provides a six-times increase in speed (measured as the number of parser analyses evaluated) while performing equivalently when used as the first-stage of a multi-stage parsing-based language model.
9027893
A Look at Parsing and Its Applications
This paper provides a brief introduction to recent work in statistical parsing and its applications. We highlight successes to date, remaining challenges, and promising future work.
3264258
Type-driven semantic interpretation and feature dependencies in R-LFG
Once one has enriched LFG's formal machinery with the linear logic mechanisms needed for semantic interpretation as proposed by Dalrymple et. al., it is natural to ask whether these make any existing components of LFG redundant. As Dalrymple and her colleagues note, LFG's f-structure completeness and coherence constraints fall out as a by-product of the linear logic machinery they propose for semantic interpretation, thus making those f-structure mechanisms redundant. Given that linear logic machinery or something like it is independently needed for semantic interpretation, it seems reasonable to explore the extent to which it is capable of handling feature structure constraints as well. 
R-LFG represents the extreme position that all linguistically required feature structure dependencies can be captured by the resource-accounting machinery of a linear or similiar logic independently needed for semantic interpretation, making LFG's unification machinery redundant. The goal is to show that LFG linguistic analyses can be expressed as clearly and perspicuously using the smaller set of mechanisms of R-LFG as they can using the much larger set of unification-based mechanisms in LFG: if this is the case then we will have shown that positing these extra f-structure mechanisms is not linguistically warranted.
17383450
Effectiveness of a machine-level, global optimizer
We present an overview of the design of a machine-code-level, global (intraprocedural) optimizer that supports several front-ends producing code for the Hewlett-Packard Precision Architecture family of machines. The basic optimization strategy is described, including information about the division of responsibilities between various components of the compiler. Optimization algorithms are described, including a discussion of the dataflow information they require. Measurements showing the collective and individual effects of various optimizer components are presented.
The performance data presented here was collected using a preliminary version of the optimizer. Development is continuing and further improvements are expected.
8126535
An adaptive approach for texture modelling
Markov random fields (MRFs) continue to be an important and useful representation for modelling textured images. Standard methods for MRF image modeling make use of the equivalent Gibbs distribution (GD) to express the joint probabilities of groups of neighboring pixels. The authors investigate a new approach to the use of the GD in image modeling. Specifically, they develop an adaptive approach to the formation of clique potential functions for the distribution. Traditional tools, such as the multi-level logistic (MLL) model, have been based on the use of a predetermined and identical set of potential functions. In the present paper it is shown that by incorporating additional parameters into the model in order to control the shape of these functions, it is possible to arrive at a more complete parametrization of the image. A simple model based on this concept is described and implemented, and image simulations using the well-known Gibbs sampler algorithm are constructed to demonstrate the usefulness of an adaptive set of potential functions.<<ETX>>
1780562
Word sense disambiguation with pictures
We introduce using images for word sense disambiguation, either alone, or in conjunction with traditional text based methods. The approach is based on a recently developed method for automatically annotating images by using a statistical model for the joint probability for image regions and words. The model itself is learned from a data base of images with associated text. To use the model for word sense disambiguation, we constrain the predicted words to be possible senses for the word under consideration. When word prediction is constrained to a narrow set of choices (such as possible senses), it can be quite reliable. We report on experiments using the resulting sense probabilities as is, as well as augmenting a state of the art text based word sense disambiguation algorithm. In order to evaluate our approach, we developed a new corpus, ImCor, which consists of a substantive portion of the Corel image data set associated with disambiguated text drawn from the SemCor corpus. Our experiments using this corpus suggest that visual information can be very useful in disambiguating word senses. It also illustrates that associated non-textual information such as image data can help ground language meaning.
32099474
Techniques to aid global search in engineering design
5650913
Dynamic Plasticity Influences the Emergence of Function in a Simple Cortical Array
In computational experiments with a simplified cortical array we investigated the factors that give rise to the functional organization of the cerebral cortex during brain development. We show that a dynamical spatial modulation of plasticity in the substrate (i.e., a "wave of plasticity") induces higher functional development in the later-developing parts of the cortical array. This result suggests an account of the role that changes in developmental timing may have in the development of different cortical structures. Copyri