5785584
Semantic Smoothing for Model-based Document Clustering
A document is often full of class-independent "general" words and short of class-specific "core " words, which leads to the difficulty of document clustering. We argue that both problems will be relieved after suitable smoothing of document models in agglomerative approaches and of cluster models in partitional approaches, and hence improve clustering quality. To the best of our knowledge, most model-based clustering approaches use Laplacian smoothing to prevent zero probability while most similarity-based approaches employ the heuristic TF*IDF scheme to discount the effect of "general" words. Inspired by a series of statistical translation language model for text retrieval, we propose in this paper a novel smoothing method referred to as context-sensitive semantic smoothing for document clustering purpose. The comparative experiment on three datasets shows that model-based clustering approaches with semantic smoothing is effective in improving cluster quality.
14856827
Relation-Based Document Retrieval for Biomedical IR
In this paper, we explore the use of term relations in information retrieval for precision-focused biomedical literature search. A relation is defined as a pair of two terms which are semantically and syntactically related to each other. Unlike the traditional “bag-of-word” model for documents, our model represents a document by a set of sense-disambiguated terms and their binary relations. Since document level co-occurrence of two terms, in many cases, does not mean this document addresses their relationships, the direct use of relation may improve the precision of very specific search, e.g. searching documents that mention genes regulated by Smad4. For this purpose, we develop a generic ontology-based approach to extract terms and their relations, and present a betweenness centrality based approach to rank retrieved documents. A prototyped IR system supporting relation-based search is then built for Medline abstract search. We use this novel IR system to improve the retrieval result of all official runs in TREC-2004 Genomics Track. The experiment shows promising performance of relation-based IR. The average P@100 (the precision of top 100 documents) for 50 topics is significantly raised from 26.37 %( the P@100 of the best run is 42.10%) to 53.69% while the MAP (mean average precision) is kept at an above-average level of 26.59%. The experiment also shows the expressiveness of relations for the representation of information needs, especially in the area of biomedical literature full of various biological relations.
14024342
A Semantic Approach for Mining Hidden Links from Complementary and Non-interactive Biomedical Literature
Two complementary and non-interactive literature sets of articles, when they are considered together, can reveal useful information of scientific interest not apparent in either of the two sets alone. Swanson called the existence of such hidden links as undiscovered public knowledge (UPK). The novel connection between Raynaud disease and fish oils was uncovered from complementary and non-interactive biomedical literature by Swanson in 1986. Since then, there have been many approaches to uncover UPK by mining the biomedical literature. These earlier works, however, required substantial manual intervention to reduce the number of possible connections. This paper proposes a semantic-based mining model for undiscovered public knowledge using the biomedical literature. Our method replaces manual ad-hoc pruning by using semantic knowledge from the biomedical ontologies. Using the semantic types and semantic relationships of the biomedical concepts, our prototype system can identify the relevant concepts collected from Medline and generate the novel hypothesis between these concepts. The system successfully replicates Swanson’s two famous discoveries: Raynaud disease/fish oils and migraine/magnesium. Compared with previous approaches such as LSI-based and traditional association rule-based methods, our method generates much fewer but more relevant novel hypotheses, and requires much less human intervention in the discovery procedure
18569940
Segmentation of bright targets using wavelets and adaptive thresholding
A general systematic method for the detection and segmentation of bright targets is developed. We use the term "bright target" to mean a connected, cohesive object which has an average intensity distribution above that of the rest of the image. We develop an analytic model for the segmentation of targets, which uses a novel multiresolution analysis in concert with a Bayes classifier to identify the possible target areas. A method is developed which adaptively chooses thresholds to segment targets from background, by using a multiscale analysis of the image probability density function (PDF). A performance analysis based on a Gaussian distribution model is used to show that the obtained adaptive threshold is often close to the Bayes threshold. The method has proven robust even when the image distribution is unknown. Examples are presented to demonstrate the efficiency of the technique on a variety of targets.
1464666
Feedforward neural networks with multilevel hidden neurons for remotely sensed image classification
Artificial neural network has been, used as a powerful tool for pattern classification. However, it is difficult to train when the data exhibit non-sparse or overlapping pattern classes which is often the case in practical applications. In this paper, we introduce the feedforward neural network with the hidden layer consisting of multilevel neurons. The convergence property of one-layer neural network with multilevel neurons is proved. The new feedforward model is inherently capable of fuzzy pattern classification of non-sparse or overlapping pattern classes. As an application, we apply the network for the classification of LANDSAT TM data. The results show that this approach produces better results compared with conventional neural networks.
12113641
Neighbor number, valley seeking and clustering
This paper proposes a novel nonparametric clustering algorithm capable of identifying shape-free clusters. This algorithm is based on a nonparametric estimation of the normalized density derivative (NDD) and the local convexity of the density distribution function, both of which are represented in a very concise form in terms of neighbor numbers. We use NDD to measure the dissimilarity between each pair of observations in a local neighborhood and to build a connectivity graph. Combined with the local convexity, this similarity measure can detect observations in local minima (valleys) of the density function, which separate observations in different major clusters. We demonstrate that this algorithm has a close relationship with the single-linkage hierarchical clustering and can be viewed as its extension. The performance of the algorithm is tested with both synthetic and real datasets. An example of color image segmentation is also given. Comparisons with several representative existing algorithms show that the proposed method can robustly identify major clusters even when there are complex configurations and/or large overlaps.
5695951
Video Event Detection using ICA Mixture Hidden Markov Models
In this paper, a framework that combines feature extraction, model learning, and likelihood computation, is presented for video event detection. First, the independent component analysis (ICA) is applied to the raw feature space to extract the spatial features. Then, a framework based on ICA mixture hidden Markov models (ICAMHMM) is used to exploit the spatial and temporal characteristics of the training data. After the model is learnt, the likelihood for a given video sequence is computed and then used to classify the video into a semantic event. Golf video sequences are used for simulations. The results show that the proposed method can effectively detect semantic video events.
14209049
Maintaining data warehouses over changing information sources
I n recent years, the number of digital information storage and retrieval systems has increased immensely. These information sources are generally interconnected via some network, and hence the task of integrating data from different sources to serve it up to users is an increasingly important one [10]. Applications that could benefit from this wealth of digital information are thus experiencing a pressing need for suitable integration tools that allow them to make effective use of such distributed and diverse data sets. In contrast to the on-demand approach to information integration, the approach of tailored information repository construction, commonly referred to as data warehousing, is characterized by the following properties: