41094552
The Statistical Inference Method in Heuristic Search Techniques
In this paper we present a new heuristic searching algorithm by introducing statistical inference method on the basic of algorithm A*. It's called algorithm SA*. The following results have been proved. (1) Algorithm SA* in superior to algorithm A*. (2) The mean complexity of SA* is CN2, but in some case A* exhibits exponential complexity (eN). (3) In a (N,d,F)- game tree, the mean complexity of SA* is CN2, but the complexity of other known game-searching algoritham (α-β , SSS* etc.) is at least dN. (4) The maximal storage-space required by SA* is C,N. 
 
This shows that under a given significance level SA* is superior to other known algorithm (e.g. A*, B*, α-β, SSS* etc.).
22470543
A Weighted Technique in Heuristic Search
As shown in [1], we examine search as a statistic sampling process. Based on some statistical inference method the probability that a subtree in search tree contains the goal can be decided. Thus some weight is in tentionaly added to the evaluation function of those nodes which are unlikely in the solution path so that the search will concentrate on the most promising path. It results in a new weighted algorithm-WSA. 
 
Tn a uniform m-ary tree, we show that a goal can be found by WSA in the polynomial time, although the computational complexity of A (or A*) may be O(e) for searching the same space. Where N is the depth at which the goal is located.
7255987
Relationship between support vector set and kernel functions in SVM
Based on a constructive learning approach, covering algorithms, we investigate the relationship between support vector sets and kernel functions in support vector machines (SVM). An interesting result is obtained. That is, in the linearly non-separable case, any sample of a given sample setK can become a support vector under a certain kernel function. The result shows that when the sample setK is linearly non-separable, although the chosen kernel function satisfies Mercer’s condition its corresponding support vector set is not necessarily the subset ofK that plays a crucial role in classifyingK. For a given sample set, what is the subset that plays the crucial role in classification? In order to explore the problem, a new concept, boundary or boundary points, is defined and its properties are discussed. Given a sample setK, we show that the decision functions for classifying the boundary points ofK are the same as that for classifying theK itself. And the boundary points ofK only depend onK and the structure of the space at whichK is located and independent of the chosen approach for finding the boundary. Therefore, the boundary point set may become the subset ofK that plays a crucial role in classification. These results are of importance to understand the principle of the support vector machine (SVM) and to develop new learning algorithms.
10975724
Adding Semantics to Email Clustering
This paper presents a novel algorithm to cluster emails according to their contents and the sentence styles of their subject lines. In our algorithm, natural language processing techniques and frequent itemset mining techniques are utilized to automatically generate meaningful generalized sentence patterns (GSPs) from subjects of emails. Then we put forward a novel unsupervised approach which treats GSPs as pseudo class labels and conduct email clustering in a supervised manner, although no human labeling is involved. Our proposed algorithm is not only expected to improve the clustering performance, it can also provide meaningful descriptions of the resulted clusters by the GSPs. Experimental results on open dataset (Enron email dataset) and a personal email dataset collected by ourselves demonstrate that the proposed algorithm outperforms the K-means algorithm in terms of the popular measurement Fl. Furthermore, the cluster naming readability is improved by 68.5% on the personal email dataset.
5296157
A Novel Scalable Algorithm for Supervised Subspace Learning
Subspace learning approaches aim to discover important statistical distribution on lower dimensions for high dimensional data. Methods such as principal component analysis (PCA) do not make use of the class information, and linear discriminant analysis (LDA) could not be performed efficiently in a scalable way. In this paper, we propose a novel highly scalable supervised subspace learning algorithm called as supervised Kampong measure (SKM). It assigns data points as close as possible to their corresponding class mean, simultaneously assigns data points to be as far as possible from the other class means in the transformed lower dimensional subspace. Theoretical derivation shows that our algorithm is not limited by the number of classes or the singularity problem faced by LDA. Furthermore, our algorithm can be executed in an incremental manner in which learning is done in an online fashion as data streams are received. Experimental results on several datasets, including a very large text data set RCV1, show the outstanding performance of our proposed algorithm on classification problems as compared to PCA, LDA and a popular feature selection approach, information gain (IG).
6845908
Mining ratio rules via principal sparse non-negative matrix factorization
Association rules are traditionally designed to capture statistical relationship among itemsets in a given database. To additionally capture the quantitative association knowledge, Korn et al. (1998) proposed a paradigm named ratio rules for quantifiable data mining. However, their approach is mainly based on principle component analysis (PCA) and as a result, it cannot guarantee that the ratio coefficient is nonnegative. This may lead to serious problems in the rules' application. In this paper, we propose a method, called principal sparse nonnegative matrix factorization (PSNMF), for learning the associations between itemsets in the form of ratio rules. In addition, we provide a support measurement to weigh the importance of each rule for the entire dataset.
27379775
Convergence of a New Decomposition Algorithm for Support Vector Machines
Decomposition methods is the main way for solving support vector machines (SVMs) with large data sets. In this paper a new decomposition algorithm is proposed, and its convergence is also proved.
34054461
Fuzzy system with adaptive rulebase
A fuzzy model is constructed out of recorded data in which an adaptive rulebase is introduced into fuzzy system modeling. Usually, the rulebase of a fuzzy system is generated and optimized offline once and for all. However, due to uncertainty and change of state of the system, this rulebase may not work well when the model is put into use. Hence, a certain length of recorded data from the current time instance is employed to extract rules and the rulebase is renewed by these rules. In the proposed method, the structure of the fuzzy model is determined in advance, then recorded data are used to extract fuzzy rules and construct a fuzzy model. In the application of the model, the rulebase is renewed in every computation period and this is a rolling process. This approach can deal with a system with much uncertainty since these newly generated rules reflect the most current state of the system. To demonstrate the effectiveness of the proposed method, it is used to build a model of a furnace and simulation results are satisfactory.