11075192
Fast Construction of Generalized Suffix Trees Over a Very Large Alphabet
The work in this paper is motivated by the real-world problems such as mining frequent traversal path patterns from very large Web logs. Generalized suffix trees over a very large alphabet can be used to solve such problems. However, traditional algorithms such as the Weiner, Ukkonen and McCreight algorithms are not sufficient assurance of practicality because of large magnitudes of the alphabet and the set of strings in those real-world problems. Two new algorithms are designed for fast construction of generalized suffix trees over a very large alphabet, and their performance is analyzed in comparison with the well-known Ukkonen algorithm. It is shown that these two algorithms have better performance, and can deal with large alphabets and large string sets well.
14422953
On-line learning of rectangles
This paper solves the following open problem: Is there an algorithmfor on-line learning of rectangles <inline-equation><f><pr align="c"><ll>i=1</ll><ul>d</ul></pr></f><?Pub Caret></inline-equation><?Pub Fmt italic>a<subscrpt>i</subscrpt>,a<subscrpt>i</subscrpt>+1,…,b<subscrpt>i</subscrpt>}<?Pub Fmt /italic>over a discrete domain<?Pub Fmt italic>{1,…,n}<supscrpt>d</supscrpt><?Pub Fmt /italic>whose error bound is polylogarithmic in the size<?Pub Fmt italic>n<supscrpt>d</supscrpt><?Pub Fmt /italic> of the domain(i.e. polynomial in <?Pub Fmt italic>d<?Pub Fmt /italic> and log<?Pub Fmt italic>n<?Pub Fmt /italic> )? We give a positive solution byintroducing a new design technique that appears to be of some intereston its own. The new learning algorithm for rectangles consists of<?Pub Fmt italic>2d<?Pub Fmt /italic> separate search strategies thatsearch for the parameters <?Pub Fmt italic>a<subscrpt>1</subscrpt>,b<subscrpt>1</subscrpt>,…,a<subscrpt>d</subscrpt>,b<subscrpt>d</subscrpt><?Pub Fmt /italic>of the target rectangle. A learning algorithm with this type of modulardesign ends to fail because of the well known “credit assignmentproblem”: Which of the <?Pub Fmt italic>2d<?Pub Fmt /italic> localsearch strategies should be “blamed” when the globalalgorithm makes an error? We overcome this difficulty by employing localsearch strategies (“error tolerant binary search”) that areable to tolerate certain types of wrong credit assignments.
Section 4 contains another application of this design technique: analgorithm for learning the union of two rectangles in the plane.
29625123
A PTAS for a disc covering problem using width-bounded separators
In this paper, we study the following disc covering problem: Given a set of discs of various radii on the plane and centers on the grid points, find a subset of discs to maximize the area covered by exactly one disc. This problem originates from the application in digital halftoning, with the best known approximation factor being 5.83 (Asano et al., 2004). We show that if their radii are between two positive constants, then there exists a polynomial time approximation scheme. Our techniques are based on the width-bounded geometric separator recently developed in Fu and Wang (2004), Fu (2006).
44651708
Personalized Web Search with Clusters
14616525
Some Formal Analysis of Rocchio's Similarity-Based Relevance Feedback Algorithm
Rocchio's similarity-based Relevance feedback algorithm, one of the most important query reformation methods in information retrieval, is essentially an adaptive supervised learning algorithm from examples. In spite of its popularity in various applications there is little rigorous analysis of its learning complexity in literature. In this paper we show that in the binary vector space model, if the initial query vector is 0, then for any of the four typical similarities (inner product, dice coefficient, cosine coefficient, and Jaccard coefficient), Rocchio's similarity-based relevance feedback algorithm makes at least n mistakes when used to search for a collection of documents represented by a monotone disjunction of at most k relevant features (or terms) over the n-dimensional binary vector space {0, 1}n. When an arbitrary initial query vector in {0, 1}n is used, it makes at least (n + k − 3)/2 mistakes to search for the same collection of documents. The linear lower bounds are independent of the choices of the threshold and coefficients that the algorithm may use in updating its query vector and making its classification.
28060413
The Architecture of Yarrow: A Real-Time Intelligent Meta-Search Engine
10821256
A Web Media Agent
A web media agent is presented, which can make a user’s web surfing experience more productive. Once the user visits a web page, semantic descriptions of the media objects on the page are automatically collected and used as their semantic indexes, which can help the user quickly find relevant media objects later.
7997128
Exploiting the hierarchical structure for link analysis
Link analysis algorithms have been extensively used in Web information retrieval. However, current link analysis algorithms generally work on a flat link graph, ignoring the hierarchal structure of the Web graph. They often suffer from two problems: the sparsity of link graph and biased ranking of newly-emerging pages. In this paper, we propose a novel ranking algorithm called Hierarchical Rank as a solution to these two problems, which considers both the hierarchical structure and the link structure of the Web. In this algorithm, Web pages are first aggregated based on their hierarchical structure at directory, host or domain level and link analysis is performed on the aggregated graph. Then, the importance of each node on the aggregated graph is distributed to individual pages belong to the node based on the hierarchical structure. This algorithm allows the importance of linked Web pages to be distributed in the Web page space even when the space is sparse and contains new pages. Experimental results on the .GOV collection of TREC 2003 and 2004 show that hierarchical ranking algorithm consistently outperforms other well-known ranking algorithms, including the PageRank, BlockRank and LayerRank. In addition, experimental results show that link aggregation at the host level is much better than link aggregation at either the domain or directory levels.
5754331
Web-page summarization using clickthrough data
Most previous Web-page summarization methods treat a Web page as plain text. However, such methods fail to uncover the full knowledge associated with a Web page needed in building a high-quality summary, because many of these methods do not consider the hidden relationships in the Web. Uncovering the hidden knowledge is important in building good Web-page summarizers. In this paper, we extract the extra knowledge from the clickthrough data of a Web search engine to improve Web-page summarization. Wefirst analyze the feasibility in utilizing the clickthrough data to enhance Web-page summarization and then propose two adapted summarization methods that take advantage of the relationships discovered from the clickthrough data. For those pages that are not covered by the clickthrough data, we design a thematic lexicon approach to generate implicit knowledge for them. Our methods are evaluated on a dataset consisting of manually annotated pages as well as a large dataset that is crawled from the Open Directory Project website. The experimental results indicate that significant improvements can be achieved through our proposed summarizer as compared to the summarizers that do not use the clickthrough data.
20150121
Joint texture-shape optimization for MPEG-4 multiple video objects
In this paper, we present a uniform framework for optimal multiple video object bit allocation in MPEG-4. We combine the rate-distortion (R-D) models for the texture and shape information of arbitrarily shaped video objects to develop the joint texture-shape R-D models. The dynamic programming technique is applied to optimize the bit allocation for the multiple video objects. The simulation results demonstrate that the proposed joint texture-shape optimization algorithm outperforms the MPEG-4 verification model on the decoded picture quality.
7582784
Hierarchical Clustering-Merging for Multidimensional Index Structures
The R-tree family index structures are among the most common index structures used in multidimensional databases. To improve the search performance it is very important to reduce the overlap between bounding regions in the R-tree. However the arbitrary insertion order in the tree construction procedure might result in tree structures inefficient in the search operations. In this paper we propose a new technique called Hierarchical Clustering-Merging (HCM) to improve the tree construction procedure of the R-tree family index structures. With this technique we can take advantage of the data distribution information in the data set to achieve an optimized tree structure and improve the search performance.