33275321
A Shot Boundary Detection Method for News Video Based on Rough Sets and Fuzzy Clustering
With the rapid growing amount of multimedia, content-based infomation retrieval has become more and more important. As a crucial step in content-based news video indexing and retrieval system, shot boundary detection attracts much more research interests in recent years. To partition news video into shots, many metrics were constructed to measure the similarity among video frames based on all the available video features. However, too many features will reduce the efficiency of the shot boundary detection. Therefore, it is necessary to perform feature reduction for every decision of shot boundary. For this purpose, the classification method based on rough sets and fuzzy c-means clustering for feature reduction and rule generation is proposed. According to the particularity of news scenes, shot transition can be divided into three types: cut transition, gradual transition and no transition. The efficacy of the proposed method is extensively tested on more than 2 h of news programs and 98.0% recall with 96.6% precision have been achieved.
46154955
A Novel Typical-Sample-Weighted Clustering Algorithm for Large Data Sets
In the field of cluster analysis, most of existing algorithms are developed for small data sets, which cannot effectively process the large data sets encountered in data mining. Moreover, most clustering algorithms consider the contribution of each sample for classification uniformly. In fact, different samples should be of different contribution for clustering result. For this purpose, a novel typical-sample-weighted clustering algorithm is proposed for large data sets. By the atom clustering, the new algorithm extracts the typical samples to reduce the data amount. Then the extracted samples are weighted by their corresponding typicality and then clustered by the classical fuzzy c-means (FCM) algorithm. Finally, the Mahalanobis distance is employed to classify each original sample into obtained clusters. It is obvious that the novel algorithm can improve the speed and robustness of the traditional FCM algorithm. The experimental results with various test data sets illustrate the effectiveness of the proposed clustering algorithm.
7186941
A Cartoon Video Detection Method Based on Active Relevance Feedback and SVM
By analyzing the particular features of visual content for cartoon videos, 8 typical features of MPEG-7 descriptors are extracted to distinguish the cartoons from other videos. Then, a content-based video classifier is developed by combining the active relevance feedback technique and SVM for detecting the cartoon videos. The experimental results on the vast real video clips illustrate that compared with the classifier based on SVM and that based on traditional relevance feedback technique and SVM, the proposed classifier has a higher advantage of cartoon video detection.
28211985
A Fully Unsupervised Image Segmentation Algorithm Based on Wavelet-Domain Hidden Markov Tree Models
A fully unsupervised image segmentation algorithm is presented in this paper, in which wavelet-domain hidden Markov tree (WD-HMT) model is exploited together with the cluster analysis and validity techniques. The true number of textures in a given image is determined by calculating the likelihood disparity of textures using the modified partition fuzzy degree (MPFD) function at one suitable scale. Then, possibilistic C-means (PCM) clustering is performed to determine the training sample data from different textures according to the true number of textures obtained. The unsupervised segmentation is changed into self-supervised one, and the HMTseg algorithm is used to achieve the final segmentation results. This algorithm is applied to segment a variety of composite texture images into distinct homogeneous regions and good segmentation results are reported.
11815466
A Wavelet Based Image Watermarking Scheme
A novel robust watermarking scheme based on wavelet transform is presented in this paper. The watermark is embedded into significant triplet of wavelet coefficients in the three lowest detail subband images. The embedding algorithm only needs to modify a small amount of the wavelet coefficients, which leads to very small distortion and guarantees the visual quality of the watermarked image. The performance of the proposed algorithm is tested on a series of normal attacks in image processing, such as JPEG compression, Gaussian noise addition, median filter, etc. The corresponding experimental results show that the proposed watermarking scheme has better performance.
35059796
A Unified Framework for Shot Boundary Detection
According to drawbacks of available algorithms,a new hierarchical and multiresolution approach to the detection and classification of scene breaks in video sequences is presented in this paper. This method gives a unified framework for different shots by using the multi-resolution analysis as mainstay. Firstly, the video clips are cut by FCM clustering method, then the fade and dissolve are detected using ECR and SCD algorithm in the high components and the low components respectively by integer-to-integer wavelet transform. Finally, according to the cut and the former detection of gradual changes, we use motion vectors in high-components of 3D-WT to detect the wipe transition. Experimental results with real video clips about 7h demonstrate that our method can detect and classify a variety of scene breaks, including cuts, fades and dissolves, even in sequences involving significant motions and flash.
40240913
Combining Contents and Citations for Scientific Document Classification
This paper introduces a classification system that exploits the content information as well as citation structure for scientific paper classification. The system first applies a content-based statistical classification method which is similar to general text classification. We investigate several classification methods including K-nearest neighbours, nearest centroid, naive Bayes and decision trees. Among those methods, the K-nearest neighbours is found to outperform others while the rest perform comparably. Using phrases in addition to words and a good feature selection strategy such as information gain can improve system accuracy and reduce training time in comparison with using words only. To combine citation links for classification, the system proposes an iterative method to update the labellings of classified instances using citation links. Our results show that, combining contents and citations significantly improves the system performance.
14110256
Query Directed Web Page Clustering
Web page clustering methods categorize and organize search results into semantically meaningful clusters that assist users with search refinement; but finding clusters that are semantically meaningful to users is difficult. In this paper, we describe a new Web page clustering algorithm, QDC, which uses the user's query as part of a reliable measure of cluster quality. The new algorithm has five key innovations: a new query directed cluster quality guide that uses the relationship between clusters and the query, an improved cluster merging method that generates semantically coherent clusters by using cluster description similarity in additional to cluster overlap, a new cluster splitting method that fixes the cluster chaining or cluster drifting problem, an improved heuristic for cluster selection that uses the query directed cluster quality guide, and a new method of improving clusters by ranking the pages by relevance to the cluster. We evaluate QDC by comparing its clustering performance against that of four other algorithms on eight data sets (four use full text data and four use snippet data) by using eleven different external evaluation measurements. We also evaluate QDC by informally analysing its real world usability and performance through comparison with six other algorithms on four data sets. QDC provides a substantial performance improvement over other Web page clustering algorithms
40362881
A Knowledge Learning Approach to Information Extraction from Multiple Text Based Web Sites
This paper describes a learning/adaptive approach to automatically building knowledge bases for information extraction from text based web pages. A frame based representation is introduced to represent domain knowledge as knowledge unit frames. A frame learning algorithm is developed to automatically learn knowledge unit frames from training examples. Some training examples can be obtained by automatically parsing a number of tabular web pages in the same domain, which greatly reduced the amount of time consuming manual work. This approach was investigated on ten web sites of real estate advertisements and car advertisements and nearly all the information was successfully extracted with very few false alarms. These results suggest that both the knowledge unit frame representation and the frame learning algorithm work well, domain specific knowledge bases can be learned from training examples, and the domain specific knowledge base can be used for information extraction from flexible text-based semi-structured Web pages on multiple Web sites. The investigation of the knowledge representation on five other domains suggests that this approach can be easily applied to other domains by simply changing the training examples.
19030773
Standardized evaluation method for Web clustering results
Web clustering assists users of a search engine by presenting search results as clusters of related pages. Many clustering algorithms with different characteristics have been developed: but the lack of a standardized Web clustering evaluation method that can evaluate clusterings with different characteristics has prevented effective comparison of algorithms. The paper solves this by introducing a new structure for defining general ideal clusterings and new measurements for evaluating clusterings with different characteristics by comparing them against the general ideal clustering.
10164763
Automatic Pattern Construction For Web Information Extraction
This paper describes a domain independent approach for automatically constructing information extraction patterns for semi-structured web pages. Given a randomly chosen page from a web site of similarly structured pages, the system identifies a region of the page that has a regular "tabular" structure, and then infers an extraction pattern that will match the "rows" of the region and identify the data elements. The approach was tested on three corpora containing a series of tabular web sites from different domains and achieved a success rate of at least 80%. A significant strength of the system is that it can infer extraction patterns from a single training page and does not require any manual labeling of the training page.