16439255
Privacy Aware Market Basket Data Set Generation: A Feasible Approach for Inverse Frequent Set Mining
Association rule mining has received a lot of attention in the data mining community and several algorithms were proposed to improve the performance of association rule or frequent itemset mining. The IBM Almaden synthetic data generator has been commonly used for performance evaluation. One recent work shows that the data generated is not good enough for benchmarking as it has very different characteristics from real-world data sets. Hence there is a great need to use real-world data sets as benchmarks. However, organizations hesitate to provide their data due to privacy concerns. Recent work on privacy preserving association rule mining addresses this issue by modifying real data sets to hide sensitive or private rules. However, modifying individual values in real data may impact on other, non-sensitive rules. In this paper, we propose a feasible solution to the NPcomplete problem of inverse frequent set mining. Since solving this problem by linear programming techniques is very computationally prohibitive, we apply graph-theoretical results to divide the original itemsets into components that preserve maximum likelihood estimation. We then use iterative proportional fitting method to each component. The technique is experimentally evaluated with two real data sets and one synthetic data set. The results show that our approach is effective and efficient for reconstructing market basket data set from a given set of frequent itemsets while preserving sensitive information.
8968053
Resource-Bounded Balanced Genericity, Stochasticity and Weak Randomness
We introduce balanced t(n)-genericity which is a refinement of the genericity concept of Ambos-Spies, Fleischhack and Huwig [2] and which in addition controls the frequency with which a condition is met. We show that this concept coincides with the resource-bounded version of Church's stochasticity [6]. By uniformly describing these concepts and weaker notions of stochasticity introduced by Wilber [19] and Ko [11] in terms of prediction functions, we clarify the relations among these resource-bounded stochasticity concepts. Moreover, we give descriptions of these concepts in the framework of Lutz's resource-bounded measure theory [13] based on martingales: We show that t(n)-stochasticity coincides with a weak notion of t(n)-randomness based on so-called simple martingales but that it is strictly weaker than t(n)-randomness in the sense of Lutz.
8247434
NP-Hard Sets are Superterse Unless NP is Small
Abstract We show that the class P- mc ( n ) of polynomial time n -membership comparable sets (defined by Ogihara, 1995) has p -measure 0. Using this result, we will show that the class of sets which are ⩽ tt P -reducible to some P-selective set has p -measure 0. Furthermore, we will show that if NP does not have p -measure 0 then no ⩽ tt p -hard set for NP is P-approximable.
5215725
Linear Complexity versus Pseudorandomness: On Beth and Dai's Result
Beth and Dai studied in their Eurocrypt paper [1] the relationship between linear complexity (that is, the length of the shortest Linear Feedback Shift Register that generates the given strings) of strings and the Kolmogorov complexity of strings. Though their results are correct, some of their proofs are incorrect. In this note, we demonstrate with a counterexample the reason why their proofs are incorrect and we prove a stronger result. We conclude our note with some comments on the use of the LIL test (the law of the iterated logarithm) for pseudorandom bits generated by pseudorandom generators.
5782664
A Separation of Two Randomness Concepts
In this paper we give an affirmative answer to a conjecture by Lutz (1992). That is, we will show that there is a Schnorr random sequence which is not rec-random.
8204880
Privacy aware data generation for testing database applications
Testing of database applications is of great importance. A significant issue in database application testing consists in the availability of representative data. In this paper, we investigate the problem of generating a synthetic database based on a-priori knowledge about a production database. Our approach is to fit general location model using various characteristics (e.g., constraints, statistics, rules) extracted from the production database and then generate the synthetic data using model learnt. The generated data is valid and similar to real data in terms of statistical distribution, hence it can be used for functional and performance testing. As characteristics extracted may contain information which may be used by attacker to derive some confidential information about individuals, we present our disclosure analysis method which applies cell suppression technique for identity disclosure analysis and perturbation for value disclosure.
16213423
DFT-MSN: The Delay/Fault-Tolerant Mobile Sensor Network for Pervasive Information Gathering
This paper focuses on the Delay/Fault-Tolerant Mobile Sensor Network (DFT-MSN) for pervasive information gathering. We develop simple and efficient data delivery schemes tailored for DFT-MSN, which has several unique characteristics such as sensor mobility, loose connectivity, fault tolerability, delay tolerability, and buffer limit. We first study two basic approaches, namely, direct transmission and flooding. We analyze their performance by using queuing theory and statistics. Based on the analytic results that show the tradeoff between data delivery delay/ratio and transmission overhead, we introduce an optimized flooding scheme that minimizes transmission overhead in flooding. Then, we propose a simple and effective DFT-MSN data delivery scheme, which consists of two key components for data transmission and queue management, respectively. The former makes decision on when and where to transmit data messages based on the delivery probability, which reflects the likelihood that a sensor can deliver data messages to the sink. The latter decides which messages to transmit or drop based on the fault tolerance, which indicates the importance of the messages. The system parameters are carefully tuned on the basis of thorough analyses to optimize network performance. Extensive simulations are carried out for performance evaluation. Our results show that the proposed DFT-MSN data delivery scheme achieves the highest message delivery ratio with acceptable delay and transmission overhead.
3357707
A method for document zone content classification
This paper describes an algorithm to classify each given document zone into one of nine classes and provides a protocol for its performance evaluation. The classification scheme uses an optimized binary decision tree and Viterbi algorithm for HMM to find the optimal solution. Our algorithm was trained and tested on a total of 24,177 zones within the 1600 images from UWCDROM III database. Its accuracy rate is 98.45% with a mean false alarm rate of 0.50%.
15514608
Application of Relief-F feature filtering algorithm to selecting informative genes for cancer classification using microarray data
Numerous recent studies have shown that microarray gene expression data is useful for cancer classification. Classification based on microarray data is very different from previous classification problems in that the number of features (genes) greatly exceeds the number of instances (tissue samples). It has been shown that selecting a small set of informative genes can lead to improved classification accuracy. It is thus important to first apply feature selection methods prior to classification. In the machine learning field, one of the most successful feature filtering algorithms is the Relief-F algorithm. In this work, we empirically evaluate its performance on three published cancer classification data sets. We use the linear SVM and the k-NN as classifiers in the experiments, and compare the performance of Relief-F with other feature filtering methods, including Information Gain, Gain Ratio, and /spl chi//sup 2/-statistic. Using the leave-one-out cross validation, experimental results show that the performance of Relief-F is comparable with other methods.
20180608
An Image Analysis System for Tongue Diagnosis in Traditional Chinese Medicine
We introduced a computer-aider tongue examination system, which can reduce the large variation between the diagnosis results of different doctors and quantize the tongue properties automatically in traditional Chinese medicine (TCM) diagnosis. Several key issues and algorithms in this system are discussed, involving some newly proposed image analysis techniques: i) a new tongue color calibration scheme is proposed to overcome the drawbacks of the previous method; ii) a gradient vector flow (GVF) snake based model integrating the chromatic information of the tongue image is used to extract the tongue body; iii) an unsupervised segmentation method of color-texture regions is adopted to quantitatively analyze the distribution of the substance and the coat on the tongue surface. The experimental results show that the presented system has a great deal of potential for the tongue diagnosis.
903722
Mobile telemedicine sensor networks with low-energy data query and network lifetime considerations
In this paper, we use an integrated architecture that takes advantage of the low cost mobile sensor networks and 3G cellular networks to accommodate multimedia medical calls with differentiated Quality-of-Service (QoS) requirements. We propose a low-energy, distributed, and concentric-zone-based data query mechanism that takes advantages of hierarchical ad hoc routing algorithms to enable a medical specialist to collect physiological data from mobile and/or remote patients. The medical specialist uses cellular network to report patients' data to the medical center. Moreover, we propose a transmission scheme among different zones with balance-based energy efficiency, which can extend network lifetime. We evaluate the validity of our proposals through simulations and analyze their performance. Our results clearly indicate the energy efficiency of the proposed sensor network query algorithms and the efficiency of our multiclass medical call admission control scheme in terms of meeting the multimedia telemedicine QoS requirements.