Thats a unique idea.You should consider the following idea to enhance your idea so that it would impact uniquely: Random sampling is a standard technique for constructing (approximate) histograms for query optimization. Hover, any real implementation in commercial products requires solving the hard problem of determining  “How much sampling is enough?”   address this critical question in the context of equi-height histograms used in many commercial products, including Microsoft SQL Server.  introduce a  conservative  error metric capturing the intuition that for an approximate histogram to have low error, the error must be small in  all  regions of the histogram.  then present a result establishing an optimal bound on the amount of sampling required for pre-specified error bounds.  also describe an  adaptive page sampling  algorithm which achieves greater efficiency by using all values in a sampled page but adjusts the amount of sampling depending on clustering of values in pages. Next,  establish that the problem of estimating the number of distinct values is  provably difficult , but propose a new error metric which has a reliable estimator and can still be exploited by query optimizers to influence the choice of execution plans. The algorithm for histogram construction was prototyped on Microsoft SQL Server 7.0 and  present experimental results showing that the adaptive algorithm accurately approximates the true histogram over different data distributions.
['Surajit Chaudhuri', 'Rajeev Motwani', 'Vivek R. Narasayya']
I am writing a research paper on a idea Random sampling for histogram construction: how much is enough?
[{"from": "human", "value": "I am writing a research paper on a idea Random sampling for histogram construction: how much is enough?"}, {"from": "gpt", "value": "Thats a unique idea.You should consider the following idea to enhance your idea so that it would impact uniquely: Random sampling is a standard technique for constructing (approximate) histograms for query optimization. Hover, any real implementation in commercial products requires solving the hard problem of determining  \u201cHow much sampling is enough?\u201d   address this critical question in the context of equi-height histograms used in many commercial products, including Microsoft SQL Server.  introduce a  conservative  error metric capturing the intuition that for an approximate histogram to have low error, the error must be small in  all  regions of the histogram.  then present a result establishing an optimal bound on the amount of sampling required for pre-specified error bounds.  also describe an  adaptive page sampling  algorithm which achieves greater efficiency by using all values in a sampled page but adjusts the amount of sampling depending on clustering of values in pages. Next,  establish that the problem of estimating the number of distinct values is  provably difficult , but propose a new error metric which has a reliable estimator and can still be exploited by query optimizers to influence the choice of execution plans. The algorithm for histogram construction was prototyped on Microsoft SQL Server 7.0 and  present experimental results showing that the adaptive algorithm accurately approximates the true histogram over different data distributions."}]