Thats a unique idea.You should consider the following idea to enhance your idea so that it would impact uniquely: For mirex 2013, the evaluation of audio chord estimation (ace) follod a new scheme. Using chord vocabularies of differing complexity as ll as segmentation measures, the new scheme provides more information than the ace evaluations from previous years. With this new information, hover, comes new interpretive challenges. What are the correlations among different songs and, more importantly, different submissions across the new measures? Performance falls off for all submissions as the vocabularies increase in complexity, but does it do so directly in proportion to the number of more complex chords, or are certain algorithms indeed more robust? What are the outliers, songalgorithm pairs where the performance was substantially higher or lor than would be predicted, and how can they be explained? Ansring these questions requires moving beyond the Friedman tests that have most often been used to compare algorithms to a richer underlying model.  propose a logistic-regression approach for generating comparative statistics for mirex ace, supported with generalised estimating equations (gees) to correct for repeated measures.  use the mirex 2013 ace results as a case study to illustrate our proposed method, including some of interesting aspects of the evaluation that might not apparent from the headline results alone.
['J. Ashley Burgoyne', 'W. Bas de Haas', 'Johan Pauwels']
I am writing a research paper on a idea On Comparative Statistics for Labelling Tasks: What can We Learn from MIREX ACE 2013
[{"from": "human", "value": "I am writing a research paper on a idea On Comparative Statistics for Labelling Tasks: What can We Learn from MIREX ACE 2013"}, {"from": "gpt", "value": "Thats a unique idea.You should consider the following idea to enhance your idea so that it would impact uniquely: For mirex 2013, the evaluation of audio chord estimation (ace) follod a new scheme. Using chord vocabularies of differing complexity as ll as segmentation measures, the new scheme provides more information than the ace evaluations from previous years. With this new information, hover, comes new interpretive challenges. What are the correlations among different songs and, more importantly, different submissions across the new measures? Performance falls off for all submissions as the vocabularies increase in complexity, but does it do so directly in proportion to the number of more complex chords, or are certain algorithms indeed more robust? What are the outliers, songalgorithm pairs where the performance was substantially higher or lor than would be predicted, and how can they be explained? Ansring these questions requires moving beyond the Friedman tests that have most often been used to compare algorithms to a richer underlying model.  propose a logistic-regression approach for generating comparative statistics for mirex ace, supported with generalised estimating equations (gees) to correct for repeated measures.  use the mirex 2013 ace results as a case study to illustrate our proposed method, including some of interesting aspects of the evaluation that might not apparent from the headline results alone."}]