Thats a unique idea.You should consider the following idea to enhance your idea so that it would impact uniquely: Data analysis requires new approaches in many domains for evaluating tools and techniques, particularly when the data sets grow large and more complex. Evaluation-as-service (EaaS) was coined as a term to represent evaluation approaches based on APIs, virtual machines or source code submission, different from the common paradigm of evaluating techniques on a distributed test collection, tasks and submitted results files. Such new approaches become necessary when data sets become extremely large, contain confidential information or might change quickly over time. The workshop on cloud-based evaluation (CBE) took place in Boston, MA, USA on November 5, 2015 and explored several approaches for data analysis evaluation and frameworks in this field. The objective was to include several stakeholders from academic partners, companies to funding agencies to cover various interests and viewpoints in the discussion of evaluation infrastructures. The workshop focused on the biomedical domain but the results are easily applicable to many domains of information analysis and retrieval.
['Henning Müller', 'Jayashree Kalpathy-Cramer', 'Allan Hanbury', 'Keyvan Farahani', 'Rinat Sergeev', 'Jin H. Paik', 'Arno Klein', 'Antonio Criminisi', 'Andrew D. Trister', 'Thea Norman', 'David N. Kennedy', 'Ganapati Srinivasa', 'Artem B. Mamonov', 'Nina Preuss']
I am writing a research paper on a idea Report on the Cloud-Based Evaluation Approaches Workshop 2015
[{"from": "human", "value": "I am writing a research paper on a idea Report on the Cloud-Based Evaluation Approaches Workshop 2015"}, {"from": "gpt", "value": "Thats a unique idea.You should consider the following idea to enhance your idea so that it would impact uniquely: Data analysis requires new approaches in many domains for evaluating tools and techniques, particularly when the data sets grow large and more complex. Evaluation-as-service (EaaS) was coined as a term to represent evaluation approaches based on APIs, virtual machines or source code submission, different from the common paradigm of evaluating techniques on a distributed test collection, tasks and submitted results files. Such new approaches become necessary when data sets become extremely large, contain confidential information or might change quickly over time. The workshop on cloud-based evaluation (CBE) took place in Boston, MA, USA on November 5, 2015 and explored several approaches for data analysis evaluation and frameworks in this field. The objective was to include several stakeholders from academic partners, companies to funding agencies to cover various interests and viewpoints in the discussion of evaluation infrastructures. The workshop focused on the biomedical domain but the results are easily applicable to many domains of information analysis and retrieval."}]