Thats a unique idea.You should consider the following idea to enhance your idea so that it would impact uniquely: Anyone offering content in a digital library is naturally interested in assessing its performance: how ll does my system meet the users' information needs? Standard evaluation benchmarks have been developed in information retrieval that can be used to test retrieval effectiveness. Hover, these generic benchmarks focus on a single document genre, language, media-type, and searcher stereotype that is radically different from the unique content and user community of a particular digital library.  proposes to derive a domain-specific test collection from readily available interaction data in search logs files that captures the domain-specificity of digital libraries.  use as case study an archival institution's complete search log that spans over multiple years, and derive a large-scale test collection.  manually derive a set of topics judged by human experts--based on a set of e-mail reference questions and responses from archivists--and use this for validation. Our main finding is that  can derive a reliable and domain-specific test collection from search log files.
['Junte Zhang', 'Jaap Kamps']
I am writing a research paper on a idea A search log-based approach to evaluation
[{"from": "human", "value": "I am writing a research paper on a idea A search log-based approach to evaluation"}, {"from": "gpt", "value": "Thats a unique idea.You should consider the following idea to enhance your idea so that it would impact uniquely: Anyone offering content in a digital library is naturally interested in assessing its performance: how ll does my system meet the users' information needs? Standard evaluation benchmarks have been developed in information retrieval that can be used to test retrieval effectiveness. Hover, these generic benchmarks focus on a single document genre, language, media-type, and searcher stereotype that is radically different from the unique content and user community of a particular digital library.  proposes to derive a domain-specific test collection from readily available interaction data in search logs files that captures the domain-specificity of digital libraries.  use as case study an archival institution's complete search log that spans over multiple years, and derive a large-scale test collection.  manually derive a set of topics judged by human experts--based on a set of e-mail reference questions and responses from archivists--and use this for validation. Our main finding is that  can derive a reliable and domain-specific test collection from search log files."}]