Thats a unique idea.You should consider the following idea to enhance your idea so that it would impact uniquely: Purpose – The purpose of this paper is to design a watcher-based crawler (WBC) that has the ability of crawling static and dynamic b sites, and can download only the updated and newly added b pages. Design/methodology/approach – In the proposed WBC crawler, a watcher file, which can be uploaded to the b sites servers, prepares a report that contains the addresses of the updated and the newly added b pages. In addition, the WBC is split into five units, where each unit is responsible for performing a specific crawling process. Findings – Several experiments have been conducted and it has been observed that the proposed WBC increases the number of uniquely visited static and dynamic b sites as compared with the existing crawling techniques. In addition, the proposed watcher file not only allows the crawlers to visit the updated and newly b pages, but also solves the crawlers overlapping and communication problems. Originality/value – The proposed WBC performs all crawling processes in the sense ...
['Saed Alqaraleh', 'Omar Ramadan', 'Muhammed Salamah']
I am writing a research paper on a idea Efficient watcher based web crawler design
[{"from": "human", "value": "I am writing a research paper on a idea Efficient watcher based web crawler design"}, {"from": "gpt", "value": "Thats a unique idea.You should consider the following idea to enhance your idea so that it would impact uniquely: Purpose \u2013 The purpose of this paper is to design a watcher-based crawler (WBC) that has the ability of crawling static and dynamic b sites, and can download only the updated and newly added b pages. Design/methodology/approach \u2013 In the proposed WBC crawler, a watcher file, which can be uploaded to the b sites servers, prepares a report that contains the addresses of the updated and the newly added b pages. In addition, the WBC is split into five units, where each unit is responsible for performing a specific crawling process. Findings \u2013 Several experiments have been conducted and it has been observed that the proposed WBC increases the number of uniquely visited static and dynamic b sites as compared with the existing crawling techniques. In addition, the proposed watcher file not only allows the crawlers to visit the updated and newly b pages, but also solves the crawlers overlapping and communication problems. Originality/value \u2013 The proposed WBC performs all crawling processes in the sense ..."}]