Thats a unique idea.You should consider the following idea to enhance your idea so that it would impact uniquely:  present Waken, an application-independent system that recognizes UI components and activities from screen captured videos, without any prior knowledge of that application. Waken can identify the cursors, icons, menus, and tooltips that an application contains, and when those items are used. Waken uses frame differencing to identify occurrences of behaviors that are common across graphical user interfaces. Candidate templates are built, and then other occurrences of those templates are identified using a multi-phase algorithm. An evaluation demonstrates that the system can successfully reconstruct many aspects of a UI without any prior application-dependant knowledge. To showcase the design opportunities that are introduced by having this additional meta-data,  present the Waken Video Player, which allows users to directly interact with UI components that are displayed in the video.
['Nikola Banovic', 'Tovi Grossman', 'Justin Matejka', 'George W. Fitzmaurice']
I am writing a research paper on a idea Waken: reverse engineering usage information and interface structure from software videos
[{"from": "human", "value": "I am writing a research paper on a idea Waken: reverse engineering usage information and interface structure from software videos"}, {"from": "gpt", "value": "Thats a unique idea.You should consider the following idea to enhance your idea so that it would impact uniquely:  present Waken, an application-independent system that recognizes UI components and activities from screen captured videos, without any prior knowledge of that application. Waken can identify the cursors, icons, menus, and tooltips that an application contains, and when those items are used. Waken uses frame differencing to identify occurrences of behaviors that are common across graphical user interfaces. Candidate templates are built, and then other occurrences of those templates are identified using a multi-phase algorithm. An evaluation demonstrates that the system can successfully reconstruct many aspects of a UI without any prior application-dependant knowledge. To showcase the design opportunities that are introduced by having this additional meta-data,  present the Waken Video Player, which allows users to directly interact with UI components that are displayed in the video."}]