ScreenCrayons: Using Screen Captures for Annotation and Research ScreenCrayons: Using Screen Captures for Annotation and Research
ScreenCrayons is a system for collecting annotations on any type of document or visual information from any application. The basis for the system is a screen capture upon which the user can highlight the relevant portions of the image. The user can define any number of topics for organizing notes. Each topic is associated with a highlighting "crayon." In addition the user can supply annotations in digital ink or text. Algorithms are described that summarize captured images based on the highlight strokes so as to provide overviews of many annotations as well as being able to "zoom in" on particular information about a given note and the context of that note. Annotations the user makes on the screen captures are automatically associated with regions of text that are then used to formulate queries to a search engine. The results of these queries are filtered and ranked based on their similarity to the original annotations. The system then presents links to these documents to the user. We also describe an experiment that shows that the documents found by the annotation system are generally found to be more relevant to a user's topic than the users own queries using the search engine.
School:Brigham Young University
School Location:USA - Utah
Source Type:Master's Thesis
Keywords:screencrayons screen captures annotation google information retrieval continuity images hierarchical containment tree
Date of Publication:12/12/2006