Abstract: Methods and computer readable mediums storing computer executable programs for managing multimodal annotations of an image are disclosed. A first communication channel is established between a first machine and a mobile device. A first hierarchical data structure generated by the mobile device is received at the first machine. The first hierarchical data structure includes an image annotated with at least one multimodal annotation. A representation of the first hierarchical data structure is rendered at the first machine. At least one multimodal annotation modification associated with the image is received at the first machine. The at least one multimodal annotation modification is incorporated into the first hierarchical data structure thereby generating a second hierarchical data structure.

Abstract: There are disclosed a method and a device for tagging a document. The method includes the steps of acquiring structural information of the document, retrieving a content block list corresponding to a user-input tag, comparing blocks in the structural information with blocks in the content block list, to obtain similar blocks, and annotating the user-input tag at positions, which correspond to the similar blocks, in the document.

Abstract: The disclosed embodiments provide a system that facilitates use of an application. During operation, the system obtains a visual annotation of a user interface for the application, in which the visual annotation corresponds to a user issue with the user interface. Next, the system uses the visual annotation to update a spatial map of user issues with the user interface. Finally, the system uses the visual annotation and the spatial map to facilitate use of the application by an end user.

Abstract: A system and method are provided for rating online electronic content. A compilation of information or other item of electronic content is presented to a user, along with comments. The comments may target discrete portions of the content item (e.g., a sentence, a statement, an assertion), the content as a whole, or another comment. A user is able to identify a specific portion of the content item as a target for a new comment, which will automatically be associated with that portion. Users may rate the content item, a portion of the item and/or other users' comments based on credibility and/or other traits (e.g., bias, accuracy, violence, enjoyability, prurience). Users' ratings are tallied to produce an overall rating for comments, commentators, portions of content item, entire content items, a program or series or other source of the content item, etc.

Abstract: Systems and methods for displaying annotated video content by mobile computing devices. An example method may comprise: presenting, on a display of a mobile computing device, a video stream including a plurality of video frames; presenting a video annotation overlaid over a frame of the plurality of video frames; receiving a user interface command via a user input interface of the mobile computing device; and performing an action related to the video annotation, the action defined by the user interface command.

Abstract: An image processing apparatus includes an obtaining unit obtaining data of an image of an object and data of a plurality of annotations attached to the image, an input unit receiving a designation of a display magnification for enlarging or reducing the image, and a generation unit generating display data with which the annotations are displayed in such a way as to be superimposed on the image enlarged at the designated display magnification, wherein the data of the plurality of annotations includes position information indicating a position in the image at which each annotation is attached and information about the display magnification of the image at the time of attachment of each annotation, and the generation unit generates display data with which display modes of annotations are made different between annotations of which the display magnifications of the image at the time of attachment thereof are different.

Abstract: A system 100 for enabling interactive annotation of an image 102, comprising a user input 160 for receiving a placement command 162 from a user, the placement command being indicative of a first placement location of a marker 140 in the image 102, and a processor 180 arranged for (i) applying an image processing algorithm to a region 130 in the image, the region being based on the first placement location, and the image processing algorithm being responsive to image portions which visually correspond to the marker 140 for establishing a plurality of match degrees between, on the one hand, the marker, and, on the other hand, a plurality of image portions within the region, (ii) establishing a second placement location in dependence on the plurality of match degrees and the respective plurality of image portions for matching the marker 140 to the region in the image, and (iii) placing the marker 140 at the second placement location in the image 102.

Abstract: Methods and systems of aligning annotation of fields of documents are provided. Training information that includes first measurement information pertaining to features of each of a plurality of fields associated with training clusters for documents of a document type is accessed. A first training cluster is annotated with a first name and the second training cluster is annotated with a second name. An electronic classification model is generated based on the training information. Second measurement information for features of fields associated with new clusters of a new document is accessed. Each of the new clusters is automatically annotated based on the second measurement information using the classification model. For example, a first new cluster that has fields of the first field type is annotated with the first name and a second new cluster that has fields of the second field type is annotated with the second name.

Abstract: A displayed document comprises an annotation widget, the widget associated with an annotation document and a corresponding annotation key in an annotation store. The annotation document associated with a workflow action program. A user with a predetermined privilege selects a widget and is presented with the annotation document. The user performs an annotation task modifying the annotation document and submits the annotation document to the annotation store, the submission triggering the workflow action program to progress the workflow to another step.

Abstract: The invention relates to a method for generating on at least one display device a graphics display of data descriptors. The data descriptors, describing items of data, are arranged on an interactive timeline as interactive timeline elements along with interactive data elements. The interactive timeline elements and the interactive data elements allow retrieval of the items of data.

Abstract: A method, system and program product for annotating a transient state of a computer displayed application enables annotation of transient applications particularly web based applications. A transient application address (or key) and state information related to an application at a transient state are stored in an annotation store along with an annotation. The annotation is related to the transient application by the application address or key. The application is automatically restored to the transient state when the annotation is requested. Optionally a screen capture of the application at the transient state is also presented.

Abstract: An image of a printed document portion is provided to a synchronizer. The synchronizer retrieves an electronic version of the printed document and identifies an electronic text portion that is textually similar to a printed text portion. The synchronizer detects an annotation in the printed document portion and inserts a corresponding digital annotation into the electronic document.

Abstract: In one embodiment, a user of a first portable digital computing device creates an annotation associated with a particular reading location within a reference document. The annotation and the reading location are shared with a second portable digital computing device storing a copy of the reference document. Using the shared information, the second device displays the reference document with the annotation shown at the reading location.

Abstract: An electronic device with a display and a touch-sensitive surface stores a document having primary content, supplementary content, and user-generated content. The device displays a representation of the document in a segmented user interface on the display. Primary content of the document is displayed in a first segment of the segmented user interface and supplementary content of the document is concurrently displayed in a second segment of the segmented user interface distinct from the first segment. The device receives a request to view user-generated content of the document. In response to the request, the device maintains display of the previously displayed primary content, ceases to display at least a portion of the previously displayed supplementary content, and displays user-generated content of the document in a third segment of the segmented user interface distinct from the first segment and the second segment.

Abstract: A method for displaying categories of content is provided. A request is received from a client to display labels that categorize content for a data source. The request includes a set of parameters. In response to receiving the request a plurality of labels are identified based on the relevance of the plurality of labels to the set of parameters. A display of the plurality of labels is generated. The display is sent to the client, wherein the display depicts the plurality of labels at the client such that each label in the plurality of labels has a selected distance from a central point in the display to indicate relevance of the labels to the set of parameters.

Abstract: A non-transitory computer-readable medium stores instructions executed by a processor of a terminal device to perform following processes. The processor acquires data indicating a document shared between a plurality of terminal devices, and displays, on a display device of the terminal device, a display range indicating at least a portion of the document. The processor receives annotation data indicating an annotation superimposed on the document in another terminal device, and determines whether the annotation is inside the display range in the document. If the annotation is not inside the display range, the processor displays a marker indicating that the annotation data has been received. The processor determines whether operation information acquired from an operation device of the terminal device indicates an operation targeting the marker.

Abstract: Various embodiments provide techniques for calibrating and annotating video content. In one or more embodiments, an instance of video content can be calibrated with one or more geographical models and/or existing calibrated video content to correlate the instance of video content with one or more geographical locations. According to some embodiments, geographical information can be used to annotate the video content. Geographical information can include identification information for one or more structures, natural features, and/or locations included in the video content. Some embodiments enable a particular instance of video content to be correlated with other instances of video content based on common geographical information and/or common annotation information. Thus, a user can access video content from other users with similar travel experiences and/or interests. A user may also access annotations provided by other users that may be relevant to a particular instance of video content.

Abstract: In general, the invention relates to a method for capturing information from a web site. The method includes accessing the web site using a browser with a browser module, where the web site comprises a number of web pages having information in a first format, and obtaining a profile corresponding to the web site, where the profile defines a manner to capture information in a first format from the web site. The method further includes capturing information, by the browser module, from at least one of the number of web pages based on the profile and sending the information captured by the browser module to a destination application, where the destination application is external to the browser and where the destination application is configured to use the information in a second format.

Abstract: A method comprising the steps of: retrieving data (100) representing a light field with a plenoptic capture device (4); executing program code for matching the retrieved data with corresponding reference data (101); executing program code for retrieving at least one annotation (61, 63, 64) in a plenoptic format associated with an element of said reference data (102); executing program code for generating annotated data in a plenoptic format from said retrieved data and said annotation (103).

Abstract: A method for processing pictures comprises steps. Generate a request signal for adding annotation information about the picture in response to an input operation to a displayed picture. Generate an input box and display the input box on the displayed picture to allow user to input annotation information. Recognize the annotation information input in the input box. Determine a position the annotation information labeled. Generate a mark to mark the position and display the mark on the position. Establish a relationship between the picture, the annotation information, the position of the annotation information, and the mark. Store the generated relationship. Generate a request signal for browsing annotation information about the picture in response to a input operation. Obtain the annotation information of the picture. Display the obtained annotation information of the picture.

Abstract: A print image forming apparatus includes: an obtaining unit that obtains a document having at least one page; a color information generating unit that generates color information from an identifier allocated to and associated with the obtained document according to a predetermined rule; and a forming unit that forms an image to be output, in which the identifier represented by a color which is in accordance with the generated color information is added to the document.

Abstract: An electronic device includes a display, an acceleration sensor, and a processing unit. The acceleration sensor detects displacement information of the electronic device. The processing unit compares the displacement information with an initial orientation information of the electronic device to determine directional movement of the electronic device. The processing unit shifts content of a display of the electronic device according to the directional movement.

Abstract: Ambient displays and electronic whiteboards are commonly used to present information during meeting or other appropriate settings. Many times graphical objects are displayed on ambient displays where users of the ambient display will create annotations to the graphical object to provide further comments, meaning, and/or context. Annotations on the ambient display may be recorded for later review. An effective way to present recorded annotations is through a hierarchical system that provides context to the annotations. Annotations may be defined as sets of annotations based upon a logical grouping (e.g. spatial density, temporal density, etc.). These sets can be displayed to users as annotation branches. One method for displaying annotations branches is with a timeline. Depending on where along the timeline a user is, different annotations and/or annotation branches are displayed in relation to one another (e.g.

Abstract: A method of adding information to a displayed electronic image includes receiving a search request based on information from the displayed electronic image, locating at least one information responsive to the search request, and receiving identification of a selected information of the at least one information. The method also includes receiving selection of a position on the displayed electronic image at which the selected information is to be added and adding the selected information at the position on the displayed electronic image.

Abstract: A system may include one or more databases to store comments relating to documents, the comments originating from first and second sources, where the comments from the first source include comments received from users via commenting functionality associated with browsers installed on client devices, and the comments from the second source include comments received from users independent of the commenting functionality associated with the browsers installed on the client devices. The system may also include one or more server devices to receive a request for comments relating to a particular document, search at least one of the one or more databases to identify comments relating to the particular document, and provide the identified comments for presentation in connection with the particular document.

Abstract: A digital processing device is configured to perform a method comprising: identifying logical page numbers of a document, the identifying constrained to identify either zero or one logical page number per page of the document, the logical page numbers and an ordering of the pages of the document defining an ordered sequence of logical page numbers; identifying a sequence of logical page number references in the document, each logical page number reference matching one of the logical page numbers of the document; and selecting a sub-sequence of the sequence of logical page number references for which corresponding logical page numbers are in a nondecreasing order in the ordered sequence of logical page numbers. The sub-sequence is used in organizing the document, for example by generating hyperlinks linking the logical page number references of the selected sub-sequence with corresponding pages indicated by the logical page numbers.

Abstract: This disclosure in part describes systems, devices, and methods for implementing a unification mechanism that enables the unification of various data sets, which can permit greater collaboration between users of a data management platform. For example, a system can be configured to enable a user to add or associate a contextual object with a data measure. In associating the contextual object with the data measure, the system can store the contextual object with the unique dimension coordinates that are associated with data measure. Other users of the system may, in turn, access the data measure and be shown the contextual object associated with the data measure.

Abstract: A device receives and displays an electronic book or electronic magazine, and receives user selection of a portion of content of the electronic book or electronic magazine. The device executes an application that obtains items of data related to the selected portion of content, receives selection of one or more items of the data, and attaches the one or more items of data to the selected portion of the content in a bookmark fashion to annotate the e-book or e-magazine.

Abstract: A plurality of objects associated with respective footnote reference information within a document are generated. An overflow object associated with overflow footnote reference information corresponding to a previous footnote marker appearing on a previous page is invoked to lay out the overflow footnote reference information, generating overflow layout data. A current page object associated with current page footnote reference information that corresponds to a current page footnote marker appearing on the page is invoked to lay out the current page footnote reference information, generating current page footnote reference information layout data, if an available footnote height is sufficient to lay out the current page footnote reference information. The page is displayed based on the overflow layout data and the current page footnote reference information layout data.

Abstract: The present invention provides a computerized method and computer program product for automating the traditional markup process such that changes to an original digitized document are displayed on the face of the original digitized document and may be printed as displayed. This invention automates the markup process by adding markup clusters to the original digitized document. A markup cluster comprises three elements: a reference graphic, a white space graphic, and a connector. The reference graphic indicates the location and type of change to existing text. The white space graphic indicates the change in text and is displayed in the margin or white space. The connector is a graphic that does not cross over text and indicates a relationship or “connection” between the reference graphic and the white space graphic. The resulting markup cluster is displayed on the original digitized document and optionally may be printed as displayed.

Abstract: The invention concerns a method of ascertaining and providing information in relation to an image in a survey comprising: displaying the image to a large number of survey persons; recording the input of metadata in relation to the image which are inputted by the large number of survey persons; and carrying out an assessment of the recorded metadata in relation to the image.

Abstract: The system and a computer-implemented method annotate a multimedia object on a web page hosted on a publisher computer system. A web page that includes a multimedia object is rendered in a web browser of a client computer system. One or more layers, including a transparent layer, at least partially located over the multimedia object displayed on the web page are generated wherein the one or more layers are configured to facilitate the creation and display of annotation data for the multimedia object based on user interface events produced by a user of the client computer system. Annotation data for the multimedia object is received from the user. The annotation data is transmitted to an annotation server for storage. A visual indicator indicating that the annotation data is associated with the multimedia object is displayed, wherein the visual indicator is rendered in the one or more layers.

Abstract: A computer-implemented method for displaying annotations for a multidimensional dataset at a client device is disclosed. The client device is connected to a server system through a network. The client device displays a first view of the multidimensional dataset. The first view includes a first graph over a period of time and a plurality of annotations, each annotation corresponding to a respective time segment within the period of time. Upon receiving a user selection of one of the plurality of annotations, the client device displays a second view of the multidimensional dataset. The second view includes a second graph over the period of time and the plurality of annotation. Finally, the client device highlights the user-selected annotation among the plurality of annotations and the time segment corresponding to the user-selected annotation in the second graph.

Abstract: There is disclosed a user interface for editing photo tags. In an embodiment, the user interface embodies a method of editing photo tags, comprising: displaying a photo on a display; providing a photo tagging mode for editing tags for the displayed photo; and for each tag used to tag a subject or object in the photo, identifying the tag type and associating a unique pointer for each tag type to highlight the corresponding tagged subject or object. The method may further comprise: displaying a tag list of tags used to tag a subject or object in the photo; and identifying the tag type of each tag in the tag list. In an embodiment, context sensitive information may be accessed for each tag depending on the tag type.

Abstract: Meeting documents are provided to N meeting participants of a meeting. Each meeting document comprises a human-readable content marking related to the subject of the meeting and a storage address marking. At the meeting, the meeting participants supply comment markings to the meeting documents, thus forming commented meeting documents. The commented meeting documents are then scanned to form commented meeting document images. The commented meeting document images are then stored in a repository based on the storage address marking. One or more users are then provided with visual access to the commented meeting documents images, thus enabling the one or more users to view the comment markings that are supplied by the meeting participants.

Abstract: Techniques for use with an electronic book reader include receiving localized evaluative feedback from users, pertaining to different locations within electronic content. The localized feedback is collected at a server and reported to content creators in reports that are formatted to indicate characteristics of the feedback at different locations within the electronic content.

Abstract: A method and system for adding annotations to content of a webpage provided by a content server includes identifying a portion of the content of the webpage and applying an annotation to the identified portion of the content. The annotation is associated with the identified portion. The annotation and its association with the identified portion is saved on an annotations server and a link is generated to an annotated webpage wherein the content for webpage is received from a content server and the annotation is received from the annotations server. The link is sharable so as to enable others to view the annotation associated with the identified portion of the content.

Abstract: Methods and apparatus for versioning an electronic document based on XML and methods and apparatus for providing an updated electronic document based on XML can use a version value. The electronic document being managed can use a syntax defining a structure of the structured electronic document. One method is characterized in that date information of when a content of the electronic document is changed is used as a version value.

Abstract: A system, method, and apparatus for annotating an electronic document independently of its content is provided. According to one variation, a tablet and stylus-based computer is programmed with a document browser that permits a user to annotate documents viewed through the browser. The annotations are stored separately from the viewed document pages but are correlated with the pages such that when a previously annotated page is revisited, annotations relating to that page are retrieved and displayed on top of the page as an “ink” layer. Three different annotation modes are possible: ink, highlight, and erase. Each mode can be selected through a user interface supplied through the browser or through controls embedded in a document.

Abstract: Systems and methods may operate to display a plurality of data containers or bubbles within a user interface so that they do not overlap. Data containers are associated with a pointer or association indicium of fixed size that indicates the relationship between the data container and a target item. They systems and methods include, among other things, determining that two or more data containers will overlap if displayed in the user interface and performing a shift of the data containers, a resizing of the data containers, a shifting of the pointer, or a combination of the above. Additional apparatus, systems, and methods are disclosed.

Abstract: Automated methods are used to augment an original script of a time-based media program that contains speech with timing metadata and an indication of a confidence level with which script portions are matched with the speech in the program audio track. An editor uses a spot dialog editor tool to produce a word-accurate spot dialog master by reviewing and editing script portions displayed next to the corresponding portions of the time-based media. The spot dialog editor tool selects for review and editing the parts of the script having a low confidence match with the speech in the program.

Abstract: A client terminal acquires from a server terminal one or more document information which includes at least a thumbnail image and document identification information for identifying document data corresponding to the thumbnail image, and includes first annotation data and/or second annotation data associated with the document identification information. If first annotation data is included in respective acquired document information, the client terminal displays a thumbnail image with which the first annotation data is combined, as a list with thumbnail view, on a display unit. If the second annotation data is included in specified document data, the client terminal individually displays specified document data with which the second annotation data is combined, on a display unit.

Abstract: An electronic book system provides interfaces particularly suited to students' use of textbooks. A finger press on a touch screen produces a contextual menu with user choices that relate to where the finger was pressed or what the user was recently doing with the book. A student provisionally navigates through a book by a specific gesture which, when it stops, returns the user to the previous position in the book. Annotations are displayed and hidden using specific gestures and through selective movement of the reader as sensed by its accelerometer.

Abstract: An annotation overlay collection, storage, and display system and method is described. The system and method allows the collection of annotations of a variety of formats from multiple users and stores these annotations separate from, but related to the reference document, or several related reference documents. The annotations are displayed when the reference document is viewed and may be displayed in a format that minimizes the use of display real-estate but allows access to the annotation when desired.

Abstract: Contextually placed chat-like annotations in an electronic record. Users can input successive time-stamped annotations at a selected location in an electronic record. The annotations are displayed chronologically in a discussion window, which is customizable by color, style, and location. The discussion window styles minimize clutter and distraction, thus providing for more effective review and collaboration. The discussion location is indicated by a discussion point icon, and can be displayed in a window of fixed size with scrolling capability. A user can email the discussion window content to other users and request an alert, notifying the user of successive annotations. An annotation engine can reside on a server and receives user input and performs functionality related to the annotations. The electronic record can reside on the server and is repeatedly updated to reflect current content relating to the electronic record and annotations.

Abstract: A method for emphasizing differences in graphical appearances between an original document and a modified document using annotations with outer and inner boundaries is disclosed. A first bitmap of the modified document and a second bitmap of the original document are received. A set of difference points is derived from a comparison of the first bitmap and the second bitmap. Those difference points are representative of coordinates within the first and second bitmaps having pixel value differences exceeding a predetermined threshold. An outer boundary and an inner boundary of the difference points is derived, then an annotation defined by an area between the outer boundary and the inner boundary is generated.

Abstract: A spatial bulletin board system for virtually writing a memo in an actual space and displaying the memo superimposed on a picked-up image of the actual space. The system includes an input device that converts drawing movement during the creation of content in an actual space to three-dimensional coordinate information and acquires positional information which specifies a place in which the memo is written and saves the information in a spatial communication server. In the image-pickup place, the picked-up image is displayed on a spatial bulletin board display device and a browsing request is sent to the spatial communication server.

Abstract: Disclosed herein are computer-implemented systems and methods for allowing an end-user to create and share annotated comments, modify published images, and/or otherwise interact with images published on digital content platforms (e.g., images published on a webpage, mobile application, etc.). The systems and methods may include: (1) providing an annotation interface to allow a first end-user to create an annotation on a published image; (2) providing a comment entry interface to receive a comment from the first end-user; (3) linking the annotation and the comment; (4) identifying when a second end-user accesses the image or comment on the digital content platform; and (5) displaying the comment and/or annotation to the second end-user.

Abstract: One embodiment of the present invention provides a method for allowing a first user to view a collaboratively annotated electronic document. During operation, the system identifies a set of users based on the similarities of online behavior between the identified users and the first user. The system further ranks the identified users based on degrees of similarities between these users and the first user. The system then retrieves an electronic document selected for viewing by the first user and determines whether at least one of the identified users has annotated the electronic document. Based on the determination, the system augments the electronic document with annotations from the identified user and displays the annotated electronic document to the first user.

Abstract: It is expected to provide a document image generating apparatus, a document image generating method and a computer program that can keep a layout of original text present in the original text image and then can improve the readability of original text and the readability annotation corresponding to the original text (e.g., translation). A translation 421 of original text 411 is aligned at the interline space between the original text 411 at the first line and the original text 412 at the second line. When the interline space is narrow as shown in FIG. 4B, the original text 411 overlays the translation 421. At that time, the color regarding the original text 411 is changed to be a low visibility color, and the color regarding the translation 421 is changed to be a high visibility color.