Abstract: A system and method to identify pictures in documents. An image representing a page of a document is received. The image is analyzed to identify text objects in the page. A masked image is generated by masking out regions of the image including the text objects in the page. Groups of pixels in the masked image are identified, wherein a respective group of pixels corresponds to at least one picture in the page. When there is one or more groups of pixels, regions for pictures are identified based on the one or more groups of pixels. Metadata tags for the pictures are stored, wherein a respective metadata tag for a respective picture includes information about a respective bounding box for the respective picture.

Abstract: A system for visually navigating a document in conjunction with a text-to-speech (“TTS) engine presents a visual display of a region of interest that is related to the text of the document that is being audibly presented as speech to a user. When the TTS engine converts the text to speech and presents the speech to the user, the system presents the corresponding section of text on a display. During the presentation, if the system encounters a linked section of text, the visual display changes to display a linked region of interest that corresponds to the linked section of text.

Abstract: Systems and methods are provided for capturing, annotating, organizing and sharing content captured by a mobile device. The content may represent meeting notes on a whiteboard and may be captured by a camera on the mobile device, or by using specialized whiteboard capture software. Regions of the content where a user wishes to add annotations are then identified, after which the user adds annotations, such as written or audio annotations, to the identified regions. The annotated content is then organized into a specific sequence in which the content and the annotations will be presented, and a video is created from the sequence so that the annotated content can be easily shared with, and understood by, other users.

Abstract: Systems and methods are provided for capturing, annotating, organizing and sharing content captured by a mobile device. The content may represent meeting notes on a whiteboard and may be captured by a camera on the mobile device, or by using specialized whiteboard capture software. Regions of the content where a user wishes to add annotations are then identified, after which the user adds annotations, such as written or audio annotations, to the identified regions. The annotated content is then organized into a specific sequence in which the content and the annotations will be presented, and a video is created from the sequence so that the annotated content can be easily shared with, and understood by, other users.

Abstract: Systems and methods for facilitating use of non-electronic whiteboards and other large displays. Images of whiteboard are input to a computer device to provide automatic detection of a collaborative portion of content on the board created during a collaborative session and distribution to relevant collaborators alone while personal content of board is not distributed. Modification history of writings are preserved and displayed as change histograms to assist a user locate content that may have been erased. User finds the content by inspecting regions of board that correspond to user's memory of approximate location and time of modifying the content and are shown on the histogram as having been modified. Persistent reminder notes that clutter board space are detected and stored based on their location on the board and duration of persisting on the board so that they may be erased.

Abstract: A system and method for identifying key frames of a presentation video that include stationary informational content. A sequence of frames is obtained from a presentation video and differences of pixel values between consecutive frames of the sequence of frames are computed. Sets of consecutive frames that are stationary are identified, wherein consecutive frames that are stationary have a proportion of changed pixel values below a first predetermined threshold, and wherein pixel values are deemed to be changed when the difference between the pixel values for corresponding pixels in consecutive frames exceeds a second predetermined threshold. Next, a set of key frames that include stationary informational content is retained. The set of key frames that include stationary informational content is then displayed for user interaction.

Abstract: An interactive system provides for increasing retrieval performance of images depicting text by allowing users to provide relevance feedback on words contained in the images. The system includes a user interface through which the user queries the system with query terms for images contained in the system. Word image suggestions are displayed to the user through the user interface, where each word image suggestion contains the same or slightly variant text as recognized from the word image by the system than the particular query terms. Word image suggestions can be included in the system by the user to increase system recall of images for the one or more query terms and can be excluded from the system by the user to increase precision of image retrieval results for particular query terms.

Abstract: A system provides for controlling a cursor on a screen automatically and dynamically when using a video camera as a pointing device. A computer displays static or dynamic content to a screen. A video camera connected to the computer points at the screen. As the video camera films the screen, frames captured by the video camera are sent to the computer. A target image is displayed by the computer onto the screen and marks the position of the screen cursor of the video camera. Frames captured by the video camera include the target image, and the computer dynamically moves the target image on the screen to ensure that the target image stays in the center of the view of the video camera.

Abstract: Systems and methods for interactive, user-driven detection, creation and completion of form fields in a digital document are provided. A document with form fields that require completion by a user is received, after which form fields are detected at the direction of the user. Once the user selects a possible form field, the system creates the appropriate fillable form field based on size, type, location, related text and other parameters of the form field and surrounding document. Additional levels of interaction include predictive text, pattern development and automatic completion of previously completed fields.

Abstract: Embodiments of the present invention include a video server that can detect and track the image of a pointing indicator in an input video stream representation of a computer display. The video server checks ordered frames of the video signal and determines movements for a pointing indicator such as a mouse arrow. Certain motions by the pointing indicator, such as lingering over a button or menu item or circling a button or menu item can provoke a control action on the server.

Abstract: In embodiments, a user interface provides for manipulating one or more physical devices for use in a conference room setting. The user interface includes a touch screen for presenting a variety of options to a user. The touch screen includes controllers, such as buttons, to enable the user to select any one of the options. Each of the controllers has goals-oriented information, enabling the user to select a goal, while insulating the user from the underlying complex processes required to carry out the goal through the selection of one of the controllers.

Abstract: The system and method enables people to use their webcam as a virtual flashlight over their screen as a picture or video clip is playing. The position, tilt and rotation of the flashlight over the screen is recorded and smoothed to generate a compelling movie. Users move the webcam closer to the screen to focus on a specific area; users can rotate the webcam to generate compelling rotations, and users can pan the webcam to simulate looking at objects from a side.

Abstract: Blogs (and other information sources) are recommended to a user based history of user's online activities. The system: (1) processes the user's web history, (2) identifies blog posts (and web pages) that link to pages read by the user, (3) generates multiple relevance scores for each identified post/page, and (4) produces multiple rankings of the corresponding source blogs (and web sites) by aggregating individual relevance scores (or combinations of relevance scores), according to users' preferences. The system allows the discovery of information sources that are likely to be interesting to the user and allows sources lost in the “long tail” to be seamlessly discovered.

Abstract: An element, such as a plug on a VGA cable, can communicate with a media storage unit to enable or disable media storage.

Abstract: A system helps filter and correct video captured and streamed from a mobile device. In particular, the system detects and streams content shown on screens, allowing anyone to stream screen content immediately without needing to develop hooks into external software (i.e. without installing a screen recorder software in the computer). The system can use a variety of user-selectable techniques to detect the screen, and utilizes the mobile device's touchscreen to allow users to manually override detected corners. However, some of these approaches could potentially be applied to other types of content, such as identifying TV screens, appliance LCD screens, other mobile devices' screens, multifunction devices. (e.g. a remote technician could help troubleshoot a malfunctioning MFD by having the end-user point his cellphone to the LCD screen of the MFD).

Abstract: A system and method for identifying key frames of a presentation video that include stationary informational content. A sequence of frames is obtained from a presentation video and differences of pixel values between consecutive frames of the sequence of frames are computed. Sets of consecutive frames that are stationary are identified, wherein consecutive frames that are stationary have a proportion of changed pixel values below a first predetermined threshold, and wherein pixel values are deemed to be changed when the difference between the pixel values for corresponding pixels in consecutive frames exceeds a second predetermined threshold. Next, a set of key frames that include stationary informational content is retained. The set of key frames that include stationary informational content is then displayed for user interaction.

Abstract: Systems and Methods that allows multiple users to see a privacy-filtered overview of a document on a large display and that allows them to view on their personal mobile device details of the same document that are specific to their credentials.

Abstract: Embodiments of the present invention combine the flexibility of the computer in segmenting, indexing, and retrieving data with the strengths of people in analyzing scenes. They provide a mechanism that allows a group of analyzers at distributed locations to collaborate in generating pieces of semantic information of a data stream, integrates these pieces into a summary representation that can be used for subsequent computation, and allows related hypotheses and information requests to be presented back to the analyzers. This description is not intended to be a complete description of, or limit the scope of, the invention. Other features, aspects, and objects of the invention can be obtained from a review of the specification, the figures, and the claims.

Abstract: A system and method to identify pictures in documents. An image representing a page of a document is received. The image is analyzed to identify text objects in the page. A masked image is generated by masking out regions of the image including the text objects in the page. Groups of pixels in the masked image are identified, wherein a respective group of pixels corresponds to at least one picture in the page. When there is one or more groups of pixels, regions for pictures are identified based on the one or more groups of pixels. Metadata tags for the pictures are stored, wherein a respective metadata tag for a respective picture includes information about a respective bounding box for the respective picture.

Abstract: User behavior while interacting with one or more first representations of digital content can be monitored. Interaction information can be determined by monitoring the user behavior while interacting. Interaction information can include information identifying interaction areas of the first representation, degree of interaction information, and sequence of interaction information. The interaction information can be maintained and used to deform a second representation of digital content. The first and second representations can be of the same or different digital content.