Abstract: Embodiments of the present invention enable an image based controller to control and manipulate objects with simple point-and-capture operations via images captured by a camera enhanced mobile device. Powered by this technology, a user is able to complete many complicated control tasks via guided control of objects without utilizing laser pointers, IR transmitters, mini-projectors, or bar code tagging and/or customized wall paper are not needed for the environment control. This description is not intended to be a complete description of, or limit the scope of, the invention. Other features, aspects, and objects of the invention can be obtained from a review of the specification, the figures, and the claims.

Abstract: Methods and systems that can be used to dynamically restructure user interfaces into a set of communicating processes. The methods and systems update new and wrapped legacy user interface components for repurposing of user interfaces. The methods and systems provide for changing one or more of at least an appearance, a behavior, and a state or condition of the user interfaces.

Abstract: A system and a method for sharing web pages. In some embodiments, the following operations are preformed at a client computer system having one or more processors that execute one or more programs stored in memory of the client computer system. A representation of a web page that is displayed in a window of a web browser in a user interface of the client computer system is generated. The representation of the web page is partitioned into a plurality of tiles based on a document object model of the web page. For each tile in the plurality of tiles, it is determined whether the tile has changed relative to a previous version of the tile. In response to determining that the tile has changed, the tile that has changed is sent to a server.

Abstract: Systems and methods for facilitating use of non-electronic whiteboards and other large displays. Images of whiteboard are input to a computer device to provide automatic detection of a collaborative portion of content on the board created during a collaborative session and distribution to relevant collaborators alone while personal content of board is not distributed. Modification history of writings are preserved and displayed as change histograms to assist a user locate content that may have been erased. User finds the content by inspecting regions of board that correspond to user's memory of approximate location and time of modifying the content and are shown on the histogram as having been modified. Persistent reminder notes that clutter board space are detected and stored based on their location on the board and duration of persisting on the board so that they may be erased.

Abstract: Method, apparatus and system for improving navigation using mobile devices by adding previously captured media to navigation maps provided by mobile device. Added media include still images and video clips. Media captured at the same location using various camera orientations are available in an image database. Images in database include metadata indicating location, orientation and other parameters associated with each image. User location and pose are matched against metadata indicating location and camera orientation of captured images. User motion may also be matched to metadata indicating camera motion of stored video clips. Other parameters like lighting, seasonal factors, and tasks of walking, biking or driving may also be matched. User pose may be derived from an accelerometer embedded in the mobile device. Some or all of user parameters desired by user may be directly input to mobile device by user instead of being automatically detected by mobile device.

Abstract: A system and method for interacting with a mobile device using an external display is disclosed, where a mobile device provides representations of an object and action to an external display for a user to select and then input back to the mobile device. An application on a mobile device provides representation data of an object and an action to a host system driving an external display. The host system arranges the representation data into a representation on the external display and allows the user to interact with the representations. The user then selects a representation and inputs the selected representation into the mobile device, where the application processes the representation to carry out the appropriate actions on the appropriate objects. The representation may be inputted to the mobile device using a photo of the representation taken by a mobile device camera, or by inputting a code provided with each representation on the external display.

Abstract: Systems and methods for bookmarking multimedia documents include displaying multiple multimedia streams, creating bookmarks comprising time signatures and snapshots of each multimedia stream based upon single action cues from a user, associating snapshots with portions of multimedia streams, displaying bookmarks and displaying portions of a multimedia stream associated with selected snapshots.

Abstract: Most documents that are in use today embed or link to animated content. Presently, a large percentage of online content is hypertext markup language (HTML) and many HTML documents embed animations. The aforesaid online content is amenable to printing. However, embedding animated content in a document will lead to information loss when the document is printed. Users cannot print the animations or the videos embedded in documents. Therefore, there is provided a method and system for automatically finding animated content embedded in documents such as web pages, slide presentations, word processing documents, and PDF documents, that are being displayed to a user, replacing the animated content by a printable version, such as a keyframe, and a unique code, and assigning each animation a URL, to allow the users to retrieve the animations via a website on computer displays or mobile devices as they read the printed document.

Abstract: A system for visually navigating a document in conjunction with a text-to-speech (“TTS) engine presents a visual display of a region of interest that is related to the text of the document that is being audibly presented as speech to a user. When the TTS engine converts the text to speech and presents the speech to the user, the system presents the corresponding section of text on a display. During the presentation, if the system encounters a linked section of text, the visual display changes to display a linked region of interest that corresponds to the linked section of text.

Abstract: A system for providing a dynamic audio-visual environment using an eSurface situated in a room environment; a projector situated for projecting images onto the eSurface; a camera situated to picture the room environment; a central processor coupled to the eSurface, the projector and the camera. The processor receives pictures from the camera for detecting the location of the eSurface; and controls the projector to aim its projection beam onto the eSurface. The eSurface is a sheet-like surface having the property of accepting optically projected image when powered, and retaining the projected image after the power is turned off.

Abstract: Multiple users access a collaborative data-sharing system during a data-sharing event. Each user can establish the level of sharing to be allowed with each other user and filtering criteria for filtering the data before it is provided to the other users. Data can be extracted from a number of different sources, including data input by other users and/or previously created information sources. For example, slides from a presentation on a similar topic may be identified and included by a user as a potential source of information to be used by other users. Shared data can be displayed on devices used by users to communicate with the collaborative data-sharing system. A user can selected data provided by the collaborative data-sharing system, which was obtained from the data input by other users and/or from the identified additional data sources and added to that user's data as data entered by that user.

Abstract: A Graphical User Interface (“GUI”) that provides a user with the ability to manipulate display objects in a non-uniform manner on a display surface is provided. For example, a user can manipulate an object so that it appears, torn, bent, folded, angled, etc. Additionally, a method and system for digitally attaching display objects to a display surface is described. The attachments include digital staples, digital push-pins, digital tape, etc. In still another aspect of the present invention a technique for transmitting and updating the display of non-uniform objects is described.

Abstract: A system and method for simultaneously conducting multiple telephone conversations is provided. In an embodiment, a user converses with one individual on a first channel while simultaneously transmitting audible utterances to a second individual or a second channel. The user can select the desired channel or channels and a desired phrase and an electronic representation of the selected phrase is transmitted over the selected channel(s).

Abstract: Embodiments of the present invention enable the extraction, classification, storage, and supplementation of presentation video. A media system receives a video signal carrying presentation video. The media system processes the video signal and generates images for slides of the presentation. The media system then extracts text from the images and uses the text and other characteristics to classify the images and store them in a database. Additionally, the system enables viewers of the presentation to provide feedback on the presentation, which can be used to supplement the presentation.

Abstract: Techniques are provided for determining collaborative notes and automatically recognizing speech, handwriting and other type of information. Domain and optional actor/speaker information associated with the support information is determined. An initial automatic speech recognition model is determined based on the domain and/or actor information. The domain and/or actor/speaker language model is used to recognize text in the speech information associated with the support information. Presentation support information such as slides, speaker notes and the like are determined. The semantic overlap between the support information and the salient non-function words in the recognized text and collaborative user feedback information are used to determine relevancy scores for the recognized text. Grammaticality, well formedness, self referential integrity and other features are used to determine correctness scores.

Abstract: A possible portion providing method involving receiving a pattern provided using a movable member, the pattern corresponding to a traveling path of the movable member, and the provided pattern corresponding to a portion of an intended sequence, determining at least one possible sequence which includes the received pattern, and displaying a remaining portion of the at least one possible sequence using a predefined font set for a plurality of components, the predefined font set including a record of a pattern corresponding to the traveling path of the movable member or another movable member for each of the plurality of components.

Abstract: Personalized change-tracking functionality for collaboratively authored documents is provided. Initially, every document or page for a given user is marked as “new”, “unread” or “unaccessed”. Any time a user edits or even reads a portion of a document, that fact is captured and those segments of the document are marked, for only that user, as “read”. However, any time another user edits that same document, if those edits overwrite areas that the first user has read or edited, or open up new areas, all those areas revert to the “new” or “unread” status. Thus, the next time the user visits that document or page, the display module will show him not what is new, but what is new to him.

Abstract: A system and method for simultaneously conducting multiple telephone conversations is provided. In an embodiment, a user converses with one individual on a first channel while simultaneously transmitting audible utterances to a second individual or a second channel. The user can select the desired channel or channels and a desired phrase and an electronic representation of the selected phrase is transmitted over the selected channel(s).

Abstract: A user-machine interface is disclosed that uses a line to connect and/or to intersect various objects displayed on a screen. A start of the line may identify a source, an end of the line may identify a sink, and line shapes and/or objects intersected by the line may identify commands.

Abstract: Techniques are provided for determining collaborative notes and automatically recognizing speech, handwriting and other type of information. Domain and optional actor/speaker information associated with the support information is determined. An initial automatic speech recognition model is determined based on the domain and/or actor information. The domain and/or actor/speaker language model is used to recognize text in the speech information associated with the support information. Presentation support information such as slides, speaker notes and the like are determined. The semantic overlap between the support information and the salient non-function words in the recognized text and collaborative user feedback information are used to determine relevancy scores for the recognized text. Grammaticality, well formedness, self referential integrity and other features are used to determine correctness scores.