Abstract: Systems and methods detect simple user gestures to enable selection of portions of segmented content, such as text, displayed on a display. Gestures may include finger (such as thumb) flicks or swipes as well as flicks of the handheld device itself. The used finger does not occlude the selected text, allowing users to easily see what the selection is at any time during the content selection process. In addition, the swipe or flick gestures can be performed by a non-dominant finger such as a thumb, allowing users to hold the device and make the selection using only one hand. After making the initial selection of a target portion of the content, to extend the selection, for example to the right, the user simply swipes or flicks the finger over the touchscreen to the right. The user could also flick the entire device in a move gesture with one hand.

Abstract: The various embodiments described herein include methods and systems for providing electronic feedback. In one aspect, a method for providing feedback to a first participant is performed at a first client device. The method includes: (a) participating in an electronic conference with remote participant(s), the conference including an outgoing communications stream for the first participant; and (b) receiving feedback corresponding to a quality of the first participant's outgoing communications stream at a client device used by the particular participant. In another aspect, a method for providing feedback from a first participant is performed at a first client device.

Abstract: Example implementations described herein are directed to systems and methods for document capture, which can involve detecting, from a plurality of frames of a recording of an application window that comprises a document, document content of the document and screen activity of the application window; and generating a web-based copy of the document based on the document content and the screen activity. Further example implementations can involve recording screen activity such as mouse cursors, text annotations, scrolling actions and other activity, and then providing an application layer to replay the screen activity onto the captured document.

Abstract: Method, apparatus and system for improving navigation using mobile devices by adding previously captured media to navigation maps provided by mobile device. Added media include still images and video clips. Media captured at the same location using various camera orientations are available in an image database. Images in database include metadata indicating location, orientation and other parameters associated with each image. User location and pose are matched against metadata indicating location and camera orientation of captured images. User motion may also be matched to metadata indicating camera motion of stored video clips. Other parameters like lighting, seasonal factors, and tasks of walking, biking or driving may also be matched. User pose may be derived from an accelerometer embedded in the mobile device. Some or all of user parameters desired by user may be directly input to mobile device by user instead of being automatically detected by mobile device.

Abstract: Systems and methods of performing a process are provided, including receiving a live document video stream of a remote collaboration session, detecting a cursor action in the live document video stream, classifying the detected cursor action into an action category, detecting key frames of the live document video stream, indexing the detected key frames based on the action category, detecting a keyword in the indexed key frames, indexing the key frames using the category, visualizing the cursor action in the key frames based on the action category, and displaying the visualized cursor action.

Abstract: The various embodiments described herein include methods and systems for providing electronic feedback. In one aspect, a method for providing feedback to a first participant is performed at a first client device. The method includes: (a) participating in an electronic conference with remote participant(s), the conference including an outgoing communications stream for the first participant; and (b) receiving feedback corresponding to a quality of the first participant's outgoing communications stream at a client device used by the particular participant. In another aspect, a method for providing feedback from a first participant is performed at a first client device.

Abstract: Systems and methods of performing a process are provided, including receiving a live document video stream of a remote collaboration session, detecting a cursor action in the live document video stream, classifying the detected cursor action into an action category, detecting key frames of the live document video stream, indexing the detected key frames based on the action category, detecting a keyword in the indexed key frames, indexing the key frames using the category, visualizing the cursor action in the key frames based on the action category, and displaying the visualized cursor action.

Abstract: A computer-implemented method performed in connection with a video comprising a plurality of video frames, the computer-implemented method being performed in a computerized system comprising a processing unit and a memory, the computer-implemented method involving: using the processing unit to detect a plurality of content components within at least one of the plurality of video frames; based on a video modification instruction received from a user, modifying at least one of the plurality of the detected content components; storing an information on the modified at least one of the plurality of the detected content components in the memory; using the central processing unit to overlay the modified at least one of the plurality of the detected content components over the video; and causing the video with the overlaid modified content component to be displayed to the user.

Abstract: A method for providing real-time feedback of an estimated quality of a captured final image, the method including obtaining a preliminary image, calculating a quality score of the preliminary image, and in response to the quality score of the preliminary image exceeding a threshold quality value, taking a first action.

Abstract: Described are systems and methods that allow a video conference participant to efficiently review semantically meaningful events within the video streams shared by their peers. Because participants are engaged in real-time communication, it is important to provide tools that let them quickly jump back to past events that were shown previously, not requiring them to manipulate a standard video timeline. Our techniques thus find meaningful events in the video stream such as scrolling pages, moving windows, typing text, etc. Using these techniques, a participant can then easily go back to e.g. the last PDF page shown by a peer, while still listening to the live audio.

Abstract: A computerized system and computer-implemented method for assisting a user with capturing a video of an activity. The system incorporates a central processing unit, a camera, a memory and an audio recording device. The computer-implemented method involves: using the camera to capture the video of the activity; using the central processing unit to process the captured video, the processing comprising determining a number of user's hands appearing in the captured video; using the recording device to capture of the audio associated with the activity; using the central processing unit to process the captured audio, the processing comprises determining a number of predetermined references in the captured audio; using the determined number of user's hands appearing in the captured video and the determined number of predetermined references in the captured audio to generate feedback to the user; and providing the generated feedback to the user using a notification.

Abstract: A method for navigating instructional video presentations is disclosed. The method includes determining a pause mode of a video presentation, and playing the video presentation on a display device. The video presentation has one or more predetermined pause positions. The method also includes, while playing the video presentation, determining that the video presentation has reached one of the one or more pause positions. The method further includes, in accordance with a determination that the video presentation is in a first pause mode, pausing the video presentation at the one of the one or more pause positions and maintaining a display of a paused frame of the video presentation, and, in accordance with a determination that the video presentation is in a second pause mode distinct from the first pause mode, continuing to play the video presentation through the one of the one or more pause positions.

Abstract: In embodiments, a user interface provides for manipulating one or more physical devices for use in a conference room setting. The user interface includes a touch screen for presenting a variety of options to a user. The touch screen includes controllers, such as buttons, to enable the user to select any one of the options. Each of the controllers has goals-oriented information, enabling the user to select a goal, while insulating the user from the underlying complex processes required to carry out the goal through the selection of one of the controllers.

Abstract: Described are systems and methods that allow a video conference participant to efficiently review semantically meaningful events within the video streams shared by their peers. Because participants are engaged in real-time communication, it is important to provide tools that let them quickly jump back to past events that were shown previously, not requiring them to manipulate a standard video timeline. Our techniques thus find meaningful events in the video stream such as scrolling pages, moving windows, typing text, etc. Using these techniques, a participant can then easily go back to e.g. the last PDF page shown by a peer, while still listening to the live audio.

Abstract: A system helps filter and correct video captured and streamed from a mobile device. In particular, the system detects and streams content shown on screens, allowing anyone to stream screen content immediately without needing to develop hooks into external software (i.e. without installing a screen recorder software in the computer). The system can use a variety of user-selectable techniques to detect the screen, and utilizes the mobile device's touchscreen to allow users to manually override detected corners. However, some of these approaches could potentially be applied to other types of content, such as identifying TV screens, appliance LCD screens, other mobile devices' screens, multifunction devices. (e.g. a remote technician could help troubleshoot a malfunctioning MFD by having the end-user point his cellphone to the LCD screen of the MFD).

Abstract: A system and method for interacting with a mobile device using an external display is disclosed, where a mobile device provides representations of an object and action to an external display for a user to select and then input back to the mobile device. An application on a mobile device provides representation data of an object and an action to a host system driving an external display. The host system arranges the representation data into a representation on the external display and allows the user to interact with the representations. The user then selects a representation and inputs the selected representation into the mobile device, where the application processes the representation to carry out the appropriate actions on the appropriate objects. The representation may be inputted to the mobile device using a photo of the representation taken by a mobile device camera, or by inputting a code provided with each representation on the external display.

Abstract: Systems and methods detect simple user gestures to enable selection of portions of segmented content, such as text, displayed on a display. Gestures may include finger (such as thumb) flicks or swipes as well as flicks of the handheld device itself. The used finger does not occlude the selected text, allowing users to easily see what the selection is at any time during the content selection process. In addition, the swipe or flick gestures can be performed by a non-dominant finger such as a thumb, allowing users to hold the device and make the selection using only one hand. After making the initial selection of a target portion of the content, to extend the selection, for example to the right, the user simply swipes or flicks the finger over the touchscreen to the right. The user could also flick the entire device in a move gesture with one hand.

Abstract: Online educational videos are often difficult to navigate. Furthermore, most video interfaces do not lend themselves to note-taking. Described system detects and reuses boundaries that tend to occur in these types of videos. In particular, many educational videos are organized around distinct breaks that correspond to slide changes, scroll events, or a combination of both. Described algorithms can detect these structural changes in the video content. From these events the system can generate navigable overviews to help users searching for specific content. Furthermore, these boundary events can help the system automatically associate rich media annotations to manually-defined bookmarks. Finally, when manual or automatically recovered spoken transcripts are available, the spoken text can be combined with the temporal segmentation implied by detected events for video indexing and retrieval. This text can also be used to seed a set of text annotations for user selection or be combined with user text input.

Abstract: A method for navigating instructional video presentations is disclosed. The method includes determining a pause mode of a video presentation, and playing the video presentation on a display device. The video presentation has one or more predetermined pause positions. The method also includes, while playing the video presentation, determining that the video presentation has reached one of the one or more pause positions. The method further includes, in accordance with a determination that the video presentation is in a first pause mode, pausing the video presentation at the one of the one or more pause positions and maintaining a display of a paused frame of the video presentation, and, in accordance with a determination that the video presentation is in a second pause mode distinct from the first pause mode, continuing to play the video presentation through the one of the one or more pause positions.

Abstract: A method for providing real-time feedback of an estimated quality of a captured final image, the method including obtaining a preliminary image, calculating a quality score of the preliminary image, and in response to the quality score of the preliminary image exceeding a threshold quality value, taking a first action.