Abstract: A computerized system comprising a processing unit and a memory, the system operating in connection with a real-time video conference stream containing a video of a user, wherein the memory embodies a set of computer-executable instructions, which cause the computerized system to perform a method involving: receiving the real time video conference stream containing the video of the user; detecting and separating the background in the received real time video conference stream from the user; and replacing the separated background with a background received from a system of a second user or with a pre-recorded background.

Abstract: A computerized system comprising a processing unit and a memory, the system operating in connection with a real-time video conference stream containing a video of a user, wherein the memory embodies a set of computer-executable instructions, which cause the computerized system to perform a method involving: receiving the real time video conference stream containing the video of the user; detecting the background in the received real time video conference stream from the user; and matching the first background and a second background associated with the second user.

Abstract: An apparatus includes a 360 camera configured to image a volume including one or more local users, and generate an output for remote users, and an illumination device configured to generate a visual output for the one or more local users that is indicative of a viewing direction or a number of the remote users, based on a mapping of a region of interest of the remote viewers. The illumination device is associated with the 360 camera.

Abstract: Systems and methods for automatic detection and insetting of digital streams into a 360 video. Various examples of such regions of interest to the user include, without limitation, content displayed on various electronic displays or written on electronic paper (electronic ink), content projected on various surfaces using electronic projectors, content of paper documents appearing in the 360-degree video and/or content written on white (black) boards inside the 360-degree video. For some content, such as whiteboards, paper documents or paintings in a museum, a participant (or curator) could have taken pictures of the regions, again stored digitally somewhere and available for download. These digital streams with content of interest to the user are obtained and then inset onto the 360-degree view generated from the raw 360-degree video feed, giving users the ability to view them at their native high resolution.

Abstract: A computer-implemented method is provided for receiving a request from a third party source or on a template to generate a payload, receiving live video via a viewer, and performing recognition on an object in the live video to determine whether the object is an item in the payload, filtering the object against a threshold indicative of a likelihood of the object matching a determination of the recognition, receiving an input indicative of a selection of the item, and updating the template based on the received input, and providing information associated with the object to complete the request.

Abstract: A computer-implemented method performed in connection with a video comprising a plurality of video frames, the computer-implemented method being performed in a computerized system comprising a processing unit and a memory, the computer-implemented method involving: using the processing unit to detect a plurality of content components within at least one of the plurality of video frames; based on a video modification instruction received from a user, modifying at least one of the plurality of the detected content components; storing an information on the modified at least one of the plurality of the detected content components in the memory; using the central processing unit to overlay the modified at least one of the plurality of the detected content components over the video; and causing the video with the overlaid modified content component to be displayed to the user.

Abstract: Example implementations described herein are directed to systems and methods for document capture, which can involve detecting, from a plurality of frames of a recording of an application window that comprises a document, document content of the document and screen activity of the application window; and generating a web-based copy of the document based on the document content and the screen activity. Further example implementations can involve recording screen activity such as mouse cursors, text annotations, scrolling actions and other activity, and then providing an application layer to replay the screen activity onto the captured document.

Abstract: A computer-implemented method is provided for coordinating sensed poses associated with real-time movement of a first object in a live video feed, and pre-recorded poses associated with movement of a second object in a video. The computer-implemented method comprises applying a matching function to determine a match between a point of one of the sensed poses and a corresponding point of the pre-recorded poses, and based on the match, determining a playtime and outputting at least one frame of the video associated with the second object for the playtime.

Abstract: An augmented reality (AR) environment synchronization method, includes, for each of a plurality of devices associated with respective users in the AR environment, receiving plane information, and generating object/unique identifier information; across the devices, coordinating the plane information; performing context-aware matching of the object/unique identifier information across the devices to generate a match between respective objects sensed by the devices; and providing synchronization control to the devices, to permit an annotation of the matched object to be locked to a landmark and the plane of one of the devices with respect to others of the devices.

Abstract: A computerized system comprising a processing unit and a memory, the system operating in connection with a real-time video conference stream containing a video of a user, wherein the memory embodies a set of computer-executable instructions, which cause the computerized system to perform a method involving: receiving the real time video conference stream containing the video of the user; detecting and separating the background in the received real time video conference stream from the user; and replacing the separated background with a background received from a system of a second user or with a pre-recorded background.

Abstract: In a telepresence scenario with remote users discussing a document or a slide, it can be difficult to follow which parts of the document are being discussed. One way to address this problem is to provide feedback by showing where the user's hand is pointing at on the document, which also enables more expressive gestural communication than a simple remote cursor. An important practical problem is how to transmit this remote feedback efficiently with high resolution document images. This is not possible with standard videoconferencing systems which have insufficient resolution. We propose a method based on using hand skeletons to provide the feedback. The skeleton can be captured using a depth camera or a webcam (with a deep network algorithm), and the small data can be transmitted at a high frame rate (without a video codec).

Abstract: A computer-implemented method performed in connection with a video comprising a plurality of video frames, the computer-implemented method being performed in a computerized system comprising a processing unit and a memory, the computer-implemented method involving: using the processing unit to detect a plurality of content components within at least one of the plurality of video frames; based on a video modification instruction received from a user, modifying at least one of the plurality of the detected content components; storing an information on the modified at least one of the plurality of the detected content components in the memory; using the central processing unit to overlay the modified at least one of the plurality of the detected content components over the video; and causing the video with the overlaid modified content component to be displayed to the user.

Abstract: An apparatus includes a 360 camera configured to image a volume including one or more local users, and generate an output for remote users, and an illumination device configured to generate a visual output for the one or more local users that is indicative of a viewing direction or a number of the remote users, based on a mapping of a region of interest of the remote viewers. The illumination device is associated with the 360 camera.

Abstract: A method at a computer system includes obtaining an electronic document comprising document elements, and injecting into the document in association with one of the document elements one or more hotspot attributes, the hotspot attributes defining attributes of a hotspot that is displayable in conjunction with the document element when the document is displayed, the hotspot attributes being associated with predefined physical gestures and respective document actions; such that the hotspot, when displayed as part of a displayed document, indicates that a viewer of the displayed document can interact with the displayed document using the predefined physical gestures (i) performed at a position that overlap a displayed version of the document in a field of view of a camera system and (ii) captured by the camera system, wherein a physical gesture results in a respective document action being performed on the displayed document.

Abstract: A computerized system comprising a processing unit and a memory, the system operating in connection with a real-time video conference stream containing a video of a user, wherein the memory embodies a set of computer-executable instructions, which cause the computerized system to perform a method involving: receiving the real time video conference stream containing the video of the user; detecting and separating the background in the received real time video conference stream from the user; and replacing the separated background with a background received from a system of a second user or with a pre-recorded background.

Abstract: Systems and methods for automatic detection and insetting of digital streams into a 360 video. Various examples of such regions of interest to the user include, without limitation, content displayed on various electronic displays or written on electronic paper (electronic ink), content projected on various surfaces using electronic projectors, content of paper documents appearing in the 360-degree video and/or content written on white (black) boards inside the 360-degree video. For some content, such as whiteboards, paper documents or paintings in a museum, a participant (or curator) could have taken pictures of the regions, again stored digitally somewhere and available for download. These digital streams with content of interest to the user are obtained and then inset onto the 360-degree view generated from the raw 360-degree video feed, giving users the ability to view them at their native high resolution.

Abstract: Example implementations described herein are directed to a system for inserting document links or document fragments in messaging applications. For input provided to a messaging application, example implementations can parse the input to determine document parameters, determine previously linked documents in messages of the messaging application corresponding to the document parameters; and embed at least one of a selected document fragment or document link from the determined previously linked documents.

Abstract: Example implementations described herein are directed to systems and methods for providing documents in the chat of a chat application. Example implementations can involve detecting, in a chat of a chat application, an indication to edit a document; inserting a fragment of the document into the chat of the chat application, the fragment configured to be editable within the chat of the chat application; and modifying the document based on input provided to the fragment of the document in the chat of the chat application.

Abstract: Example implementations are directed to methods and systems for curating messages from viewers to identify a question associated with a recorded video that include video data, where the question is extracted from a queue of the video data; analyze the video data to determine one or more answer segments for the question that satisfy a confidence score based on a location of the question in the recorded video; and generate an answer summary for the question with links to each of the one or more segments, where the links are ranked based on the confidence score.

Abstract: Example implementations described herein are directed to systems and methods for providing documents in the chat of a chat application. Example implementations can involve detecting, in a chat of a chat application, an indication to edit a document; inserting a fragment of the document into the chat of the chat application, the fragment configured to be editable within the chat of the chat application; and modifying the document based on input provided to the fragment of the document in the chat of the chat application.