Abstract: Methods and systems provide a dynamically user-configurable interface for a communication session. In one embodiment, a system presents, at a client device connected to a communication session, a user interface (“UI”), the UI including a canvas section with one or more canvas assets and an asset selector section with one or more selector components representing canvas assets. The system receives a request to place a chosen selector component from the asset selector section into a specified location in the canvas section. In response to the request, the system identifies a type and size properties of the canvas assets and size properties of the canvas section; determines a size for the chosen selector component; and presents the chosen selector component within the specified location in the canvas section at the determined size while concurrently recompositing the canvas assets.

Abstract: A local background replacement image (LBGRI) is received at a first device of a first conference participant. The first device is connected to an audio-visual conference that includes conference participants. The conference participants include the first conference participant and a second participant. A source output image that includes a source foreground segment representative of the second participant is received from a second device of the second participant. The LBGRI is combined with the source foreground segment to generate a target output image. The target output image is output at the first device.

Abstract: One or more actions are performed to prevent exposure of media of a video conference to an unauthorized person who, during the video conference, enters a physical space from which one or more conference participants are attending the video conference. The one or more actions correspond to modifications to the media of the video conference output at one or more devices within the physical space and may, for example, include blurring video content of the video conference and/or distorting audio content of the video conference. Based on a resolution event associated with the unauthorized person, such as a conference participant authorizing access to the conference by the unauthorized person or a determination that the unauthorized person has left the physical space, the media of the video conference may be restored at the one or more devices within the physical space.

Abstract: Systems and methods for providing instant processing of virtual meeting recordings are provided.

Abstract: Provided herein are systems and methods for delta models for providing privatized speech-to-text during virtual meetings. In one embodiment, a system may include a non-transitory computer-readable medium; a communications interface; and a processor. The processor may be configured to execute processor-executable instructions to: join a virtual meeting. Each participant in the virtual meeting may exchange audio streams with other participants in the virtual meeting. The instructions may include receiving, from a video conference provider, a local model for speech recognition. The local model may be a copy of a centralized model. The instructions may include performing speech recognition using the local model on the audio streams.

Abstract: Illumination testing is performed to passively check the health of a display of a shared device within a physical space, such as a conference room. A test pattern is output to the display within the physical space. Using a camera within the physical space, a test image of the physical space is captured while the test pattern is output to the display. A determination is then made as to whether the display is in a fail state by comparing the test image against a reference image depicting an expected illumination of the physical space according to the test pattern. Where the device is determined to be in a fail state, a notification indicating the fail state is transmitted to an administrator device to alert an administrator associated therewith of the fail state.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media relate to a method for providing multi-point video presentations with live annotations within a communication platform. First, the system receives video feeds depicting imagery of a number of users. The system then determines a boundary about each user in the video feeds, with the boundaries each having an interior portion and an exterior portion. The system provides a media background for the exterior portions, then generates a composite video for each of the feeds. The system then determines that one or more client devices have annotation permissions, and receives one or more annotation inputs corresponding to at least one of the composite videos. Finally, the system updates at least one of the composite videos to additionally depict the annotation inputs within a third layer.

Abstract: A server determines, during a conference implemented using conferencing software and based on stored data associated with two or more users participating in the conference, that the two or more users are accessing the conferencing software from separate user devices located in separate areas of an office premises. The server determines, by accessing stored conference room scheduling data of the office premises, that a conference room within the office premises is available for use by the two or more users. The server transmits, to each of the separate user devices, a prompt recommending that the two or more users further participate in the conference using a shared device configured to access the conferencing software within the conference room.

Abstract: A server determines, during a conference implemented using conferencing software and based on stored data associated with two or more users participating in the conference, that the two or more users are accessing the conferencing software from separate user devices located in separate areas of an office premises. The server determines, by accessing stored conference room scheduling data of the office premises, that a conference room within the office premises is available for use by the two or more users. The server transmits, to each of the separate user devices, a prompt recommending that the two or more users further participate in the conference using a shared device configured to access the conferencing software within the conference room.

Abstract: A first composite video depicting a media background shared by a first user of the users is transmitted for display at devices of users of a conference. A presentation content is received from a device of a second user of the users. A second composite video depicting the media background partially overlaid by the presentation content is transmitted to at least a subset of the devices for display at the at least the subset of the devices. A request may be received from a device of the first user to grant an access right to the second user to share the presentation content for depiction within the second composite video.

Abstract: A source device provides, during a conference, shared data from the source device participating in the conference to one or more destination devices participating in the conference. The source device receives a representation of a download progress of the shared data at the one or more destination devices. A presenter device prompts a user of the presenter device to select a presentation time of the shared data based on the download progress. The presenter device is the source device or one of the one or more destination devices.

Abstract: A virtual background (VBG) spreading request that includes a replacement VBG is received. The replacement VBG is partitioned into a number of portions matching a number of conference participants. A first portion of the portions is assigned to a conference participant. Images of the conference participant are received. Foreground segments of the images of the conference participant are overlayed onto the first portion to obtain output images. The output images are transmitted for display or are displayed.

Abstract: A background-setting request for a target user device of a target conference participant is received. The background-setting request identifies a source conference participant. A source user device of the source conference participant is configured to use a virtual background (VBG) image. A replacement VBG is obtained based on the background-setting request and the VBG image of the source user device. The replacement VBG is used to set a VBG at the target user device.

Abstract: Methods and systems provide for presenting real-time engagement analytics for communication sessions. In one embodiment, a method maintains a communication session with a number of participants, wherein session content is presented during the communication session to the participants, and wherein participants can request real-time notes to be generated for the session content to be captured. The method determines one or more engagement metrics for participants based on the participants requesting real-time notes to be generated during the communication session. Finally, the method presents, to one or more participants of the communication session, information corresponding to at least a subset of the determined engagement metrics.

Abstract: Methods and systems provide for indication of non-verbal cues within a video communication session. In one embodiment, a method displays, for each of a number of participants within a video communication session, a user interface including participant windows corresponding to the plurality of participants, and a video for each of at least a subset of the participants, where the video is displayed within the corresponding participant window for the participant. The method analyzes, in real time, the video to detect a non-verbal cue from a participant. The method determines that the non-verbal cue has been sustained for a duration that exceeds a designated threshold of time. The method then displays, within the UI of at least one of the participants, a prompt associated with the non-verbal cue.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media provide for composite video with live annotations within a video communications platform. First, the system receives video content depicting imagery of a first user, with the video content having multiple video frames. The system then determines a boundary about the first user in the video frames, with the boundary having an interior portion and an exterior portion. The system provides a media background for the exterior portion, then generates a composite video for display on client devices, with the composite video depicting the media background in a first layer and the first user in a second layer. The system then receives one or more annotation inputs corresponding to the composite video. The annotation inputs can include media-based and/or messaging-based annotations. Finally, the system updates the composite video to additionally depict the annotation inputs within a third layer.

Abstract: A method comprising determining a quantitative dispersion image of an object based on a set of quantitative phase images, each quantitative phase image of the set of quantitative phase images having been obtained with a respective different illumination light wavelength.

Abstract: A note is dynamically generated with captured content from a communication session. At least a portion of the session content is recorded. A request to generate a note is received from one of the participants of the communication session. In response to receiving the request, the a note is generated that includes at least a designated portion of the recorded session content. Access to the portion of the session content identified in the note is granted to the requesting participant upon demand.

Abstract: An optical device for capturing an image of a scene, the optical device comprising: a plurality of image sensors each operable to capture a respective initial image of the scene; a lens arrangement operable to receive light from the scene and to form each initial image on each respective image sensor, each image sensor being located at a different respective distance from the lens arrangement; and an image processor operable to generate the captured image of the scene on the basis of image data from one or more of the captured initial images.

Abstract: Methods and systems provide for preventing content capture within a communication session. In one embodiment, a method maintains a communication session with a number of participants, where session content is presented during the communication session to the participants, and where participants can request the session content to be captured for later access. The system receives or identifies one or more signals for capture prevention to be initiated for at least a portion of the session content. The system further receives, in real time during the communication session, a request from one of the participants for a current portion of session content to be captured. The system then determines, via processing of the one or more signals, that the current portion of session content is to be prevented from capture, and then prevents the current portion of session content from being captured.