Abstract: Systems and methods may be used for access control. These systems and methods may include using a data processing system to access a video stream, the video stream including an image including a virtual background, segmenting the image into a foreground portion and a background portion to determine whether the foreground portion or the background portion of the image meets a threshold requirement, and outputting an alert in response to determining that the foreground portion or the background portion of the image fails to meet the threshold requirement.

Abstract: Systems and methods may be used for access control. These systems and methods may include using a data processing system to identify a video stream, determine an identification of a source type of the video stream, determine whether the video stream is live or pre-recorded based on a determined type of the source type, and output an alert to a device in response to determining that the source type indicates the video stream is pre-recorded.

Abstract: Techniques are described for efficiently embedding frame masks in a video stream. In some solutions, a computer implemented method includes operations for encoding a frame of video data comprising an array of pixels to generate an encoded video frame, and transmitting the encoded video frame to a video decoder. The array of pixels include foreground pixels and background pixels. The foreground pixels have respective first chroma component values which are bounded within a first chroma component range. Encoding the frame of video data can include converting the first chroma component values of the foreground pixels to second chroma component values by applying a mapping function. The second chroma component values are bounded within a second chroma component range. The second chroma component range is shifted or compressed from the first chroma component range.

Abstract: Techniques are described for efficiently embedding frame masks in a video stream. In some solutions, a computer implemented method includes operations for encoding a frame of video data comprising an array of pixels to generate an encoded video frame and transmitting the encoded video frame. The array of pixels can include foreground pixels and background pixels. The foreground pixels can have respective original luma values which are bounded within a first luma range. In certain examples, encoding the frame of video data can include converting the original luma values of the foreground pixels to updated luma values which are bounded within a second luma range. The second luma range can be shifted and/or compressed from the first luma range.

Abstract: A computer implemented method can decode a frame of video data comprising an array of pixels to obtain decoded luma values and decoded chroma values corresponding to the array of pixels, and extract a frame mask based on the decoded luma values. The frame mask can include an array of mask values respectively corresponding to the array of pixels. A mask value indicates whether a corresponding pixel is in foreground or background of the frame. The method can perform a morphological operation to the frame mask to change one or more mask values to indicate their corresponding pixels are removed from the foreground and added to the background of the frame. The method can also identify foreground pixels after performing the morphological operation to the frame mask, and render a foreground image for display based on the decoded luma values and decoded chroma values of the foreground pixels.

Abstract: Techniques are described for efficiently embedding frame masks in a video stream. In some solutions, a computer implemented method includes operations for encoding a frame of video data comprising an array of pixels to generate an encoded video frame and transmitting the encoded video frame. The array of pixels can include foreground pixels and background pixels. The foreground pixels can have respective original luma values which are bounded within a first luma range. In certain examples, encoding the frame of video data can include converting the original luma values of the foreground pixels to updated luma values which are bounded within a second luma range. The second luma range can be shifted and/or compressed from the first luma range.

Abstract: A computer implemented method can decode a frame of video data comprising an array of pixels to obtain decoded luma values and decoded chroma values corresponding to the array of pixels, and extract a frame mask based on the decoded luma values. The frame mask can include an array of mask values respectively corresponding to the array of pixels. A mask value indicates whether a corresponding pixel is in foreground or background of the frame. The method can perform a morphological operation to the frame mask to change one or more mask values to indicate their corresponding pixels are removed from the foreground and added to the background of the frame. The method can also identify foreground pixels after performing the morphological operation to the frame mask, and render a foreground image for display based on the decoded luma values and decoded chroma values of the foreground pixels.

Abstract: Techniques provided herein determine a modification to apply at a respective facial position of one or more facial positions on a face in a first image; and apply the determined modification to one or more other images to the respective facial position on the face in the one or more other images to generate a modified video including the modifications at the respective facial position.

Abstract: Techniques for processing content for communication sessions are described. Implementations, for example, enable various ways of detecting and storing events that occur during communication sessions.

Abstract: According to a disclosed example, a first video stream is captured via a first camera associated with a first communication device engaged in a multi-party video conference. The first video stream includes a plurality of two-dimensional image frames. A subset of pixels corresponding to a first human subject is identified within each image frame of the first video stream. A second video stream is captured via a second camera associated with a second communication device engaged in the multi-party video conference. A composite video stream formed by at least a portion of the second video stream and the subset of pixels of the first video stream is rendered, and the composite video stream is output for display at one or more of the first and/or second communication devices. The composite video stream may provide the appearance of remotely located participants being physically present within the same visual scene.

Abstract: Techniques provided herein determine a modification to apply at a respective facial position of one or more facial positions on a face in a first image; and apply the determined modification to one or more other images to the respective facial position on the face in the one or more other images to generate a modified video including the modifications at the respective facial position.

Abstract: Techniques provided herein apply a precomputed graphical object to one or more images to generate a video that is modified with the precomputed graphical object. Various implementations characterize facial positions on a face in a first image and determine a respective facial position on the face to apply a precomputed graphical object at. One or more implementations modify the first image by applying the precomputed graphical object to the respective facial position in the first image. Some implementations modify one or more images that are captured after the first image by applying the precomputed graphical object to each respective location for the respective facial position in the one or more images. In turn, various implementations generate a video with images that are modified based on the precomputed graphical object.

Abstract: Techniques for processing content for communication sessions are described. Implementations, for example, enable various ways of detecting and storing events that occur during communication sessions.

Abstract: Techniques provided herein apply a precomputed graphical object to one or more images to generate a video that is modified with the precomputed graphical object. Various implementations characterize facial positions on a face in a first image and determine a respective facial position on the face to apply a precomputed graphical object at. One or more implementations modify the first image by applying the precomputed graphical object to the respective facial position in the first image. Some implementations modify one or more images that are captured after the first image by applying the precomputed graphical object to each respective location for the respective facial position in the one or more images. In turn, various implementations generate a video with images that are modified based on the precomputed graphical object.

Abstract: Embodiments discussed herein include: accessing by a user terminal a recording of a communication session in the form of a media file wherein the media file comprises at least an audio component; accessing by the user terminal, metadata associated with the media file, wherein the metadata comprises an indication of a respective one or more visual representations of each of a plurality of events determined to have occurred during the communication session, wherein at least some of the visual representations comprise text converted from at least one communication stream of the recorded communication session, and wherein the metadata further comprises timing information linking the respective visual representations to the events; playing the media file using a media playing application running on the user terminal; and controlling play back of the media file so that a play back rate of the audio component is synchronized with a rate of a user scrolling through the visual representations.

Abstract: A method comprising: displaying a UI for display of received video; detecting selection of a UI displayed button while a received video frame is displayed; in response, disabling the display of video frames received after the received video frame; determining a position of a face of a user in the received frame; receiving a plurality of drawing inputs while the button is selected, each drawing input defining image data to be applied at a position on said face; modifying the video frame in accordance with the drawing inputs by applying the image data to each of the positions; detecting a condition and in response, for each video frame received after the detection, determining a position of the face in the frame to determine the location of the positions in the frame, applying the image data to each of the positions, and displaying the modified video frame in the UI.

Abstract: A method for automatically selecting one or more portions of text data, said text data being converted from one or more communication streams of a communication session, the method comprising: accessing, by a user terminal, the communication session in the form of a media file; accessing by the user terminal, temporal metadata associated with the media file, wherein the metadata defines events determined to have occurred during the communication session; displaying, in a user interface of an application running on the user terminal, one or more portions of the text data, said events being represented by ones of said portions; respectively assigning each of the portions with a relevance value; and associating each unique relevance value with a respective zoom level of the user interface so that said displaying of the text data comprises the application selecting for display one or more of said portions of text at different zoom levels of the user interface based on the relevance value respectively assigned to

Abstract: Embodiments discussed herein include: accessing by a user terminal a recording of a communication session in the form of a media file wherein the media file comprises at least an audio component; accessing by the user terminal, metadata associated with the media file, wherein the metadata comprises an indication of a respective one or more visual representations of each of a plurality of events determined to have occurred during the communication session, wherein at least some of the visual representations comprise text converted from at least one communication stream of the recorded communication session, and wherein the metadata further comprises timing information linking the respective visual representations to the events; playing the media file using a media playing application running on the user terminal; and controlling play back of the media file so that a play back rate of the audio component is synchronised with a rate of a user scrolling through the visual representations.

Abstract: A method comprising: displaying a UI for display of received video; detecting selection of a UI displayed button whilst a received video frame is displayed; in response, disabling the display of video frames received after the received video frame; determining a position of a face of a user in the received frame; receiving a plurality of drawing inputs whilst the button is selected, each drawing input defining image data to be applied at a position on said face; modifying the video frame in accordance with the drawing inputs by applying the image data to each of the positions; detecting a condition and in response, for each video frame received after the detection, determining a position of the face in the frame to determine the location of the positions in the frame, applying the image data to each of the positions, and displaying the modified video frame in the UI.

Abstract: A method comprising: displaying a UI for display of received video; detecting selection of a UI displayed button while a received video frame is displayed; in response, disabling the display of video frames received after the received video frame; determining a position of a face of a user in the received frame; receiving a plurality of drawing inputs while the button is selected, each drawing input defining image data to be applied at a position on said face; modifying the video frame in accordance with the drawing inputs by applying the image data to each of the positions; detecting a condition and in response, for each video frame received after the detection, determining a position of the face in the frame to determine the location of the positions in the frame, applying the image data to each of the positions, and displaying the modified video frame in the UI.