Abstract: A device implementing the subject technology may include at least one processor configured to transmit an allocation request requesting allocation of a group communication session with a plurality of devices and receive an allocation response in response to the allocation request, the allocation response including credential information for the device to use to join the group communication session. The at least one processor may be further configured to transmit an allocation bind request with the credential information to join the group communication session using the credential information and receive an allocation bind success response in response to the allocation bind request, the allocation bind success response indicating that the device has joined the group communication session. The at least one processor may be further configured to provide a join notification to the plurality of devices via an intermediary device to notify that the device has joined the group communication session.

Abstract: Aspects of the subject technology provide for transcription of audio content during a conferencing session, such as an audio conferencing session or a video conferencing session. The transcription can be generated by the device at which the audio input is received, and transmitted to a remote device at which the transcription is displayed. Video content can also be provided from the device that generates the transcription to the remote device that displays in the transcription. The transcription can be provided with time information corresponding to time information in the video content, for synchronized display of the transcription and the corresponding video content.

Abstract: The subject technology receives, at a local device, a requested camera format based on specifications of a display associated with a remote device. The remote device and the local device are devices participating in a video conference. The requested camera format includes a first resolution. Camera formats supported by a camera associated with the local device are determined. If a second resolution of a first camera format matches among the supported camera formats matches with the first resolution, the first camera format is selected for capturing the video stream by the camera. Otherwise, a second camera format among the supported camera formats is determined for capturing the video stream so as to maximize a field of view of the video stream relative to other camera formats supported by the camera.

Abstract: The subject technology provides a video conferencing application in which a live incoming or outgoing video stream can be supplemented with supplemental content, such as stickers, animations, etc., from within the video conferencing application. In this manner, a user participating in a video conferencing session with a remote user can add stickers, animations, and/or adaptive content to an outgoing video stream being captured by the device of the user, or to an incoming video stream from the device of the remote user, without having to locally cache/store a video clip before editing, and without having to leave the video conferencing session (or the video conferencing application) to access a video editing application.

Abstract: Aspects of the subject technology provide for transcription of audio content during a conferencing session, such as an audio conferencing session or a video conferencing session. The transcription can be generated by the device at which the audio input is received, and transmitted to a remote device at which the transcription is displayed. Video content can also be provided from the device that generates the transcription to the remote device that displays in the transcription. The transcription can be provided with time information corresponding to time information in the video content, for synchronized display of the transcription and the corresponding video content.

Abstract: A device implementing a system for packet loss management may include a memory and at least one processor configured to identify a plurality of categories of packets provided for transmission to an electronic device. The at least one processor may be further configured to determine a respective packet loss value for a respective category of the plurality of categories of packets. The at least one processor may be further configured to identify a particular category of the plurality of categories of packets for which the determined respective packet loss value satisfies a packet loss condition. The at least one processor may be further configured to adjust subsequent transmission of packets in the particular category of packets based at least in part on the packet loss condition being satisfied by the determined respective packet loss value for the particular category of packets.

Abstract: Systems and processes for providing textual representations for a communication session are provided. For example, at least one audio input is received at an electronic device, wherein each audio input of the at least one audio input is associated with a respective priority level. A priority level of an audio input detected at a microphone of the electronic device is determined, wherein a highest priority level among the determined priority level and each received priority level corresponding to the at least one audio input is identified. A textual representation of a respective audio input corresponding to the identified highest priority level is obtained, wherein the obtained textual representation is displayed on a display of the electronic device.

Abstract: A method and apparatus of a device that manages a video stream is described. In an exemplary embodiment, the device receives a plurality of packets for a video stream from a transmitting device via a server. The device may additionally store a first packet of the plurality of packets in a first buffer when the first packet is on-time and store a second packet of the plurality of packets in a second buffer when the second packet is late. The device may also further forward a frame from the second buffer to the first buffer when frame is complete.

Abstract: A device implementing a system for multipath connection management may include first and second local communication interfaces, and a processor configured to establish a primary connection for communicating between the first local communication interface and a first remote communication interface of an other device, and a secondary connection for communicating between the second local communication interface and a second remote communication interface. The processor may be configured to transmit application and control data over the primary connection and concurrently transmit a copy of control data over the secondary connection. The processor may be configured to determine that a degradation of the quality of the primary connection is attributable to the other device. The processor may be configured to switch the secondary connection to the first local communication interface and the second remote communication interface.

Abstract: Devices, methods, and non-transitory program storage devices are disclosed to enable the automatic establishment of a secure audio/video data streaming connection between electronic devices. For example, a first electronic device may enter into a first state of a peer device advertising protocol, and then, based on a determination that the first electronic device meets a first set of device state criteria (e.g., including at least an orientation state criterion), the first electronic device may enter into a second (e.g., enhanced) state of the peer device advertising protocol. In response to detecting a presence of a second electronic device in its proximity, the first electronic device may connect to the second electronic device via a secure peer-to-peer connection protocol and then send one or more images captured by a first image capture device of the first electronic device to the connected second electronic device via the secure wireless peer-to-peer connection protocol.

Abstract: A method performed a local device that is communicatively coupled with several remote devices, the method includes: receiving, from each remote device with which the local device is engaged in a communication session, an input audio stream; receiving, for each remote device, a set parameters; determining, for each input audio stream, whether the input audio stream is to be 1) rendered individually or 2) rendered as a mix of input audio streams based on the set of parameters; for each input audio stream that is determined to be rendered individually, spatial rendering the input audio stream as an individual virtual sound source that contains only that input audio stream; and for input audio streams that are determined to be rendered as the mix of input audio streams, spatial rendering the mix of input audio streams as a single virtual sound source that contains the mix of input audio streams.

Abstract: A device implementing a system for packet loss management may include a memory and at least one processor configured to identify a plurality of categories of packets provided for transmission to an electronic device. The at least one processor may be further configured to determine a respective packet loss value for a respective category of the plurality of categories of packets. The at least one processor may be further configured to identify a particular category of the plurality of categories of packets for which the determined respective packet loss value satisfies a packet loss condition. The at least one processor may be further configured to adjust subsequent transmission of packets in the particular category of packets based at least in part on the packet loss condition being satisfied by the determined respective packet loss value for the particular category of packets.

Abstract: Aspects of the subject technology include transmitting, by a first device, an advertisement message corresponding to a communications session the first device is participating in with at least a second device. The first device may receive, during the communications session, a communications session control message generated by a third device. The communications session control message may include information contained in the advertisement message. The first device may validate the third device based on the communications session control message and remove the first device from the communications session in response to successfully validating the third device.

Abstract: A device implementing dynamic redundancy may include at least one processor configured to receive, from another device, packet reception data corresponding to video data previously provided for transmission from the device to the other device and determine, based at least in part on the packet reception data, an amount of redundancy to apply to video data provided for transmission to the other device. The at least one processor may be further configured to determine, based at least in part on the amount of redundancy, an encoding scheme for applying the redundancy to the video data. The at least one processor may be further configured to apply the amount of redundancy to the video data based at least in part on the encoding scheme to generate redundant data items and provide the video data and the redundant data items for transmission to the other device.

Abstract: A device implementing a system for multipath connection management may include first and second local communication interfaces, and a processor configured to establish a primary connection for communicating between the first local communication interface and a first remote communication interface of an other device, and a secondary connection for communicating between the second local communication interface and a second remote communication interface. The processor may be configured to transmit application and control data over the primary connection and concurrently transmit a copy of control data over the secondary connection. The processor may be configured to determine that a degradation of the quality of the primary connection is attributable to the other device. The processor may be configured to switch the secondary connection to the first local communication interface and the second remote communication interface.

Abstract: The embodiments described herein can dynamically adjust timing of network bandwidth estimations by adjusting a target frequency for sending probing sequences to one or more receivers of content. The receivers receive these probing sequences from a transmitter and respond to the transmitter with network bandwidth estimations. In one embodiment, the probing sequences can use the content itself to create the probing sequences. The embodiments can be used in video conferencing applications to control how a transmitter of content can adjust transmissions based upon the network bandwidth estimations. In one embodiment, a policy can be used at a transmitter to begin a video transmission with a high frequency target for sending probing sequences (with, e.g., smaller length probing sequences) and transition to a lower frequency target (with, e.g., longer length probing sequences) when network bandwidth deteriorates and then return to the higher frequency target when the network bandwidth improves.

Abstract: The subject technology provides a messaging application in which an image can be captured and supplemented with supplemental content such as stickers, animations, etc., from within an active messaging thread. In this manner, a user participating in a messaging conversation with a remote user can add stickers, animations, and/or adaptive content to an image captured by the user, without having to locally cache/store the captured image before editing and without having to leave the messaging conversion (or the messaging application) to access an image editing application.

Abstract: In an example method, a system receives a plurality of frames of a video, and generates a data structure representing the video and representing a plurality of temporal layers. Generating the data structure includes: (i) determining a plurality of quality levels for presenting the video, where each of the quality levels corresponds to a different respective sampling period for sampling the frames of the video, (ii) assigning, based on the sampling periods, each of the frames to a respective one of the temporal layers of the data structure, and (iii) indicating, in the data structure, one or more relationships between (a) at least one the frames assigned to at least one of the temporal layers of the data structure, and (b) at least another one of the frames assigned to at least another one of the temporal layers of the data structure. Further, the system outputs the data structure.

Abstract: The embodiments described herein can dynamically adjust timing of network bandwidth estimations by adjusting a target frequency for sending probing sequences to one or more receivers of content. The receivers receive these probing sequences from a transmitter and respond to the transmitter with network bandwidth estimations. In one embodiment, the probing sequences can use the content itself to create the probing sequences. The embodiments can be used in video conferencing applications to control how a transmitter of content can adjust transmissions based upon the network bandwidth estimations. In one embodiment, a policy can be used at a transmitter to begin a video transmission with a high frequency target for sending probing sequences (with, e.g., smaller length probing sequences) and transition to a lower frequency target (with, e.g., longer length probing sequences) when network bandwidth deteriorates and then return to the higher frequency target when the network bandwidth improves.

Abstract: A device implementing cellular communication protocol aware multimedia streaming may include at least one processor configured to establish a link for communicating with another device, wherein the link utilizes at least one of a first cellular communication protocol or a second cellular communication protocol. The at least one processor may be configured to determine a bit rate for a video stream to be provided to the other device based at least in part on whether the link utilizes the first cellular communication protocol or the second cellular communication protocol, wherein a first bit rate is determined when the link utilizes the first cellular communication protocol and a second bit rate is determined when the link utilizes the second cellular communication protocol. The at least one processor may be configured to provide, for transmission over the link to the other electronic device, the video stream at the determined bit rate.