Abstract: A device implementing the subject technology may include at least one processor configured to transmit an allocation request requesting allocation of a group communication session with a plurality of devices and receive an allocation response in response to the allocation request, the allocation response including credential information for the device to use to join the group communication session. The at least one processor may be further configured to transmit an allocation bind request with the credential information to join the group communication session using the credential information and receive an allocation bind success response in response to the allocation bind request, the allocation bind success response indicating that the device has joined the group communication session. The at least one processor may be further configured to provide a join notification to the plurality of devices via an intermediary device to notify that the device has joined the group communication session.

Abstract: The subject technology receives, at a local device, a requested camera format based on specifications of a display associated with a remote device. The remote device and the local device are devices participating in a video conference. The requested camera format includes a first resolution. Camera formats supported by a camera associated with the local device are determined. If a second resolution of a first camera format matches among the supported camera formats matches with the first resolution, the first camera format is selected for capturing the video stream by the camera. Otherwise, a second camera format among the supported camera formats is determined for capturing the video stream so as to maximize a field of view of the video stream relative to other camera formats supported by the camera.

Abstract: A device implementing a system for packet loss management may include a memory and at least one processor configured to identify a plurality of categories of packets provided for transmission to an electronic device. The at least one processor may be further configured to determine a respective packet loss value for a respective category of the plurality of categories of packets. The at least one processor may be further configured to identify a particular category of the plurality of categories of packets for which the determined respective packet loss value satisfies a packet loss condition. The at least one processor may be further configured to adjust subsequent transmission of packets in the particular category of packets based at least in part on the packet loss condition being satisfied by the determined respective packet loss value for the particular category of packets.

Abstract: Systems and processes for providing textual representations for a communication session are provided. For example, at least one audio input is received at an electronic device, wherein each audio input of the at least one audio input is associated with a respective priority level. A priority level of an audio input detected at a microphone of the electronic device is determined, wherein a highest priority level among the determined priority level and each received priority level corresponding to the at least one audio input is identified. A textual representation of a respective audio input corresponding to the identified highest priority level is obtained, wherein the obtained textual representation is displayed on a display of the electronic device.

Abstract: A method and apparatus of a device that manages a video stream is described. In an exemplary embodiment, the device receives a plurality of packets for a video stream from a transmitting device via a server. The device may additionally store a first packet of the plurality of packets in a first buffer when the first packet is on-time and store a second packet of the plurality of packets in a second buffer when the second packet is late. The device may also further forward a frame from the second buffer to the first buffer when frame is complete.

Abstract: A device implementing a system for multipath connection management may include first and second local communication interfaces, and a processor configured to establish a primary connection for communicating between the first local communication interface and a first remote communication interface of an other device, and a secondary connection for communicating between the second local communication interface and a second remote communication interface. The processor may be configured to transmit application and control data over the primary connection and concurrently transmit a copy of control data over the secondary connection. The processor may be configured to determine that a degradation of the quality of the primary connection is attributable to the other device. The processor may be configured to switch the secondary connection to the first local communication interface and the second remote communication interface.

Abstract: Devices, methods, and non-transitory program storage devices are disclosed to enable the automatic establishment of a secure audio/video data streaming connection between electronic devices. For example, a first electronic device may enter into a first state of a peer device advertising protocol, and then, based on a determination that the first electronic device meets a first set of device state criteria (e.g., including at least an orientation state criterion), the first electronic device may enter into a second (e.g., enhanced) state of the peer device advertising protocol. In response to detecting a presence of a second electronic device in its proximity, the first electronic device may connect to the second electronic device via a secure peer-to-peer connection protocol and then send one or more images captured by a first image capture device of the first electronic device to the connected second electronic device via the secure wireless peer-to-peer connection protocol.

Abstract: A method performed a local device that is communicatively coupled with several remote devices, the method includes: receiving, from each remote device with which the local device is engaged in a communication session, an input audio stream; receiving, for each remote device, a set parameters; determining, for each input audio stream, whether the input audio stream is to be 1) rendered individually or 2) rendered as a mix of input audio streams based on the set of parameters; for each input audio stream that is determined to be rendered individually, spatial rendering the input audio stream as an individual virtual sound source that contains only that input audio stream; and for input audio streams that are determined to be rendered as the mix of input audio streams, spatial rendering the mix of input audio streams as a single virtual sound source that contains the mix of input audio streams.

Abstract: A device implementing a system for packet loss management may include a memory and at least one processor configured to identify a plurality of categories of packets provided for transmission to an electronic device. The at least one processor may be further configured to determine a respective packet loss value for a respective category of the plurality of categories of packets. The at least one processor may be further configured to identify a particular category of the plurality of categories of packets for which the determined respective packet loss value satisfies a packet loss condition. The at least one processor may be further configured to adjust subsequent transmission of packets in the particular category of packets based at least in part on the packet loss condition being satisfied by the determined respective packet loss value for the particular category of packets.

Abstract: Aspects of the subject technology include transmitting, by a first device, an advertisement message corresponding to a communications session the first device is participating in with at least a second device. The first device may receive, during the communications session, a communications session control message generated by a third device. The communications session control message may include information contained in the advertisement message. The first device may validate the third device based on the communications session control message and remove the first device from the communications session in response to successfully validating the third device.

Abstract: A device implementing dynamic redundancy may include at least one processor configured to receive, from another device, packet reception data corresponding to video data previously provided for transmission from the device to the other device and determine, based at least in part on the packet reception data, an amount of redundancy to apply to video data provided for transmission to the other device. The at least one processor may be further configured to determine, based at least in part on the amount of redundancy, an encoding scheme for applying the redundancy to the video data. The at least one processor may be further configured to apply the amount of redundancy to the video data based at least in part on the encoding scheme to generate redundant data items and provide the video data and the redundant data items for transmission to the other device.

Abstract: A device implementing a system for multipath connection management may include first and second local communication interfaces, and a processor configured to establish a primary connection for communicating between the first local communication interface and a first remote communication interface of an other device, and a secondary connection for communicating between the second local communication interface and a second remote communication interface. The processor may be configured to transmit application and control data over the primary connection and concurrently transmit a copy of control data over the secondary connection. The processor may be configured to determine that a degradation of the quality of the primary connection is attributable to the other device. The processor may be configured to switch the secondary connection to the first local communication interface and the second remote communication interface.

Abstract: In an example method, a system receives a plurality of frames of a video, and generates a data structure representing the video and representing a plurality of temporal layers. Generating the data structure includes: (i) determining a plurality of quality levels for presenting the video, where each of the quality levels corresponds to a different respective sampling period for sampling the frames of the video, (ii) assigning, based on the sampling periods, each of the frames to a respective one of the temporal layers of the data structure, and (iii) indicating, in the data structure, one or more relationships between (a) at least one the frames assigned to at least one of the temporal layers of the data structure, and (b) at least another one of the frames assigned to at least another one of the temporal layers of the data structure. Further, the system outputs the data structure.

Abstract: A device implementing cellular communication protocol aware multimedia streaming may include at least one processor configured to establish a link for communicating with another device, wherein the link utilizes at least one of a first cellular communication protocol or a second cellular communication protocol. The at least one processor may be configured to determine a bit rate for a video stream to be provided to the other device based at least in part on whether the link utilizes the first cellular communication protocol or the second cellular communication protocol, wherein a first bit rate is determined when the link utilizes the first cellular communication protocol and a second bit rate is determined when the link utilizes the second cellular communication protocol. The at least one processor may be configured to provide, for transmission over the link to the other electronic device, the video stream at the determined bit rate.

Abstract: The subject technology receives, at a local device, a requested camera format based on specifications of a display associated with a remote device. The remote device and the local device are devices participating in a video conference. The requested camera format includes a first resolution. Camera formats supported by a camera associated with the local device are determined. If a second resolution of a first camera format matches among the supported camera formats matches with the first resolution, the first camera format is selected for capturing the video stream by the camera. Otherwise, a second camera format among the supported camera formats is determined for capturing the video stream so as to maximize a field of view of the video stream relative to other camera formats supported by the camera.

Abstract: In an example method, a system receives a plurality of frames of a video, and generates a data structure representing the video and representing a plurality of temporal layers. Generating the data structure includes: (i) determining a plurality of quality levels for presenting the video, where each of the quality levels corresponds to a different respective sampling period for sampling the frames of the video, (ii) assigning, based on the sampling periods, each of the frames to a respective one of the temporal layers of the data structure, and (iii) indicating, in the data structure, one or more relationships between (a) at least one the frames assigned to at least one of the temporal layers of the data structure, and (b) at least another one of the frames assigned to at least another one of the temporal layers of the data structure. Further, the system outputs the data structure.

Abstract: Techniques are disclosed for coding video data in which frames from a video source are partitioned into a plurality of tiles of common size, and the tiles are coded as a virtual video sequence according to motion-compensated prediction, each tile treated as having respective temporal location of the virtual video sequence. The coding scheme permits relative allocation of coding resources to tiles that are likely to have greater significance in a video coding session, which may lead to certain tiles that have low complexity or low motion content to be skipped during coding of the tiles for select source frames. Moreover, coding of the tiles may be ordered to achieve low coding latencies during a coding session.

Abstract: A device implementing dynamic redundancy may include at least one processor configured to receive, from another device, packet reception data corresponding to video data previously provided for transmission from the device to the other device and determine, based at least in part on the packet reception data, an amount of redundancy to apply to video data provided for transmission to the other device. The at least one processor may be further configured to determine, based at least in part on the amount of redundancy, an encoding scheme for applying the redundancy to the video data. The at least one processor may be further configured to apply the amount of redundancy to the video data based at least in part on the encoding scheme to generate redundant data items and provide the video data and the redundant data items for transmission to the other device.

Abstract: A method and apparatus of a device that manages a video telephony call is described. In an exemplary embodiment, the device receives a network event from a network service of a device. The device further determines that the network event that is due to a local disruption of a network component of the device. In addition, and in response to the determination, the device restricts a local dynamic control of the video telephony call.

Abstract: A method performed a local device that is communicatively coupled with several remote devices, the method includes: receiving, from each remote device with which the local device is engaged in a communication session, an input audio stream; receiving, for each remote device, a set parameters; determining, for each input audio stream, whether the input audio stream is to be 1) rendered individually or 2) rendered as a mix of input audio streams based on the set of parameters; for each input audio stream that is determined to be rendered individually, spatial rendering the input audio stream as an individual virtual sound source that contains only that input audio stream; and for input audio streams that are determined to be rendered as the mix of input audio streams, spatial rendering the mix of input audio streams as a single virtual sound source that contains the mix of input audio streams.