Abstract: Methods and systems for improved quality of a streaming session using multiple simultaneous streams. For the multiple simultaneous streams an audio/video device (A/V device) records and generates a high-resolution stream and a low-resolution stream for simultaneous transmission to a server. The server selects one of the two streams for retransmission to a destination client device. The server also monitors the streaming session and estimates a total available bandwidth between the server and the A/V device and assigns a confidence value to the bandwidth estimation. The server periodically transmits the bandwidth estimate and confidence value to the A/V device to improve the efficiency of the streams being generated by the A/V device. The A/V device can use the received bandwidth estimate and confidence value to adapt the resolution of each of the streams to efficiently use the total available bandwidth between the A/V device and the server.

Abstract: In particular embodiments, a computing system may receive a color image captured by a color camera and a monochrome image captured by a monochrome camera. The color camera and the monochrome camera are associated with an artificial reality system. The computing system may compute, for each of the color and monochrome images, histogram statistics and perform, based on the histogram statistics, tone map matching to normalize the monochrome image with respect to the color image. The computing system may perform local motion estimation to calculate motion vectors indicating pixel correspondence between the normalized monochrome image and the color image. The computing system may generate a mono-color merged image for display on the artificial reality system by adding, for each pixel in the normalized monochrome image, color information extracted from corresponding pixel in the color image using the motion vectors.

Abstract: Methods and systems for improved quality of a streaming session using multiple simultaneous streams. For the multiple simultaneous streams an audio/video device (A/V device) records and generates a high-resolution stream and a low-resolution stream for simultaneous transmission to a server. The server selects one of the two streams for retransmission to a destination client device. The server also monitors the streaming session and estimates a total available bandwidth between the server and the A/V device and assigns a confidence value to the bandwidth estimation. The server periodically transmits the bandwidth estimate and confidence value to the A/V device to improve the efficiency of the streams being generated by the A/V device. The A/V device can use the received bandwidth estimate and confidence value to adapt the resolution of each of the streams to efficiently use the total available bandwidth between the A/V device and the server.

Abstract: An embodiment of a camera device may include an optical filter. The camera device may attempt to actuate the optical filter from an inactive position to an active position, record video, count a quantity of pixels, and/or a quantity of lines of pixels, in one or more frames of the video that are a color that is characteristic of the absence of the optical filter, determine that the quantity is greater than a threshold, and again attempt to move the optical filter to its active position.

Abstract: Described herein are techniques related to multi-pass quantization and bit-packing (PAK) parameters algorithm in video encoding.

Abstract: Approaches to enable a computing device, such as a phone or tablet computer, to utilize a number of cues to detect the presence of a face (or head) in an image captured by a camera of the computing device. The cues may include the elliptical shape of the face, the stereo disparity signature of the face, color or image brightness, among others. The facial detection may be performed by using a boosted classifier ensemble that has been trained using a plurality of images that are known (i.e., have been previously identified) to contain faces. The classifier ensemble can combine a number of different cues, such as the elliptical shape and/or stereo disparity signature, to be used for detecting faces within an image.

Abstract: Described herein are techniques related to multi-pass quantization and bit-packing (PAK) parameters algorithm in video encoding.

Abstract: Methods and systems to determine a quantization parameter (QP) that may then be used in a bit rate control process during video compression and decompression. The QP for a frame may be derived by determining an initial QP, adapting this value, and applying a final control calculation. The QP for a frame may be calculated from a variety of variables, that may include the frame type (intracoded (I), predictive (P), or bipredictive (B)), the fullness of a hypothetical reference decoder (HRD) buffer, the instant and target bit rates, a total encode size, a total target size, the number of P frames between I frames in a group of pictures (GOP), the number of B frames between I frames in the GOP, and the size of previous frames.

Abstract: Methods and systems to determine a quantization parameter (QP) that may then be used in a bit rate control process during video compression and decompression. The QP for a frame may be derived by determining an initial QP, adapting this value, and applying a final control calculation. The QP for a frame may be calculated from a variety of variables, that may include the frame type (intracoded (I), predictive (P), or bipredictive (B)), the fullness of a hypothetical reference decoder (HRD) buffer, the instant and target bit rates, a total encode size, a total target size, the number of P frames between I frames in a group of pictures (GOP), the number of B frames between I frames in the GOP, and the size of previous frames.

Abstract: Methods, apparatus, and systems are provided for order-adaptive compression. A sting is iterated to produce a compression sequence relative to an alphabet having symbols associated with the string. During the iteration, the order of the alphabet is altered in response to a given frequency condition.