Abstract: This disclosure describes, in part, an audio/video (A/V) device that includes a first camera for generating first image data and one or more second cameras for both motion detection and generating second image data. For instance, the A/V device may generate and then store the second image data in one or more buffers. The A/V device may then detect an event, such as possible motion of an object. Based on detecting the event, A/V device may cause the one or more second cameras to cease generating the second image data and cause the first camera to begin generating the first image data. The A/V device may then process the second image data and send the processed second image data to a computing system. Next, the A/V device may process the first image data and send the processed first image data to the computing system.

Abstract: Techniques are generally described for network pattern matching. In various examples, first data may be sent over a network at a first bit rate to a second device. A plurality of network congestion profiles of the network may be stored in a memory. Network conditions of the network may be determined over a first period of time. A correlation between the network conditions and a first network congestion profile of the plurality of network congestion profiles may be determined. A second bit rate may be determined based on the first network congestion profile. Second data may be sent over the network to the second device at the second bit rate.

Abstract: This disclosure describes, in part, techniques for selecting encoding parameters for an electronic device. For instance, remote system(s) may receive, from the electronic device, video data representing a video. The remote system(s) may then analyze the video data to identify portions of the video that represented different areas located within the field of view (FOV) of the electronic device. The areas may include static areas, which do not include recurring motion, and/or dynamic areas, which include recurring motion. Additionally, the remote system(s) may analyze the video data to select encoding parameters for encoding the video data and/or for encoding the portions of the video data that represent the identified areas. The electronic device may then receive the encoding parameters from the remote system(s) and use the encoding parameters to encode additional video data that is generated by the electronic device.

Abstract: Techniques are generally described for compression encoding of images. In various examples, the techniques may comprise receiving image data. In some examples, the techniques may further comprise generating a first compressed representation of luminance values of the image data by encoding luminance values of the image data with reference to a luminance palette. In some examples, the techniques may further include generating a second compressed representation of chrominance values of the image data by applying a frequency domain based image transform to the chrominance values of the image data. In various further examples, the techniques may further comprise combining the first compressed representation and the second compressed representation to generate compressed image data.

Abstract: This disclosure describes, in part, an audio/video (A/V) device that includes a first camera for generating first image data and one or more second cameras for both motion detection and generating second image data. For instance, the A/V device may generate and then store the second image data in one or more buffers. The A/V device may then detect an event, such as possible motion of an object. Based on detecting the event, A/V device may cause the one or more second cameras to cease generating the second image data and cause the first camera to begin generating the first image data. The A/V device may then process the second image data and send the processed second image data to a computing system. Next, the A/V device may process the first image data and send the processed first image data to the computing system.

Abstract: Methods to switch between renditions of a video stream are generally described. In some examples, the methods may include encoding a video stream at a first image quality in a first rendition and a second, lower image quality in a second rendition. The methods may further include sending the first rendition to a recipient computing device. The methods may include receiving a request to switch from the first rendition to the second rendition. The methods may include determining that first indicator data of a first inter-coded frame indicates that the video stream can be switched to a lower image quality rendition at the first inter-coded frame. In some examples, the methods may further include sending the second rendition to the recipient computing device.

Abstract: Methods of video streaming are generally described. In some examples, the methods may be performed by a server device and may include generating first intra-coded frame (I-frame) data and a plurality of enhancement layer data corresponding to the first I-frame data. The methods may further include sending the first I-frame data to a client device. The methods may further include transmitting first enhancement layer data to the client device. The methods may include sending first inter-coded frame data to the client device. In some examples, the first inter-coded frame data can be decoded by referencing first reference frame data generated by combining the first I-frame data and the first enhancement layer data.

Abstract: Techniques are generally described for catch-up pacing for video streaming. In various examples, a camera may capture first video data representing a physical environment. In some examples, motion in the physical environment may be detected from the first video data. A communication channel may be established with a remote computing device. In some examples, the camera may capture second video data. In various examples, the second video data may be captured during a period of time corresponding to the establishment of the communication channel. An available bandwidth of the communication channel may be determined. The available bandwidth may comprise a first bitrate. Third video data may be captured by the camera. The third video data may be encoded at a second bitrate lower than the first bitrate. The first video data, second video data and third video data may be sent to the remote computing device.

Abstract: Techniques are generally described for compression encoding and decoding of video frames. In various examples, the techniques may include generating first reference frame data, first enhancement layer data corresponding to the first reference frame data, and second enhancement layer data corresponding to the first reference frame data. In various examples, the techniques may further include sending the first reference frame data, the first enhancement layer data, and the second enhancement layer data to at least one recipient computing device. The techniques may further include determining that the recipient computing device did not receive first unreceived data. In some examples, the first unreceived data may comprise at least one of the first reference frame data, the first enhancement layer data, and the second enhancement layer data. In other examples, the techniques may include resending the first unreceived data to the recipient computing device.

Abstract: Techniques are generally described for enhanced compression of video data. In various examples, the techniques may include receiving first video data representing a scene in an environment. The techniques may further include generating illumination map data representing illumination of the scene in the first video data. The techniques may further comprise generating reflectance map data representing a reflectance of at least one object in the first video data. In some examples, the techniques may include sending, to a second computing device, the illumination map data and the reflectance map data. The techniques may further include receiving second video data representing the scene. The techniques may include determining a first illumination difference between the second video data and the first video data. The techniques may comprise sending, to the second computing device, the first illumination difference.

Abstract: Techniques are described for detecting timing data anomalies in streaming video. Techniques are also described for adjusting playback operations based on detecting possible timing data anomalies.

Abstract: Devices and techniques are generally described for multi-band projection of image data. In various examples, image data may be identified. In some examples, first image data of a first frequency may be generated from the image data. In some examples, second image data of a second frequency may be generated from the image data. In various examples, the first frequency may be higher than the second frequency. In some examples, a first image may be projected onto a projection surface using a raster projector. In an example, the first image may correspond to the first image data. In further examples, a second image may be projected onto the projection surface overlaying the first image. In various other examples, projecting the second image onto the projection surface may be performed using a lamp-based projector. In some examples, the second image may correspond to the second image data.

Abstract: Various examples are directed to methods and systems for compressing panoramic video. An image processor may receive a frame comprising a plurality of pixel values arranged according to a two-dimensional grid and divide the frame into a plurality of pixel blocks comprising a first pixel block and a second pixel block. The first pixel block may be positioned in a first edge column adjacent a first edge of the frame and the second pixel block may be positioned in a second edge column adjacent a second edge of the frame opposite the first edge. The image processor may identify a spatial continuity between the first pixel block and the second pixel block and replace the first pixel block with a reference to the second pixel block.

Abstract: Devices and techniques are generally described for estimation of ambient light levels. In various examples, an image sensor may capture a frame of image data. In some examples, an ambient light value of the frame may be determined. In some examples, a first region of the frame corresponding to a first physical characteristic and a second region of the frame corresponding to a second physical characteristic may be determined. In various examples, a first reflection coefficient associated with the first physical characteristic and a second reflection coefficient associated with the second physical characteristic may be determined. In some examples, an IR correction value may be determined for the frame of image data based at least in part on the first reflection coefficient and the second reflection coefficient. An estimated ambient light value may be determined based at least in part on the IR correction value and the ambient light value.

Abstract: Devices, systems and methods are disclosed that detect and interpret the meaning of visual and/or audio indicators of devices, and provide information, solutions to potential malfunctions, and/or automatic ordering of consumable products to users. For example, sequences of visual indicators (such as LEDs) and/or audio indicators (such as speakers that output beeps) generated by home electronics and other devices may be monitored using an image capture component (such as a camera) or audio capture component (such as a microphone), and the sequences may be interpreted to provide users with information of what is wrong with a device, how to fix a device, purchase a new device, offer repair services, etc. The systems and methods may also provide users with notifications relating to such indicators when the user is away from home.

Abstract: Systems and techniques are generally described for audio signal processing for motion detection. In some examples, a first energy level of a first audio signal detected by a first microphone is determined over a first period of time. In some further examples, a first change in the first energy level from a first energy level value to a second energy level value is determined during the first period of time. In some other examples, a determination is made that the first change in the first energy level exceeds a threshold change value associated with the first period of time. In at least some other examples, a bias of an audio amplifier of the first device is adjusted.

Abstract: An electronic device can have two or more pairs of cameras capable of performing three-dimensional imaging. In order to provide accurate disparity information, these cameras should be sufficiently rectified. Automatic rectification can be performed by periodically capturing images with a pair of front-facing cameras, and locating matching facial or other feature points in corresponding images captured by those cameras. Small misalignment errors can be treated as linear translations, such that a set of linear equations can be used to solve for the misalignments. Another process can process a set of homographies for the cameras until a cost function converges. Various other approaches can be used as well, such as to directly solve for yaw, pitch, and roll errors. Once this information is obtained, the misalignment values (or related values) can be stored for use in correcting images subsequently captured by those cameras.

Abstract: Methods to switch between renditions of a video stream are generally described. In some examples, the methods may include encoding a video stream at a first image quality in a first rendition and a second, lower image quality in a second rendition. The methods may further include sending the first rendition to a recipient computing device. The methods may include receiving a request to switch from the first rendition to the second rendition. The methods may include determining that first indicator data of a first inter-coded frame indicates that the video stream can be switched to a lower image quality rendition at the first inter-coded frame. In some examples, the methods may further include sending the second rendition to the recipient computing device.

Abstract: A video capture device may include multiple cameras that simultaneously capture video data. The video capture device may include one or more motion sensors that track the motion of the video capture device during video capture. Using the motion data, motion vectors can be calculated and used by an encoder to compress and encode a stream of video data. The motion vectors calculated for one stream of video data can then be used to compress and encode a second stream of video data due to the symmetry of a first camera that captured the first video stream and a second camera that captured the second video stream. The video capture device and/or remote computing resources may stitch together the first and second video streams to generate a panoramic video.

Abstract: Devices, systems and methods are disclosed for generating stitched video data by combining video data from multiple image capture devices. For example, video data from a first image capture device and a second image capture device located near the first image capture device may be combined to generate unique panoramas. The system may determine transitions between the video data based on a focus distance to improve the stitched video data. The system may remove individual objects from first video data by substituting corresponding portions of second image data. The system may determine depth information associated with a first object represented in the video data and may add additional objects in front of or behind the first object, properly scaling and masking the additional object. The system may generate a virtual environment by weighting images from individual image capture devices and the virtual environment may be three dimensional.