Abstract: In one embodiment, a computing system may receive sensor data from an image sensor having a pixel array including color pixel sensors and panchromatic pixel sensors in a first pattern. Each of the color pixel sensors is associated with one of several color channels. The computing system may generate, based on the sensor data, a filtered monochrome image including monochrome values corresponding to the pixel array of the image sensor. The computing system may generate a filtered color image having a second pattern of color channels. A first pixel of a particular color channel at a first pixel location in the filtered color image is determined based on the monochrome value corresponding to the first pixel location in the filtered monochrome image, the sensor data measured by a color pixel sensor at a second pixel location, and the monochrome value at the second pixel location in the filtered monochrome image.

Abstract: A hardware accelerator includes a local buffer configured to receive and store stream data of a sparse color image that includes pixel data of panchromatic pixels and pixel data of color pixels, a first circuit configured to generate pixel data of a monochromatic image using the stream data received and stored in the local buffer while the local buffer continues to receive and store the stream data of the sparse color image, and a second circuit configured to generate pixel data of a Bayer color image using the stream data of the sparse color image received and stored in the local buffer and the pixel data of the monochromatic image while the local buffer continues to receive and store the stream data of the sparse color image.

Abstract: A sensor includes a first image pixel array including first image pixels and a second image pixel array including second image pixels. A polarization layer is disposed between the first image pixels and the second image pixels. Scene light incident upon the second image pixels propagates through the first image pixels and the polarization layer to reach the second image pixels.

Abstract: A sensor includes a first image pixel array including first image pixels and a second image pixel array including second image pixels. A polarization layer is disposed between the first image pixels and the second image pixels. Scene light incident upon the second image pixels propagates through the first image pixels and the polarization layer to reach the second image pixels.

Abstract: An imaging device captures images of a head-mounted display (HMD), or other object, including locators providing a pattern of light. The imaging device compresses captured images of the locators of the HMD by identifying pixels of a captured image having at least a threshold brightness and additional pixels within a threshold distance of the identified pixels. To generate a compressed image, the camera performs run-length encoding of pixels other than the identified pixels and additional pixels. The compressed image is provided by the imaging device to a console or other computing device. In some embodiments, the imaging device also determines whether a segment of adjacent pixels in a captured image is above the threshold brightness and sets the segment of adjacent pixels to a specific value and performs run-length encoding on the segment of adjacent pixels above the threshold brightness.

Abstract: A system for transmitting camera data may include (i) identifying at least two streams of video data that are each produced by a different video source, (ii) receiving a set of at least two frames of video data that includes exactly one frame from each of the at least two streams of video data, (iii) placing, within an image, the set of at least two frames of video data received from the at least two streams of video data, and (iv) transmitting the image that includes the set of at least two frames of video data received from the at least two streams of video data via a single transmission channel. Various other apparatuses, systems, and methods, are also disclosed.

Abstract: A method for rescaling data to be displayed on a display device (e.g., an organic light emitting diode display device) is disclosed. The method includes receiving a frame of data for displaying on the display device, where the received data includes a first portion of the data corresponding to a first pixel region at a first pixel resolution and a second portion of the data corresponding to a second pixel region at a second pixel resolution lower than the first pixel resolution. The method also includes rescaling the received data for displaying the received data at a native pixel resolution of the display device, where the rescaling of the received data includes scaling the first portion of the data using a first scaling factor and the second portion of the data using a second scaling factor. The method further includes providing the rescaled data for displaying on the display device.