Abstract: Encoding using locally mixed colors is disclosed. A method for encoding an image block using palletization includes selecting a fixed palette for the image block, the fixed palette including fixed palette entries; selecting a mixed palette for the image block, the mixed palette including mixed palette entries, each mixed palette entry corresponding, respectively, to a pixel neighborhood, a mixing of the pixel neighborhood, and a manipulation of the mixing of the pixel neighborhood; determining a pixel map, the pixel map comprising, for a pixel of at least some pixels of the image block, a respective mapping to one of a fixed palette entry or a mixed palette entry; and encoding, in an encoded bitstream, the pixel map.

Abstract: Systems and methods are disclosed for coding images. For example, methods may include: receiving an encoded bitstream that was generated at least in part by applying a sharpening filter to an input image to obtain a sharpened image and applying a blockwise encoder to the sharpened image; decoding, using a blockwise decoder, data from an encoded bitstream to obtain a plurality of blocks of image data; combining the plurality of blocks of image data to form a blocked image; and applying a blurring filter, which is matched to the sharpening filter, to the blocked image to obtain an output image.

Abstract: This technology relates to encoding data. For example, a sequence of one or more structured records as input data, at least one of the structured records including one or more field tags and associated field data. The input data may be parsed into data buffers, each data buffer corresponding to a field tag in the one or more field tags, wherein each data buffer includes the associated field data of the corresponding field tag. A control sequence specifying a sequence of the one or more fields tags may be encoded into a transition record. A state machine comprising nodes and transitions may be generated, with each node corresponding to occurrences of the one or more field tags and each transition corresponding to successive pairs of the one or more field tags. The data buffers, a representation of the state machine, and the encoded control sequence may be output.

Abstract: A spatially adaptive quantization-aware deblocking filter is used for encoding or decoding video or image frames. The deblocking filter receives a reconstructed frame produced based on dequantized and inverse transformed coefficients of a video frame or an image frame. The reconstructed frame is filtered according to adaptive quantization field data for the video or image frame. The adaptive quantization field data represents weights applied to quantization values used at different areas of the video or image frame. A number of blocking artifacts remaining within the resulting filtered frame is determined. The adaptive quantization field data is then adjusted based on that number of blocking artifacts. The filtered frame is then filtered according to the adjusted adaptive quantization field data. The resulting re-filtered frame is then output to an output source, such as for transmission, display, storage, or further processing.

Abstract: An image encoder includes a processor and a memory. The memory includes instructions configured to cause the processor to perform operations. In one example implementation, the operations may include determining whether a dictionary item is available for replacing a block of an image being encoded, the determining based on a hierarchical lookup mechanism, and encoding the image along with reference information of the dictionary item in response to determining that the dictionary item is available. In one more example implementation, the operations may include performing principal component analysis (PCA) on a block to generate a corresponding projected block, the block being associated with a group of images, comparing the projected block with a corresponding threshold, descending the block recursively based on the threshold until a condition is satisfied, and identifying a left over block as a cluster upon satisfying of the condition.

Abstract: Morphological anti-ringing is disclosed. A method for encoding a block of an image includes generating a transform block for the block of first values, generating quantized transform coefficients for the transform block, determining a clamping value for the block, encoding the quantized transform coefficients in a compressed bitstream, and encoding the clamping value in the compressed bitstream. The clamping value is used to clamp second values. The second values correspond to the first values and result from inverse transforming the transform block. An apparatus for decoding a block of an image includes a memory and a processor configured to execute instructions stored in the memory to decode, from a compressed bitstream, a quantized transform block; obtain, using the quantized transform block, a decoded block of pixel values; decode, from a compressed bitstream, a clamping value for the block; and clamp the pixel values using the clamping value.

Abstract: A spatially adaptive quantization-aware deblocking filter is used for encoding or decoding video or image frames. The deblocking filter receives a reconstructed frame produced based on dequantized and inverse transformed coefficients of a video frame or an image frame. The reconstructed frame is filtered according to adaptive quantization field data for the video or image frame. The adaptive quantization field data represents weights applied to quantization values used at different areas of the video or image frame. A number of blocking artifacts remaining within the resulting filtered frame is determined. The adaptive quantization field data is then adjusted based on that number of blocking artifacts. The filtered frame is then filtered according to the adjusted adaptive quantization field data. The resulting re-filtered frame is then output to an output source, such as for transmission, display, storage, or further processing.

Abstract: A method includes obtaining, at one or more computing devices, an input image, applying an image sharpening process to at least one of one or more chroma components of the input image, subsampling the one or more chroma components of the input image to reduce a spatial resolution of the one or more chroma components of the input image, encoding the input image subsequent to applying the image sharpening process and subsampling, and performing at least one of storing or transmitting the input image subsequent to encoding.

Abstract: Methods, systems, apparatus, including computer-readable media storing executable instructions, for color filter arrays for image sensors. In some implementations, an imaging device includes a color filter array arranged to filter incident light. The color filter array has a repeating pattern of color filter elements. The color filter elements include yellow filter elements, green filter elements, and blue filter elements. The imaging device includes an image sensor having photosensitive regions corresponding to the color filter elements. The photosensitive regions are configured to respectively generate electrical signals indicative of intensity of the color-filtered light at the photosensitive regions. The imaging device includes one or more processors configured to generate color image data based on the electrical signals from the photosensitive regions.

Abstract: The present disclosure provides systems and methods for modification (e.g., pruning, compression, quantization, etc.) of artificial neural networks based on estimations of the utility of network connections (also known as “edges”). In particular, the present disclosure provides novel techniques for estimating the utility of one or more edges of a neural network in a fashion that requires far less expenditure of resources than calculation of the actual utility. Based on these estimated edge utilities, a computing system can make intelligent decisions regarding network pruning, network quantization, or other modifications to a neural network. In particular, these modifications can reduce resource requirements associated with the neural network. By making these decisions with knowledge of and based on the utility of various edges, this reduction in resource requirements can be achieved with only a minimal, if any, degradation of network performance (e.g., prediction accuracy).

Abstract: Methods, systems, apparatus, including computer-readable media storing executable instructions, for color filter arrays for image sensors. In some implementations, an imaging device includes a color filter array arranged to filter incident light. The color filter array has a repeating pattern of color filter elements. The color filter elements include yellow filter elements, green filter elements, and blue filter elements. The imaging device includes an image sensor having photosensitive regions corresponding to the color filter elements. The photosensitive regions are configured to respectively generate electrical signals indicative of intensity of the color-filtered light at the photosensitive regions. The imaging device includes one or more processors configured to generate color image data based on the electrical signals from the photosensitive regions.

Abstract: Video decoding may include transform coefficient continuity smoothing, which may include coefficient continuity smoothing, defined correlation coefficient smoothing, pixel range projection, and luminance correlated chrominance resampling. Coefficient continuity smoothing may include obtaining encoded block data from the encoded bitstream, the encoded block data corresponding to a current block from the reconstructed frame, and generating reconstructed block data for the current block based on the encoded block data using transform coefficient continuity smoothing.

Abstract: Systems and methods are disclosed for coding images. For example, methods may include: receiving an encoded bitstream that was generated at least in part by applying a sharpening filter to an input image to obtain a sharpened image and applying a blockwise encoder to the sharpened image; decoding, using a blockwise decoder, data from an encoded bitstream to obtain a plurality of blocks of image data; combining the plurality of blocks of image data to form a blocked image; and applying a blurring filter, which is matched to the sharpening filter, to the blocked image to obtain an output image.

Abstract: This technology relates to encoding data. For example, a sequence of one or more structured records as input data, at least one of the structured records including one or more field tags and associated field data. The input data may be parsed into data buffers, each data buffer corresponding to a field tag in the one or more field tags, wherein each data buffer includes the associated field data of the corresponding field tag. A control sequence specifying a sequence of the one or more fields tags may be encoded into a transition record. A state machine comprising nodes and transitions may be generated, with each node corresponding to occurrences of the one or more field tags and each transition corresponding to successive pairs of the one or more field tags. The data buffers, a representation of the state machine, and the encoded control sequence may be output.

Abstract: Techniques of compressing color images in the presence of chromatic aberrations involve performing, prior to compression, a chromatic aberration correction operation on a color image. Along these lines, the chromatic aberration of an imaging system may be represented as a vector displacement map between a red channel and a green channel of a color image, a blue channel and a green channel of the color image, or both. In some implementations, prior to adding the vector displacements to each of the images of the red channel and the blue channel, these displacements are weighted according to proximity from an edge of each of the respective red and blue images. In some further implementations, the vector displacement maps as well as the weights are blurred with a blurring kernel such as a gaussian. Once these vector displacements are added to each of the red and blue images, the resulting color images are linearly combined to produce a new brightness channel Y.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, receiving a search query from a user; determining that a voting user interface (VUI) is to be provided based on the search query, the VUI enabling the user to submit one or more votes in a vote-based campaign; receiving search results that are responsive to the search query; and transmitting instructions to display the search results and the VUI.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, determining that a voting user interface (VUI) is to be provided with search results, the VUI enabling a user to submit one or more votes in a voting-based campaign; receiving social content, the social content having been distributed using one or more social networking services; receiving search results that are responsive to a search query; and transmitting instructions to display the search results and the VUI, the VUI comprising the social content.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, receiving a search query from a user; determining that a voting user interface (VUI) is to be provided based on the search query, the VUI enabling the user to submit one or more votes in a vote-based campaign; receiving search results that are responsive to the search query; and transmitting instructions to display the search results and the VUI.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining that a voting user interface (VUI) is to be provided to a user, the VUI enabling a user to submit one or more votes in a voting-based campaign; receiving an advertisement; receiving search results that are responsive to a search query; and transmitting instructions to display the search results and the advertisement, the advertisement providing the VUI.