Abstract: An encoder includes circuitry configured to receive a video, determine a plurality of long-term reference frames, determine a long-term reference retention time, and encode the video into a bitstream including the determined plurality of long-term reference fames and the determined retention time. Related apparatus, systems, techniques and articles are also described.

Abstract: Systems and methods for the selection of resolutions for seamless resolution switching of multimedia content in accordance with embodiments of the invention are disclosed. In one embodiment of the invention, a source encoder includes a processor configured by a source encoder application to receive multimedia content, where the multimedia content comprises video data having a primary resolution and a primary sample aspect ratio and encode the video data as a set of alternative streams, where a plurality of the streams in the set of alternative streams have different maximum bitrates and resolutions, the resolution of each of the plurality of streams comprises a width and height that are both an integer number of pixels, and both the width and height of each of the plurality of streams is a common fraction of the width and height of the corresponding primary resolution.

Abstract: Various embodiments provide an encoder that performs an up-conversion and a down-conversion on a first quantization matrix to generate a second quantization matrix, and quantizes transform coefficients of a current block using the second quantization matrix. The first quantization matrix has a first number of rows and a first number of columns equal to the first number of rows, and the second quantization matrix has a second number of rows and a second number of columns different from the second number of rows. In the up-conversion, the circuitry generates the second quantization matrix such that one of the second number of rows or the second number of columns is larger than the first number of rows. In the down-conversion, the circuitry generates the second quantization matrix such that the other of the second number of rows or the second number of columns is smaller than the first number of rows.

Abstract: A data structure defining a high dynamic range image comprises a tone map having a reduced dynamic range and HDR information. The high dynamic range image can be reconstructed from the tone map and the HDR information. The data structure can be backwards compatible with legacy hardware or software viewers. The data structure may comprise a JFIF file having the tone map encoded as a JPEG image with the HDR information in an application extension or comment field of the JFIF file, or a MPEG file having the tone map encoded as a MPEG image with the HDR information in a video or audio channel of the MPEG file. Apparatus and methods for encoding or decoding the data structure may apply pre- or post correction to compensate for lossy encoding of the high dynamic range information.

Abstract: An example client device for retrieving media data includes a memory configured to store media data; and one or more processors implemented in circuitry and configured to execute a plurality of video decoders; determine a complexity value for the media data including a plurality of encoded video streams, the complexity value representing complexity of an aggregation of the encoded video streams; retrieve the media data including the encoded video streams in response to determining that the client device is capable of decoding the encoded video streams using the complexity value; and distribute the encoded video streams and synchronization information to corresponding video decoders of the plurality of video decoders to cause the video decoders to decode the corresponding video streams and to output decoded video data from the video streams in a synchronized fashion.

Abstract: Coding quantization parameter variation or adaptation is made more effective by basing the determination of a coding quantization parameter for a predetermined block of the picture on a dispersion of a statistical sample value distribution of a high-pass filtered version of the predetermined block. The usage of the high-pass filtered version of the predetermined block as a basis for the determination of the dispersion instead of using, for instance, the un-filtered or original version of the predetermined block assists in a better adaptation of the resulting coding quantization parameter variation across the picture to the human visual system. Alternatively or additionally, coding quantization parameter variation or adaptation across a picture is made more efficient by a control of coding quantization parameter variation/adaptation across a picture in a manner dependent on a prediction of the actual dispersion.

Abstract: An image encoding/decoding method of the present invention constructs a merge candidate list of a current block, derives motion information of the current block on the basis of the merge candidate list and a merge candidate index, and performs inter prediction on the current block on the basis of the derived motion information, wherein the merge candidate list can improve encoding/decoding efficiency by adaptively determining a plurality of merge candidates on the basis of the position or size of a merge estimation region (MER) to which the current block belongs.

Abstract: The present invention relates to a method of decoding a video bitstream, the method comprising the steps of: receiving a bitstream representing: residual samples produced by subtracting encoder filtered motion compensated prediction samples from image samples; and motion vectors used in forming the motion compensated prediction samples; the encoder filtering process conducted on the motion compensated prediction samples at an encoder having at least one parameter; using said motion vectors to provide motion compensated prediction samples from a previously reconstructed image; decoder filtering said motion compensated prediction samples in accordance with said at least one parameter; and adding said filtered motion compensated prediction samples to said residual samples to reconstruct images. A system and apparatus corresponding to this method are also disclosed.

Abstract: A deterioration compensation apparatus includes a zone determiner, a stress generator, a first memory and a stress compensator. The zone determiner divides a display area into zones based on a distance from a central portion of the display area. The stress generator generates stress values of output image data for blocks including a plurality of pixels in the display area. The first memory accumulates the stress values of the output image data for the blocks and stores the accumulated stress values of the output image data for the blocks. The stress compensator receives the accumulated stress values of the output image data for the blocks and compensates input image data in a unit of pixels. A number of the pixels included in a block of the blocks varies according to the zone in which the pixels included in the block are located.

Abstract: An apparatus comprising at least one processor, and at least one memory including computer program code, wherein the at least one memory and the computer program code are configured, with the at least one processor, to: receive an input signal, the input signal comprising a piecewise-smooth signal and a noise signal; determine a prior probability density function of a representation of the piecewise-smooth signal, the representation of the piecewise-smooth signal comprising a combination of a smooth, Gaussian, variable and a jump, Cauchy, variable; determine a likelihood function based on the input signal; determine a posterior probability density function based on the likelihood function and the prior probability density function distribution; and estimate the piecewise-smooth signal based on an estimate of a posterior probability density function.

Abstract: A decoder including a receiver and a processor configured to receive an encoded bitstream containing a motion vector (MV) candidate index for a current block. The processor is coupled to the receiver, and configured to obtain precisions of candidate motion vectors (MVs) corresponding to neighboring blocks of the current block, perform first rounding of the precisions based on a rounding scheme, perform second rounding of the candidate MVs based on the first rounding, perform pruning of the candidate MVs, generate a candidate list based on the second rounding and the pruning, and select one of the candidate MVs from the candidate list for decoding the current block based on the MV candidate index.

Abstract: An encoder, includes: circuitry; and memory. Using the memory, the circuitry: in inter prediction for a current block, determines a base motion vector, and writes, in an encoded signal, a delta motion vector representing (i) one direction among a plurality of directions including a diagonal direction and (ii) a distance from the base motion vector; and encodes the current block using the delta motion vector and the base motion vector as a motion vector of the current block.

Abstract: Examples of techniques for cache line cleanup for prevention of side channel attack are described herein. An aspect includes determining, by a rollback control unit, a start of a speculative execution in a computer processor. Another aspect includes setting a field in a speculative buffer of the computer processor based on a load or a store to a cache line of a cache being performed by the speculative execution. Another aspect includes determining a failure of the speculative execution. Another aspect includes, based on the failure of the speculative execution, traversing the speculative buffer to determine the set field and performing a cleanup of the cache line based on the set field in the speculative buffer.

Abstract: A sensor data processing apparatus can be coupled to multiple image sensors of different types. The apparatus adjusts frame transmission rates based on the number of sensors and type of image data sourced by the sensors to optimize utilization of bandwidth on a number of transport channels. The apparatus can be configured to transport selected frames in the image data that are identified as critical frames at a higher rate than non-selected frames in the image data.

Abstract: Multi-resolution encoded files are stored on a plurality of disk drives using systematic network coded storage. In some embodiments, the stored files are used to provide video streaming services for users.

Abstract: A system and method disposed to enable encoding, decoding and manipulation of digital video with substantially less processing load than would otherwise required. In particular, one disclosed method is directed to generating a compressed video data structure that is selectively decodable to a plurality of resolutions including the full resolution of the uncompressed stream. The desired number of data components and the content of the data components that make up the compressed video data, which determine the available video resolutions, are variable based upon the processing carried out and the resources available to decode and process the data components. During decoding, efficiency is substantially improved because only the data components necessary to generate a desired resolution are decoded. In variations, both temporal and spatial decoding are utilized to reduce frame rates, and hence, further reduce processor load. The system and method are particularly useful for real-time video editing applications.

Abstract: An image encoder includes a processor and a memory. The memory includes instructions configured to cause the processor to perform operations. In one example implementation, the operations may include determining whether a dictionary item is available for replacing a block of an image being encoded, the determining based on a hierarchical lookup mechanism, and encoding the image along with reference information of the dictionary item in response to determining that the dictionary item is available. In one more example implementation, the operations may include performing principal component analysis (PCA) on a block to generate a corresponding projected block, the block being associated with a group of images, comparing the projected block with a corresponding threshold, descending the block recursively based on the threshold until a condition is satisfied, and identifying a left over block as a cluster upon satisfying of the condition.

Abstract: There is provided an audio encoding apparatus including a memory, and a processor coupled to the memory and the processor configured to determine whether a tone is included in a boundary between a low-frequency that is a frequency bandwidth below a predetermined frequency of an input signal and a high-frequency that is a frequency bandwidth above the predetermined frequency of the input signal, suppress a tone in one of the low-frequency and the high-frequency, encode the input signal having the low-frequency to generate a low-frequency code, encode the input signal having the high-frequency to generate a high-frequency code, and generate an encoded stream by multiplexing the low-frequency code and the high-frequency code.

Abstract: Methods of video streaming are generally described. In some examples, the methods may be performed by a server device and may include generating first intra-coded frame (I-frame) data and a plurality of enhancement layer data corresponding to the first I-frame data. The methods may further include sending the first I-frame data to a client device. The methods may further include transmitting first enhancement layer data to the client device. The methods may include sending first inter-coded frame data to the client device. In some examples, the first inter-coded frame data can be decoded by referencing first reference frame data generated by combining the first I-frame data and the first enhancement layer data.

Abstract: Systems and methods for the selection of resolutions for seamless resolution switching of multimedia content in accordance with embodiments of the invention are disclosed. In one embodiment of the invention, a source encoder includes a processor configured by a source encoder application to receive multimedia content, where the multimedia content comprises video data having a primary resolution and a primary sample aspect ratio and encode the video data as a set of alternative streams, where a plurality of the streams in the set of alternative streams have different maximum bitrates and resolutions, the resolution of each of the plurality of streams comprises a width and height that are both an integer number of pixels, and both the width and height of each of the plurality of streams is a common fraction of the width and height of the corresponding primary resolution.

Abstract: A method of data compression performed by at least one core communicating with a central memory. The input data presents a two-dimensional input array formed by a plurality data items stored contiguously in the central memory according to a contiguous direction. The method comprises a step of wavelet transform comprising the following sub-steps: forming from the input array at least one tile comprising a plurality of consecutive data block columns, each data block column being formed by a plurality of lines of consecutive data items according to the contiguous direction, the length of each line being a multiple of the cache line length; and for each data block column computing dot products between a filter vector and each group of N lines using fused multiply-add instructions for the core.

Abstract: In an embodiment, a method includes: receiving an audio frame; decomposing the received audio frame into M sub-band pulse-code modulation (PCM) audio frames, where M is a positive integer number; predicting a PCM sample of one sub-band PCM audio frame of the M sub-band PCM audio frames; comparing the predicted PCM sample with a corresponding received PCM sample to generate a prediction error sample; comparing an instantaneous absolute value of the prediction error sample with a threshold; and replacing the corresponding received PCM sample with a value based on the predicted PCM sample when the instantaneous absolute value of the prediction error sample is greater than the threshold.

Abstract: To provide an encoding method for reducing deterioration in encoding efficiency when encoding a video/an image by selecting one operation mode out of a number of operation modes. The encoding method includes: extracting one or more features from one or more reconstructed pixel groups; categorizing the one or more reconstructed pixel groups using the extracted one or more features and a first machine learning model; and performing an encoding process on a current block of image samples included in a current picture using a parameter set corresponding to a result of the categorizing, the parameter set being one of a plurality of predefined parameter sets.

Abstract: Live streaming video content is processed and stored for real-time delivery of the content, future VoD viewing of the content, and time-shifted viewing of the content, by manipulating a common manifest or playlist. Previously stored content may be reordered and/or recombined in order to provide a personalized content viewing experience.

Abstract: Techniques are described for controlling display of video data and/or other image data based at least in part on selective mapping of pixel values to pixels. Such techniques may include separating a display panel into multiple regions, with at least one primary region having a highest resolution of displayed image data and with one or more secondary regions having one or more lower resolutions of displayed image data (e.g., by using a 1-to-M mapping of image pixel values to display panel pixels for each such secondary region, where M is greater than 1, such that each such image pixel value controls the display of M such pixels). The image data may further be encoded and optionally decoded in accordance with such a display panel arrangement, such as to encode the image data per the display panel arrangement to reduce its size before transmission to the display panel.

Abstract: The present disclosure provides a system, method, and apparatus for a virtual trainer for a control panel for a vehicle. In one or more embodiments, the disclosed system comprises a device with a screen, where the virtual trainer is loaded onto the device, and the virtual trainer is to display, on the screen of the device, available selections relating to different functions for the vehicle, as shown on the control panel for the vehicle. In one or more embodiments, the vehicle is a multi-passenger vehicle. In at least one embodiment, the vehicle is an aircraft, a terrestrial vehicle, or a marine vehicle. In some embodiments, the device is mobile or stationary. In one or more embodiments, the device is a tablet device and/or the control panel itself. In at least one embodiment, the screen of the device is a touch screen.

Abstract: A quality-of-experience optimization system configured to optimize quality (QoE: Quality of Experience) that a user experiences in a content distribution service, including: a recommend request apparatus configured to output a distribution parameter candidate of content distribution for optimizing QoE of content distribution, and to receive a distribution parameter for optimizing the QoE as a recommend value; and a quality-of-experience optimization apparatus configured to estimate QoE from the distribution parameter candidate received from the recommend request apparatus, and to calculate a distribution parameter for optimizing the QoE as a recommend value to output the recommend value.

Abstract: Apparatus and methods for digital video data compression via a scalable, multi-resolution approach. In one embodiment, the video content may be encoded using a multi-resolution and/or multi-quality scalable coding approach that reduces computational and/or energy load on a client device. In one implementation, a low fidelity image is obtained based on a first full resolution image. The low fidelity image may be encoded to obtain a low fidelity bitstream. A second full resolution image may be obtained based on the low fidelity bitstream. A portion of a difference image obtained based on the second full resolution image and the first full resolution may be encoded to obtain a high fidelity bitstream. The low fidelity bitstream and the high fidelity bitstream may be provided to e.g., a receiving device.

Abstract: According to examples, inventory, growth, and risk prediction using image processing may include receiving a plurality of images captured by a vehicle during movement of the vehicle along a vehicle path. The images may include a plurality of objects. The images may be pre-processed for feature extraction. A plurality of features of the objects may be extracted from the pre-processed images by using a combination of computer vision techniques. A parameter related to the objects may be determined from the extracted features. A spatial density model may be generated, based on the determined parameter and the extracted features, to provide a visual indication of density of distribution of the objects related to a portion of the images, and/or to provide an alert corresponding to the objects related to the portion of the images.

Abstract: A frame buffer is adapted to store at least one reference frame of a video stream, said reference frame being different from a current frame of the video stream. A motion estimation unit is adapted to generate a motion vector by estimating motion between a reference block of the reference frame and a current block of the current frame. A blurring filter selection unit is adapted to select one of a plurality of blurring filters depending on the orientation of the motion vector. A filtering unit is adapted to generate a filtered reference block by applying the selected blurring filter to the reference block. A motion compensation unit is adapted to generate a filtered prediction block of the current block on the basis of the current block, the motion vector and the filtered reference block.

Abstract: A frame buffer is adapted to store at least one reference frame of a video stream, said reference frame being different from a current frame of the video stream. A motion estimation unit is adapted to generate a motion vector by estimating motion between a reference block of the reference frame and a current block of the current frame. A blurring filter selection unit is adapted to select one of a plurality of blurring filters depending on the orientation of the motion vector. A filtering unit is adapted to generate a filtered reference block by applying the selected blurring filter to the reference block. A motion compensation unit is adapted to generate a filtered prediction block of the current block on the basis of the current block, the motion vector and the filtered reference block.

Abstract: A data storage device includes a memory, a first module, and a second module. The first module is configured to sense data stored at the memory to generate a first set of soft bits having a first number of bits. The second module is configured to perform an operation using the first set of soft bits to generate a second set of soft bits having a second number of bits that is less than the first number of bits. In an illustrative implementation, the second set of soft bits is used in connection with a three-stage decoding process to decode a set of hard bits that represents the data.

Abstract: A method of encoding a video signal using a graph-based transformation includes: generating a residual block using a prediction block generated according to an intra prediction mode; obtaining at least one of a self-loop weight indicating a weight of boundary pixels in the residual block or a correlation coefficient indicating an inter-pixel correlation, on the basis of a prediction angle corresponding to the intra prediction mode; generating a graph on the basis of at least one of the self-loop weight or the correlation coefficient; determining a graph-based transformation kernel on the basis of the graph; and performing a transform for the residual block using the graph-based transformation kernel.

Abstract: There is provided a speech synthesizer comprising a processor configured to receive one or more linguistic units, convert said one or more linguistic units into a sequence of speech vectors for synthesizing speech, and output the sequence of speech vectors. Said conversion comprises modelling higher and lower spectral frequencies of the speech data as separate high and low spectral streams by applying a first set of one or more statistical models to the higher spectral frequencies and a second set of one or more statistical models to the lower spectral frequencies.

Abstract: A system that incorporates teachings of the subject disclosure may include, for example, dividing a media content item into a plurality of media content segments, at each media content segment of the plurality of media content segments, applying motion estimation between at least two video frames of the media content segment to determine a content weight for the media content segment, determining a bit rate for the media content segment according to the determined content weight for the media content segment, and encoding the media content segment at the determined bit rates to generate a data stream for the media content segment, whereby a plurality of data streams for the plurality of media content segments of the media content are generated, and transmitting the plurality of data streams for the plurality of media content segments of the media content to the one or more media devices. Other embodiments are disclosed.

Abstract: An image frame interpolation apparatus includes a motion vector generator configured to generate a motion vector based on a first image frame and a second image frame; a motion scaler configured to scale the motion vector to thereby generate a scaled motion vector; and a motion compensator including an internal memory, the motion compensator being configured to perform motion compensation based on the scaled motion vector and generate an interpolation frame using the internal memory, the motion scaler being configured to scale the motion vector based on a size of the motion vector and a size of the internal memory.

Abstract: A deep learning based compression (DLBC) system generates a progressive representation of the encoded input image such that a client device that requires the encoded input image at a particular target bitrate can readily be transmitted the appropriately encoded data. More specifically, the DLBC system computes a representation that includes channels and bitplanes that are ordered based on importance. For a given target rate, the DLBC system truncates the representation according to a trained zero mask to generate the progressive representation. Transmitting a first portion of the progressive representation enables a client device with the lowest target bitrate to appropriately playback the content. Each subsequent portion of the progressive representation allows the client device to playback the content with improved quality.

Abstract: Methods and systems for image processing are provided. A target image may be acquired, wherein the target image may include a plurality of elements, an element of which may correspond to a pixel or a voxel. The target image may be decomposed into at least one layer, wherein the at least one layer may include a low frequency sub-image and a high frequency sub-image. The at least one layer may be transformed. The transformed layer may be reconstructed into a composite image.

Abstract: In one aspect, an example method for modifying a media stream having a variable data rate includes: (i) receiving, by a first computing system, a media stream generated by a second computing system, the media stream representing media content and having a variable data rate; (ii) determining, by the first computing system, a target constant data rate at which a third computing system has requested to receive the media stream; and (iii) while receiving the media stream: (a) modifying, by the first computing system, the media stream to have a modified data rate that is based on the determined target constant data rate; and (b) transmitting, by the first computing system, to the third computing system, the media stream having the modified data rate.

Abstract: A computing device for re-encoding 360 video based on adjusted bitrate allocation receives and decodes a 360 video. The computing device partitions the 360 video into a plurality of regions and determines a pixel number for each of the plurality of regions. The computing device also determines a distortion level for each of the plurality of regions and performs bitrate allocation for each of the regions based on one or more of: the corresponding pixel number and the corresponding distortion level.

Abstract: Innovations in compression and decompression of point cloud data are described. For example, an encoder is configured to encode point cloud data, thereby producing encoded data. In particular, the encoder applies a region-adaptive hierarchical transform (“RAHT”) to attributes of occupied points, thereby producing transform coefficients. The encoder can also quantize the transform coefficients and perform adaptive entropy coding of the quantized transform coefficients. For corresponding decoding, a decoder is configured to decode the encoded data to reconstruct point cloud data. In particular, the decoder applies an inverse RAHT to transform coefficients for attributes of occupied points. The decoder can also perform adaptive entropy decoding and inverse quantization of the quantized transform coefficients. The adaptive entropy coding/decoding can use estimates of the distribution of values for the quantized transform coefficients.

Abstract: A method, system, and apparatus for video coding and decoding with embedded motion information are disclosed. Image data is associated with basis functions and motion data. A method of identifying one or more basis functions which are representative of image data and associating the basis function with the motion data. A method or receiving information indicative of a basis function and of motion data and determining a motion vector based on the motion data. A system where portions of an image representative of basis functions are further associated with motion data at an encoder and then communicated to a decoder. A decoder produces at least portions of a predicted image using basis functions parameters and motion data.

Abstract: Systems and methods for encoding multiple video streams in accordance with embodiments of the invention are disclosed. In one embodiment, a source encoder configured to encode source video as a number of alternative video streams includes a parallel processing system configured to collect statistics on source video data and write the statistics to shared memory in a first pass through the received multimedia content, determine initial encoding information for source video data and write the initial encoding information to shared memory during the first, encode the source video data in parallel using collected statistics and initial encoding information to produce a plurality of alternative video streams during a second pass, and parallel encoding processes are configured to reuse additional encoding information that has already been determined for a portion of video and to generate additional encoding information that has not already been determined for a portion of video.

Abstract: Systems and methods of filtering video data using a plurality of filters are disclosed. In an embodiment, a method includes receiving and decoding a plurality of filters embedded in a video data bitstream at a video decoder. The method includes selecting, based on information included in the video data bitstream, a particular filter of the plurality of filters. The method further includes applying the particular filter to at least a portion of decoded video data of the video data bitstream to produce filtered decoded video data.

Abstract: A high resolution 3D image may be encoded into a first multiplexed image frame and a second multiplexed image frame in a base layer (BL) video signal and an enhancement layer (EL) video signal. The first multiplexed image frame may comprise horizontal high resolution image data for both eyes, while the second multiplexed image frame may comprise vertical high resolution image data for both eyes. Encoded symmetric-resolution image data for the 3D image may be distributed to a wide variety of devices for 3D image processing and rendering. A recipient device may reconstruct reduced resolution 3D image from one of the first multiplexed image frame or the second multiplexed image frame. A recipient device may also reconstruct high resolution 3D image by combining high resolution image data from both of the first multiplexed image frame and the second multiplexed image frame.

Abstract: A method for video decoding includes: dividing a plurality of luma component data of a reference frame into a plurality of primary data and a plurality of secondary data, respectively stored in a first memory region and a second memory region; accessing the first memory region to perform a motion estimation; and accessing the second region to perform a luma motion compensation.

Abstract: To generate a compressed video having a reduced video file size, an original video having a plurality of images are captured. Each of the plurality of images are compared. If images of the plurality of images are determined to be redundant images, the images are deleted. The original video having the redundant images removed is saved to form the compressed video.

Abstract: Disclosed is a method comprising: (a) receiving a layer 0 bitstream, the layer 0 bitstream including coding information for the layer 0 bitstream; (b) receiving a layer 1 bitstream, the layer 1 bitstream including coding information for the layer 1 bitstream; and (c) reconstructing the layer 0 bitstream using previously received information for another layer 0 bitstream and previously received information for another layer 1 bitstream.

Abstract: A terminal device is intended to reduce a decrease in reception performance in response to inter-cell interference and inter-user interference even when multiple interference streams are received. The terminal device connected with a first base station apparatus receives a first interference signal serving as inter-user interference from the first base station apparatus, and a second interference signal serving as inter-cell interference from a second base station apparatus, demodulates at least one interference stream of the first interference signal using terminal information transmitted from the first base station, and suppresses the second interference signal using a reception weight.

Abstract: A method and an apparatus for allocating bits of an audio signal. The method includes dividing a frequency band of an audio signal into multiple sub-bands, and quantizing a sub-band normalization factor of each sub-band; classifying the multiple sub-bands into multiple groups, and acquiring a sum of intra-group sub-band normalization factors of each group; performing initial inter-group bit allocation to determine the initial number of bits of each group; performing secondary inter-group bit allocation to allocate coding bits of the audio signal to at least one group; and allocating the bits of the audio signal to sub-bands in the group. The present disclosure can, by means of grouping, ensure relatively stable allocation in a previous frame and a next frame and reduce an impact of global allocation on local discontinuity in a case of low and medium bit rates.