Abstract: The transmission of broadcast data, such as financial data and news feeds, is accelerated over a communication channel using data compression and decompression to provide secure transmission and transparent multiplication of communication bandwidth, as well as reduce the latency. Broadcast data may include packets having fields. Encoders associated with particular fields may be selected to compress those particular fields.

Abstract: Gaze tracking data may representing a user's gaze with respect to one or more images transmitted to a user are analyzed to determine one or more regions of interest. Compression of the one or more transmitted images is adjusted so that fewer bits are needed to transmit data for portions of an image outside the one or more regions interest than for portions of the image within the one or more regions of interest.

Abstract: A method of coding at least one image comprising the steps of splitting the image into a plurality of blocks, of grouping said blocks into a predetermined number of subsets of blocks, of coding each of said subsets of blocks in parallel, the blocks of a subset considered being coded according to a predetermined sequential order of traversal. The coding step comprises, for a current block of a subset considered, the sub-step of predictive coding of said current block with respect to at least one previously coded and decoded block, and the sub-step of entropy coding of said current block on the basis of at least one probability of appearance of a symbol.

Abstract: A method for decoding an image according to the present invention comprises the steps of: receiving and decoding MPM index information for indicating an MPM candidate which is to be used as an intra prediction mode of a current block; generating an MPM candidate list containing a plurality of MPM candidates for the current block; determining the MPM candidate indicated by the decoded MPM index information as the intra prediction mode of the current block, among the plurality of the MPM candidates which constitute the MPM candidate list; and generating a prediction block corresponding to the current block by performing intra prediction for the current block based on the determined intra prediction mode.

Abstract: A method for coding a block of video data in simplified block prediction mode of a constant bitrate video coding scheme for transmission over display links is disclosed. In one aspect, the method includes determining a candidate block to be used to predict a current block in a current slice, the candidate block being within a range of pixel positions that each correspond to a reconstructed pixel in the current slice. The range of pixel positions may comprise (i) a first region including one or more first pixel positions in a first line of pixels that overlaps the current block, and (ii) a second region including one or more second pixel positions in a second line of pixels that does not overlap the current block. The method may further comprise determining and signaling a prediction vector indicative of a pixel position of the candidate block.

Abstract: An example method of entropy coding video data includes obtaining a pre-defined initialization value for a context of a plurality of contexts used in a context-adaptive entropy coding process to entropy code a value for a syntax element in a slice of the video data, wherein the pre-defined initialization value is stored with N-bit precision; determining, using a look-up table and based on the pre-defined initialization value, an initial probability state of the context for the slice of the video data, wherein a number of possible probability states for the context is greater than two raised to the power of N; and entropy coding, based on the initial probability state of the context, a bin of the value for the syntax element.

Abstract: Motion blur occur when acquiring images and videos with cameras fitted to the high speed motion devices, for example, drones. Distorted images intervene with the mapping of the visual points, hence the pose estimation and tracking may get corrupted. System and method for solving inverse problems using a coupled autoencoder is disclosed. In an embodiment, solving inverse problems, for example, generating a clean sample from an unknown corrupted sample is disclosed. The coupled autoencoder learns the autoencoder weights and coupling map (between source and target) simultaneously. The technique is applicable to any transfer learning problem. The embodiments of the present disclosure implements/proposes a new formulation that recasts deblurring as a transfer learning problem which is solved using the proposed coupled autoencoder.

Abstract: Flexible frame referencing is described that is suitable for use with a display transport. In one example, the referencing is a method that includes receiving frames at a computer system for transmission to a display, sending frames to the display without inter-frame compression in an intra-frame mode, saving the sent frames to a reference frame list, switching the computer system to an inter-frame mode, selecting a reference frame from the reference frame list, compressing additional received frames using the selected reference frame, and sending the additional frames to the display compressed in the inter-frame mode.

Abstract: Systems, methods and apparatuses of processing data of a VR system are disclosed that comprise receiving tracking information which includes at least one of user position information and eye gaze point information. One or more processors may be used to predict, based on the user tracking information, a user viewpoint of a next frame of a sequence of frames of video data to be displayed. Using the prediction, a portion of the next frame of video data to be displayed is rendered at an estimated location in the next frame. A corresponding matching portion in a previously encoded frame is determined based on the estimated location of the portion in the next frame and the portion of the next frame of video data is encoded.

Abstract: A method, executed by an encoding circuit, for selecting an optimal decimated grid includes estimating, among a plurality of decimated grids within a coded block, a weight decimation error for each of a vertical decimated grid and a horizontal decimated grid. A weight decimation error is estimated for each of remaining decimated grids among the plurality of decimated grids based on a corresponding weight decimation error among the vertical decimated grid and the horizontal decimated grid. For each of the plurality of decimated grids, an initial combined error is determined by combining the weight decimation error and a color format choice error. Two decimated grids having the least initial combined errors, among the plurality of decimated grids, are selected as optimal decimated grids.

Abstract: A video encoder receives a frame to be encoded and divides the current frame into blocks of pixels. For each block, a spatial variability is calculated and a cost function used to evaluate a cost for inter-coding the block of pixels is set to be dependent on the spatial variability. A ratio of a weight associated with a cost of encoding a motion vector and a weight associated with a sum of differences value is set to be lower if the spatial variability of the block of pixels in the current frame is below a first threshold compared to if the spatial variability is equal to or above the first threshold. The block is matched with a plurality of blocks in a reference frame, and a cost for inter-coding the block with reference to each of the plurality of blocks in a reference frame is evaluated according to the cost function.

Abstract: An unencoded video frame of a sequence of video frames is encoded to generate an encoded bit-stream representative of the unencoded video frame. The encoded bit-stream includes a header portion and a video data payload portion. The unencoded video frame may be divided into an array of prediction blocks, including a first prediction block. A coding mode is selected from a plurality of coding modes for use in encoding the first prediction block. The first prediction block is encoded using the selected coding mode to generate a portion of the video data payload of the encoded bit-stream. A coding mode selection flag is provided in the header portion of the encoded bit-stream, which indicates which coding mode of the plurality of coding modes was selected for encoding the first prediction block.

Abstract: Data employed in computations amongst multiple processors in a computing system is processed so that less bits than a full representation of the data needs to be communicated yet all of the relevant information is communicated. More specifically, a sensitivity value is determined for various items of the data which reflect the number of bits in the data items that are not garbage bits, and only information in the data items that are indicated by the sensitivity value to not be garbage bits are necessarily effectively retained. At least the information that is not garbage bits and the corresponding associated sensitivity are packed together. The results of computations that are performed using the data items as at least one of the operands for the computation are associated with a sensitivity that is derived from the individual sensitivities of the operands used in the computation.

Abstract: Techniques and tools for encoding enhancement layer video with quantization that varies spatially and/or between color channels are presented, along with corresponding decoding techniques and tools. For example, an encoding tool determines whether quantization varies spatially over a picture, and the tool also determines whether quantization varies between color channels in the picture. The tool signals quantization parameters for macroblocks in the picture in an encoded bit stream. In some implementations, to signal the quantization parameters, the tool predicts the quantization parameters, and the quantization parameters are signaled with reference to the predicted quantization parameters. A decoding tool receives the encoded bit stream, predicts the quantization parameters, and uses the signaled information to determine the quantization parameters for the macroblocks of the enhancement layer video. The decoding tool performs inverse quantization that can vary spatially and/or between color channels.

Abstract: A decoding apparatus for decoding an image by obtaining transformation coefficients of a sub residual block based on location information of at least one non-zero transformation coefficient and level information of the at least one non-zero transformation coefficient obtained from a bitstream.

Abstract: In a video processing system, a method and system for generating a transform size syntax element for video decoding are provided. For high profile mode video decoding operations, the transform sizes may be selected based on the prediction macroblock type and the contents of the macroblock. A set of rules may be utilized to select from a 4.×.4 or an 8.×.8 transform size during the encoding operation. Dynamic selection of transform size may be performed on intra-predicted macroblocks, inter-predicted macroblocks, and/or direct mode inter-predicted macroblocks. The encoding operation may generate a transform size syntax element to indicate the transform size that may be used in reconstructing the encoded macroblock. The transform size syntax element may be transmitted to a decoder as part of the encoded video information bit stream.

Abstract: An image decoding method of decoding, on a block-by-block basis, image data included in a coded stream includes: deriving candidates for an intra prediction mode to be used for intra prediction for a decoding target block, the number of the candidates constantly being a plural number; obtaining, from the coded stream, an index for identifying one of the derived candidates for the intra prediction mode; and determining, based on the obtained index, one of the derived candidates for the intra prediction mode as the intra prediction mode to be used for intra prediction for the decoding target block.

Abstract: A method of creating a hierarchical dictionary comprises, with a processor, extracting a number of symbols from a first image, constructing a number of refinement dictionary entries based on the symbols, the refinement dictionary entries forming a refinement dictionary, grouping a number of the refinement dictionary entries into clusters to form a number of refinement dictionary entry clusters, and constructing a number of direct dictionary entries for each of the refinement dictionary entry clusters, the direct dictionary entries forming a direct dictionary.

Abstract: A method for identifying metadata for cyber content sharing and governance (abbreviated as an MDCCSG method) and application method thereof. The MDCCSG method is proposed based on the requirements of big data sharing and governance under a big data and pan media environment, and is applicable for generating unified identifications on various categories of content resources; and the application method matched with the MDCCSG method can effectively support high-efficient sharing and governance of the big data, wherein the MDCCSG method comprises a unified description framework of metadata, a unified specification method of metadata, and a definition of the core MDCCSG identification element; and the MDCCSG method not only can describe rich semantics of contents in detail, but also has a built-in content trust authentication and security assurance ability.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage medium, to facilitate searching indexed resources associated with sort key values. In one aspect, a method includes actions of maintaining an index including a respective index entry for each of multiple resources, wherein each index entry includes a first sort key that is associated with a corresponding sort key value, receiving a query from a user device, obtaining, based on query features, a first restrict criterion that includes one or more binary value bits, determining, based on (i) the first restrict criterion and (ii) the first sort key, a first count of index entries that are each associated with a respective resource that is responsive to the query, and in response to determining that the first count of index entries satisfies the predetermined threshold, obtaining a set of index entries corresponding to resources related to the query.

Abstract: Methods, apparatuses and systems directed to frequency domain transforms, including fast integer transforms and directional integer transforms. Further described is a video codec that utilizes a novel class of fast integer and directional transforms.

Abstract: A method for decoding a multilayer video signal, according to the present invention, is characterized by: inducing the number of active references of a current picture in consideration of whether the maximum number of active reference pictures of the current picture in a current layer is limited; obtaining a reference layer identifier based on the number of active references; determining an active reference picture of the current picture using a reference layer identifier; generating an interlayer reference picture by upsampling the active reference picture, and performing interlayer prediction of the current picture using an interlayer reference picture.

Abstract: A method of decoding including obtaining transformation coefficients of a sub residual block based on location information of a non-zero transformation coefficient and level information of the non-zero transformation coefficient obtained from a bitstream.

Abstract: A method for decoding a multilayer video signal, according to the present invention, is characterized by: inducing the number of active references of a current picture, in consideration of whether the maximum number of active reference pictures of the current picture in a current layer is limited; obtaining a reference layer identifier based on the number of active references, determining an active reference picture of the current picture using a reference layer identifier, generating a reference picture list including the active reference pictures, and performing interlayer prediction of the current picture using the reference picture list.

Abstract: A decoding apparatus for decoding an image by obtaining transformation coefficients of a sub residual block based on location information of a non-zero transformation coefficient and level information of the non-zero transformation coefficient obtained from the bitstream.

Abstract: Innovations in adaptive encoding and decoding for units of a video sequence can improve coding efficiency. For example, some of the innovations relate to encoding/decoding that includes adaptive switching of color spaces between units within a video sequence. Other innovations relate encoding/decoding that includes adaptive switching of color sampling rates between units within a video sequence. Still other innovations relate encoding/decoding that includes adaptive switching of bit depths between units within a video sequence.

Abstract: A system and method for transmission of a video stream are provided. The system may include: an encoder adapted to generate a video stream comprising a plurality of encoded frames, encoded according to at least one encoding parameter; a comparator in communication with the encoder, the comparator adapted to compare encoded frames of the plurality of encoded frames with input frames to determine a fitness metric reflective of visual quality of the encoded frames; and a controller in communication with the comparator, the controller adapted to adjust the at least one encoding parameter based on the fitness metric.

Abstract: A decoding apparatus for decoding an image by obtaining transformation coefficients of a sub residual block based on location information of a non-zero transformation coefficient and level information of the non-zero transformation coefficient obtained from a bitstream.

Abstract: A video encoding device includes: transform means 11 for transforming an image block; entropy encoding means 12 for entropy-encoding transformed data of the image block transformed by the transform means 11; PCM encoding means 13 for PCM-encoding the image block; multiplex data selection means 14 for selecting output data of the entropy encoding means 12 or the PCM encoding means 13, in a block of a block size set from the outside; and multiplexing means 15 for embedding a PCM header in a bitstream, in the block of the set from the outside block size.

Abstract: An example method of entropy coding video data includes determining a window size of a plurality of window sizes for a context of a plurality of contexts used in a context-adaptive coding process to entropy code a value for a syntax element of the video data; entropy coding, based on a probability state of the context, a bin of the value for the syntax element; updating a probability state of the context based on the window size and the coded bin. The example method also includes entropy coding a next bin with the same context based on the updated probability state of the context.

Abstract: A decoding apparatus includes a splitter which splits the image into a plurality of maximum coding units, hierarchically splits a maximum coding unit among the plurality of maximum coding units into a plurality of coding units, and determines one or more transformation residual blocks from a coding unit among the plurality of coding units, wherein the one or more transformation residual blocks include sub residual blocks, a parser which obtains an effective coefficient flag of a sub residual block among the sub residual blocks from a bitstream, the effective coefficient flag of the sub residual block indicating whether at least one non-zero effective transformation coefficient exists in the sub residual block, and when the effective coefficient flag indicates that at least one non-zero transformation coefficient exists in the sub residual block, obtains transformation coefficients of the sub residual block based on location information of the non-zero transformation coefficient and level information of the no

Abstract: To reduce the amount of processing related to coding and decoding of transform coefficients, a sub-block coefficient presence/absence flag indicating whether or not at least one non-zero transform coefficient is included is decoded for each of two or more sub-blocks obtained by dividing a unit region, and a context index of a target sub-block is derived on the basis of transform coefficient presence/absence flags each indicating whether or not a transform coefficient is 0. In accordance with the sub-block coefficient presence/absence flags of adjacent sub-blocks that are adjacent to the target sub-block, the context index of the target sub-block is derived.

Abstract: Method For Implementing A Quantizer In A Multimedia Compression And Encoding System is disclosed. In the Quantizer system of the present invention, several new quantization ideas are disclosed. In one embodiment, adjacent macroblocks are grouped together into macroblock groups. The macroblock groups are then assigned a common quantizer value. The common quantizer value may be selected based upon how the macroblocks are encoded, the type of macroblocks within the macroblock group (intra-blocks or inter-blocks), the history of the motion vectors associated with the macroblocks in the macroblock group, the residuals of the macroblocks in the macroblock group, and the energy of the macroblocks in the macroblock group. The quantizer value may be adjusted in a manner that is dependent on the current quantizer value. Specifically, if the quantizer value is at the low end of the quantizer scale, then only small adjustments are made.

Abstract: A method for encoding a multi-view frame in a video encoder is provided that includes computing a depth quality sensitivity measure for a multi-view coding block in the multi-view frame, computing a depth-based perceptual quantization scale for a 2D coding block of the multi-view coding block, wherein the depth-based perceptual quantization scale is based on the depth quality sensitive measure and a base quantization scale for the 2D frame including the 2D coding block, and encoding the 2D coding block using the depth-based perceptual quantization scale.

Abstract: When rendering a region of a three-dimensional object represented by a base set of polygon vertices in a graphics processing pipeline, a first processing stage uses meta-information representative of the surface relief of the region of the three-dimensional object to determine whether to generate a set of additional polygon vertices over the region of the three-dimensional object, and generates the additional set of polygon vertices (when this is deemed necessary). A second processing stage then uses information representative of the surface relief of the region of the three-dimensional object to modify the positions of one or more of the polygon vertices, before the vertices are assembled into primitives that are then rasterised and rendered.

Abstract: A video processing device receives video data and transmits the video to a display device at a new bit rate that is dynamically adjusted based on variable conditions. The new bit rate is adjusted, at least, by scaling the video and/or a residual image and may be adjusted utilizing compression functions, compression parameters, scale factor, frame rate, color space, and chroma sub-sampling. The display receives video at the adjusted new bit rate and decompresses the video in accordance with corresponding adjustments in the video processing device. Bit rate determination is based on variable operating conditions, display information, image quality, BER, packet error, SNR, desired level of compression, energy consumption, link congestion and display capabilities. Video may be scaled prior to compression. The video may comprise a frame and/or a slice. DPCM, H.264, AVC, transform compression and scaling may be utilized. The display may utilize intra-frame spatial prediction.

Abstract: Disclosed are image quantization parameter decoding method and systems for decoding a quantization parameter for a video decoding process that is based on context-based adaptive binary arithmetic coding. In one embodiment, an image quantization parameter decoding method includes binary-arithmetic-decoding a first bin indicating whether or not a delta quantization parameter is significant, other bins, which are subsequent to the first bin, indicating an absolute value of the delta quantization parameter, and a sign bin, which is subsequent to the other bins, indicating whether the delta quantization parameter is positive or negative. The method further includes generating a delta quantization parameter by de-binarizing the first bin, the other bins and the sign bin. The method further includes generating a re-constructed quantization parameter by adding a predicted quantization parameter to the delta quantization parameter.

Abstract: Provided are a method and apparatus for intra predicting an image, which generate a prediction value via linear interpolation in horizontal and vertical directions of a current prediction unit. The method includes: generating first and second virtual pixels by using at least one adjacent pixel located upper right and lower left to a current prediction unit; obtaining a first prediction value of a current pixel via linear interpolation using an adjacent left pixel located on the same line as the first virtual pixel and the current pixel; obtaining a second prediction value of the current pixel via linear interpolation using an adjacent upper pixel located on the same column as the second virtual pixel and the current pixel; and obtaining a prediction value of the current pixel by using the first and second prediction values.

Abstract: A method for regulating output from stream operators performing a windowing operation may include receiving stream of tuples to be processed by a plurality of processing elements, each processing element having one or more stream operators. The method may also include receiving a first stream of tuples at a first stream operator, the first stream operator being configured to generate a stream of accumulated tuples according to a set of windowing conditions. The method may then include processing the stream of accumulated tuples in response to a window trigger, where the processing generates a quantity of output. At least one processor may then monitor the quantity of output to determine whether the quantity of output exceeds a data output threshold. The processing may then be adjusted, in response to determining that the quantity of output exceeds the data output threshold, to reduce the output to approach the data output threshold.

Abstract: An image coding method for coding image data on a block-by-block basis includes: segmenting a block including coefficients of frequency components, into groups corresponding to frequency ranges based on types of the coefficients, and determining a context corresponding to each of the groups; performing, for each of the coefficients, binary arithmetic coding on the coefficient according to a probability information item corresponding to the context, the context being corresponding to the group having the coefficient; and updating, for each of probability information items, the probability information item corresponding to the context, based on the coefficient included in the group corresponding to the context, wherein in the segmenting, the block is segmented into the groups with various numbers of coefficients.

Abstract: The present invention relates to an image processing apparatus and method that can improve encoding efficiency while preventing an increase in load. An extraction circuit 71 of a filtering prediction circuit 64 extracts motion compensation images for generating a prediction image in a high-resolution enhancement layer from reference frames in a low-resolution base layer. A filtering circuit 72 of the filtering prediction circuit 64 performs filtering, which involves upconversion and which uses analysis in the time direction, on a plurality of motion compensation images in the base layer extracted by the extraction circuit 71 to generate a prediction image in the enhancement layer. The present invention can be applied to, for example, an encoding apparatus and a decoding apparatus.

Abstract: Provided are a method and apparatus for intra predicting an image, which generate a prediction value via linear interpolation in horizontal and vertical directions of a current prediction unit. The method includes: generating first and second virtual pixels by using at least one adjacent pixel located upper right and lower left to a current prediction unit; obtaining a first prediction value of a current pixel via linear interpolation using an adjacent left pixel located on the same line as the first virtual pixel and the current pixel; obtaining a second prediction value of the current pixel via linear interpolation using an adjacent upper pixel located on the same column as the second virtual pixel and the current pixel; and obtaining a prediction value of the current pixel by using the first and second prediction values.

Abstract: Provided are a method and apparatus for intra predicting an image, which generate a prediction value via linear interpolation in horizontal and vertical directions of a current prediction unit. The method includes: generating first and second virtual pixels by using at least one adjacent pixel located upper right and lower left to a current prediction unit; obtaining a first prediction value of a current pixel via linear interpolation using an adjacent left pixel located on the same line as the first virtual pixel and the current pixel; obtaining a second prediction value of the current pixel via linear interpolation using an adjacent upper pixel located on the same column as the second virtual pixel and the current pixel; and obtaining a prediction value of the current pixel by using the first and second prediction values.

Abstract: Provided are a method and apparatus for intra predicting an image, which generate a prediction value via linear interpolation in horizontal and vertical directions of a current prediction unit. The method includes: generating first and second virtual pixels by using at least one adjacent pixel located upper right and lower left to a current prediction unit; obtaining a first prediction value of a current pixel via linear interpolation using an adjacent left pixel located on the same line as the first virtual pixel and the current pixel; obtaining a second prediction value of the current pixel via linear interpolation using an adjacent upper pixel located on the same column as the second virtual pixel and the current pixel; and obtaining a prediction value of the current pixel by using the first and second prediction values.

Abstract: Methods and apparatus are provided for adaptive motion vector candidate ordering for video encoding and decoding. An apparatus includes a video encoder (100) for encoding a block in a picture by selecting an order of motion vector predictor candidates for the block responsive to a characteristic available at both the video encoder and a corresponding decoder. The characteristic excludes a mode in which the block is partitioned.

Abstract: There is provided a computerized method and system of controlling a quality measure in a compression quality evaluation system, the method comprising: calculating a grain value indicative of an extent of grain present in an input image, the grain value being calculated based on one or more features characterizing a base image related to the input image; and configuring the quality measure upon a criterion being met by the value, the quality measure being indicative of perceptual quality of a compressed image compressed from the input image. The calculated grain value may be dependent also on further characteristics of the input image, or in the case of a sequence of images, dependent also on the relation between the image and the preceding image.

Abstract: In a case where a partition mode in which luma signals are partitioned horizontally and vertically is set when an intra prediction of a picture signal is made in units of minimal coding blocks set in advance, an intra prediction unit is configured to make an intra prediction of a chroma signal in units of prediction blocks of the intra prediction of chroma signals within the minimal coding block set in accordance with a chroma format. A second bitstream constructing unit constructs a bitstream of information relating to a luma intra prediction mode of a prediction block of luma signals and information relating to a chroma intra prediction mode of a prediction block of chroma signals.

Abstract: The present invention proposes to provide methods, apparatus and systems for inverse tone mapping of a high dynamic range image. The method may include the operations of obtaining a luminance component of the high dynamic range image. The method may further include determining an HDR to HDR inverse tone mapper operator. The method may further include determining a tone expanded image by applying the HDR to HDR inverse tone mapper to the luminance component of the high dynamic range image. The method may further include wherein the HDR to HDR inverse tone mapper curve comprises a linear part for dark and mid-tone levels, and an expanding non-linear part for highlights. The system or apparatus may be configured to perform the operations of the method.

Abstract: Techniques related to content adaptive entropy coding are described. A technique for video coding may include obtaining first and second video data for entropy encoding such that the first and second video data comprise different data types, determining a first entropy encoding technique for the first video data such that the first entropy encoding technique comprises at least one of an adaptive symbol-run video length coding technique or an adaptive proxy variable length coding technique, entropy encoding the first video data using the first encoding technique to generate first compressed video data and the second video data using a second encoding technique to generate second compressed video data, and assembling the first compressed video data and the second compressed video data to generate an output bitstream.

Abstract: A codec according to an exemplary embodiment includes a codec processor which receives a current frame, determines a type of a received current frame, and sets rate control parameters of the current frame, and a bit-rate estimator which allocates total target bits to a first group of picture (GOP) including the current frame, and allocates a target bit to each of frames included in the first GOP based on a determined type of the current frame and set rate control parameters.