Abstract: Techniques described herein convert digital images into images suitable for use as coloring book pages and the like. The techniques include applying a smoothing operator to at least one channel image of a digital input image to form at least one smoothed image. A scaling operator is then applied to the at least one smoothed image to form at least one scaled image. A tone equalization operator is then applied to the at least one scaled image to form at least one equalized image. An edge detection operator is then applied to the at least one scaled image to form at least one edge image. In addition, a threshold operator is applied to the at least one edge image to form at least one threshold image. A digital line drawing is then created based at least in part on the at least one threshold image.

Abstract: Provided is an image processing apparatus including a prediction section that generates a predicted value of a color difference component of a pixel of an image to be decoded by using a function of a value of a corresponding luminance component, a coefficient calculation section that calculates a coefficient of the function used by the prediction section by referencing a pixel around a block to which the pixel belongs, and a controller that controls a ratio of a number of reference pixels used by the coefficient calculation section to a block size of the block.

Abstract: Systems and methods for content-protecting video codecs are described. At least one embodiment of the invention comprises a system for protecting video content comprising computer memory comprising a stored set of instructions for processing video data; and at least one microprocessor configured to process the video data according to the stored set of instructions, the stored set of instructions requiring identification of data to be removed, at least a portion of which is essential to obtaining a visually acceptable reproduction of video, the stored set of instructions being further configured to replace removed data with data-hiding values, wherein the visually acceptable reproduction of video cannot be generated without a key that enables recovery of enough of the removed data from the data-hiding values that replaced the removed data.

Abstract: A motion vector derivation unit includes a comparison unit for comparing a parameter TR1 for a reference vector with a predetermined value to determine whether it exceeds the predetermined value or not; a switching unit for switching selection between the maximum value of a pre-stored parameter TR and the parameter TR1 according to the comparison result by the comparison unit; a multiplier parameter table (for multipliers); and a multiplier parameter table (for divisors) for associating the parameter TR1 with a value approximate to the inverse value (1/TR1) of this parameter TR1.

Abstract: A video coder stores only one derived disparity vector (DDV) for a slice of a current picture of the video data. The video coder uses the DDV for the slice in a Neighboring Block Based Disparity Vector (NBDV) derivation process to determine a disparity vector for a particular block. Furthermore, the video coder stores, as the DDV for the slice, the disparity vector for the particular block.

Abstract: A decoder receives a bitstream containing quantized coefficients representative of blocks of video representative of a plurality of pixels and decodes the bitstream using context adaptive binary arithmetic coding that includes at least two decoding modes, the first mode decoding the bitstream based upon a probability estimate which is based upon at least one of spatially and temporally adjacent syntax element values to a current syntax element being decoded, the second mode decoding the bitstream not based upon a probability estimate based upon other syntax elements to the current syntax element being decoded. The coding decodes the current syntax element using the first mode if the current syntax element is intra-coded and selecting between sets probable modes with different probabilities. The coding decodes the current syntax element using the second mode if the current syntax element is intra-coded and if selecting among one of the second set of probable modes.

Abstract: A method for encoding a video stream having a plurality of blocks including a current block. The method includes identifying, from a plurality of previously coded blocks, a plurality of candidate motion vectors; identifying, for the current block, a set of reconstructed pixel values corresponding to a set of previously coded pixel values; determining, for at least one of the plurality of candidate motion vectors, an error value based on the set of reconstructed pixel values and a set of predicted values for the set of previously coded pixel values; and selecting, from the plurality of candidate motion vectors, a reference motion vector for the current block based on the error value.

Abstract: Techniques are described to use a reference motion vector to reduce the amount of bits needed to encode motion vectors for inter prediction. One method includes identifying a candidate motion vector used to inter predict each of a plurality of previously coded blocks to define a plurality of candidate motion vectors, identifying a set of reconstructed pixel values corresponding to a set of previously coded pixels for the current block, and generating, using each candidate motion vector, a corresponding set of predicted values for the set of previously coded pixel values within each reference frame of a plurality of reference frames. A respective error value based on a difference between the set of reconstructed pixel values and each set of predicted values is used to select a reference motion vector from the candidate motion vectors that is used to encode the motion vector for the current block.

Abstract: The invention relates to image block encoding and decoding. More precisely, the invention relates to block prediction using reference blocks of the image. It is proposed a method which comprises using processing means for using at least the block for determining one reference block in an already encoded part of the image, encoding and reconstructing a part of the image, using at least the block for determining one reference block in the reconstructed part and a vector referencing the one reference block, using the one reference block for determining at least one further reference block in the reconstructed part and encoding the determined vector and a residual of the block with respect to a combination of the one and the at least one further reference block. Using the block for determination of the one reference block allows for selecting it such that it resembles the block and correlation with the block is maintained.

Abstract: A method to transmit images of a video sequence over a transmission channel between a transmitter and a receiver of a communication network, the image being composed of several image areas, the method for an image to be transmitted including: identifying image areas of a first type in the image; identifying image areas of a second type in the image; determining a transmission rate for transmission of the image to the receiver as a function of the number of first-type image areas compared with the number of second-type image areas; selecting a coding scheme for each image area as a function of area type; modifying the coding parameters as a function of the determined transmission rate; encoding the image areas by applying the selected coding scheme and the modified coding parameters; and transmitting the image areas at the determined transmission rate. Improved image quality is thus obtained.

Abstract: A method of processing a sequence of frames of multimedia data is presented. The method provides for progressively refreshing the image data. The method includes dynamically selecting portions of frames of the sequence with progressively increasing area to refresh, and excluding non-refreshed areas as potential reference data for other frames.

Abstract: In one example, a device includes a video coder configured to determine, for each reference picture in one or more reference picture lists for a current picture, whether the reference picture is to be included in a plurality of reference pictures based on types for the reference pictures in the reference picture lists, compare picture order count (POC) values of each of the plurality of reference pictures to a POC value of the current picture to determine a motion vector predictor for a current block based on motion vectors of a co-located block of video data in a reference picture of the plurality of reference pictures, determine whether a forward motion vector or a backward motion vector of the co-located block is to be initially used to derive the motion vector predictor, and code a motion vector for the current block of video data relative to the motion vector predictor.

Abstract: According to one embodiment, a prediction unit generates a prediction block to be used for prediction of a coding target block, based on at least one reference block adjacent to the coding target block in the image. Each number of pixels in the coding target block and the prediction block is a power of two. A calculation unit calculates a residual block having residual pixel values between the coding target block and the prediction block. A decision unit decides whether to code the residual block, based on pixel values of at least one of the coding target block, the reference block and the prediction block. A coding unit codes the residual block by variable length coding when the residual block is decided to be coded, and codes a skip flag representing the residual block not being coded when the residual block is not decided to be coded.

Abstract: An image coding method includes: generating a first flag indicating whether or not a motion vector predictor is to be selected from among one or more motion vector predictor candidates; generating a second flag indicating whether or not a motion vector predictor is to be selected from among the one or more motion vector predictor candidates in coding a current block to be coded in a predetermined coding mode, when the first flag indicates that a motion vector predictor is to be selected; and generating a coded signal in which the first flag and the second flag are included in header information, when the first flag indicates that a motion vector predictor is to be selected.

Abstract: An image processing system comprises an image processor having image processing circuitry and an associated memory. The image processor is configured to implement a foreground processing module utilizing the image processing circuitry and the memory. The foreground processing module is configured to obtain one or more images, to estimate a foreground region of interest from the one or more images, to determine a plurality of segments of the foreground region of interest, to calculate amplitude statistics for respective ones of the plurality of segments, to classify respective segments as being respective portions of static foreground objects or as being respective portions of dynamic foreground objects based at least in part on the calculated amplitude statistics and one or more defined patterns for known static and dynamic objects, and to remove one or more segments classified as static foreground objects from the foreground region of interest.

Abstract: A method for video coding is described. Signaling of a maximum number of sub-layers for inter-layer prediction is obtained. A sub-layer non-reference picture is also obtained. It is determined whether a value of a temporal identifier of the sub-layer non-reference picture is greater than the maximum number of sub-layers for inter-layer prediction minus 1. The sub-layer non-reference picture is marked as “unused for reference” if the value of the temporal identifier of the sub-layer non-reference picture is greater than the maximum number of sub-layers for inter-layer prediction minus 1. In some cases a sub-layer non-reference picture is also obtained. It is determined whether a value of a temporal identifier of the sub-layer non-reference picture is greater than the maximum number of sub-layers for inter-layer prediction.

Abstract: Methods and apparatus are presented herein to perform selective and/or scalable complexity control of the video codec, so that the amount of processing resources consumed by a video codec may be increased or reduced. Based on the configurable thresholds set within complexity control algorithms, the nonpredictive and the predictive coding sections of the video codec may be selectively implemented. The configurable thresholds are used to determine whether a desired amount of spatial information, such as texture information or motion information, is present within a video frame.

Abstract: Video data streams can be encoded and decoded using inter or intra prediction. The blocks of a frame can be divided into groups of blocks to be inter predicted and blocks to be intra predicted, and the blocks to be inter predicted are encoded first. The availability of data from the inter predicted blocks can improve the performance of intra prediction over processing the blocks in the scan order since more pixel data is available for intra prediction of some blocks. For example, when the scan order is raster scan order, intra prediction of a block can use pixels peripheral to the bottom and right sides of the block in addition to the pixels peripheral to the top and left sides of the block.

Abstract: In general, in one aspect, a decode order for a group of picture (GOP) frame structure for a video stream is modified to include regenerated P frames. The modified decode order includes a regenerated P frame of a P frame decoded prior to a sequence of B frames after last B frame in the sequence of B frames and before next I or P frame. The frames are decoded in modified decode order by a decode engine. The decoded frames are post processed in a display order (only includes regenerated P frames and does not include initial P frames defined in the decode order) by a post processing engine. The post processing engine may ignore the initial P frames or the decode engine may not forward the initial P frames to the post processing engine. The post processed frames may be prepared for presentation by a display engine.

Abstract: Provided is a method that derives an intra prediction mode of a prediction unit, determines a size of a current block using transform size information, generates a prediction block of the current block according to the intra prediction mode, generating a residual block of the current block according to the intra prediction mode and generating a reconstructed block of the current block using the prediction block and the residual block. The sizes of the prediction block and the residual block are set equal to a size of a transform unit. Therefore, the distance of intra prediction becomes short, and the amount of coding bits of residual block is reduced by generating a prediction block very similar to original block. Also, the signaling bits required to signal intra prediction mode decrease by generating MPM group adaptively according to the neighboring intra prediction modes.

Abstract: An image coding device includes a first block encoder and a second block encoder. The first block encoder compresses input pixel values including first and second input pixel values in a block. The first input pixel value is located at a first position of the block, and the second input pixel value is located at a second position of the block. The second block encoder compresses the input pixel values by the unit block. The first and second block encoders compare the input pixel values based on different methods of compression. The first block encoder outputs the first input pixel value as a first compressed pixel value, and compresses the second input pixel value to a second compressed pixel value.

Abstract: In a case that a pixel shape in a luma domain is not similar to a pixel shape in a chroma domain in an input image, a prediction image that is generated in the reuse of a luma prediction mode is made more accurate. A moving image decoding apparatus 1 includes a gradient deriving unit 1453B that references a chroma gradient definition DEFANG1C, and derives a chroma prediction direction from a prediction mode based on a luma prediction direction.

Abstract: Disclosed is an adaptive transform method based on an in-screen prediction, and an apparatus using the method. A method for encoding an image can comprise a step of determining in-screen prediction mode groups, and a step of transforming by using a different transform method according to the in-screen prediction mode group. As a result, transforming can be performed by applying the different transform method according to the in-screen prediction mode group.

Abstract: Disclosed is an adaptive transform method based on an in-screen prediction, and an apparatus using the method. A method for encoding an image can comprise a step of determining in-screen prediction mode groups, and a step of transforming by using a different transform method according to the in-screen prediction mode group. As a result, transforming can be performed by applying the different transform method according to the in-screen prediction mode group.

Abstract: Selective intra and/or inter-prediction video encoding. Based upon anticipation of a future communication channel rate (e.g., actual physical layer channel rate) or video data rate of a communication channel, a given prediction mode for video encoding may be adaptively selected. Prediction of a future or expected value corresponding to at least one parameter associated with the communication channel (e.g., channel rate, video data rate, etc.) can drive operational mode selection/adaptation in accordance with video coding. Alternatively, one or more actual measured values corresponding to at least one parameter can drive operational mode selection/adaptation in accordance with video coding. In some instances, neither intra-prediction nor inter-prediction is performed in accordance with a non-feedback operational mode, and an input video signal undergoes compression (e.g., without intra-prediction and/or inter-prediction).

Abstract: Disclosed are an intra-prediction method using filtering and an apparatus using the method. An image-decoding method comprises: a step of filtering an n upper reference pixel of a block to be predicted and neighboring pixels of the n upper reference pixel so as to obtain the filtered n upper reference pixel; and a step of filtering an n left reference pixel of a block to be predicted and neighboring pixels of the n left reference pixel so as to obtain the filtered n left reference pixel. According to the present invention, intra-prediction may be efficiently performed to improve image-encoding/decoding efficiency.

Abstract: There are provided a method and apparatus for video error concealment in multi-view coded video using high level syntax. The apparatus includes a decoder for decoding pictures for at least one view corresponding to multi-view video content from a bitstream. The pictures are representative of at least a portion of a video sequence. At least some of the pictures correspond to different time instances in the video sequence. The decoder determines whether any of the pictures corresponding to a particular one of the different time instances are lost using an existing syntax element. The existing syntax element is for indicating a number of coded views in the bitstream, including the at least one view.

Abstract: An image data encoding apparatus and method and an image data decoding apparatus and method are provided. The image data encoding apparatus may perform at least one image prediction with respect to image data, and select a prediction mode for encoding. The image data encoding apparatus may simultaneously perform both intra prediction and color prediction, and thereby may efficiently perform encoding.

Abstract: An image coding apparatus includes a quantization matrix coding unit configured to code quantization matrices, wherein the quantization matrix coding unit is configured to code a difference between a coefficient to be coded and a coefficient adjacent to the coefficient to be coded, and to use, when coding the difference having a positive value, a coding table that uses a code of a bit number equal to or less than that of a code used to code the difference having a negative value having the same absolute value as the absolute value of the positive value.

Abstract: A system, method, and apparatus for encoding and decoding a video signal having at least one frame with a plurality of blocks are disclosed. The method disclosed includes, in one implementation, transforming coefficients in the plurality of blocks, quantizing the transformed coefficients, and ordering the quantized transform coefficients such that zero value coefficients and non-zero value coefficients are grouped together. The method also includes identifying at least one characteristic associated with at least one of the transform coefficients, an encoding process, or a quantization process, determining at least one threshold criteria for a segment, comparing the at least one threshold criteria for the segment with the at least one identified characteristic using a processor, and assigning the at least one block in the plurality of blocks to a segment based on the comparison.

Abstract: A method for transporting data with embedded information is provided. The method is adapted to a data transmission interface for coding an original data and then transporting thereof, including: packing the original data, wherein every N bits form a packet, and N is an integer of at least 4; analyzing whether or not existing a long-run length of long-run data with consecutive same bit data in the packet, wherein when the long-run length is greater than a predetermined length, bit data with a predetermined bit length after an Lth bit of the long-run data is toggled; coding the packet to embed a coding information, wherein the coding information determines whether or not the long-run data has been toggled; and transporting the coded packet.

Abstract: When removing a block distortion occurring in a local decoded image, a loop filtering part 11 of an image coding device carries out a filtering process on each of signal components (a luminance signal component and color difference signal components) after setting the intensity of a filter for removing the block distortion for each of the signal components according to a coding mode (an intra coding mode or an inter coding mode) selected by a coding controlling part 1.

Abstract: An image coding method includes: (i) determining, for each of one or more associated blocks, whether to add a motion vector of the associated block to a list, and (ii) adding the motion vector of the associated block to the list when determining that the motion vector of the associated block is to be added to the list; selecting a motion vector from the list as a motion vector predictor; and (i) coding a current block using a motion vector of the current block, and (ii) coding a difference between the motion vector of the current block and the motion vector predictor, and in the determining, it is determined that the motion vector of the associated block is not to be added to the list when an associated picture and an associated reference picture match temporally or when a current picture and a current reference picture match temporally.

Abstract: A method and apparatus for encoding and decoding motion information. The encoding method includes determining whether motion information of spatial prediction units that are spatially collocated to a current prediction unit and motion information of temporal prediction units that are temporally collocated to the current prediction are available; when the number of the motion information of the spatial prediction units and the motion information of the temporal prediction units is less than a predetermined number, generating additional candidate motion information by using the available motion information of the spatial prediction units and the motion information of the temporal prediction units such that the total number of pieces of candidate motion information is the predetermined number; and decoding motion information of the current prediction unit by using the ‘n’ pieces of motion information.

Abstract: A moving picture coding apparatus includes a counter unit which counts the number of pictures following an intra coded picture; and a motion estimation unit which compares respectively only reference pictures which are the intra coded picture or the following pictures, selected from among a reference picture Ref1, a reference picture Ref2 and a reference picture Ref3 stored in memories, with a picture signal, and determines the reference picture whose inter picture differential value is smallest.

Abstract: There is provided a picture coding device that performs intra prediction coding of a picture signal including a luma signal and a chroma signal in units of blocks and codes information relating to an intra prediction mode. When the intra prediction of a picture signal is made in units of coding blocks, in a case where a chroma format is 4:2:2, in a mode for setting a chroma intra prediction mode in accordance with the luma intra prediction mode, an intra prediction unit sets the chroma intra prediction mode based on the luma intra prediction mode and the chroma format and makes an intra prediction of the chroma signal.

Abstract: There are provided methods and apparatus for transform selection in video coding. An apparatus includes a video encoder for encoding at least a block in a picture by selecting a transform to apply to a residue of the block from a set of two or more available transforms. The transform is selected based on at least one of an inter prediction mode used to predict at least one reference for the block, one or more values corresponding to a motion vector, a value of a residue of one or more previously encoded blocks, a value of prediction data for the block, one or more transform selections of one or more neighboring reconstructed blocks, and a quantization step applied to transform coefficients for the residue of the block.

Abstract: Implementations of independent temporally concurrent video stream coding may include generating a sequence of encoded frames by encoding a plurality of input frames, wherein encoding the plurality of input frames may include generating a first plurality of encoded frames based on the plurality of input frames, the first plurality of encoded frames including a first plurality of intra-coded frames and a first plurality of inter-coded frames, and independently generating a second plurality of encoded frames based on the plurality of input frames, wherein the second plurality of encoded frames includes a second plurality of intra-coded frames and a second plurality of inter-coded frames, such that the first plurality of encoded frames and the second plurality of encoded frames are temporally concurrent, and such that the intra-coded frames from the second plurality of intra-coded frames are temporally nonconcurrent with the intra-coded frames from the first plurality of intra-coded frame.

Abstract: A method and apparatus for encoding and decoding motion information. The encoding method includes determining whether motion information of spatial prediction units that are spatially collocated to a current prediction unit and motion information of temporal prediction units that are temporally collocated to the current prediction are available; when the number of the motion information of the spatial prediction units and the motion information of the temporal prediction units is less than a predetermined number, generating additional candidate motion information by using the available motion information of the spatial prediction units and the motion information of the temporal prediction units such that the total number of pieces of candidate motion information is the predetermined number; and decoding motion information of the current prediction unit by using the ‘n’ pieces of motion information.

Abstract: As a parameter control unit that controls video encoding parameters regarding video encoding in a video encoding unit and transmission channel parameters regarding error correction coding and modulation in a channel coding/modulation unit so as to be linked to each other, a cross layer rate control unit is provided. The cross layer rate control unit performs variable control of the GOP size according to propagation changes by reducing the GOP size when the amount of change in the predicted value of the PHY transmission rate is larger than a determined amount of change and increasing the GOP size when the amount of change in the predicted value of the PHY transmission rate is equal to or less than the determined amount of change.

Abstract: Novel “loss rate” metrics are presented that can be used to indicate the quality of a video stream. These metrics may be determined using a simplified method or by a more sophisticated method, the latter method applying different “weights” (i.e., adjustments) to error computations based on the type of frame involved (i.e., I, P, B). Both methods may produce a video quality score within a given range (e.g., in the range of 0 to 1) where one end of the range indicates a video stream of high quality (i.e., no frames are affected), and the other end indicates a video stream of low quality (i.e., all frames are affected).

Abstract: Provided is an image processing apparatus and method for filling a hole area in an image. The image processing apparatus may include a candidate pixel setting unit to set a plurality of candidate pixels corresponding to at least one hole pixel in a hole area using neighboring pixels around the hole area, and a pixel value determining unit to determine a pixel value of the hole pixel using the plurality of candidate pixels.

Abstract: Provided are a method and apparatus for estimating a motion vector using a plurality of motion vector predictors, an encoder, a decoder, and a decoding method. The method includes calculating spatial similarities between the current block and the plurality of neighboring partitions around the current block, selecting at least one of the neighboring partitions based on the calculated spatial similarities, and estimating a motion vector of the selected partition as the motion vector of the current block.

Abstract: Provided are a method and apparatus for estimating a motion vector using a plurality of motion vector predictors, an encoder, a decoder, and a decoding method. The method includes calculating spatial similarities between the current block and the plurality of neighboring partitions around the current block, selecting at least one of the neighboring partitions based on the calculated spatial similarities, and estimating a motion vector of the selected partition as the motion vector of the current block.

Abstract: When controlling transmission channel parameters and video encoding parameters so as to be linked to each other in video transmission, the video quality on the receiving side is further improved. As a parameter control unit that controls video encoding parameters regarding video encoding in a video encoding unit and transmission channel parameters regarding error correction coding and modulation in a channel coding/modulation unit so as to be linked to each other, a cross layer rate control unit is provided. The cross layer rate control unit performs variable control of the GOP size according to propagation changes by reducing the GOP size when the predicted value of the PHY transmission rate is larger than a determined reference value and increasing the GOP size when the predicted value of the PHY transmission rate is equal to or less than the determined reference value.

Abstract: A decoder receives a bitstream containing quantized coefficients representative of blocks of video representative of a plurality of pixels and decodes the bitstream using context adaptive binary arithmetic coding that includes at least two decoding modes, the first mode decoding the bitstream based upon a probability estimate which is based upon at least one of spatially and temporally adjacent syntax element values to a current syntax element being decoded, the second mode decoding the bitstream not based upon a probability estimate based upon other syntax elements to the current syntax element being decoded. The coding decodes the current syntax element using the first mode if the current syntax element is intra-coded and selecting between sets probable modes with different probabilities. The coding decodes the current syntax element using the second mode if the current syntax element is intra-coded and if selecting among one of the second set of probable modes.

Abstract: There are provided methods and apparatus for transform selection in video coding. An apparatus includes a video encoder for encoding at least a block in a picture by selecting a transform to apply to a residue of the block from a set of two or more available transforms. The transform is selected based on at least one of an inter prediction mode used to predict at least one reference for the block, one or more values corresponding to a motion vector, a value of a residue of one or more previously encoded blocks, a value of prediction data for the block, one or more transform selections of one or more neighboring reconstructed blocks, and a quantization step applied to transform coefficients for the residue of the block.

Abstract: This disclosure describes apparatuses and methods of encoding coefficients associated with a block of video data. In one example, a method may comprise selecting a scan order for the coefficients based on an intra coding mode used to predict the block of video data and a transform block size used in transforming the block of video data, and generating a syntax element to communicate the selected scan order for the block of video data.

Abstract: A direction of regularity, which minimizes a directional energy computed from pixel values of consecutive first and second frames of an input video sequence, is respectively associated with each pixel of the first frame and with each pixel of the second frame. Another direction of regularity (vz), which minimizes a directional energy computed from pixel values of the first and second frames, is also associated with an output pixel (z) of a frame of an output video sequence, located in time between the first and second frames. For processing such output pixel, the respective minimized directional energies for the output pixel, at least one pixel (z?) of the first frame and at least one pixel (z?) of the second frame are compared to control an interpolation performed to determine a value of the output pixel. The interpolation uses pixel values from at least one of the first and second frames of the input video sequence depending on the comparison of the minimized directional energies.

Abstract: A method of decoding an image includes the steps of restoring a residual value by performing inverse quantization and inverse transform on the residual value by entropy decoding a received bit stream, generating a prediction unit by performing intra prediction selectively using one of a plurality of prediction modes on a prediction unit split by conducting at least one of asymmetric partitioning and geometrical partitioning, and restoring an image by adding the residual value to the prediction unit. It may be possible to enhance encoding efficiency of high-resolution images having a resolution of HD or higher by performing intra prediction on the asymmetric partitioning and/or geometrical partitioning.