Abstract: Disclosed herein is a method for decoding a video signal having at least one frame with a plurality of blocks including a current block, including generating, for at least a selected pixel in the current block, a predicted value for at least one pixel located in a row i and a column j of the current block using a processor and according to the following equation: Xij=Li+Aj?C; wherein Xij is the predicted value, Li is the value of a pixel to the left of the current block, Aj is the value of a pixel in a row above the current block and C is the value of a pixel in the row above and the column to the left of the current block and decoding the current block using the predicted value.

Abstract: A method of predicting a portion of an image, for encoding or decoding of an image, the image portion being predicted by an intra prediction process with respect to samples of at least one reference image portion of the image, the method comprising deriving samples from at least one reference image portion; generating, from said derived samples, by the intra prediction process, at least one prediction image portion corresponding to the image portion to be predicted; and applying a parametric displacement transformation to at least the derived samples and/or the prediction image portion. A method and device for encoding and a method an device for decoding are also described.

Abstract: A method and apparatus for variable accuracy inter-picture timing specification for digital video encoding is disclosed. Specifically, the present invention discloses a system that allows the relative timing of nearby video pictures to be encoded in a very efficient manner. In one embodiment, the display time difference between a current video picture and a nearby video picture is determined. The display time difference is then encoded into a digital representation of the video picture. In a preferred embodiment, the nearby video picture is the most recently transmitted stored picture. For coding efficiency, the display time difference may be encoded using a variable length coding system or arithmetic coding. In an alternate embodiment, the display time difference is encoded as a power of two to reduce the number of bits transmitted.

Abstract: There are provided methods and apparatus for video coding. Using the method, a video encoder (100) performs filtering of at least one reference picture to obtain at least one filtered reference picture (310), and predictively codes the picture using the at least one filtered reference picture (315). In an exemplary embodiment, the filtering is done using parametric filtering.

Abstract: Provided are a method and apparatus for encoding an image, which can variably encode a residual of a current block that is predicted with a skip mode according to prediction modes of neighboring blocks, and a method and apparatus for decoding the encoded image. When both the prediction mode of the current block and the prediction modes of the neighboring blocks are skip modes, since the method of encoding the image also encodes the residual of the current block that is predicted with the skip mode, more bits can be assigned to the current block with a high probability of acting as a reference block for other blocks.

Abstract: The invention is related to the generation of an image data stream and the reconstruction of an image from an image data stream. The method for generating an image data stream comprises the steps of (a) assigning search regions in a reference image to source macro blocks of a current image; (b) determining in the search regions best matches and corresponding residuals and (c) encoding the determined residuals in a data stream. A further feature of the method is related to the fact that the processing order in at least one of the steps (b) and (c) depends on positions of the assigned search regions in the reference image. The variation in the processing order allows for more efficient determination of best matches at encoder side and/or reduced processing requirements at decoder side.

Abstract: Architecture that employs texture sensitive temporal filtering to reuse motion estimation information in a realtime encoder. The temporal filter is applied for classified static areas. The architecture reuses the motion estimation results on motion vectors, cost estimates (e.g., sum of absolute difference (SAD)), and edge awareness texture information to apply the temporal filter on the current picture. Filtering can be applied at the pixel level, block level or macroblock level.

Abstract: A device, computer program product, and method control the operation of one or more cameras associated with a video conference endpoint in a video conference call. A camera control unit (remote control) includes a touch enabled end user component that presents to the user graphical objects representing video conference endpoints currently connected in a conference call, and/or one or more live video feeds currently captured by the video conference endpoint's cameras, and allows the user to manipulate a camera's pan, tilt and zoom using a touch screen display embedded in said camera control unit.

Abstract: Provided are a motion estimation apparatus and method and an image encoding apparatus and method employing the same. The motion estimation apparatus includes an optimal motion estimation unit performing motion estimation in an initial block mode while skipping remaining block modes excluding the initial block mode from a plurality of block modes of the current block, or performing motion estimation in candidate block modes determined from the plurality of block modes.

Abstract: A prediction mode selection unit selects, before a pixel subject to encoding is encoded, a prediction mode used to encode the pixel subject to encoding, using a local decoded value of a pixel on a line preceding a line including the pixel subject to encoding by at least 1 line in the order of encoding and in accordance with a predetermined conditional expression, and determines a prediction mode index corresponding to the selected prediction mode. A prediction mode index storage unit stores the prediction mode index. A prediction unit generates a predicted value for the pixel subject to encoding, based on the prediction mode index for the pixel subject to encoding read from the prediction mode index storage unit and using local decoded values of a plurality of adjacent pixels.

Abstract: The invention facilitates the use of low resolution estimation to identify an optimal sequence of frame types for encoding a stream of video data. In one embodiment a series of video frames are downscaled and divided into superblocks. Low resolution motion estimation metrics are calculated for the superblocks and compared to corresponding superblocks of a previous frame. A series of video frame types is selected based on the comparison metrics and used to encode the video frames.

Abstract: An apparatus generally including a first circuit and a second circuit is disclosed. The first circuit may be configured to generate an intermediate bitstream by parsing a Joint Picture Expert Group (JPEG) bitstream carrying a picture. The intermediate bitstream generally includes one or more encoded frames each representing a portion of the picture. The second circuit may be configured to (i) generate one or more intermediate images by decoding the encoded frames and (ii) recreate the picture using the intermediate images.

Abstract: A Method and apparatus for encoding and decoding a multi-view image are provided. The method of encoding a multi-view image includes determining whether each of pictures included in multi-view image sequences is a reference picture referred to by other pictures included in the multi-view image sequences for inter-view prediction, and encoding the pictures using at least one of inter-view prediction and temporal prediction based on the determination result, thereby efficiently encoding and decoding the multi-view image at high speed.

Abstract: A method of transmitting three dimensional video information over an interface from a playback device to a displaying device, the displaying device and the interface such that the properties of the displaying device can be queried over the interface, the method comprising determining one or more video format in which a compressed three dimensional video information is available to an input of the playback device, the three dimensional video information available either as stored on a record medium or received via a data transmission system; querying the displaying device over the interface with respect to one or more three dimensional video formats which the displaying device is able to process; selecting a best matching video format, wherein the best matching video format different from at least one available video format, the selection of the best matching video format based on the available video format and the video formats which the displaying device is able to process; processing the compressed three di

Abstract: A displacement vector detection unit searches for a signal with high correlation with an encoding target block using a locally-decoded image in an already encoded block so as to calculate, using a signal with the highest correlation as a displacement prediction signal, a displacement vector. A reduced-image displacement vector detection unit searches for a signal with high correlation with the encoding target block using a signal resulting from performing reduction at least either horizontally or vertically for the locally-decoded image in an already encoded block so as to obtain, using the signal with the highest correlation as the displacement prediction signal, the displacement vector indicating the displacement in a screen between a reduced encoding target block and a reduction displacement prediction signal. Then a signal with high correlation with the encoding target block from the displacement prediction signal and the reduction displacement prediction signal is selected as a prediction signal.

Abstract: A method and system for transmitting uncompressed video over a wireless channel by inputting a frame of pixel information, partitioning spatially correlated pixels into different packets, and transmitting the packets separately over a wireless channel. For robust transmission, error detection data can be generated for each packet and appended to each packet before transmission. A receiver receives the transmitted packets and checks if a received packet is corrupt based on the appended error detection data. For a corrupt packet, the receiver corrects the corrupt pixels using pixel information in other received packets containing neighboring pixels to recover each corrupt pixel in the corrupt packet.

Abstract: Encoding and decoding methods are provided to improve the coding efficiency when implementing random access. A recovery point is defined. The encoding method includes: encoding an I-frame to obtain a first reconstructed image; encoding a reference image between the I-frame and the recovery point to obtain a second reconstructed image; refreshing the second reconstructed image to obtain a first refreshed image; using at least one of the first reconstructed image and the first refreshed image as a reference image to encode the corresponding frame at the recovery point. When random access occurs at the I-frame, from the recovery point correct decoding starts at the decoder and the decoded image is consistent with the coded image at the encoder. An encoder, a decoder, and an image processing system are also provided herein.

Abstract: According to a picture coding method, a coded picture is stored, as a reference picture, into a storage unit; commands indicating correspondence between reference pictures and reference indices for designating reference pictures and coefficients used for generation of predictive images are generated; a reference picture being used when motion compensation is performed on a current block in a current picture to be coded is designated by a reference index; a predictive image is generated by performing linear prediction on a block being obtained by motion estimation within the designated reference picture, by use of a coefficient corresponding to the reference index; a coded image signal including a coded signal obtained by coding a prediction error being a difference between the current block in the current picture to be coded and the predictive image, the commands, the reference index and the coefficient is outputted.

Abstract: There is presented a system and method for providing real-time object recognition to a remote user. The system comprises a portable communication device including a camera, at least one client-server host device remote from and accessible by the portable communication device over a network, and a recognition database accessible by the client-server host device or devices. A recognition application residing on the client-server host device or devices is capable of utilizing the recognition database to provide real-time object recognition of visual imagery captured using the portable communication device to the remote user of the portable communication device. In one embodiment, a sighted assistant shares an augmented reality panorama with a visually impaired user of the portable communication device where the panorama is constructed from sensor data from the device.

Abstract: Provided is an image processing system that can uniquely identify a motion vector for each pixel of an interpolation frame and accurately identify a motion vector. A motion vector candidate selection unit (301) sequentially selects predetermined motion vector candidates in an interpolation frame. A differential image generation unit (302), a binary image generation unit (303) and an area image generation unit (304) generate a differential image, a binary image and an area image, respectively, based on a selected motion vector candidate. For each pixel of the interpolation frame, a motion vector determination unit (305) identifies a motion vector candidate with which a pixel value of a pixel in the area image corresponding to the pixel is the largest as a motion vector. A pixel value determination unit (306) determines each pixel value of the interpolation frame by using the motion vector identified for each pixel, thereby generating an interpolation frame.

Abstract: A refresh area is taken advantage of when a series of images are coded using Intra-frame coding and Inter-frame coding, a partial area of an image being forcefully Intra-frame coded (Intra MBs) in the refresh area. As the prediction mode for prediction of the Intra MBs inside the refresh area, a prediction mode is selected where the prediction is executable based on only the image that exists inside the refresh area.

Abstract: A method of performing motion compensation includes dividing at least one frame of image data into blocks, performing phase plane correlation to determine a correlation surface for each block between a first frame and a second frame, using the correlation surfaces for each block in the first frame to produce a global correlation surface for a first frame, using the global correlation surface to produce a refined correlation surface, selecting peaks in the refined correlation surface, and perform sub-pixel motion vector calculations to produce global motion vectors using the peaks.

Abstract: The present invention relates to message encoding. One claim recites a method of providing information to transform a plural-bit message for steganographic encoding, said method comprising: providing a unique plural-bit number; altering the unique plural-bit number; error correction encoding the altered, unique plural-bit number, wherein the error correction encoded, altered, unique plural-bit number comprises information for transforming an independent message. Of course, other claims and combinations are provided too.

Abstract: This disclosure describes techniques for second pass video coding in a multi-pass video coding scenario. The coding modes for some video blocks encoded during a second pass may be changed relative to the coding modes used for such video blocks in the first pass. However, motion information does not change for those video blocks that have the changed modes. In particular, mode changes can be made in the second coding pass relative to the modes used in the first coding pass without changing the manner in which motion information will be derived at the decoder, e.g., due to similarities between the original modes of the first pass and changed modes used in the second pass. The second pass coding techniques may also include quantization parameter adjustments, and the mode changes can cause such quantization parameter adjustments to have more profound refinements effects on the second pass coding.

Abstract: Provided are a method and apparatus for compensating motion of a moving image. The method includes calculating a pixel value of a pixel located between pixels of a reference image corresponding to a current image based on pixel values of the pixels of the reference image by using at least one method from among a plurality of methods, such as a vertical linear filtering, a horizontal linear filtering, and a cubic filtering, of interpolating the pixels of the reference image according to codec information indicating one of a plurality of codecs, such as MPEG4, H.264/AVC, and VC1, and restoring the current image by adding motion compensation data, including the calculated pixel value, and a difference between the reference image and the current image.

Abstract: A method of providing CABAC compliant changes such as watermarks comprises accessing encoded data such as video which comprise at least two blocks; creating or accessing a list of changes to the encoded data that include a direct change to a block; determining motion character or motion vector differential of non-immediate block, non-immediate blocks being adjacent to an immediate block that are immediately adjacent to the block; determining change to the immediate block based on original motion character of the block and the non-immediate block and the motion character of the block that would result from the application of the change; storing the change to the list if the change does not cause a difference to the immediate block; and evaluating other potential changes if other potential changes are available, wherein the other potential changes are subjected to the same process steps as the direct change.

Abstract: Computer processor hardware receives image data specifying element settings for each image of multiple original images in a sequence. The computer processor hardware analyzes the element settings across the multiple original images. The computer processor hardware then utilizes the element settings of the multiple original images in the sequence to produce first encoded image data specifying a set of common image element settings, the set of common image element settings being a baseline to substantially reproduce each of the original images in the sequence.

Abstract: The coded block parameters used to code blocks of image samples into structures called macroblocks are compressed more efficiently by exploiting the correlation between chrominance and luminance blocks in each macroblock. In particular, the coded block pattern for chrominance and luminance are combined into a single parameter for the macroblock and jointly coded with a single variable length code. To further enhance coding efficiency, the spatial coherence of coded block patterns can be exploited by using spatial prediction to compute predicted values for coded block pattern parameters.

Abstract: Aspects of a method and system for signaling and decoding AVS1-P2 bitstreams of different versions are provided. A sequence user data indicating decoding version information such as a decoding version identifier, for example, may inserted into an AVS1-P2 bitstream. The decoding version information may be, for example, AVS1-P2 Rm52j_r1 or AVS1-P2. The AVS1-P2 bitstream may be decoded based on the decoding version information. The sequence user data may be inserted in the AVS1-P2 bitstream during AVS encoding or during AVS1-P2 bitstream transcoding. Upon receiving the AVS1-P2 bitstream, the sequence user data may be detected and extracted to determine the decoding version information. The received encoded AVS1-P2 bitstream may be decoded based on the decoding version information. When no specific decoding version information can be decided, default decoder version information may be used by the video decoder.

Abstract: Techniques for reducing bus traffic during texture decoding of a video bitstream are provided. In one configuration, a wireless communication device (e.g., cellular phone, etc.) comprises a processor configured to execute instructions operative to decode and separate in a bitstream macroblock (MB) information and residual packet data. The residual packet data is used to generate codec-independent non-zero MB-packets having a universal order that is codec independent. The codec-independent non-zero MB-packets and MB information are then used for reconstructing pixels of a respective frame of the video bitstream.

Abstract: A reproduction apparatus includes a reproduction unit that reproduces plural moving image data having different frame rates from a recording medium, an output unit that outputs the reproduced moving image data to a display device, a setting unit that sets one of a first and a second reproduction modes, and a control unit that controls the output unit to select some of frames of the reproduced moving image data and output moving image data of the selected frames according to an instruction for high-speed reproduction. In the first reproduction mode, the control unit selects frames at a predetermined frame interval according to reproduction speed for the high-speed reproduction. In the second reproduction mode, the control unit selects frames at a frame interval determined based on the reproduction speed for the high-speed reproduction and a frame rate of the reproduced moving image data.

Abstract: An automated human action recognition system may automatically recognize one or more actions of a human from 2D input image data representing a sequential series of input images of the human performing the one or more actions. Each input image may be from an unknown viewpoint. A computer memory system may contain 2D reference image data representing a plurality of reference actions which a human may perform. The 2D reference image data may include a plurality of linked sequences of key poses, including a linked sequence of key poses for each reference action. For each reference action, each key pose within the linked sequence of key poses for the reference action may consist essentially of 2D image data that is representative of a human figure performing the reference action at a selected point during the reference action.

Abstract: An image processing method which adaptively reduces compression noise of a digital image and an image processing apparatus using the same are provided. The image processing method determines weight to reduce compression noise of an image based on local information and frame information, and processes the image according to the weight. Therefore, noise is adaptively reduced according to an image, and also noise is reduced with the optimal extent.

Abstract: The present invention relates to generation of an appropriate high-resolution image with respect to a plurality of input images. An image processing apparatus including a unit for acquiring a relative movement amount for each first image between a reference image selected from a plurality of first images and the first images; a unit for generating a fourth image having a first resolution for each first image in accordance with a third image having a second resolution, the relative movement amounts, and image capture characteristics of an image capture device; a unit for acquiring, for each fourth image, an evaluation value indicating a difference between the fourth image and the first image corresponding to the fourth image; and a unit for generating a second image having the second resolution by updating the third image using an update value that is determined using the fourth images in accordance with the evaluation values.

Abstract: A method for calculating a prediction motion vector of a block to be coded, by performing a median operation using motion vectors of neighboring blocks. If one of the neighboring blocks has motion vectors MV1 and MV2, direction (forward or backward) information of reference pictures referred to, respectively, by the motion vectors are acquired and one of the motion vectors is selected with reference to the acquired direction information. Then, the median operation including the selected motion vector is performed to obtain the prediction motion vector of the block to be coded.

Abstract: An image encoding method using a Binary Partition Tree (BPT) includes performing the BPT on a reference frame, detecting blocks, each having a difference in a pixel value exceeding a threshold value in a current frame, based on a result of the BPT of the reference frame, and performing the BPT of the current frame on the detected blocks. In accordance with the present invention, block partition is not applied to all frames, but a partial partition method based on a difference between the pixel values of a reference frame and a current frame to be encoded is provided. Accordingly, the encoding speed within the P frame or the B frame can be improved. Furthermore, the PSNR of a corresponding frame can be maintained within a specific range of the PSNR of a reference frame, and a compression effect can be improved.

Abstract: In one embodiment, the apparatus includes a decoder. The decoder is configured to obtain first and second motion vectors of at least one block other than the current block. The other blocks neighbor the current block at one of a left, top and top right position. The decoder is configured to determine a direction of the first and second motion vectors of the other blocks. The decoder is configured to determine first and second predication motion vectors of the current block based on the determined directions. The decoder is configured to determine the first and second predication motion vectors by applying a median operation to the first motion vectors of the other blocks and applying a median operation to the second motion vectors of the other blocks.

Abstract: For encoding of a picture whose macroblock is divided into parts of various sizes, a picture encoding method is provided to appropriately reduce a coding amount of a motion vector, without lowering coding efficiency. In order to reduce a processing amount and an increase of a coding amount, which result from generation of a large number of motion vectors due to bi-directional prediction selected for a small-sized part, a motion estimation unit selects the optimal prediction method from prediction method candidates decided by a prediction-method-candidate determination unit. Thereby, when motion compensation is performed for a large-sized part, forward-directional, backward-directional, and bi-directional prediction can be permitted. On the other hand when motion compensation is performed for a small-sized part, the bi-directional prediction is prohibited but the forward-directional or backward-directional prediction is permitted.

Abstract: An image coding method includes: (i) determining, for each of one or more associated blocks, whether to add a motion vector of the associated block to a list, and (ii) adding the motion vector of the associated block to the list when determining that the motion vector of the associated block is to be added to the list; selecting, from the list, a motion vector which is to be merged to a current block; and (i) merging the selected motion vector to the current block, and (ii) coding the current block using the merged motion vector as a motion vector of the current block, and in the determining, it is determined that the motion vector of the associated block is not to be added to the list when an associated picture and an associated reference picture match temporally or when a current picture and a current reference picture match temporally.

Abstract: Disclosed is a parallel intra prediction method for video data, including: dividing, by an intra prediction unit, pixels included in at least one prediction unit configuring a coding unit or a sub-coding unit so as to belong to any one of a reference pixel group and a prediction group; generating, by the intra prediction unit, reference sub blocks and prediction sub blocks, respectively, using reference pixels belonging to the reference pixel group and prediction pixels belonging to the prediction pixel group; performing, by the intra prediction unit, encoding processing on the reference sub blocks; and performing, by the intra prediction unit, encoding processing on the prediction sub blocks.

Abstract: The present technology relates to an encoding device and encoding method, and a decoding device and decoding method, whereby encoding efficiency when performing intra prediction can be improved. A candidate prediction image generating unit 41 performs intra prediction processing as to a PU of an image to be encoded, in multiple intra prediction modes, and generates a prediction image. A prediction mode determining unit 43 determines an optimal intra prediction mode of the PU for intra prediction processing. A MostProbableMode generating unit 51 generates a MostProbableMode using a peripheral optimal intra prediction mode. A difference mode generating unit 52 generates optimal difference intra prediction mode information indicating the difference between a number of the optimal intra prediction mode of the PU for intra prediction processing and the MostProbableMode. An intra skip determining unit 45 transmits optimal difference intra prediction mode information.

Abstract: A lossless decoding unit 52 takes quantization parameters of decoded blocks spatially or temporally adjacent to a block to be decoded, as selection candidates, and extracts, from stream information, difference information indicating difference as to a prediction quantization parameter selected from the selection candidates. A quantization parameter calculating unit 59 calculates, from the prediction quantization parameter and the difference information, a quantization parameter of the block to be decoded. Thus, decoding of the image can be performed correctly by calculating a quantization parameter equal to a quantization parameter used at the time of image encoding.

Abstract: A Method and apparatus for encoding and decoding a multi-view image are provided. The method of encoding a multi-view image includes determining whether each of pictures included in multi-view image sequences is a reference picture referred to by other pictures included in the multi-view image sequences for inter-view prediction, and encoding the pictures using at least one of inter-view prediction and temporal prediction based on the determination result, thereby efficiently encoding and decoding the multi-view image at high speed.

Abstract: A method for processing a plurality of motion vectors for a video frame to be interpolated using a first reference frame and a second reference frame, each reference frame having a content map, the method including partitioning the video frame to be interpolated into a plurality of areas; determining a number of motion vectors passing through one area of the plurality of areas based on the content maps of the first reference frame and the second reference frame; and generating a motion vector to assign to the one area based on the number of motion vectors passing through the one area. An apparatus for performing the method is also described.

Abstract: Local motion estimation is described herein. Each picture of a video is partitioned into blocks for the local motion estimation. An extended-block FFT is calculated for each block, where the extended-block denotes that a certain area around the block is also included for applying FFT. Extending the block for FFT helps to account for the motion of objects that are moving into or out of the block. Phase correlation is applied to attain a set of Motion Vector (MV) candidates for the blocks, and a cost function is evaluated for each MV. If no MV candidate produces a cost function below a pre-defined threshold, a hierarchical variable block matching search is applied and the process is repeated with blocks for finer resolution. Also, predictive MV candidates are used during the block matching search along with temporal constraints tracking to select an MV that yields the minimum cost function.

Abstract: In one embodiment, the apparatus includes a decoder. The decoder is configured to obtain at least one motion vector of a block other than the current block. The other block is associated with at least one reference picture indicated by a reference index for a set of multiple reference pictures. The decoder is configured to compare picture output order information of the picture to be decoded with picture output order information of the at least one reference picture, and is configured to predict the motion vector for the current block using said at least one motion vector, based on the comparison.

Abstract: A Method and apparatus for encoding and decoding a multi-view image are provided. The method of encoding a multi-view image includes determining whether each of pictures included in multi-view image sequences is a reference picture referred to by other pictures included in the multi-view image sequences for inter-view prediction, and encoding the pictures using at least one of inter-view prediction and temporal prediction based on the determination result, thereby efficiently encoding and decoding the multi-view image at high speed.

Abstract: Systems and methods for processing image signals are described. One method comprises obtaining a generator signal based on an image signal and determining relative latencies associated with two or more pulses in a pulsed signal using a function of the generator signal that can comprise a logarithmic function. The function of the generator signal can be the absolute value of its argument. Information can be encoded in the pattern of relative latencies. Latencies can be determined using a scaling parameter that is calculated from a history of the image signal. The pulsed signal is typically received from a plurality of channels and the scaling parameter corresponds to at least one of the channels. The scaling parameter may be adaptively calculated such that the latency of the next pulse falls within one or more of a desired interval and an optimal interval.

Abstract: A communicating apparatus is supplied capable of maintaining a receiving corresponding to high communication capability for receiving from all partner apparatuses; reducing the cost of apparatus; and eliminating dependence on an exchange machine.

Abstract: Coding techniques for a video image compression system involve improving an image quality of a sequence of two or more bi-directionally predicted intermediate frames, where each of the frames includes multiple pixels. One method involves determining a brightness value of at least one pixel of each bi-directionally predicted intermediate frame in the sequence as an equal average of brightness values of pixels in non-bidirectionally predicted frames bracketing the sequence of bi-directionally predicted intermediate frames. The brightness values of the pixels in at least one of the non-bidirectionally predicted frames is converted from a non-linear representation.