Abstract: An apparatus has a synchronizing signal generator to which a trigger signal is input and that outputs a first synchronizing signal and a second synchronizing signal based on the trigger signal, an image pickup unit that has an image pickup surface, performs a first image picking-up based on the first synchronizing signal, and performs a second image picking-up based on the second synchronizing signal, and an image pickup element tilting unit that changes the angle of the image pickup surface relative to the optical axis during a period after the first image picking-up and before the second image picking-up.

Abstract: An encoder receives a first image of a first spatial resolution and a second image of a second spatial resolution, wherein both the first image and the second image represent the same scene and the second spatial resolution is higher than the first spatial resolution. A filter is selected to up-sample the first image to a third image with a spatial resolution same as the second spatial resolution. The filtering coefficients for the up-sampling filter are computed by minimizing an error measurement (e.g., MSE) between pixel values of the second image and the third image. The computed set of filtering coefficients is signaled to a receiver (e.g., as metadata). A decoder receives the first image (or its approximation) and the metadata, and may up-sample the first image using the same filter and optimally selected filtering coefficients as those derived by the encoder.

Abstract: A video processing system includes a video transcoder that receives a independent video layer stream and a first dependent video layer stream that requires the independent video layer for decoding, the video transcoder generating a transcoded video signal based at least one of the independent video stream and the dependent video layer stream.

Abstract: A method of compressing a video signal. The method comprises: for each of a plurality of image portions, transforming from a spatial domain representation into a transform domain representation; and for each of a plurality of target image portions to be encoded, determining a respective reference portion, determining a prediction of the target image portion based on the reference portion, and encoding the target image portion based on the prediction. The prediction comprises predicting a non-lateral motion of the target image portion relative to the reference portion based on processing of their transform domain coefficients. The encoding comprises generating an encoded bitstream comprising information about the non-lateral motion for use by a decoder.

Abstract: This disclosure relates to video segment identification and organization based on dynamic characterizations. A media component streams media content to a user device at a rate based at least in part on a congestion window size, and a trickle component determines the congestion window size based at least in part on a set of limiting criteria. The set of limiting criteria can include but is not limited to a queuing delay, a target transmission rate, and/or a packet loss compensation factor.

Abstract: An example image decoding apparatus and method involves acquiring encoded data including an image code sequence corresponding to a slice of a plurality of slices obtained by dividing a picture of a moving image and first timing information indicating a first time at which the slice is to be decoded and no underflow or overflow occurs in a first virtual reception buffer from which the image code sequence is output in a slice unit. The image code sequence is decoded on the basis of the first timing information.

Abstract: A system and method for efficiently performing motion estimation during temporal prediction for coding. When a new frame is presented for coding, an encoder may identify a limited number of pixel blocks within the input frame that are complex. The encoder may perform motion estimation searches to find reference frame(s) that are adequate prediction references for the complex pixel blocks. The encoder may search for prediction references for the remaining pixel blocks of the new frame, confining the search to the reference frame(s) that were selected as prediction references of the complex pixel blocks.

Abstract: A first image stream has a first dynamic range and a first color space. First and the second image streams are received in a layered codec. The second image stream has a second dynamic range, which is higher than the first dynamic range. The first image stream is in the codec's base layer; the second image stream is in its enhancement layer. The first image stream is encoded to obtain an encoded image stream, which is decoded to obtain a decoded image stream. The decoded image stream is converted from the first non-linear or linear color space to a second, different color space to obtain a color converted image stream. A higher dynamic range image representation of the color converted image stream is generated to obtain a transformed image stream. Inverse tone mapping parameters are generated based on the transformed image stream and the second image stream.

Abstract: Methods and systems for providing a universal screen content codec are described. One method includes receiving screen content comprising a plurality of screen frames, wherein at least one of the screen frames includes a plurality of types of screen content. The method also includes encoding the at least one of the screen frames, including the plurality of types of screen content, using a single codec, to generate an encoded bitstream compliant with a standards-based codec. The plurality of types of screen content can include text, video, or image content. Blocks containing the various content types can be individually and collectively encoded.

Abstract: Techniques to perform fast motion estimation are described. An apparatus may comprise a motion estimator operative to receive as input a current frame and a reference frame from a digital video sequence. The motion estimator may generate and output a motion vector. The motion vector may represent a change in position between a current block of the current frame and a matching reference block of the reference frame. The motion estimator may utilize an enhanced block matching technique to perform block matching based on stationary and spatially proximate blocks. Other embodiments are described and claimed.

Abstract: A method comprises encoding a set of frames of multimedia data, encoding null data for a period following the set of frames of multimedia data, modulating the encoded set of frames and the null data, wherein modulating the null data creates a null interval over the period, transmitting the encoded set of frames via a transmitter, and blanking the transmitter during the null interval.

Abstract: An information processing apparatus that generates images for displaying a computer execution result on a display unit of a terminal device connected through a network and that transmits the images to the terminal device. The apparatus includes an image memory that holds the images; a first transmitting unit that transmits the images, a detecting unit that detects an area obtained by updating accumulated changes between frames of the images or a frequency of changes between frames of the images, and a second transmitting unit that compresses the images by a compression method and that transmits the compressed images, when the area or the frequency detected by the detecting unit is larger than or equal to a predetermined threshold, the compression method being different from a compression method for the first transmitting unit.

Abstract: Embodiments of the present invention comprise systems and methods for predicting high dynamic range (HDR) image blocks with block-specific prediction data, where the systems and methods may comprise low dynamic range (LDR) image data and HDR image data for a target image block, where a scaled, offset LDR image block may be combined with HDR residual image block to form an HDR image block corresponding to the target image block.

Abstract: A system and method are described below for encoding interactive low-latency video using interframe coding.

Abstract: Techniques and tools are described for scalable video encoding and decoding. In some embodiments, an input frame is downsampled in terms of sample depth and chroma sampling rate, encoded, and output from the encoder as a base layer bitstream. The base layer bitstream is also reconstructed and upsampled to produce a reconstructed bitstream which is subtracted from the original input frame to produce a residual layer. The residual layer is split and encoded as a sample depth residual layer bitstream and a chroma high-pass residual layer bitstream. To recover the encoded input frame, a decoder receives one or more of these bitstreams, decodes them, and combines them to form a reconstructed image. The use of separate codecs is allowed for the base layer and the enhancement layers, without inter-layer dependencies.

Abstract: One embodiment of the present invention uses an abbreviated blanking period, in comparison to the standard VESA and CEA-EIA blanking periods, in order to send data, including low bandwidth, non-timing information, over one or more channels of the digital video link. By shortening the blanking period, the amount of time available for sending data in each scan line is increased, enabling the system to send more data over each channel. The inactive video portion of a scan line sent during vertical sync may also be used to send additional digital data. Shortening the blanking periods and/or using the inactive video sections of the horizontal scan lines adds to the overall data capacity of the link and may be used to send other digital data, such as multichannel audio, video, control, timing, closed captioning or other digital data.

Abstract: Systems and methods of processing video data are provided. Video data having a series of video frames is received and processed. One or more instances of a candidate feature are detected in the video frames. The previously decoded video frames are processed to identify potential matches of the candidate feature. When a substantial amount of portions of previously decoded video frames include instances of the candidate feature, the instances of the candidate feature are aggregated into a set. The candidate feature set is used to create a feature-based model. The feature-based model includes a model of deformation variation and a model of appearance variation of instances of the candidate feature. The feature-based model compression efficiency is compared with the conventional video compression efficiency.

Abstract: A wireless communication unit comprises a receiver for receiving information from a remote transmitter unit. The receiver comprises a demodulator for demodulating received data packets operably coupled to a decoder arranged to perform a cyclic redundancy check (CRC) on the demodulated received data packets and perform multi-protocol encapsulated (MPE) decoding thereon. The demodulator forwards both valid CRC corrected data packets and non-corrected CRC data packets to the decoder and the decoder is configured to place the MPE non-corrected CRC data packets into Reed Solomon (RS) code words.

Abstract: A live streaming system/method provides cross platform live streaming capabilities to mobile devices. A file format compatible with legacy HTTP infrastructure is used to deliver media over a persistent connection. Legacy client media players can dynamically change the encoded rate of the media delivered over a persistent connection. Standard HTTP servers may be used without modification, leveraging standard media players embedded in mobile devices for seamless media delivery over wireless networks with high bandwidth fluctuations.

Abstract: Data compression and decompression methods for compressing and decompressing data based on an actual or expected throughput (bandwidth) of a system. In one embodiment, a controller tracks and monitors the throughput (data storage and retrieval) of a data compression system and generates control signals to enable/disable different compression algorithms when, e.g., a bottleneck occurs so as to increase the throughput and eliminate the bottleneck.

Abstract: Disclosed are various embodiments directed to transcoding a bit stream in parallel. A bit stream may be divided into a plurality of segments, where a plurality of transcoders encode at least a portion of the segments in parallel. If encoding is performed using variable bit rate (BR) encoding, each encoder may encode a segment and vary a BR for the segment. A measured average BR is compared with a target average BR to determine whether to adjust a video quality level (VQL) or any other encoder parameter. A relatively constant subjective quality may be maintained using variable BR encoding while achieving a target average BR. When using constant BR encoding, a VQL or other encoder parameter is used by encoders to achieve relatively constant subjective quality. For example, a relatively continuous quantization parameter between adjacent encoded segments may be achieved.

Abstract: Techniques and tools for encoding and decoding motion vector information for video images are described. For example, a video encoder yields an extended motion vector code by jointly coding, for a set of pixels, a switch code, motion vector information, and a terminal symbol indicating whether subsequent data is encoded for the set of pixels. In another aspect, an encoder/decoder selects motion vector predictors for macroblocks. In another aspect, a video encoder/decoder uses hybrid motion vector prediction. In another aspect, a video encoder/decoder signals a motion vector mode for a predicted image. In another aspect, a video decoder decodes a set of pixels by receiving an extended motion vector code, which reflects joint encoding of motion information together with intra/inter-coding information and a terminal symbol. The decoder determines whether subsequent data exists for the set of pixels based on e.g., the terminal symbol.

Abstract: A system for encoding a video stream into a processed video signal that includes at least one image, includes a region identification signal generator for detecting a region of interest in the at least one image and generating a region identification signal when the pattern of interest is detected. An encoder section generates the processed video signal based on the operation of a plurality of encoding tools, each having at least one encoder quality parameter. The encoder section adjusts the at least one encoding quality parameter of at least one of the plurality of encoding tools in response to the region identification signal.

Abstract: An audio visual system includes an input unit for receiving data containing video data and audio data and dividing the data into the audio data and the video data, a video decoder for decoding the video data divided by the input unit, an audio decoder for decoding the audio data divided by the input unit, and an output unit for superimposing and outputting the video data decoded by the video decoder and the audio data decoded by the audio decoder. The video decoder or audio decoder has a plurality of data output paths and sets delay times for each of the output paths to synchronize the decoded video data with the decoded audio data.

Abstract: Psychovisual image compression techniques are disclosed that compress pixel data by a fixed compression ratio with little or no perceptual loss of detail. In some implementations, a psychovisual compression process is selected among several psychovisual compression processes based on characteristics of the pixel data. Compression is achieved during encoding by discarding psychovisually unnecessary bits from the pixel data. The psychovisual compression processes can be implemented in hardware and operate on scan lines of pixels captured by the image sensor. The psychovisual compression techniques can be used with image compression techniques to compress further the pixel data.

Abstract: A system for transmitting video from a plurality of transmitters to a plurality of receivers over a shared wireless channel includes a plurality of transmitters each receiving a respective video stream to transmit over the shared wireless channel. Distortion-related information is associated with each of the respective video streams and each of the plurality of transmitters having access to the distortion-related information for the respective video stream while not having access to the distortion-related information for other the video streams. Each of the plurality of transmitters using the respective distortion-related information of the respective the video stream to determine how to modify the video stream for transmission based upon a channel time constraint.

Abstract: Video data signals are encoded such that the encoded video data signal includes at least a primary and at least a secondary video data signal. The primary and secondary video data signals are jointly compressed. The primary video data signal is compressed in a self-contained manner, and the secondary video data signal is compressed using data from the primary video data signal. The jointly compressed video data signal is split into separate bitstreams, at least a primary bitstream including data for the primary video data signal and at least a secondary bitstream including data for the secondary video data signal. The primary and secondary bitstreams are multiplexed into a multiplexed signal, and the primary and secondary signals are provided with separate codes.

Abstract: A moving image encoding method includes outputting encoded data that comprises an image code sequence corresponding to slices of a moving image and first timing information indicating times at which the slices are to be decoded.

Abstract: A temporal motion vector predictor is includable, together with one or more spatial motion vector predictors, in a set of motion vector predictors for a block to encode of a current frame. A method of determining the temporal motion vector predictor comprises selecting as the temporal predictor one motion vector from among motion vectors in a reference block of a reference frame different from the current frame. The reference block is a block of the reference frame collocated with the block to encode or a block of the reference frame neighboring the collocated block. The selection is based on a diversity criterion for achieving diversity among the predictors of the set. This can reduce the motion vector memory requirements with no or no significant additional coding efficiency penalty. Alternatively, even if the motion vector memory is not reduced in size, coding efficiency improvements can be achieved.

Abstract: A method for encoding pictures within a groups of pictures using prediction, where a first reference picture from a group of pictures and a second reference pictures from the subsequent group of pictures are used in predicting pictures in the group of pictures associated with the first reference picture. A plurality of anchor pictures in the group of pictures associated with the first reference picture may be predicted using both the first and second reference pictures to ensure a smooth transition between different groups of pictures within a video frame.

Abstract: An apparatus and method for encoding video data and an apparatus and method for decoding video data are provided. The encoding method includes: splitting a current picture into at least one maximum coding unit; determining a coded depth to output an encoding result by encoding at least one split region of the at least one maximum coding unit according to operating mode of coding tool, respectively, based on a relationship among a depth of at least one coding unit of the at least one maximum coding unit, a coding tool, and an operating mode, wherein the at least one split region is generated by hierarchically splitting the at least one maximum coding unit according to depths; and outputting a bitstream including encoded video data of the coded depth, information regarding a coded depth of at least one maximum coding unit, information regarding an encoding mode, and information regarding the relationship.

Abstract: An apparatus may include a memory to store a video frame, a processor circuit and a selective encoding component for execution on the processor to perform selective encoding of the video frame, the selective encoding to classify the video frame into a primary object region and a background region, and encode the primary object region at a first quality level and the background region at a background quality level, the first quality level to comprise a higher quality level than the background quality level.

Abstract: A method comprises defining a period of time for encoding a set of frames of multimedia data, encoding a first portion of the set of frames of multimedia data at a first encoding rate, encoding a second portion of the set of frames of multimedia data at a second encoding rate, wherein the second encoding rate is less than the first encoding rate so as to create a null interval during the period of time, transmitting the encoded set of frames via a transmitter, and blanking the transmitter during the null interval.

Abstract: A constrained variable rate coding technique limits the number of bits used in an encoding process. A quality setting indicates a maximum level of quality to be used in the encoding process which limits the number of bits used in the encoding process. A bandwidth reclamation factor which indicates an amount of bandwidth to conserve may also be used with the quality setting. The constrained variable rate coding technique using a lower quality encoding process for less complex video data and a higher quality encoding technique for higher quality video data.

Abstract: A scalable encoding apparatus that determines a motion mode of an enhanced layer using motion information of a base layer in a scalable video coding having a structure of the base layer and the enhanced layer. The scalable encoding apparatus includes: a second image detector that detects a current image frame from images input to the enhanced layer; a second motion detector that assigns weight to motion modes of a macro block and macro blocks adjacent to the macro block of the current image frame based on motion mode information and motion vector information obtained from the current image frame of the BASE LAYER, determines motion modes for the current image frame of the enhanced layer by applying the weight and comparing a sum of calculated mode values and a plurality of thresholds, and detects the corresponding motions; and a second motion compensator that compensates the motions detected in the second motion detector to compress the current image frame.

Abstract: A system and method provide a video coding system for adaptively transcoding videos based on video coding complexity (VCC). A VCC engine of the system is configured to generate a measure of how difficult to encode a source video based on a trained VCC model. A video rate-distortion modeling engine of the system is configured to estimate a rate-distortion model and a scaling model. The VCC model, rate-distortion model and the scaling model are trained on a video corpus of the system. The trained VCC model, rate-distortion model and the scaling model are used by an adaptive bitrate transcoding sub-system to transcode a source video with an optimized bitrate and visual quality. The trained VCC model, rate-distortion model and the scaling model are further used by an adaptive resolution transcoding sub-system to transcode a source video with an optimized resolution and visual quality.

Abstract: The use of a picture delimiter that is contained in a NAL unit type value that is reserved in the current AVC or SVC specification. The present invention provides the scalability information for the H.264/AVC base layer in such a manner that bitstreams remain decodable with H.264/AVC decoders. In addition, the picture delimiter of the present invention may contain many other syntax elements that can help in easier processing of bitstreams compared to the plain H.264/AVC bitstream syntax.

Abstract: There are provided video encoders, video decoders, and corresponding methods. A video encoder for encoding video signal data for an image block includes an encoder for encoding all color components of the video signal data using a common predictor.

Abstract: A method, medium, and apparatus for encoding and/or decoding video by generating a scalable bitstream formed with a base layer bitstream and an enhancement layer bitstream, in order to provide forward compatibility, is described.

Abstract: An information processing apparatus includes: an analysis means for analyzing a code stream in which picture data is encoded during transmission; a dividing position determination means for determining a dividing position of the code stream in accordance with a picture size of the picture data based on an analysis result by the analysis means; and a decoding means for decoding code streams in plural units of division in parallel, which are obtained by the code stream being divided at the dividing position determined by the dividing position determination means.

Abstract: A method and apparatus for variable accuracy inter-picture timing specification for digital video encoding is disclosed. Specifically, the present invention discloses a system that allows the relative timing of nearby video pictures to be encoded in a very efficient manner. In one embodiment, the display time difference between a current video picture and a nearby video picture is determined. The display time difference is then encoded into a digital representation of the video picture. In a preferred embodiment, the nearby video picture is the most recently transmitted stored picture. For coding efficiency, the display time difference may be encoded using a variable length coding system or arithmetic coding. In an alternate embodiment, the display time difference is encoded as a power of two to reduce the number of bits transmitted.

Abstract: There are provided video encoders, video decoders, and corresponding methods. A video encoder for encoding video signal data for an image block includes an encoder for encoding all color components of the video signal data using a common predictor. A video decoder for decoding video signal data for an image block includes a decoder for decoding all color components of the video signal data using a common predictor. Additionally, an apparatus and method for encoding and decoding signal data for an image block includes an encoder and decoder for encoding/decoding color components of the video signal data without applying a residual color transform thereto. Furthermore, a video encoder and decoder for encoding/decoding video signal data for an image block includes an encoder and decoder for encoding/decoding the video signal data using unique predictors for each of color components of the video signal data.

Abstract: A system, apparatus, and method for encoding a plurality of frames in a video stream with temporal scalability. The method includes identifying a non-uniform sequence of time values within a period, determining a frame corresponding to each time value in the non-uniform sequence, within at least one period, and assigning each of the determined frames to one of a plurality of temporal encoding layers.

Abstract: In an image encoding apparatus including an intra-frame prediction unit that executes intra-frame prediction regarding an input image, when locally decoded pixels are not available, pseudo reference pixels are set to calculate an intra-frame-prediction evaluation value, and a method of encoding to be used for a block to be encoded is determined on the basis of the intra-frame-prediction evaluation value.

Abstract: There are provided video encoders, video decoders, and corresponding methods. A video encoder for encoding video signal data for an image block includes an encoder for encoding all color components of the video signal data using a common predictor. A video decoder for decoding video signal data for an image block includes a decoder for decoding all color components of the video signal data using a common predictor. Additionally, an apparatus and method for encoding and decoding signal data for an image block includes an encoder and decoder for encoding/decoding color components of the video signal data without applying a residual color transform thereto. Furthermore, a video encoder and decoder for encoding/decoding video signal data for an image block includes an encoder and decoder for encoding/decoding the video signal data using unique predictors for each of color components of the video signal data.

Abstract: An encoder receives a signal. The encoder utilizes one or more downsample operations to produce downsampled renditions of the signal at successively lower levels of quality in the hierarchy. In a reverse direction, the encoder applies the one or more upsample operations to a downsampled rendition of the signal at a first level of quality to produce an upsampled rendition of the signal at a second level of quality in the hierarchy. The second level of quality is higher than the first level of quality. The one or more upsample operations and one or more downsample operations can be asymmetrical with respect to each other. That is, the function applied during downsampling can differ from the function applied when upsampling. The encoder produces residual data indicating a difference between the downsampled rendition of the signal at the second level of quality and the upsampled rendition of the signal at the second level of quality.

Abstract: A system, method, and apparatus for encoding a frame of video having a plurality of pixels are disclosed. The method includes identifying a plurality of sets of substantially identical adjacent pixels within the frame and determining a number of pixels in each set. The method includes assigning the pixels in each set to one of an enhancement layer or base layer based at least in part on the number of pixels in that set. The method further includes encoding the pixels assigned to the base layer using a first encoding technique and encoding the pixels assigned to the enhancement layer using a second encoding technique.

Abstract: A video transmission method is provided, which includes receiving state information from at least one mobile terminal that intends to perform a video stream service through a wireless network, determining a size of an image by selecting a specified spatial layer bit stream on the basis of the state information of the mobile terminal from a plurality of spatial layer bit streams generated at different bit rates during encoding of the bit stream, selecting a specified time and an SNR layer bit stream by increasing or decreasing time of the image and a layer position of the SNR layer bit stream on the basis of network parameters included in the state information of the mobile terminal, and transmitting the bit stream generated by extracting the specified layer bit stream of the selected layer to the mobile terminal.

Abstract: A method of encoding a plurality of adaptive filter coefficients (104, 107, 112) into a bitstream (110). The method comprises the steps of entropy encoding (109) the adaptive filter coefficients (104, 107, 112) into the bitstream (110), whereby a prediction (202) for an instance (204) of the adaptive filter coefficients is determined (201) based on at least one of the remaining adaptive filter coefficients (206), a prediction error (205) is determined (203) based on the difference between the instance (204) of the adaptive filter coefficients and the prediction (202), and wherein the step of entropy encoding (109) the plurality of adaptive filter coefficients (104, 107, 112) comprises entropy encoding (109) the prediction error (205) for the instance (204) of the adaptive filter coefficients and entropy encoding (109) the remaining adaptive filter coefficients (206).

Abstract: A method and an apparatus of compressing image data are provided. The method of compressing data comprises calculating differences between values of predetermined pixels from among pixels constructing an image and values of reference pixels respectively corresponding to the predetermined pixels; ordering bits, which correspond to bit strings of the differences, into bit planes; and coding the bit planes according to priority of the bit planes.