Abstract: An interactive video/multimedia application (IVM application) may specify one or more media assets for playback. The IVM application may define the rendering, composition, and interactivity of one or more the assets, such as video. Video multimedia application data (IVMA data may) be used to define the behavior of the IVM application. The IVMA data may be embodied as a standalone file in a text or binary, compressed format. Alternatively, the IVMA data may be embedded within other media content. A video asset used in the IVM application may include embedded, content-aware metadata that is tightly coupled to the asset. The IVM application may reference the content-aware metadata embedded within the asset to define the rendering and composition of application display elements and user-interactivity features. The interactive video/multimedia application (defined by the video and multimedia application data) may be presented to a viewer in a player application.

Abstract: Techniques related to content adaptive, characteristics compensated prediction for video coding are described.

Abstract: Techniques related to content adaptive prediction and entropy coding of motion vectors are described.

Abstract: Techniques related to matched filtering of prediction and reconstruction signals for video coding are described.

Abstract: A system and method of removing noise in a bitstream is disclosed. Based on the segment classifications of a bitstream, each segment or portion is encoded with a different encoder associated with the portion model and chosen from a plurality of encoders. The coded bitstream for each segment includes information regarding which encoder was used to encode that segment. A circuit for removing noise in video content includes a first filter connected to a first input switch and a first output switch, the first filter being in parallel with a first pass-through line, a second filter connected to a second input switch and a second output switch, the second filter connected in parallel with a second pass-through line, and a third filter connected to a third input switch in a third output switch.

Abstract: A predictive video coder performs gradient prediction based on previous blocks of image data. For a new block of image data, the prediction determines a horizontal gradient and a vertical gradient from a block diagonally above the new block (vertically above a previous horizontally adjacent block). Based on these gradients, the encoder predicts image information based on image information of either the horizontally adjacent block or a block vertically adjacent to the new block. The encoder determines a residual that is transmitted in an output bitstream. The decoder performs the identical gradient prediction and predicts image information without need for overhead information. The decoder computes the actual information based on the predicted information and the residual from the bitstream.

Abstract: Techniques related to content adaptive entropy coding of partitions data are described.

Abstract: Techniques related to intra video frame or image coding using wavelets and High Efficiency Video Coding (HEVC) are discussed. Such techniques may include wavelet decomposition of a frame or image to generate subbands and coding the subbands using compliant and/or modified HEVC coding techniques.

Abstract: Techniques related to intra video frame or image coding using wavelets and (Advanced Video Coding) AVC, modified AVC, VPx, modified VPx, or modified High Efficiency Video Coding (HEVC) are discussed. Such techniques may include wavelet decomposition of a frame or image to generate subbands and coding the subbands using compliant and/or modified coding techniques.

Abstract: Techniques related to intra video frame or image coding using wavelets and variable size transform coding are discussed. Such techniques may include wavelet decomposition of a frame or image to generate subbands and coding partitions of the frame or image or subbands based on variable size transforms.

Abstract: A number of novel configurations for MPEG-4 playback, browsing and user interaction are disclosed. MPEG-4 playback systems are not simple extensions of MPEG-2 playback systems, but, due to object based nature of MPEG-4, present new opportunities and challenges in synchronized management of independent coded objects as well as scene composition and presentation. Therefore, these configurations allow significantly new and enhanced multimedia services and systems. In addition, MPEG-4 aims for an advanced functionality, called Adaptive Audio Visual Session (AAVS) or MPEG-J. Adaptive Audio Visual Session (AAVS) (i.e., MPEG-AAVS, MPEG-Java or MPEG-J) requires, in addition to the definition of configurations, a definition of an application programming interface (API) and its organization into Java packages. Also disclosed are concepts leading to definition of such a framework.

Abstract: A method and apparatus prioritizing video information during coding and decoding. Video information is received and an element of the video information, such as a visual object, video object layer, video object plane or keyregion, is identified. A priority is assigned to the identified element and the video information is encoded into a bitstream, such as a visual bitstream encoded using the MPEG-4 standard, including an indication of the priority of the element.

Abstract: A method and apparatus for performing motion estimation in a digital video system is disclosed. Specifically, the present invention discloses a system that quickly calculates estimated motion vectors in a very efficient manner. In one embodiment, a first multiplicand is determined by multiplying a first display time difference between a first video picture and a second video picture by a power of two scale value. This step scales up a numerator for a ratio. Next, the system determines a scaled ratio by dividing that scaled numerator by a second first display time difference between said second video picture and a third video picture. The scaled ratio is then stored calculating motion vector estimations. By storing the scaled ratio, all the estimated motion vectors can be calculated quickly with good precision since the scaled ratio saves significant bits and reducing the scale is performed by simple shifts.

Abstract: Techniques related to content adaptive entropy coding of modes and reference types data are described.

Abstract: A system and method of removing noise in a bitstream is disclosed. Based on segment classifications of a bitstream, each segment or portion is encoded with a different encoder associated with the portion model and chosen from a plurality of encoders. The coded bitstream for each segment includes information regarding which encoder was used to encode that segment. A circuit for removing noise in video content includes a first filter connected to a first input switch and a first output switch, the first filter being in parallel with a first pass-through line, a second filter connected to a second input switch and a second output switch, the second filter connected in parallel with a second pass-through line, and a third filter connected to a third input switch in a third output switch.

Abstract: A system and method for quality restoration filtering is described that can be used either in conjunction with video coding, or standalone for postprocessing. It uses wiener filtering approach in conjunction with an efficient codebook representation.

Abstract: Techniques related to content adaptive background-foreground segmentation for video coding.

Abstract: A method and apparatus for variable accuracy inter-picture timing specification for digital video encoding is disclosed. Specifically, the present invention discloses a system that allows the relative timing of nearby video pictures to be encoded in a very efficient manner. In one embodiment, the display time difference between a current video picture and a nearby video picture is determined. The display time difference is then encoded into a digital representation of the video picture. In a preferred embodiment, the nearby video picture is the most recently transmitted stored picture. For coding efficiency, the display time difference may be encoded using a variable length coding system or arithmetic coding. In an alternate embodiment, the display time difference is encoded as a power of two to reduce the number of bits transmitted.

Abstract: A method of decoding, composing and rendering a scene. First information is obtained, the first information including a part of a MPEG-4 BIFS scene description stream and at least one coded MPEG-4 media stream. The first information is decoded by invoking a BIFS scene decoder and one or more specific media decoders that are required by the scene. Second information is obtained, the second information including a second part of a BIFS scene description stream that contains a reference to an external application. The second information is decoded by invoking the BIFS scene decoder and an external application decoder. An integrated scene is composed, the integrated scene including one or more decoded MPEG-4 media objects and one or more external application objects specified in the decoded scene descriptions streams. The composed integrated scene is rendered on a display.

Abstract: A method and apparatus for performing motion estimation in a digital video system is disclosed. Specifically, the present invention discloses a system that quickly calculates estimated motion vectors in a very efficient manner. In one embodiment, a first multiplicand is determined by multiplying a first display time difference between a first video picture and a second video picture by a power of two scale value. This step scales up a numerator for a ratio. Next, the system determines a scaled ratio by dividing that scaled numerator by a second first display time difference between said second video picture and a third video picture. The scaled ratio is then stored calculating motion vector estimations. By storing the scaled ratio, all the estimated motion vectors can be calculated quickly with good precision since the scaled ratio saves significant bits and reducing the scale is performed by simple shifts.