Abstract: One embodiment provides for a display system to generate and display data on a display device, the display system comprising one or more graphics processors to generate one or more frames of data for display on the display device; a window manager to submit a request to display the one or more frames of data; a display engine to present the one or more frames of data to the display device for display; and display logic to receive the request to display the one or more frames of data and generate one or more display events for the display engine based on the request to display the one or more frames of data, wherein the display logic is to manage a set of statistics associated with the request.

Abstract: Disclosed is a method and apparatus for constructing and playing a sensory effect media data file, which includes information on sensory effects. A method for constructing a sensory effect media data file according to an embodiment of the present invention includes: inserting first composition information, which represents a property of media data, into a composition information container field; inserting second composition information, which represents a property of sensory effect data, into the composition information container field; inserting a sample of the media data into a media data field, where the sample represents data associated with a timestamp; and inserting a sample of the sensory effect data into the media data field.

Abstract: An apparatus for coding video data according to certain aspects includes a memory unit and a processor in communication with the memory unit. The memory unit stores video data. The video data may include a base layer comprising samples with a lower bit depth and an enhancement layer comprising samples with a higher bit depth. The processor predicts the values of samples in the enhancement layer based on the values of samples in the base layer. The prediction performed by the processor includes applying a preliminary mapping to the base layer samples to obtain preliminary predictions, and then applying adaptive adjustments to the preliminary predictions to obtain refined predictions. Parameters used for the adaptive adjustments may depend on the values and distribution of base layer samples. The processor may encode or decode the video data.

Abstract: Techniques for delivery and presentation/display of audio-visual signals over electronic communications network channels are disclosed herein. In an exemplary embodiment, a video server for an IPTV system is disclosed. The system includes a video extractor/transporter (shortly referred to as video extractor) for extracting encoded audio-visual signals from at least one video source, and distributing the signals over the electronic communications network channels. The system also includes control logic which can receive control messages from receivers and invoke the video extractor to extract audio-visual signals therefrom.

Abstract: Techniques for delivery and presentation/display of audio-visual signals over electronic communications network channels are disclosed herein. In an exemplary embodiment, a video server for an IPTV system is disclosed. The system includes a video extractor/transporter (shortly referred to as video extractor) for extracting encoded audio-visual signals from at least one video source, and distributing the signals over the electronic communications network channels. The system also includes control logic which can receive control messages from receivers and invoke the video extractor to extract audio-visual signals therefrom.

Abstract: A 3D graphics rendering pipeline is used to carry out data comparisons for motion estimation in video data encoding. Video data for the pixel block of the video frame currently being encoded is loaded into the output buffers of the rendering pipeline. The video data for the comparison pixel blocks from the reference video frame is stored as texture map values in the texture cache of the rendering pipeline. Once the sets of pixel data for comparison have been stored, the rendering pipeline is controlled to render a primitive having fragment positions and texture coordinates corresponding to the data values that it is desired to compare. As each fragment is rendered, the stored and rendered fragment data is compared by fragment compare unit and the determined differences in the data values are accumulated in an error term register.

Abstract: A 3D graphics rendering pipeline is used to carry out data comparisons for motion estimation in video data encoding. Video data for the pixel block of the video frame currently being encoded is loaded into the output buffers of the rendering pipeline. The video data for the comparison pixel blocks from the reference video frame is stored as texture map values in the texture cache of the rendering pipeline. Once the sets of pixel data for comparison have been stored, the rendering pipeline is controlled to render a primitive having fragment positions and texture coordinates corresponding to the data values that it is desired to compare. As each fragment is rendered, the stored and rendered fragment data is compared by fragment compare unit and the determined differences in the data values are accumulated in an error term register.

Abstract: A residual picture is produced and encoded that is a residual picture that is a residual signal between a picture to be coded that is an input moving-picture video signal to be subjected to coding and a predictive picture produced from a reference picture that is a local decoded video signal for each of a plurality of rectangular zones, each composed of a specific number of pixels, into which a video area of the moving-picture video signal is divided. A boundary condition of each of a plurality of borders is obtained between the rectangular zones and another plurality of rectangular zones adjacent to the rectangular zones, and a border, of the reference picture, having a boundary condition that matches the boundary condition, is found by motion-vector search in the reference picture, and border motion-vector data is generated that is data on a motion vector from a border of the rectangular zone in the picture to be coded to the border of the reference picture thus found.

Abstract: A system and method are disclosed for streaming scalable video data over a variable-bandwidth network such as a packet-based one. In other words, the number of bits (for FGS) or sub-layers (for discrete multi-layer scalability) is chosen to be transmitted for each enhancement layer frame. Further, these bits or sub-layers are also partitioned over multiple packets if being sent over a packet-based network. Further, a windowing function is used to smooth the variation in the number of bits or sub-layers transmitted for each frame in situations where the network bandwidth is varying.

Abstract: A video coding technique having motion compensation within a fine granular scalable coded enhancement layer. In one embodiment, the video coding technique involves a two-loop prediction-based enhancement layer including non-motion-predicted enhancement layer I- and P-frames and motion-predicted enhancement layer B-frames. The motion-predicted enhancement layer B-frames are computed using: 1) motion-prediction from two temporally adjacent differential I- and P- or P- and P-frame residuals, and 2) the differential B-frame residuals obtained by subtracting the decoded base layer B-frame residuals from the original base layer B-frame residuals. In a second embodiment, the enhancement layer further includes motion-predicted enhancement layer P-frames.

Abstract: Methods and systems for providing a video stream from a server to a client over a network include a memory for storing a forward-encoded bit-stream and a reverse-encoded bit-stream for a video data, The forward-encoded bit-stream includes I-frames encoded without inter-frame dependencies and P-frames encoded depending on forward-direction preceding frames, and the reverse-encoded bit-stream includes I-frames and P-frames encoded depending on reverse-direction preceding frames. When the server receives a request with a video cassette recoding (VCR) function from the client, the server reads out and transmits frames selectively from among the first, second, third, and fourth frames in accordance with the request. The server can select the closest I-frame to a requested frame in an either bit-stream for a fast-mode play or a random-access play, and switch the bit-streams to use subsequent P-frames in a different direction than that of the closest I-frame.

Abstract: An improved loss recovery method for coding streaming media classifies each data unit in the media stream as an independent data unit (I unit), a remotely predicted unit (R unit) or a predicted data unit (P unit). Each of these units is organized into independent segments having an I unit, multiple P units and R units interspersed among the P units. The beginning of each segment is the start of a random access point, while each R unit provides a loss recovery point that can be placed independently of the I unit. This approach separates the random access point from the loss recovery points provided by the R units, and makes the stream more impervious to data losses without substantially impacting coding efficiency. The most important data units are transmitted with the most reliability to ensure that the majority of the data received by the client is usable. The I units are the least sensitive to transmission losses because they are coded using only their own data.

Abstract: The present invention provides an apparatus and method for encoding, storing, transmitting and decoding multimedia information in the form of scalable, streamed digital data. A base stream containing basic informational content and subsequent streams containing additive informational content are initially created from standard digital multimedia data by a transcoder. Client computers, each of which may have different configurations and capabilities are capable of accessing a stream server that contains the scalable streamed digital data. Each different client computer, therefore, may access different stream combinations according to a profile associated with each different client computer. Thus, the streams accessed from the server are tailored to match the profile of each client computer so that the best combination of streams can be provided to maximize the resolution of the 3D, audio and video components.

Abstract: An image processing system is adapted to display pixel data for a specified small area on a screen. The system decodes compressed picture data represented in terms of coded differential data, and includes a plurality of decoding sections operating at a time in one clock for decoding the data of a pixel outside the specified area for high-speed decoding. In the specified area, the decoding sections operate in number corresponding to an enlargement/reduction ratio for the image in the specified area.

Abstract: An image is coded by counting runs of non-background picture elements, and counting consecutive scanning lines having only background picture elements. Consecutive scanning lines of this type are coded as a single command and value, giving the number of scanning lines. Consecutive scanning lines having identical numbers of runs of non-background picture elements are coded as another single command and value, giving the run count, followed by run information describing each run. Sparse images, consisting mostly of background area, can be coded efficiently in this way.