Abstract: High quality intraframe-only compression of video can be achieved using rate distortion optimization and without resizing or bit depth modification. The compression process involves transforming portions of the image to generate frequency domain coefficients for each portion. A bit rate for each transformed portion using a plurality of scale factors is determined. Distortion for each portion is estimated according to the plurality of scale factors. A scale factor is selected for each portion to minimize the total distortion in the image to achieve a desired bit rate. A quantization matrix is selected according to the desired bit rate. The frequency domain coefficients for each portion are quantized using the selected plurality of quantizers as scaled by the selected scale factor for the portion. The quantized frequency domain coefficients are encoded using a variable length encoding to provide compressed data for each of the defined portions.

Abstract: Smoothing operations on a three-dimensional geometrical primitive, such as a mesh, are restricted by filtering the set of smoothing vectors to apply a user-selected restriction to the set of vectors. The user-selected restriction limits the set of smoothing vectors according to a normal of a surface corresponding to the primitive. The filtered set of vectors are applied to the primitive to smooth the primitive. Thus, smoothing may be applied proportionally to the convexity or concavity of the surface. Smoothing also may be applied to move a control point of the primitive, such as a vertex in a mesh, only in a direction parallel to the normal of the surface at that control point or perpendicular to the normal of the surface at that control point. Each control point also may be reprojected after smoothing onto the original surface along the normal of the smoothed surface, or the normal of the original surface.

Abstract: A non-linear editing (NLE) system for editing and/or modifying 3D animation information comprises elements represented by clip objects which can be positioned and/or manipulated relative to a time line. The elements can comprise conventional 1D (audio) or 2D (video) information or can comprise 3D animation information which can include animation objects and animation parameters associated with them, as well as 2D renderings of those objects. Positioning and/or manipulation of clip objects representing 3D animation elements can result in alteration of the 2D rendering and or re-rendering of the 3D information, as appropriate.

Abstract: A keyer is provided with a graphical user interface that helps a user visualize the relationship between the key and the image to be processed using that key. A color space swatch is processed by the keyer using the defined key. The output of the keyer as applied to the color space swatch is displayed to the user to illustrate which colors match the defined key. The alpha matte generated by applying the key to the color space swatch also may be displayed. Each pixel in either the color space swatch or the alpha matte generated by applying the key to the color space swatch may be modified to indicate whether its corresponding color is present in the input image or in the preprocessed input image. Luminance processing also may be applied. In particular, the alpha value for a pixel may be adjusted according to the luminance of the pixel according to a user defined function. The alpha matte displayed to the user may include the effects of such luminance processing.

Abstract: An ellipsoid chroma region of a chroma plane may be defined to specify a range of chromas for which a secondary chroma modification is to be applied, and to determine an output chroma for each chroma of the chroma plane based on the ellipsoid chroma region. Further, two or more different-shaped chroma regions of a chroma plane may be defined and manipulated, each chroma region specifying a range of chroma for which a secondary chroma modification is to be applied, and to determine an output chroma for each chroma of the chroma plane based on the two or more different-shaped chroma regions. Also, chroma-matching techniques may be used to define and manipulate the chroma region of a chroma plane that specifies a range of chroma for which a secondary chroma modification is to be applied, and an output chroma may be determined for each chroma of the chroma plane based on the chroma region.

Abstract: Subdividing rotation between two poses in three dimensions may be accomplished in three parts. First, data defining the two poses is obtained from the animation or modeling interface. Second, a path associated with the two poses is determined. Third, using quaternion interpolation, the roll between the two poses is interpolated at intermediate positions along the path. The amount of roll at each of these intermediate positions then may be applied to three dimensional structures used for character rigging.

Abstract: A retiming function that defines a rampable retiming effect is used to generate new audio and video samples at appropriate output times. In particular, for each output time, a corresponding input time is determined from the output time by using the retiming function. The retiming function may be a speed curve, a position curve that maps output times to input times directly or a mapping defining correspondence times between points in the video data and points in the audio data. An output sample is computed for the output time based on at least the data in the neighborhood of the corresponding input time, using a resampling function for the type of media data. Synchronization is achieved by ensuring that the input times determined to correspond to output times for video samples correspond to the input times determined to correspond to the same output times for audio samples.

Abstract: A visual programming interface allows an artist to create real time shaders using a tree of shader nodes. Each shader node represents an operation that can be performed in real time through the real time rendering engine. The visual interface allows the arbitrary combinations of these shader nodes to be made and allows the parameters of the shaders to be manipulated or animated. The visual programming interface may be activated in an interactive animation environment through a designation that a real time shader is to be applied to a surface. By integrating the visual programming interface with an interactive animation environment, an artist can experiment readily with different custom real time shaders. An artist also has the flexibility to create arbitrary real time shader trees and to view them interactively without requiring a programmer to develop or modify a custom shader.

Abstract: Subdividing rotation between two poses in three dimensions may be accomplished in three parts. First, data defining the two poses is obtained from the animation or modeling interface. Second, a path associated with the two poses is determined. Third, using quaternion interpolation, the roll between the two poses is interpolated at intermediate positions along the path. The amount of roll at each of these intermediate positions then may be applied to three dimensional structures used for character rigging.

Abstract: Method and apparatus for selecting samples for presentation on an output device, such as a display or speaker, from a sequence of stored media samples, such as audio or video information. Position information is received from a pointing device, such as a mouse, and translated into direction and magnitude information. A second sample is then retrieved based on this position and magnitude information. This method may be used to implement jog or shuttle controls for a media composer, which may be provided with simulated “inertia” for ease of use.

Abstract: The problem of editing motion data can be solved by providing a way to specify control points (herein called “handles”) along the path of the motion data and to describe the motion data as a combination of layers of information describing the motion in relationship to these handles. A first layer may describe, for each point in the motion data, the distance of the point between the handles. For example, a path between two handles may be defined. Each point in the motion data is closest to a point along that path. That point along the line has a distance to the two handles. These distances may be defined as a percentage of the length of the path. A second layer may describe the offset of points in the motion data from the line between the two handles.

Abstract: Image data having a bit depth of m bits, where m is not a power of two, may be divided into two parts for storage. The first part is the n most significant bits, where n is a power of two. The second part is the k least significant bits, where k=m?n and k<n. For example, 10-bit data may be separated into 8-bit and 2-bit parts. The 8-bit data for a given image is placed in the bitstream as a contiguous block with the end of the data aligned with a memory boundary, such as a page boundary. The 2-bit data is collected into bytes that are placed in the bitstream as a contiguous block. The block of 2-bit data is placed in the bitstream preceding and contiguous with the block of 8-bit data. Padding may be provided to align the beginning of the image data with a memory boundary. The image data for multiple images may be placed in the bitstream contiguously for storage. 10-bit data for an alpha channel, if any, also may be split into 8-bit and 2-bit parts.

Abstract: A graphical user interface for a computer-assisted motion video editing system directs a user through the process of editing a video program. The graphical user interface may also enables a user to plan a video program. Alternatively selectable interfaces within a single window interface, each of which provide a group of planning, capturing, editing, and recording functions can provide such an interface for producing a video program. Other simplifications to the user interface can be provided to assist in editing, such as by maintaining a video display window for displaying the edited video program at a fixed position for all available editing operations. Additionally, video information can be captured directly into a timeline representation of a video program, rather than a bin. Using a storyboard tied to the capturing process, a user is directed through the process of collecting and capturing the video clips to be used in the video program.

Abstract: Multiple applications request data from multiple storage units over a computer network. The data is divided into segments and each segment is distributed randomly on one of several storage units, independent of the storage units on which other segments of the media data are stored. At least one additional copy of each segment also is distributed randomly over the storage units, such that each segment is stored on at least two storage units. This random distribution of multiple copies of segments of data improves both scalability and reliability. When an application requests a selected segment of data, the request is processed by the storage unit with the shortest queue of requests. Random fluctuations in the load applied by multiple applications on multiple storage units are balanced nearly equally over all of the storage units.

Abstract: Two images are analyzed to compute a set of motion vectors that describes motion between the first and second images. A motion vector is computed for each pixel in an image at a time between the first and second images. This set of motion vectors may be defined at any time between the first and second images, such as the midpoint. The motion vectors may be computed using any of several techniques. An example technique is based on the constant brightness constraint, also referred to as optical flow. Each vector is specified at a pixel center in an image defined at the time between the first and second images. The vectors may point to points in the first and second images that are not on pixel centers. The motion vectors are used to warp the first and second images to a point in time of an output image between the first and second images using a factor that represents the time between the first and second image at which the output image occurs.

Abstract: A graphical user interface facilitates color modification of a sequence of segments of moving images on a display of a general purpose computer. The graphical user interface may include a three-image display. The three image display may include a first region on the display for displaying an image from a current segment in the sequence to which a color modification is to be applied, a second region on the display and adjacent to the first region for displaying an image from a previous segment in the sequence before the current segment, and a third region on the display and adjacent to the first region for displaying an image from a next segment in the sequence after the current segment. A function screen allows a user to select a color modification to be performed to the current image. The function screen may include an interface that simultaneously displays a plurality of user modifiable graphs.

Abstract: Methods and system are disclosed for archiving and forwarding multimedia data. A server can receive multimedia data for a project from any number of users. The server can archive or store the multimedia data in a database for later access. The server can distribute the received multimedia data to users associated with the project. The server can also distribute the multimedia data in the database to individual users associated with the project at different instances in time.

Abstract: A rotary encoder of a control surface has a display. The display includes a ring of light emitting elements, such as light emitting diodes (LEDs), in the control surface around the shaft and knob of the rotary encoder. The rotary encoder has a shaft that rotates about an axis under control of an operator. The rotary encode has an output providing a signal indicative of the rotational movement of the shaft. A knob engages the shaft and is used by the operator to rotate the shaft. The knob, in general, has a narrow stem that engages the shaft of the rotary encoder and extends away from the control surface, and a top portion which the operator manipulates to turn the knob. The stem has a substantially circular cross-section, in a plane perpendicular to the axis of the shaft of the rotary encoder, with a narrow diameter.

Abstract: The invention is a data pipeline system which synchronizes the display of digitized audio and video data regardless of the speed at which the data was recorded on its linear medium. To do this, the video data is played at a constant speed, synchronized by the audio speed. Further, the invention uses a method of “staging” data in storage buffers, i.e., ring buffers, which encourages efficient use of the viewer module resources by not permitting the viewer to read excessive amounts of data at any one time, i.e., to read only enough data into any one ring buffer so that the amount of data in the ring buffer is roughly equivalent to the amount of data in the other ring buffers and yet permitting the viewer to read large enough chunks of data to promote efficient use of the fill system.