Abstract: High dynamic range media sensor output is encoded using a hybrid transfer function. The hybrid transfer function conforms to existing industry standards over standard brightness level ranges, such as between black and white reference points, and uses a different function to encode captured signals having intensities below the black point and above the white point. Precision over the expanded dynamic range of captured image data is optimally preserved using a two-byte per pixel representation. The transfer function varies across the full dynamic range without clamping off below the maximum value of the expanded captured intensity range. One hybrid transfer function conforms to BT.1886 up to the white point, and uses a linearly varying encoding gamma above the white point up to 1300% IRE, producing encoded values in a 2.14 fixed point representation. The hybrid transfer function is continuous at the white point, and may also have a continuous gradient there.

Abstract: High dynamic range media sensor output is encoded using a hybrid transfer function. The hybrid transfer function conforms to existing industry standards over standard brightness level ranges, such as between black and white reference points, and uses a different function to encode captured signals having intensities below the black point and above the white point. Precision over the expanded dynamic range of captured image data is optimally preserved using a two-byte per pixel representation. The transfer function varies across the full dynamic range without clamping off below the maximum value of the expanded captured intensity range. One hybrid transfer function conforms to BT.1886 up to the white point, and uses a linearly varying encoding gamma above the white point up to 1300% IRE, producing encoded values in a 2.14 fixed point representation. The hybrid transfer function is continuous at the white point, and may also have a continuous gradient there.

Abstract: A synchronized media project, synchronization SDK, and synchronization service enable multiple users to produce a media composition collaboratively. A media project includes composition assets that reference media assets. A synchronization SDK enables multiple applications to edit the media project independent of an internal organization of the project. A project synchronization service synchronizes copies of media projects located on clients with a server-based versioned master project. User-selectable project synchronization modes determine whether media project assets are stored on clients, on the server, or on both, and when media assets are transferred. Synchronized media projects include composition assets in proprietary formats and in interoperable formats. Interoperable composition assets are rendered from proprietary composition assets on a track-by-track basis.

Abstract: Pixel-based and region-based methods, computer program products, and systems for detecting, flagging, highlighting on a display, and automatically fixing edge violations in stereoscopic images and video. The highlighting and display methods involve signed, clamped subtraction of one image of a stereo image pair from the other image, with the subtraction preferably isolated to a region of interest near the lateral edges. Various embodiments include limiting the detection, flagging, and highlighting of edge violations to objects causing a degree of perceptual discomfort greater than a user-set or preset threshold, or to objects having a certain size and/or proximity and/or degree of cut-off by a lateral edge of the left or right eye images of a stereo image pair. Methods of removing violations include automatic or semi-automatic cropping of the offending object, and depth shifting of the offending object onto the screen plane.

Abstract: A portable development and execution framework for processing media objects. The framework involves: accepting an instruction to perform a media processing function; accepting a media object to be associated with the media processing function; wrapping the media object with an attribute that specifies a type and format of the media object, and a hardware domain associated with the media object; and causing an execution domain to perform the media processing function on the media object. The instruction to perform the media processing function is expressed in a form that is independent of the hardware domain associated with the media object, and may also be independent of the type and format of the media object. The media object may be an image, and the media processing function may include an image processing function performed on a GPU.

Abstract: A set of tools in a media composition system for stereoscopic video provides visualizations of the perceived depth field in video clips, including depth maps, depth histograms, time-based depth histogram ribbons and curves displayed in association with a media timeline, and multi-panel displays including views of clips temporally adjacent to a clip being edited. Temporal changes in perceived depth that may cause viewer discomfort are automatically detected, and when they exceed a predetermined threshold, the editor is alerted. Depth grading tools facilitate matching depths in an outgoing clip to those in an incoming clip. Depth grading can be performed automatically upon detection of excessively large or rapid perceived depth changes.

Abstract: A portable development and execution framework for processing media objects. The framework involves: accepting an instruction to perform a media processing function; accepting a media object to be associated with the media processing function; wrapping the media object with an attribute that specifies a type and format of the media object, and a hardware domain associated with the media object; and causing an execution domain to perform the media processing function on the media object. The instruction to perform the media processing function is expressed in a form that is independent of the hardware domain associated with the media object, and may also be independent of the type and format of the media object. The media object may be an image, and the media processing function may include an image processing function performed on a GPU.

Abstract: A set of tools in a media composition system for stereoscopic video provides visualizations of the perceived depth field in video clips, including depth maps, depth histograms, time-based depth histogram ribbons and curves displayed in association with a media timeline, and multi-panel displays including views of clips temporally adjacent to a clip being edited. Temporal changes in perceived depth that may cause viewer discomfort are automatically detected, and when they exceed a predetermined threshold, the editor is alerted. Depth grading tools facilitate matching depths in an outgoing clip to those in an incoming clip. Depth grading can be performed automatically upon detection of excessively large or rapid perceived depth changes.

Abstract: Transformation hierarchies and effects trees may be defined in the same user interface by treating animated transformations as another type of time-varying data stream. Effects operators in the effect tree are provided with an input to receive a transformation. The effects operators can be set to either use a transformation having parameters specified by the user, or use an input transformation, or both. Transform operators may generate an output transform based on user specified parameters or based on a function of data input to the transform operator. If there is no input connected to a transform operator, the transform operator may generate its own local transform. In the user interface, the user can connect the output of one transformation operator to the next (e.g., parent to child) using the same output to input port connections as used for images and effects operators.

Abstract: A portable development and execution framework for processing media objects. The framework involves: accepting an instruction to perform a media processing function; accepting a media object to be associated with the media processing function; wrapping the media object with an attribute that specifies a type and format of the media object, and a hardware domain associated with the media object; and causing an execution domain to perform the media processing function on the media object. The instruction to perform the media processing function is expressed in a form that is independent of the hardware domain associated with the media object, and may also be independent of the type and format of the media object. The media object may be an image, and the media processing function may include an image processing function performed on a GPU.

Abstract: Transformation hierarchies and effects trees may be defined in the same user interface by treating animated transformations as another type of time-varying data stream. Effects operators in the effect tree are provided with an input to receive a transformation. The effects operators can be set to either use a transformation having parameters specified by the user, or use an input transformation, or both. Transform operators may generate an output transform based on user specified parameters or based on a function of data input to the transform operator. If there is no input connected to a transform operator, the transform operator may generate its own local transform. In the user interface, the user can connect the output of one transformation operator to the next (e.g., parent to child) using the same output to input port connections as used for images and effects operators.

Abstract: A fixed point integer color component representation has been defined that provides accuracy and computational speed similar to an integer format, but has a range that supports super-black and super-white values. This color component representation uses m bits, with an n-bit integer part and a k-bit fractional part. The m-bit integer represents a range of values having a minimum value less than zero and a maximum value greater than one. A value of zero represents the black point of the color gamut whereas a value of one represents the white point of the color gamut. The range of values includes values between zero and one correspond to legal values in the color gamut. Values less than zero represent super black values. Values greater than one represent super white values. To achieve this, m should be greater than or equal to three and n should be greater than or equal to two. In a particular implementation, this representation uses 16 bits to define a signed 2-bit integer with a 14-bit fractional part.

Abstract: The present invention provides for a property editor in a graphics image system in order to specify parameter values for effects in an effect tree. A separate instance of the property editor is not invoked for each effect within the effect tree, but rather the property editor permits the modification of multiple effects from the same instance of the editor. Advantageously, the user is not required to navigate between a view of the effect tree and the property editor in order to edit effects.

Abstract: Performance of rendering of effects on media data may be improved by analyzing properties defined for an effect to identify static and dynamic time segments within the effect. A static time segment in an effect is a time segment for which only one image is rendered. A dynamic time segment in an effect is a time segment for which each sample of media data in the time segment is rendered. An effect can contain any number of static and dynamic time segments. By identifying these time segments in an effect, processing and caching of the rendered effect are more finely grained. In particular, rendered time segments in an effect may be cached, such that a change in the effect in one time segment does not require re-rendering of other time segments. Thus, unnecessary rendering may be avoided, and invalidation of cached rendered media data and subsequent rerendering also may be reduced.