Abstract: Certain types of parametric spatial coding encoders use interchannel amplitude differences, interchannel time differences, and interchannel coherence or correlation to build a parametric model of a multichannel soundfield that is used by a decoder to construct an approximation of the original soundfield. However, such a parametric model does not reconstruct the original temporal envelope of the soundfield's channels, which has been found to be extremely important for some audio signals. The present invention provides for the reshaping the temporal envelope of one or more of the decoded channels in a spatial coding system to better match one or more original temporal envelopes.

Abstract: The invention relates to the measurement and control of the perceived sound loudness and/or the perceived spectral balance of an audio signal. An audio signal is modified in response to calculations performed at least in part in the perceptual (psychoacoustic) loudness domain. The invention is useful, for example, in one or more of: loudness-compensating volume control, automatic gain control, dynamic range control (including, for example, limiters, compressors, expanders, etc.), dynamic equalization, and compensating for background noise interference in an audio playback environment. The invention includes not only methods but also corresponding computer programs and apparatus.

Abstract: One or a combination of two or more specific loudness model functions selected from a group of two or more of such functions are employed in calculating the perceptual loudness of an audio signal. The function or functions may be selected, for example, by a measure of the degree to which the audio signal is narrowband or wideband. Alternatively or with such a selection from a group of functions, a gain value G[t] is calculated, which gain, when applied to the audio signal, results in a perceived loudness substantially the same as a reference loudness. The gain calculating employs an iterative processing loop that includes the perceptual loudness calculation.

Abstract: An apparatus and method for generating 3D graphics objects utilizes algorithms to generate the objects when driven by audio events. In one embodiment a “hydra” object has branches that are recursively generated. Parameters used to algorithmically generate the object are controlled by a control signal driven by detected events in an audio signal. Additional algorithms include a phase plot using audio parameters. A generalized system includes an audio analysis block for generating audio control signals utilized by object generation, objects selection and object placement blocks to generate 3D objects.

Abstract: A technique for enhancing an audio-driven computer generated animation includes the step of mapping a video clip generated by a digital camera to an object displayed in the animation. Additionally, the object or the video clip can be deformed when selected events are detected during playback of the video clip.

Abstract: A method and device to process at least two audio streams is provided. The method includes adjusting a tempo of at least one of the audio streams, and processing the audio streams to obtain a phase difference between the audio streams. Thereafter, the tempo of the adjusted audio stream is re-adjusted in response to the phase difference. The method may include repetitively re-adjusting the tempo of at least one of the audio streams to reduce any lead and lag. In one embodiment, the method includes determining an energy distribution of each audio stream, and comparing the energy distributions of the at least two audio streams. The tempo of at least one of the audio streams may be re-adjusted in response to the comparison. In one embodiment, a cross-correlation analysis and an autocorrelation analysis is used to beat match two or more audio streams.

Abstract: A technique for changing the appearance of visual images mapped on a 3D object rendered by a computer includes the stepped of remapping texture coordinates to vertices of a 3D object at discrete time intervals and blending the remapped images. The control intervals are triggered by events in monitored signal such as an audio feed or a video stream. The images of the video stream can be the textures mapped to the 3D object.

Abstract: A method and system to drive transformations of a visual representation, in real-time, that synchronizes the audio and visual outputs and controls the magnitude of object deformation to be visual pleasing. In one embodiment, sudden increases in the spectral energy are detected to time the initialization of deformations and a smoothed signal is derived from the time varying spectral energy curve to control the magnitude of the deformations.