Abstract: A user-configurable modular audio control surface comprises master modules for controlling global surface properties and channel modules for controlling one or more individual audio channels. The modules are disposed in a two-dimensional spatial arrangement such that any module can occupy a location within the control surface not occupied by another module. The modules are connected to each other and to external platforms hosting media applications and plug-ins via a network. Control surface users can interact with external applications via remote graphical user interfaces displayed on modules within the surface, and can automate multiple external applications using an automation system built into the surface. Automation line graphs and metadata for both internal and external applications are displayed over the corresponding waveform displays that can include audio ahead of a current playback location.

Abstract: Computer-based methods infer a metrical grid from music that has been input without a predetermined time signature or tempo, enabling such free rhythm input to be annotated with the inferred grid, and stored and transcribed as a musical score. The methods use Bayesian modeling techniques, in which an optimal metrical grid is inferred by identifying the metrical grid that best explains the given sequence of notes by maximizing the posterior probability that it represents the note sequence. Prior musical input from a given user as well as explicit information about the musical style of the input may be used to improve the accuracy of the transcription.

Abstract: A transmission medium and protocol is provided for bi-directional communication between an audio system and a peripheral device. The transmission medium includes a communication medium for communicating data and a communication medium for communicating a clock signal that corresponds to a transmission rate of bits on the other communication media. By transmitting the clock signal on a separate communication medium from the data, clock recovery is avoided. There may be multiple clock domains. By having multiple clock domains, multiple sample rates can be supported. Synchronization information is embedded in the signal by using run length limiting markers between the data for each channel and a synchronization word having more consecutive zero bits than the number of bits for each channel. One or more channels may be dedicated to providing control and status information.

Abstract: Methods and systems for remote video editing include a source media file on a storage device and an input for receiving video editing commands, over a low-bandwidth network, pertaining to the source media file. A virtual representation of the source media file includes the editing commands and a link to the source media file. A media delivery engine reads the source media file over a high-bandwidth link, applies the editing commands thereto, and produces a proxy representation of the edited source media file, and an output transmits the proxy representation over the low-bandwidth network. Requested individual frames of the edited media may also be output.

Abstract: A crosspoint matrix for digital signal routing and control, the matrix realized by software code includes a plurality of configurable inputs adapted to accept one or more input signals; a plurality of configurable outputs connected via signal paths to the inputs; and a plurality of variable gain control circuits described by code at each signal path intersection for enabling signal strength level adjustment. In a preferred embodiment, the matrix is a software interface inserted between a sound editing application and a sound card.

Abstract: A media editing system provides an editor with full visibility and editing capability for synchronous data that is adjunct to audio and video. The data tracks include one or more streams of data packets, each stream being of a particular data type. Synchronous data tracks are displayed on the timeline, facilitating data track editing independent of the associated media tracks. The UI also enables selective playback and export of the data tracks along with the corresponding video and audio. The system also enables data streams to be filtered and combined. Data from the data tracks can be extracted and imported into a media asset management system, enabling the data to be searched.

Abstract: Creation of a program with interactive content and time-based media would be improved by having several people working simultaneously on both the interactive content and the time-based media. The range of types of data that can be associated with the time-based media also can include a variety of types of content that enhance the time-based media, including data that is opaque to the editing system. To support editing of such programs, enhanced content may be edited into a program as either a clip or a locator, according to a user's selection. The components that represent enhanced content also may be edited in the same way as components that represent time-based media. Enhanced content may be represented by enhancement files that include data defining enhancements. An enhancement includes an identifier of the enhancement within the enhancement file, and a reference to a file defining enhanced content associated with the enhancement.

Abstract: Methods of representing, recreating, and editing an audio composition involving: receiving at a digital audio workstation audio data that has been processed by an audio processing device; receiving at the digital audio workstation a set of metadata specifying a value for each of a plurality of settings of the audio processing device that define the state of the corresponding setting of the audio processing device when raw audio data received by the audio processing device was processed to generate the processed audio data; and storing the received processed audio data and the received set of metadata in an audio file, wherein the processed audio data is designated as audio information and the metadata is designated as settings data. The settings may be stored in a WAV or AIFF audio file, and may be retrieved, parsed, and applied to restore the audio processing device to the state corresponding to the retrieved audio.

Abstract: Computer-based methods for time-based media composition of programs that include secondary material. The methods involve searching for secondary media available from secondary material providers over a wide-area network, selecting secondary material, receiving metadata pertaining to the selected secondary material, inserting a representation of the selected secondary media into a media composition, playing back a sequence of the media composition that includes the secondary media, wherein playback of the secondary media involves playing an evaluation version of the secondary media streamed to a media composition system over the wide area network, and displaying metadata pertaining to the selected secondary material. The media composition system facilitates purchasing and transfer, and re-linking of the secondary media for inclusion within the media composition.

Abstract: Methods and systems for populating a cache memory that services a media composition system. Caching priorities are based on a state of the media composition system, such as media currently within a media composition timeline, a composition playback location, media playback history, and temporal location within clips that are included in the composition. Caching may also be informed by descriptive metadata and media search results within a media composition client or a within a media asset management system accessed by the client. Additional caching priorities may be based on a project workflow phase or a client project schedule. Media may be partially written to or read from cache in order to meet media request deadlines. Caches may be local to a media composition system or remote, and may be fixed or portable.

Abstract: Methods and systems for multi-screen media authoring include displaying an integrated graphical user interface with a timeline for first screen linear time-based media editing and a second timeline for editing second screen content associated with the first screen content. Second screen content includes a sequence of modules that involve active viewer interaction and/or passive consumption. The display of the first and second timelines are temporally aligned with each other, and enable time-line-based editing of second screen content synchronized to the first screen. Selection of a second screen module on the second timeline invokes an editing environment corresponding to the type of module selected. Integrated monitors show end user or proxy views of first and second screen content corresponding to the first and second timelines respectively.

Abstract: A computer-based method for media composition of a family of related time-based media programs. The method involves creating a master program with time-based elements of video and/or audio as well as time-based and non-time-based metadata, creating a derivative program that includes derivative elements, defining an inheritance relationship between the master program and the derivative program that specifies elements of the master program to be inherited by the derivative program, and causing the derivative program to inherit the specified elements from the master program in accordance with the inheritance relationship. User interfaces are provided for creating, editing, and viewing hierarchical trees of related programs.

Abstract: Computer-based methods infer a metrical grid from music that has been input without a predetermined time signature or tempo, enabling such free rhythm input to be annotated with the inferred grid, and stored and transcribed as a musical score. The methods use Bayesian modeling techniques, in which an optimal metrical grid is inferred by identifying the metrical grid that best explains the given sequence of notes by maximizing the posterior probability that it represents the note sequence. Prior musical input from a given user as well as explicit information about the musical style of the input may be used to improve the accuracy of the transcription.

Abstract: An apparatus for measuring torque in a rotary encoder between the encoder body and encoder shaft. The apparatus includes a rotary stage for mounting and rotating the body of the rotary encoder, a probe arm having a first end for engaging the shaft of the rotary encoder in a stationary position, and a force sensor mourned on an adjustable assembly. The adjustable assembly enables the force sensor to be placed in contact with a second end of the probe arm, such that the plane of the force sensor is parallel to a plane defined by the vertical center plane of the probe arm passing through an axis of rotation of the shaft of the rotary encoder. By rotating the encoder body at a constant speed in clockwise and counterclockwise directions and measuring torque at regular time intervals, the range of torque, torque grittiness, and torque hysteresis may be determined.

Abstract: A transmission medium and protocol is provided for bi-directional communication between an audio system and a peripheral device. The transmission medium includes a communication medium for communicating data and a communication medium for communicating a clock signal that corresponds to a transmission rate of bits on the other communication media. By transmitting the clock signal on a separate communication medium from the data, clock recovery is avoided. There may be multiple clock domains. By having multiple clock domains, multiple sample rates can be supported. Synchronization information is embedded in the signal by using run length limiting markers between the data for each channel and a synchronization word having more consecutive zero bits than the number of bits for each channel. One or more channels may be dedicated to providing control and status information.

Abstract: Methods, systems, and computer program products for generating an animated playback of a musical composition represented as a digital musical score. The methods involve, for each of a series of landmarks in the digital musical score: determining a temporal location of audio playback of the landmark in an audio playback of the composition; generating a video output frame showing a page of the musical score spanning the landmark in an output page format; generating a segment of the animated playback of the composition having a video component showing the video output frame for a duration approximately equal to the difference between temporal locations of audio playback of successive landmarks and an audio component including an audio rendering of a portion of the score between the successive landmarks; and generating the animated playback of the musical composition by concatenating the segments. The score format is optimized for the video aspect ratio.

Abstract: A set of tools in a media composition system for stereoscopic video provides visualizations of the perceived depth field in video clips, including depth maps, depth histograms, time-based depth histogram ribbons and curves displayed in association with a media timeline, and multi-panel displays including views of clips temporally adjacent to a clip being edited. Temporal changes in perceived depth that may cause viewer discomfort are automatically detected, and when they exceed a predetermined threshold, the editor is alerted. Depth grading tools facilitate matching depths in an outgoing clip to those in an incoming clip. Depth grading can be performed automatically upon detection of excessively large or rapid perceived depth changes.

Abstract: A communication protocol over the serial bus allows a peripheral device to control the flow of data between a host computer and the peripheral device so as to maintain synchronization to a periodic reference signal. The protocol involves transferring flow control messages between the peripheral device and the host computer, allowing the peripheral device to control how and when the host computer sends the uncompressed audio and video data.

Abstract: A computer-based method for media composition of a family of related time-based media programs. The method involves creating a master program with time-based elements of video and/or audio as well as time-based and non-time-based metadata, creating a derivative program that includes derivative elements, defining an inheritance relationship between the master program and the derivative program that specifies elements of the master program to be inherited by the derivative program, and causing the derivative program to inherit the specified elements from the master program in accordance with the inheritance relationship. User interfaces are provided for creating, editing, and viewing hierarchical trees of related programs.

Abstract: A media editing system provides an editor with full visibility and editing capability for synchronous data that is adjunct to audio and video. The data tracks include one or more streams of data packets, each stream being of a particular data type. Synchronous data tracks are displayed on the timeline, facilitating data track editing independent of the associated media tracks. The UI also enables selective playback and export of the data tracks along with the corresponding video and audio. The system also enables data streams to be filtered and combined. Data from the data tracks can be extracted and imported into a media asset management system, enabling the data to be searched.