Abstract: Augmented reality enables an operator to visualize values of parameters of audio channels during audio mixing. A heads-up display worn by the operator, such as smart glasses, displays virtual graphical objects representing the parameters so that they appear within a three-dimensional space surrounding the operator and an audio mixing console. Parameter values are represented by the location, size, and other attributes of the virtual graphical objects. The operator adjusts the parameter values using physical and touch controls on the console and by manipulating the virtual objects with a body part such as a finger. Sensors mounted on the heads-up display and on other body parts capture position and movement of the operator in real time and send the captured data to a system running augmented reality control software. Graphical user interfaces of a media processing application controlled by the console and of plug-in modules may also be displayed on the heads-up display.

Abstract: Augmented reality enables an operator to visualize values of parameters of audio channels during audio mixing. A heads-up display worn by the operator, such as smart glasses, displays virtual graphical objects representing the parameters so that they appear within a three-dimensional space surrounding the operator and an audio mixing console. Parameter values are represented by the location, size, and other attributes of the virtual graphical objects. The operator adjusts the parameter values using physical and touch controls on the console and by manipulating the virtual objects with a body part such as a finger. Sensors mounted on the heads-up display and on other body parts capture position and movement of the operator in real time and send the captured data to a system running augmented reality control software. Graphical user interfaces of a media processing application controlled by the console and of plug-in modules may also be displayed on the heads-up display.

Abstract: Augmented reality enables an operator to visualize values of parameters of audio channels during audio mixing. A heads-up display worn by the operator, such as smart glasses, displays virtual graphical objects representing the parameters so that they appear within a three-dimensional space surrounding the operator and an audio mixing console. Parameter values are represented by the location, size, and other attributes of the virtual graphical objects. The operator adjusts the parameter values using physical and touch controls on the console and by manipulating the virtual objects with a body part such as a finger. Sensors mounted on the heads-up display and on other body parts capture position and movement of the operator in real time and send the captured data to a system running augmented reality control software. Graphical user interfaces of a media processing application controlled by the console and of plug-in modules may also be displayed on the heads-up display.

Abstract: A user-configurable modular audio control surface comprises master modules for controlling global surface properties and channel modules for controlling one or more individual audio channels. The modules are disposed in a two-dimensional spatial arrangement such that any module can occupy a location within the control surface not occupied by another module. The modules are connected to each other and to external platforms hosting media applications and plug-ins via a network. Control surface users can interact with external applications via remote graphical user interfaces displayed on modules within the surface, and can automate multiple external applications using an automation system built into the surface. Automation line graphs and metadata for both internal and external applications are displayed over the corresponding waveform displays that can include audio ahead of a current playback location.

Abstract: A user-configurable modular audio control surface comprises master modules for controlling global surface properties and channel modules for controlling one or more individual audio channels. The modules are disposed in a two-dimensional spatial arrangement such that any module can occupy a location within the control surface not occupied by another module. The modules are connected to each other and to external platforms hosting media applications and plug-ins via a network. Control surface users can interact with external applications via remote graphical user interfaces displayed on modules within the surface, and can automate multiple external applications using an automation system built into the surface. Automation line graphs and metadata for both internal and external applications are displayed over the corresponding waveform displays that can include audio ahead of a current playback location.

Abstract: Systems and methods for linking time-based media and temporal metadata provide single command control during editing of media having associated temporal metadata. A single control enables an editor to switch between monitoring both source media and its corresponding temporal metadata and monitoring both a pre-recorded version of the media and its corresponding temporal metadata. Another single control enables an editor to start and stop the recording of a source media track and its corresponding source temporal metadata. In one application, the editing is performed for media tracks having time-based spatial metadata for playback in immersive environments with the spatial metadata defining an apparent location of sound objects within the immersive environment.

Abstract: Large numbers of similar-looking or identical physical controls on an audio control surface can make it difficult for operators to rapidly locate desired controls. Highlighting of selected controls focuses the operator's visual attention on controls the operator is manipulating, or has just manipulated and is likely to manipulate again. Controls peripheral to or otherwise related to manipulated controls may also be highlighted. Highlighting methods include the use of control illumination intensity, color, and labeling display text. Visual focusing may include highlighting relationships between channel strips or between individual physical controls, or between the physical controls of a surface and one or more digital audio workstations.

Abstract: Large numbers of similar-looking or identical physical controls on an audio control surface can make it difficult for operators to rapidly locate desired controls. Highlighting of selected controls focuses the operator's visual attention on controls the operator is manipulating, or has just manipulated and is likely to manipulate again. Controls peripheral to or otherwise related to manipulated controls may also be highlighted. Highlighting methods include the use of control illumination intensity, color, and labeling display text. Visual focusing may include highlighting relationships between channel strips or between individual physical controls, or between the physical controls of a surface and one or more digital audio workstations.

Abstract: A user-configurable modular audio control surface comprises master modules for controlling global surface properties and channel modules for controlling one or more individual audio channels. The modules are disposed in a two-dimensional spatial arrangement such that any module can occupy a location within the control surface not occupied by another module. The modules are connected to each other and to external platforms hosting media applications and plug-ins via a network. Control surface users can interact with external applications via remote graphical user interfaces displayed on modules within the surface, and can automate multiple external applications using an automation system built into the surface. Automation line graphs and metadata for both internal and external applications are displayed over the corresponding waveform displays that can include audio ahead of a current playback location.

Abstract: A user-configurable modular audio control surface comprises master modules for controlling global surface properties and channel modules for controlling one or more individual audio channels. The modules are disposed in a two-dimensional spatial arrangement such that any module can occupy a location within the control surface not occupied by another module. The modules are connected to each other and to external platforms hosting media applications and plug-ins via a network. Control surface users can interact with external applications via remote graphical user interfaces displayed on modules within the surface, and can automate multiple external applications using an automation system built into the surface. Automation line graphs and metadata for both internal and external applications are displayed over the corresponding waveform displays that can include audio ahead of a current playback location.

Abstract: A user-configurable modular audio control surface comprises master modules for controlling global surface properties and channel modules for controlling one or more individual audio channels. The modules are disposed in a two-dimensional spatial arrangement such that any module can occupy a location within the control surface not occupied by another module. The modules are connected to each other and to external platforms hosting media applications and plug-ins via a network. Control surface users can interact with external applications via remote graphical user interfaces displayed on modules within the surface, and can automate multiple external applications using an automation system built into the surface. Automation line graphs and metadata for both internal and external applications are displayed over the corresponding waveform displays that can include audio ahead of a current playback location.

Abstract: A user-configurable modular audio control surface comprises master modules for controlling global surface properties and channel modules for controlling one or more individual audio channels. The modules are disposed in a two-dimensional spatial arrangement such that any module can occupy a location within the control surface not occupied by another module. The modules are connected to each other and to external platforms hosting media applications and plug-ins via a network. Control surface users can interact with external applications via remote graphical user interfaces displayed on modules within the surface, and can automate multiple external applications using an automation system built into the surface. Automation line graphs and metadata for both internal and external applications are displayed over the corresponding waveform displays that can include audio ahead of a current playback location.

Abstract: A control surface has one or more soft devices for which functionality may be assigned, a central processing unit (CPU), including operating code, for managing at least functionality of the soft devices on the control surface, and a network connection for connecting to one or more computerized appliances. The control code assigns individual ones of the one or more soft devices to specific functions of an individual one of the one or more computerized appliances. There may be a variety of different kinds of soft devices, and the functionality for the soft devices of the control surface may be determined by which application is frontmost on one of the computerized appliances.

Abstract: A technique for providing routing of various multimedia events throughout the course of a multimedia presentation using a computer with a storage and a display. A variety of multimedia objects are defined in the storage and grouped in logical relationships to enable multimedia presentations. A display is used to create the presentations interactively by positioning objects representative of the multimedia events and joining them with geometric figures, such as line segments. Each object can then be directly manipulated via a mouse or other pointing device to position a multimedia object to a particular position, or adjust the playback rate of a multimedia object.

Abstract: A digital processing system for monitoring sound effects produced by codecs during a signal processing session is provided. The digital processing system comprises, a sound source for producing signals for processing, a sound monitor having at least two channels for monitoring sound quality of the sound source, a sound recorder for recording the sound source, a playback device for playing a recorded file of sound produced by the sound source, a codec simulator for simulating sound effects produced by codecs, a plurality of codecs for compressing and decompressing sound files and a control interface for sampling, adjusting, and implementing an optimum codec based on monitoring of sound effects produced by codec simulation. A user controlling the system may monitor sound variances produced by any one of the plurality of codecs affecting the quality of sound from the sound source during signal processing of the source sound without interruption of the signal-processing session.

Abstract: A technique for providing routing of various multimedia events throughout the course of a multimedia presentation using a computer with a storage and a display. A variety of multimedia objects are defined in the storage and grouped in logical relationships to enable multimedia presentations. A display is used to create the presentations interactively by positioning objects representative of the multimedia events and joining them with geometric figures, such as line segments. Each object can then be directly manipulated via a mouse or other pointing device to position a multimedia object to a particular position, or adjust the playback rate of a multimedia object.

Abstract: A digital processing system for monitoring sound effects produced by codecs during a signal processing session is provided. The digital processing system comprises, a sound source for producing signals for processing, a sound monitor having at least two channels for monitoring sound quality of the sound source, a sound recorder for recording the sound source, a playback device for playing a recorded file of sound produced by the sound source, a codec simulator for simulating sound effects produced by codecs, a plurality of codecs for compressing and decompressing sound files and a control interface for sampling, adjusting, and implementing an optimum codec based on monitoring of sound effects produced by codec simulation. A user controlling the system may monitor sound variances produced by any one of the plurality of codecs affecting the quality of sound from the sound source during signal processing of the source sound without interruption of the signal-processing session.

Abstract: A technique for providing routing of various multimedia events throughout the course of a multimedia presentation using a computer with a storage and a display. A variety of multimedia objects are defined in the storage and grouped in logical relationships to enable multimedia presentations. A display is used to create the presentations interactively by positioning objects representative of the multimedia events and joining them with geometric figures, such as line segments. Each object can then be directly manipulated via a mouse or other pointing device to position a multimedia object to a particular position, or adjust the playback rate of a multimedia object.

Abstract: A system for connecting a video object to various multimedia objects to enable an object-oriented simulation of a multimedia presentation using a computer with a storage and a display. A plurality of multimedia objects are created on the display including at least one connection object and at least one video object in the storage. Multimedia objects are displayed on the display, including at least one video object. The multimedia object and the video object are connected, and information is routed via the connection between the multimedia object and the video object to create a multimedia presentation.

Abstract: A system for connecting a video object to various multimedia objects to enable an object-oriented simulation of a multimedia presentation using a computer with a storage and a display. A plurality of multimedia objects are created on the display including at least one connection object and at least one video object in the storage. Multimedia objects are displayed on the display, including at least one video object. The multimedia object and the video object are connected, and information is routed via the connection between the multimedia object and the video object to create a multimedia presentation.