Abstract: A control instrument for a system for generating acoustic output which includes a processor for receiving user input signals and control the acoustic output in response to the user input signals. The control instrument includes an instrument body, and at least one sensor element carried by the instrument body. The sensor element generates user input signals upon tactile actuation of the sensor element by a user. The user input signals indicate the location of contact and amount of force applied to the sensor element by the user. A music synthesis system and a sound processing system each including the control instrument are also provided.

Abstract: Two or more microphones are mounted in an environment that contains an equal or lesser number of distinct sound sources. Acoustic energy from each source, with its attendant echoes and reverberation, impinges on each microphone. Using direction-of-arrival information, a first module attempts to extract the original source signals as if the acoustic environment were anechoic. Any residual crosstalk between the channels, which may be caused by echoes and reverberation, is removed by a second module. The first and second modules may be implemented using existing technology.

Abstract: Existing media signals are processed to create new media content by defining content representations for the existing media and establishing functional dependencies between the representations. The content representations constitute different data types which determine the kinds of operations that can be performed and dependencies that can be established. Among the types of transformation that can be achieved are synchronization, substitution resequencing temporal compression and dilation, and the creation of parametric special effects. The content representations and their functional dependencies are combined to construct a functional dependency network which causes the desired transformations to occur on input media signals. The inputs to the functional dependency network are parametrically specified by media data types to construct a template that can be used to create adaptive media productions.

Abstract: An improved music generation system that facilitates artistic expression by non-musician and musician performers in both individual and group performance contexts. Mappings are provided between 1) gestures of a performer as indicated by manipulation of a user input device, 2) displayed motion of a graphic object, and 3) global features of a musical segment. The displayed motions and global features are selected so as to reinforce the appearance of causation between the performer's gestures and the produced musical effects and thereby assist the performer in refining his or her musical expression. The displayed motion is isomorphically coherent with the musical segment in order to achieve the appearance of causation. The global features are segment characteristics perceivable to human listeners. Control at the global feature level in combination with isomorphic visual feedback provides advantages to both non-musicians and musicians in producing artistic effect.

Abstract: A computer input system and method is described which includes a spatial reference member having a body with a first surface and an opposing second surface. The spatial reference member separates a first spatial region including the first surface from a second spatial region including the second surface. A physical object is movable within the first spatial region. Optical indicia tracks the physical object through the body. The optical indicia is observable from the second spatial region. An optical detector positioned in the second spatial region tracks the optical indicia and develops signals which may serve as inputs to a computer. The object may emit a signal which is tracked by the optical detector.

Abstract: A constraint-based graphics system employs different examples of an image to define the constraints of the system. The examples are grouped into subsets which can be interpolated with one another, according to a user-specified input that determines the relative proportion of each example image. An animation can be created by defining a sequence of such interpolated images. Alternatively, a user can directly manipulate observable components of an image to define a particular state for the image. Automatic transformations are defined to provide registration of an image within an overall scene by shifting the frame of reference for an image so that unnatural movements do not occur as the animation proceeds through a sequence of states. The structure of the system permits an animation to be divided into distinct components that can be combined with complementary components of other animations, to provide new results.

Abstract: A hierarchical memory for use in a programmable gate array integrated circuit comprises an interconnect structure having a plurality of interconnect nodes electrically connected in a tree configuration. The interconnect nodes include a root node which receives a multi-bit address word indicative of a selected memory location. The hierarchical memory further includes a plurality of memory cells electrically connected to the interconnect structure to form leaf nodes of the tree. Each of the memory cells contains at least one memory location for storing binary data. The interconnect structure is traversed from the root node to a memory cell containing the selected memory location based upon the multi-bit address word, wherein the interconnect structure provides a communication path for accessing the selected memory location from the root node.

Abstract: The invention enables the apparent display rate of an audiovisual display to be varied. The invention can modify an original set of audio data in accordance with a target display rate, then modify a related original set of video data to conform to the modifications made to the audio data set, such that the modified audio and video data sets are synchronized. When the modified audio and video data sets so produced are used to generate an audiovisual display, the audiovisual display has an apparent display rate that approximates the target display rate. The target display rate can be faster or slower than a normal display rate at which an audiovisual display system generates an audiovisual display from the original sets of audio and video data. The target display rate can be established solely by a user instruction, by analysis of the audiovisual data, or by modification of a user-specified nominal target display rate based upon analysis of the audiovisual data.

Abstract: A method and a system for audio communication between a plurality of users at a plurality of sites utilizes a set of audio input sensors at each site. Each set of audio input sensors binaurally senses an auditory space in proximity thereto. A metaphorical representation of each of the sites is provided. Each metaphorical representation has a position which is variable within a metaphorical space. The metaphorical representations can be based upon, for example, a physical metaphor, a visual metaphor, an auditory metaphor, or a textual metaphor. The auditory space sensed at each site is combined to form at least one synthetic auditory space. The at least one synthetic auditory space is formed in dependence upon the position of each metaphorical representation within the metaphorical space. A binaurally perceivable auditory environment is produced at one or more sites based upon the at least one synthetic auditory space.

Abstract: The synchronization of an existing video to a new soundtrack is carried out through the phonetic analysis of the original soundtrack and the new soundtrack. Individual speech sounds, such as phones, are identified in the soundtrack for the original video recording, and the images corresponding thereto are stored. The new soundtrack is similarly analyzed to identify individual speech sounds, which are used to select the stored images and create a new video sequence. The sequence of images are then smoothly fitted to one another, to provide a video stream that is synchronized to the new soundtrack. This approach permits a given video sequence to be synchronized to any arbitrary utterance. Furthermore, the matching of the video images to the new speech sounds can be carried out in a highly automated manner, thereby reducing required manual effort.

Abstract: A system and method for adaptively traversing a network of linked textual or multi-media information utilizes one or more heuristics to explore the network and present information to a user. An exploration or search heuristic governs activity while examining and exploring the linked information resources, while a presentation heuristic controls presentation of a manageable amount of information resources to the user. The system and method accept relevance feedback from the user which is used to refine future search, retrieval, and presentation of information resources. The user may present an information query of various degrees of specificity or the system and method may search and present information resources based entirely on relevance feedback from the user.

Abstract: An affect-based method of communication between robots is provided by displaying a visual facial expression indicative of a simulated emotional state on a display device of a first robot, and viewing the visual facial expression using a camera on a second robot. The simulated emotional state may be one of happiness, anger, or sadness, for example. The second robot determines the simulated emotional state based upon the visual facial expression. The second robot processes the simulated emotional state to redefine its own simulated emotional state, and to display a visual facial expression indicative thereof. The visual facial expression allows a human observer to discern the simulated emotional state of the robot. Optionally, the robots further communicate affect using audio tones.

Abstract: To modify the temporal scale of recorded speech, relative stress and relative speaking rate terms are computed for individual sections, or frames, of the speech. These terms are then combined into a single value denoted as audio tension. For a nominal time-scale modification rate, the audio tension is employed to adjust the modification rate of the individual frames of speech in a non-uniform manner, relative to one another. With this approach, compressed speech can be reproduced at a relatively fast rate, while remaining intelligible to the listener.

Abstract: The invention enables the display of an image to be paused, then, at the end of the pause, resumed at an accelerated rate until a time at which the content of the display corresponds to the content that would have been displayed had the image been displayed at the normal display rate without the pause, at which time display of the image at the normal display rate resumes. The invention can be used with display systems that display pre-recorded images (such as are found on video or audio cassettes, or video or audio compact discs, for example) or with display systems that display images based upon display data that is only momentarily available to the display system (such as occurs in the display of television or radio broadcasts). The invention can be used with either analog or digital display systems. Further, the invention can be used with any type of image display, such as, for example, audio displays, video displays or audiovisual displays.

Abstract: An input device and method for interacting with motion pictures incorporating content-based haptic response is provided. Content data relating to the motion picture is stored in a content data storage device while motion picture data is stored in a prerecorded image data storage device. A viewer input device is provided so that a viewer (end-user) can move forwards and backwards through the frames on a display screen while substantially simultaneously, the content data is accessed and braking commands are sent to the viewer input device. The result is that the viewer is provided with haptic responses to the viewer's input through the viewer input device.

Abstract: A wearable speaker system which provides improved quality audio response and which does not interfere with the wearer's activities or block environmental sounds is disclosed. Transducer arrays, e.g. pairs of speakers, are situated in a wearable garment, headband, or the like and positioned on opposite sides of the wearer's head. In one embodiment, the transducer arrays share a common enclosure and are driven 180.degree. out of phase, so that back pressures cancel and low frequency response is enhanced. In another embodiment, two open-ended enclosures are provided, each with its own transducer array. In another embodiment, linear arrays of transducers are provided with appropriate time-delays between the audio signals. The speaker system is connected to or in communication with a conventional source of audio signals, such as a radio, tape player, CD player, cellular telephone or the like.

Abstract: An apparatus for sensing an angular rate of motion includes a body which defines a surface having a protuberant portion, and an orifice through the surface and proximate to the protuberant portion through which a fluid jet is directed along an initial jet axis. The protuberant portion directs the fluid jet in a path along the surface in accordance with the Coanda effect. A first flow sensor is fixed relative to the body and proximate to the path of the fluid jet along the surface of the body. The first flow sensor produces a first indication of a rate of flow of a first portion of the fluid jet proximate thereto. A second flow sensor is fixed relative to the body and proximate to the path of the fluid jet along the surface of the body. The second flow sensor produces a second indication of a rate of flow of a second portion of the fluid jet proximate thereto. The angular rate of motion of the body is sensed in dependence upon the first indication and the second indication.

Abstract: A personal communications apparatus using a garment-based audio interface includes a garment member worn on the upper torso of a person, wherein the garment member includes a neck opening which allows extension therethrough of the neck of the person. An audio output device capable of producing hi-fidelity spatialized 3-D sound aiming in selected directions is located adjacent the neck opening of the garment member. A receiver capable of receiving at least one transmitted signal and producing an audio signal based thereupon is coupled to the audio output device. An audio input device capable of capturing spatialized 3-D sound from selected directions is located adjacent the neck opening of the garment member. The audio signal from the audio input device is provided to a transmitter capable of transmitting a signal in dependence upon the audio signal. Embodiments of the garment member include a shirt and a necklace.

Abstract: In the first step of a sound morphing process, each sound which forms the basis for the morph is converted into one or more quantitative representations, such as spectrograms. After the representations have been obtained, the temporal axes of the two sounds are matched, so that similar components of the two sounds, such as onsets, harmonic regions and inharmonic regions, are aligned with one another. Other characteristics of the sounds, such as pitch, formant frequencies, or the like, are then matched. Once the energy in each of the sounds has been accounted for and matched to that of the other sound, the two sounds are cross-faded, to produce a representation of a new sound. This representation is then inverted, to generate the morphed sound.

Abstract: A portable, wearable personal audio system which includes an acoustic sample chamber and an acoustically transparent ear insert member. A tubular member transmits the audio from the sample chamber and module to the ear canal. An additional transducer, preferably made from a piezoelectric material, can be provided in the ear insert member or at the outer end of the tubular member. An electronics mechanism is preferably supplied as part of a behind-the-ear module or as part of the temple of a pair of eyeglasses. Stereo systems require separate systems for each ear. A quick exchange adapter mechanism is provided to connect the eyeglasses with a behind-the-ear module. A Velcro-type fastener or magnetic fastener mechanism connects the end of the eyeglasses to the module.