Abstract: The synchronization of an existing video to a new soundtrack is carried out through the phonetic analysis of the original soundtrack and the new soundtrack. Individual speech sounds, such as phones, are identified in the soundtrack for the original video recording, and the images corresponding thereto are stored. The new soundtrack is similarly analyzed to identify individual speech sounds, which are used to select the stored images and create a new video sequence. The sequence of images are then smoothly fitted to one another, to provide a video stream that is synchronized to the new soundtrack. This approach permits a given video sequence to be synchronized to any arbitrary utterance. Furthermore, the matching of the video images to the new speech sounds can be carried out in a highly automated manner, thereby reducing required manual effort.

Abstract: A system and method for adaptively traversing a network of linked textual or multi-media information utilizes one or more heuristics to explore the network and present information to a user. An exploration or search heuristic governs activity while examining and exploring the linked information resources, while a presentation heuristic controls presentation of a manageable amount of information resources to the user. The system and method accept relevance feedback from the user which is used to refine future search, retrieval, and presentation of information resources. The user may present an information query of various degrees of specificity or the system and method may search and present information resources based entirely on relevance feedback from the user.

Abstract: A wearable universal user interface device is provided for interacting with a variety of electronic apparatus. The interface device includes various sensors, such as a temperature sensor, pressure sensor, and a two-dimensional quadrant force sensor. The interface device also includes processing circuitry, a wireless transmitter, and an optional receiver. In the preferred embodiment, the interface device is in the form of a ring adapted to be worn on the finger of a user. The device is operated by the wearer's fingers and thumb. Preferably, the interface device includes an internally mounted pressure sensor and an externally mounted two-dimensional force sensor. The body of the ring itself serves as an omnidirectional loop antenna for transmission and reception of signals. Representative applications of the interface device include use as a wireless computer mouse, a remote controller for a television, stereo, VCR, or the like.

Abstract: An affect-based method of communication between robots is provided by displaying a visual facial expression indicative of a simulated emotional state on a display device of a first robot, and viewing the visual facial expression using a camera on a second robot. The simulated emotional state may be one of happiness, anger, or sadness, for example. The second robot determines the simulated emotional state based upon the visual facial expression. The second robot processes the simulated emotional state to redefine its own simulated emotional state, and to display a visual facial expression indicative thereof. The visual facial expression allows a human observer to discern the simulated emotional state of the robot. Optionally, the robots further communicate affect using audio tones.

Abstract: To modify the temporal scale of recorded speech, relative stress and relative speaking rate terms are computed for individual sections, or frames, of the speech. These terms are then combined into a single value denoted as audio tension. For a nominal time-scale modification rate, the audio tension is employed to adjust the modification rate of the individual frames of speech in a non-uniform manner, relative to one another. With this approach, compressed speech can be reproduced at a relatively fast rate, while remaining intelligible to the listener.

Abstract: The invention enables the display of an image to be paused, then, at the end of the pause, resumed at an accelerated rate until a time at which the content of the display corresponds to the content that would have been displayed had the image been displayed at the normal display rate without the pause, at which time display of the image at the normal display rate resumes. The invention can be used with display systems that display pre-recorded images (such as are found on video or audio cassettes, or video or audio compact discs, for example) or with display systems that display images based upon display data that is only momentarily available to the display system (such as occurs in the display of television or radio broadcasts). The invention can be used with either analog or digital display systems. Further, the invention can be used with any type of image display, such as, for example, audio displays, video displays or audiovisual displays.

Abstract: An input device and method for interacting with motion pictures incorporating content-based haptic response is provided. Content data relating to the motion picture is stored in a content data storage device while motion picture data is stored in a prerecorded image data storage device. A viewer input device is provided so that a viewer (end-user) can move forwards and backwards through the frames on a display screen while substantially simultaneously, the content data is accessed and braking commands are sent to the viewer input device. The result is that the viewer is provided with haptic responses to the viewer's input through the viewer input device.

Abstract: A wearable speaker system which provides improved quality audio response and which does not interfere with the wearer's activities or block environmental sounds is disclosed. Transducer arrays, e.g. pairs of speakers, are situated in a wearable garment, headband, or the like and positioned on opposite sides of the wearer's head. In one embodiment, the transducer arrays share a common enclosure and are driven 180.degree. out of phase, so that back pressures cancel and low frequency response is enhanced. In another embodiment, two open-ended enclosures are provided, each with its own transducer array. In another embodiment, linear arrays of transducers are provided with appropriate time-delays between the audio signals. The speaker system is connected to or in communication with a conventional source of audio signals, such as a radio, tape player, CD player, cellular telephone or the like.

Abstract: A system and method for wide angle imaging create a high resolution image using a convex primary mirror concentrically positioned relative to a concave secondary mirror and one or more detectors spherically juxtaposed. The radii of the primary and secondary mirrors are related by the square of the "golden ratio" to reduce low order aberrations. A fiber optic faceplate coupled to each detector corrects field curvature of the image which may then be detected with a conventional flat detector, such as a CCD camera.

Abstract: An apparatus for sensing an angular rate of motion includes a body which defines a surface having a protuberant portion, and an orifice through the surface and proximate to the protuberant portion through which a fluid jet is directed along an initial jet axis. The protuberant portion directs the fluid jet in a path along the surface in accordance with the Coanda effect. A first flow sensor is fixed relative to the body and proximate to the path of the fluid jet along the surface of the body. The first flow sensor produces a first indication of a rate of flow of a first portion of the fluid jet proximate thereto. A second flow sensor is fixed relative to the body and proximate to the path of the fluid jet along the surface of the body. The second flow sensor produces a second indication of a rate of flow of a second portion of the fluid jet proximate thereto. The angular rate of motion of the body is sensed in dependence upon the first indication and the second indication.

Abstract: A personal communications apparatus using a garment-based audio interface includes a garment member worn on the upper torso of a person, wherein the garment member includes a neck opening which allows extension therethrough of the neck of the person. An audio output device capable of producing hi-fidelity spatialized 3-D sound aiming in selected directions is located adjacent the neck opening of the garment member. A receiver capable of receiving at least one transmitted signal and producing an audio signal based thereupon is coupled to the audio output device. An audio input device capable of capturing spatialized 3-D sound from selected directions is located adjacent the neck opening of the garment member. The audio signal from the audio input device is provided to a transmitter capable of transmitting a signal in dependence upon the audio signal. Embodiments of the garment member include a shirt and a necklace.

Abstract: In the first step of a sound morphing process, each sound which forms the basis for the morph is converted into one or more quantitative representations, such as spectrograms. After the representations have been obtained, the temporal axes of the two sounds are matched, so that similar components of the two sounds, such as onsets, harmonic regions and inharmonic regions, are aligned with one another. Other characteristics of the sounds, such as pitch, formant frequencies, or the like, are then matched. Once the energy in each of the sounds has been accounted for and matched to that of the other sound, the two sounds are cross-faded, to produce a representation of a new sound. This representation is then inverted, to generate the morphed sound.

Abstract: A portable, wearable personal audio system which includes an acoustic sample chamber and an acoustically transparent ear insert member. A tubular member transmits the audio from the sample chamber and module to the ear canal. An additional transducer, preferably made from a piezoelectric material, can be provided in the ear insert member or at the outer end of the tubular member. An electronics mechanism is preferably supplied as part of a behind-the-ear module or as part of the temple of a pair of eyeglasses. Stereo systems require separate systems for each ear. A quick exchange adapter mechanism is provided to connect the eyeglasses with a behind-the-ear module. A Velcro-type fastener or magnetic fastener mechanism connects the end of the eyeglasses to the module.

Abstract: A personal object or obstacle detector apparatus comprises a continuous transmission frequency modulation (CTFM) ranging system and an audio output device. The CTFM ranging system transmits a frequency-swept pressure wave, receives a reflected frequency-swept pressure wave from at least one object, and forms an audio signal based upon a frequency difference between the frequency-swept pressure wave and the reflected frequency-swept pressure wave the audio signal having an amplitude dependent upon size of the object. The audio output device produces an acoustic pressure wave in dependence upon the audio signal. In a preferred embodiment, the acoustic pressure wave contains separate tones for each of the objects detected, wherein each tone has a pitch dependent upon the distance from the CTFM ranging system to the corresponding object. Another embodiment utilizes a pair of CTFM ranging systems to produce a stereo auditory map of objects and obstacles.

Abstract: Methods and systems for sensing an auditory environment using a tympanic membrane of an individual are disclosed. An embodiment of a method comprises a step of dynamically sensing a displacement of the tympanic membrane in response to excitation by the auditory environment. An electrical signal based upon the sensed displacement is produced. Consequently, the electrical signal is representative of the auditory environment as sensed by the individual. Embodiments for sensing the displacement of the tympanic membrane are based upon laser interferometry and ultrasonic ranging. Further disclosed are methods and systems for modifying a sensed auditory environment, and methods and systems for producing a virtual auditory environment based upon directly sensing the displacement of the tympanic membrane of an individual.

Abstract: This invention is a component of an adaptive filter signal processor whose purpose is to separate a mixture of signals received by each of a plurality of transducers. This invention accomplishes a key step in that separation: it estimates, from the transducer signals, the relative propagation delays among the transducers for each source. First, it randomly generates a fixed number of sets of delay parameters, called a population. Thereafter, the following events occur at each clock cycle. Each set is processed by an instantaneous-performance calculator, to generate an instantaneous-performance value. The instantaneous performance value of each set is added to a cumulative performance value. The set with the greatest cumulative performance value is transferred to the adaptive filter signal processor. New parameter sets are generated at random.

Abstract: A portable, wearable personal audio system which includes an acoustic sample chamber and an acoustically transparent ear insert member. A tubular member transmits the audio from the sample chamber and module to the ear canal. The ear insert stabilizes and secures the tubular member in the ear canal. One or more surfaces of the ear insert member can be coated with a perforated flexible material. An additional transducer, preferably made from a piezoelectric material, can be provided in the ear insert member or at the outer end of the tubular member. An electronics mechanism is preferably supplied as part of a behind-the-ear module or as part of the temple of a pair of eyeglasses. Stereo systems require separate systems for each ear.

Abstract: A wearable portable entertainment and personal communication system which provides high quality sound, particularly at low audio frequencies, and which does not block or attenuate environmental sounds is disclosed. In a first embodiment, a transducer or transducer array is positioned on a wall in a sampling chamber between two cavities. One of the cavities is sealed and the other has one or more conduit members which direct the acoustic signals to one or both of the wearer's ears. In a second embodiment, both cavities have conduits, one directed to each of the wearer's ears. With either embodiment, the sampling chamber optionally can be combined with separate high frequency transducers. With both embodiments, the chambers are incorporated into a wearable garment and the transducers are connected to a source of audio signals.

Abstract: A wearable portable entertainment and personal communication system which provides high quality sound, particularly at low audio frequencies, and which does not block or attenuate environmental sounds is disclosed. In a first embodiment, a transducer or transducer array is positioned on a wall in a sampling chamber between two cavities. One of the cavities is sealed and the other has one or more conduit members which direct the acoustic signals to one or both of the wearer's ears. In a second embodiment, both cavities have conduits, one directed to each of the wearer's ears. With either embodiment, the sampling chamber optionally can be combined with separate high frequency transducers. With both embodiments, the chambers are incorporated into a wearable garment and the transducers are connected to a source of audio signals.

Abstract: A device with a speaker system and adapted to wear on the head of a wearer, such as a headband, is provided. Transducers are situated in a wearable device and positioned on opposite sides of the wearer's head, adjacent the ears. In one embodiment, the transducers share a common enclosure and are driven 180.degree. out of phase, so that back pressures cancel and low frequency response is enhanced. In another embodiment, two vented enclosures are provided, each with its own transducers. In other embodiments, acoustic concentrators can be incorporated to direct the audio more directly toward the wearer's ears. The speaker system is connected to or in communication with a conventional source of audio signals, such as a radio, tape player, CD player, cellular telephone or the like.