Abstract: A powerful, scaleable, and reconfigurable image processing system and method of processing data therein is described. This general purpose, reconfigurable engine with toroidal topology, distributed memory, and wide bandwidth I/O are capable of solving real applications at real-time speeds. The reconfigurable image processing system can be optimized to efficiently perform specialized computations, such as real-time video and audio processing. This reconfigurable image processing system provides high performance via high computational density, high memory bandwidth, and high I/O bandwidth. Generally, the reconfigurable image processing system and its control structure include a homogeneous array of 16 field programmable gate arrays (FPGA) and 16 static random access memories (SRAM) arranged in a partial torus configuration. The reconfigurable image processing system also includes a PCI bus interface chip, a clock control chip, and a datapath chip. It can be implemented in a single board.

Abstract: Techniques from computer vision and computer graphics are combined to robustly track a target (e.g., a user) and perform a function based upon the image and/or the identity attributed to the target's face. Three primary modules are used to track a user's head: depth estimation, color segmentation, and pattern classification. The combination of these three techniques allows for robust performance despite unknown background, crowded conditions, and rapidly changing pose or expression of the user. Each of the modules can also provide an identity classification module with valuable information so that the identity of a user can be estimated. With an estimate of the position of a target in 3-D and the target's identity, applications such as individualized computer programs or graphics techniques to distort and/or morph the shape or apparent material properties of the user's face can be performed.

Abstract: The present invention teaches a variety of methods and systems for providing computer/human interfaces. According to one method, the user interfaces with an electronic device such as a computer system by engaging a sensor with desired regions of an encoded physical medium. The encoded physical medium is preferably chosen to provide intuitive meaning to the user, and is thus an improved metaphor for interfacing with the computer system. Suitable examples of the encoded physical medium include a data-linked book, magazine, globe, or article of clothing. Some or all of the selected regions have had certain information encoded therein, information suitable for interfacing and controlling the computer system. When the user engages the sensor with a region having certain encoded information, the certain encoded information is interpreted and an appropriate action taken. For example, the sensor or the computer system may provide suitable feedback to the user.

Abstract: A short range inductively coupled wireless communication system employs analog frequency modulation of a high frequency carrier and magnetic coupling between a transmitting antenna and a receiving antenna. A transmitter coupled to the transmitting antenna modulates multiple high-fidelity analog audio signals and digital control messages onto separate high frequency (“HF”) carriers. The electric field portion of the transmitted electromagnetic field is substantially eliminated during transmission, while the magnetic field portion is substantially unaffected. The receiving antenna is coupled to a demodulator which reproduces the audio frequency signals and decodes control messages sent by the transmitter.

Abstract: Fluid flow can be measured using a multiplicity of sensors in a manner that enables acquisition of detailed information regarding the fluid flow. In particular, the invention can advantageously be used in situations in which the measured fluid flow is anticipated to be turbulent. Even more particularly, the invention can be advantageously be used to obtain measurements of fluid flow in the vicinity of an animate object (e.g., human) which can be used, together with knowledge of the characteristics of the animate object and, if relevant, of one or more objects in the vicinity of the animate object, to determine an intention of, or an effect produced by, the animate object. The invention can be used by people in interacting with a large variety of devices to effect control of those devices.

Abstract: Disclosed is a position detection system for determining a state of a physical object. The position detection system includes a platform and a physical object positioned adjacent to the platform. The physical object has an object state that is changeable. The position detection system also includes a first resonator having a first resonator position state. The first resonator is arranged such that a change in the object state causes a change in the first resonator position state and such that the first resonator position state is different from the object state. The first resonator is further arranged to output a resonator signal that is associated with the first resonator position state when an excitation signal with a predetermined frequency range is received by the first resonator.

Abstract: The present invention teaches a computer interface system for providing content to a user using at least two encoded hotspots. A first hotspot is a context hotspot which activates functions in the computer system, selects databases and/or sets selection criteria. A second, content, hotspot is decoded based on its encoded information as well as the information decoded from the context hotspot. Content of the second hotspot includes direction and indirection content and may access data or executable programs.

Abstract: The deferred scanline converter system in accordance with the present invention receives triangle data from a front end processor, identifies the triangles that are in competition for a given pixel location, and determines the winning triangle from among the competing triangles to generate the pixel for that pixel location. The system includes a triangle buffer write logic and a scan-out logic. The triangle buffer write logic initially receives triangle data, re-orients the triangle data to top, middle, and bottom vertices, and writes the triangle data to the triangle buffer in accordance with a triangle buffer writing scheme. The writing scheme uses a coverage mask to limit the number of triangles in competition for a given pixel location (i.e., if a triangle cannot be written to the triangle buffer within the confines of the coverage mask, it will be discarded).

Abstract: The identification of hidden data, such as feature-based control points in an image, from a set of observable data, such as the image, is achieved through a two-stage approach. The first stage involves a learning process, in which a number of sample data sets, e.g. images, are analyzed to identify the correspondence between observable data, such as visual aspects of the image, and the desired hidden data, such as the control points. Two models are created. A feature appearance-only model is created from aligned examples of the feature in the observed data. In addition, each labeled data set is processed to generate a coupled model of the aligned observed data and the associated hidden data. In the second stage of the process, the modeled feature is located in an unmarked, unaligned data set, using the feature appearance-only model. This location is used as an alignment point and the coupled model is then applied to the aligned data, giving an estimate of the hidden data values for that data set.

Abstract: A technique for compressing video images uses temporary compression of blocks during compression, integrated color rotation of compressed images, direct compression of a composite video signal, and border filters to allow blocks to be compressed independently. Temporary compression reduces storage needed in an integrated circuit. An incoming frame is compressed block-by-block and placed in temporary storage. A corresponding block of a later frame is also compressed. Both blocks are decoded back into the transform domain and the two blocks are compared in the transform domain. Color rotation on compressed color information is integrated with overall compression and is performed upon the chrominance transform pyramids after transformation of the video signal rather than performing a rotation on the raw signal itself. Color rotation is performed at any stage and uses serial multiplication (shift and add) for more efficient processing, rather than using parallel multiplication.

Abstract: A motion wavelet transform zero tree codec achieves high compression and is implemented in hardware of modest size and at very low cost. A wavelet transform is combined with a tree walk technique for encoding the resulting wavelet coefficients. A 2-6 wavelet transform is used. Wavelet coefficients from the transform are represented in a pyramid of wavelet coefficients. An array of zero trees are formed from the pyramid to hold the wavelet coefficients, one coefficient to each node. Significance values for each node are calculated to assist with the tree walk and encoding. Each zero tree is traversed to produce an output of encoded bits. Encoded bits are output directly during the tree walk.

Abstract: The invention enables the apparent display rate of an audiovisual display to be varied. The invention can modify an original set of audio data in accordance with a target display rate, then modify a related original set of video data to conform to the modifications made to the audio data set, such that the modified audio and video data sets are synchronized. When the modified audio and video data sets so produced are used to generate an audiovisual display, the audiovisual display has an apparent display rate that approximates the target display rate. The target display rate can be faster or slower than a normal display rate at which an audiovisual display system generates an audiovisual display from the original sets of audio and video data. The target display rate can be established solely by a user instruction, by analysis of the audiovisual data, or by modification of a user-specified nominal target display rate based upon analysis of the audiovisual data.

Abstract: Image-based synthesis for non-rigid bodies whose appearances do not form a linear manifold is carried out by representing mappings from control parameters to appearances as subsets of piecewise smooth functions. Each subset contains example images which are well approximated by particular examples which lie on the convex hull of the subset's parameter values. Once the subsets of examples are defined, interpolation is performed by using only the examples in a single subset. To provide for efficient operation, image transforms based upon radial cumulative similarities are used to automatically estimate the correspondence between example images.

Abstract: A computerized interactor system uses physical, three-dimensional objects as metaphors for input of user intent to a computer system. When one or more interactors are engaged with a detection field, the detection field reads an identifier associated with the object and communicates the identifier to a computer system. The computer system determines the meaning of the interactor based upon its identifier and upon a semantic context in which the computer system is operating. One specific embodiment of the present invention is a bead interactor system that is a user playable sound and light show system. When an interactor bead is positioned within the detection space of the bead interactor system, a sound sequence begins and continues to play unaltered until the bead interactor is removed or other bead interactors are positioned within or removed from the detection space.

Abstract: The present invention teaches methods and apparatus for social interaction allowing users to communicate at their leisure (asynchronously or “semi-synchronously”) by providing simple, flexible access to a persistent, shared space. For example, an electronic communication system according to one embodiment provides a shared persistent data space to a plurality of clients. This system comprises a server and at least two input/display units (IDUS) which clients use to access shared persistent data in the form of group boards. The group boards store discrete notes in a group database made accessible to all members of the group. In order to allow clients to select a desired group, each IDU includes an input detection space operable to receive user input indicative of a request to access a specific group.

Abstract: A given point of interest in an image is defined by two properties, a local attribute, such as color, and a neighborhood function that describes a similarity pattern. The color value is not influenced by nearby background regions of the image, and functions as a descriptor for each location. The neighborhood function distinguishes locations of similar color from one another, by capturing patterns of change in the local color. The neighborhood function measures the similarity between the local color and colors at nearby points, and reduces the measured similarity values that lie beyond contrast boundaries. Through the computation of such a transform for points of interest in an image, corresponding points in other images can be readily identified.

Abstract: Existing media signals are processed to create new media content by defining content representations for the existing media and establishing functional dependencies between the representations. The content representations comprise different data types which determine the kinds of operations that can be performed and dependencies that can be established. Among the types of transformation that can be achieved are synchronization, sound substitution, and the creation of parametric special effects. The content representations and their functional dependencies are combined to construct a functional dependency network which causes the desired transformations to occur on input media signals. The inputs to the functional dependency network are parametrically specified by media data types to construct a template that can be used to create adaptive media productions.

Abstract: Acoustic modules adapted to be worn on the head of a wearer, such as with a headband, or fastened to a hat or eyeglasses, are provided. The modules are situated on opposite sides of the wearer's head, adjacent the ears, and each contains a transducer, an outlet port and a vent port. The audio system is connected to, or in communication with, a conventional source of audio signals, such as a radio, tape player, CD player, cellular telephone, or the like.

Abstract: A variable bandwidth communication system includes a first communication station and a second communication station coupled to the first communication station for continuous, by directional communication. The first communication station is capable of transmitting at a first bandwidth and a second bandwidth greater than the first bandwidth, and is capable of receiving at a third bandwidth and a fourth bandwidth greater than the third bandwidth. The transmitting bandwidth of the first communication station is selectable by first user. The second communication station is capable of receiving at the first bandwidth and at the second bandwidth and is capable at transmitting at the third bandwidth and the fourth bandwidth. Again, the transmitting bandwidth of the second communication station is selectable by the second user. Preferably, but not necessarily, the first bandwidth and the third bandwidth are about the same, and the second bandwidth and the fourth bandwidth are about the same.

Abstract: A computerized interactor system uses physical, three-dimensional objects as metaphors for input of user intent to a computer system. When one or more interactors are engaged with a detection field, the detection field reads an identifier associated with the object and communicates the identifier to a computer system. The computer system determines the meaning of the interactor based upon its identifier and upon a semantic context in which the computer system is operating. The interactors can be used to control other systems, such as audio systems, or it can be used as intuitive inputs into a computer system for such purposes as marking events in a temporal flow. The interactors, as a minimum, communicate their identity, but may also be more sophisticated in that they can communicate additional processed or unprocessed data, i.e. they can include their own data processors.