Abstract: The methods and systems of the present invention receive video or image data, for example via television broadcast, cable, or satellite television signal, or directly from a video player, and process the data to determine the geometry and material properties of various objects represented in the video image. Geometry and material property information may be deciphered from a video image by reference to various fixed data sources and/or the application of known methods for elucidating such information from video or image data, such as shape-from-motion or shape-from-shading techniques. Alternatively, all or some of this information may be provided to the system together with the video or image data via a preconfigured side channel. The system coordinates and assembles the image data with the data relating to geometry and material properties of the objects and provides a realistic haptic interaction with those objects to the user.

Abstract: In a music synthesis system, a scanning apparatus repeatedly scans a physical attribute of a vibrating object at a sequence of points of the vibrating object so as to repeatedly generate corresponding sequences of values. The music synthesis system generates an audio frequency waveform whose shape corresponds to the sequences of values. The vibrating object may be a physical object or a simulated object. The system may include a sensor for receiving user input, and means for mapping the user input into a stimulus signal that is applied to the vibrating object. In a preferred embodiment, the object vibrates and is manipulated by the user at haptic frequencies (0 to 15 hertz), while the sequences of scanned values are cyclically read at an audio frequencies so as to generate an audio frequency waveform whose timbre varies at the haptic frequencies associated with the object's vibration.

Abstract: The identification of hidden data, such as feature-based control points in an image, from a set of observable data, such as the image, is achieved through a two-stage approach. The first stage involves a learning process, in which a number of sample data sets, e.g. images, are analyzed to identify the correspondence between observable data, such as visual aspects of the image, and the desired hidden data, such as the control points. Two models are created. A feature appearance-only model is created from aligned examples of the feature in the observed data. In addition, each labeled data set is processed to generate a coupled model of the aligned observed data and the associated hidden data. In the second stage of the process, the modeled feature is located in an unmarked, unaligned data set, using the feature appearance-only model. This location is used as an alignment point and the coupled model is then applied to the aligned data, giving an estimate of the hidden data values for that data set.

Abstract: An improved visual user interface enables control of the interaction of a device with a spatial region. The visual user interface includes a display of a control space and a display of a target space. The content of the displayed target space can be a representation of some or all of the spatial region. The content of the displayed control space and displayed target space can also be established such that the displayed target space provides context for the displayed control space. The device is operated in accordance with the state of the displayed control space. The visual user interface enables a user to change the display of the control space, thereby controlling the operation of the device.

Abstract: The deferred scanline converter system in accordance with the present invention receives. triangle data from a front end processor, identifies the triangles that are in competition for a given pixel location, and determines the winning triangle from among the competing triangles to generate the pixel for that pixel location. The system includes a triangle buffer write logic and a scan-out logic. The triangle buffer write logic initially receives triangle data, re-orients the triangle data to top, middle, and bottom vertices, and writes the triangle data to the triangle buffer in accordance with a triangle buffer writing scheme. The writing scheme uses a coverage mask to limit the number of triangles in competition for a given pixel location (i.e., if a triangle cannot be written to the triangle buffer within the confines of the coverage mask, it will be discarded).

Abstract: The present invention improves the human/computer interface by providing printable interfaces that enable a user to invoke and control computer processes. The present invention teaches an encoded physical medium suitable for use in interfacing a computer user and a computer system such that the user can control and/or access a plurality of computer implemented processes such computer applications and web pages. The encoded physical medium has a Linkmark and an instruction mark. Encoded within the Linkmark is machine readable linking information directing to a computer implemented process. Encoded within the instruction mark is a machine readable operating instruction that, when decoded, may be executed by the computer implemented process. The present invention also teaches that the marks can present human readable information related to the nature of the machine readable information stored therein.

Abstract: A method and system for displaying advertisements. The advertisements are displayed on a television having a controlled connected thereto and configured for receiving commands from a viewer of the television. The method includes displaying a first advertisement on the television, receiving a command from the viewer of the television to display a second advertisement, the second advertisement being a variant of the first advertisement, and displaying the second advertisement on the television.

Abstract: A speech/music discriminator employs data from multiple features of an audio signal as input to a classifier. Some of the feature data is determined from individual frames of the audio signal, and other input data is based upon variations of a feature over several frames, to distinguish the changes in voiced and unvoiced components of speech from the more constant characteristics of music. Several different types of classifiers for labeling test points on the basis of the feature data are disclosed. A preferred set of classifiers is based upon variations of a nearest-neighbor approach, including a K-d tree spatial partitioning technique.

Abstract: Quantifying the level of interest of an item of current interest is disclosed. An indication that an item is of current interest is received. The indication is processed to determine an intensity value. The intensity value is stored.

Abstract: The present invention teaches a variety of methods and systems for providing computer/human interfaces. According to one method, the user interfaces with an electronic device such as a computer system by engaging a sensor with desired regions of an encoded physical medium. The encoded physical medium is preferably chosen to provide intuitive meaning to the user, and is thus an improved metaphor for interfacing with the computer system. Suitable examples of the encoded physical medium include a data-linked book magazine, globe, or article of clothing. Some or all of the selected regions have had certain information encoded therein, information suitable for interfacing and controlling the computer system. When the user engages the sensor with a region having a certain encoded information, the certain encoded information is interpreted and an appropriate action taken. For example, the sensor or the computer system may provide suitable feedback to the user.

Abstract: The present invention teaches a variety of methods and systems for providing computer/human interfaces. According to one method, the user interfaces with an electronic device such as a computer system by engaging a sensor with desired regions of an encoded physical medium. The encoded physical medium is preferably chosen to provide intuitive meaning to the user, and is thus an improved metaphor for interfacing with the computer system. Suitable examples of the encoded physical medium include a data-linked book, magazine, globe, or article of clothing. Some or all of the selected regions have had certain information encoded therein, information suitable for interfacing and controlling the computer system. When the user engages the sensor with a region having certain encoded information, the certain encoded information is interpreted and an appropriate action taken. For example, the sensor or the computer system may provide suitable feedback to the user.

Abstract: A technique for compressing video images uses temporary compression of blocks during compression, integrated color rotation of compressed images, direct compression of a composite video signal, and border filters to allow blocks to be compressed independently. Temporary compression reduces storage needed in an integrated circuit. An incoming frame is compressed block-by-block and placed in temporary storage. A corresponding block of a later frame is also compressed. Both blocks are decoded back into the transform domain and the two blocks are compared in the transform domain. Color rotation on compressed color information is integrated with overall compression and is performed upon the chrominance transform pyramids after transformation of the video signal rather than performing a rotation on the raw signal itself. Color rotation is performed at any stage and uses serial multiplication (shift and add) for more efficient processing, rather than using parallel multiplication.

Abstract: An attention manager presents information to a person in the vicinity of a display device in a manner that engages at least the peripheral attention of the person. The information is embodied by one or more sets of content data (e.g., video or audio data). Each set of content data is formulated by a content provider and made available for use by content display systems. Upon appropriate activation, each content display system displays images corresponding to the sets of content data in accordance with predetermined scheduling information. The attention manager makes use of “unused capacity” of the display device and the person's attention, providing information to the person that the person might not otherwise expend adequate energy to obtain.

Abstract: A powerful, scaleable, and reconfigurable image processing system and method of processing data therein is described. This general purpose, reconfigurable engine with toroidal topology, distributed memory, and wide bandwidth I/O are capable of solving real applications at real-time speeds. The reconfigurable image processing system can be optimized to efficiently perform specialized computations, such as real-time video and audio processing. This reconfigurable image processing system provides high performance via high computational density, high memory bandwidth, and high I/O bandwidth. Generally, the reconfigurable image processing system and its control structure include a homogeneous array of 16 field programmable gate arrays (FPGA) and 16 static random access memories (SRAM) arranged in a partial torus configuration. The reconfigurable image processing system also includes a PCI bus interface chip, a clock control chip, and a datapath chip. It can be implemented in a single board.

Abstract: Techniques from computer vision and computer graphics are combined to robustly track a target (e.g., a user) and perform a function based upon the image and/or the identity attributed to the target's face. Three primary modules are used to track a user's head: depth estimation, color segmentation, and pattern classification. The combination of these three techniques allows for robust performance despite unknown background, crowded conditions, and rapidly changing pose or expression of the user. Each of the modules can also provide an identity classification module with valuable information so that the identity of a user can be estimated. With an estimate of the position of a target in 3-D and the target's identity, applications such as individualized computer programs or graphics techniques to distort and/or morph the shape or apparent material properties of the user's face can be performed.

Abstract: The present invention teaches a variety of methods and systems for providing computer/human interfaces. According to one method, the user interfaces with an electronic device such as a computer system by engaging a sensor with desired regions of an encoded physical medium. The encoded physical medium is preferably chosen to provide intuitive meaning to the user, and is thus an improved metaphor for interfacing with the computer system. Suitable examples of the encoded physical medium include a data-linked book, magazine, globe, or article of clothing. Some or all of the selected regions have had certain information encoded therein, information suitable for interfacing and controlling the computer system. When the user engages the sensor with a region having certain encoded information, the certain encoded information is interpreted and an appropriate action taken. For example, the sensor or the computer system may provide suitable feedback to the user.

Abstract: A short range inductively coupled wireless communication system employs analog frequency modulation of a high frequency carrier and magnetic coupling between a transmitting antenna and a receiving antenna. A transmitter coupled to the transmitting antenna modulates multiple high-fidelity analog audio signals and digital control messages onto separate high frequency (“HF”) carriers. The electric field portion of the transmitted electromagnetic field is substantially eliminated during transmission, while the magnetic field portion is substantially unaffected. The receiving antenna is coupled to a demodulator which reproduces the audio frequency signals and decodes control messages sent by the transmitter.

Abstract: Fluid flow can be measured using a multiplicity of sensors in a manner that enables acquisition of detailed information regarding the fluid flow. In particular, the invention can advantageously be used in situations in which the measured fluid flow is anticipated to be turbulent. Even more particularly, the invention can be advantageously be used to obtain measurements of fluid flow in the vicinity of an animate object (e.g., human) which can be used, together with knowledge of the characteristics of the animate object and, if relevant, of one or more objects in the vicinity of the animate object, to determine an intention of, or an effect produced by, the animate object. The invention can be used by people in interacting with a large variety of devices to effect control of those devices.

Abstract: Disclosed is a position detection system for determining a state of a physical object. The position detection system includes a platform and a physical object positioned adjacent to the platform. The physical object has an object state that is changeable. The position detection system also includes a first resonator having a first resonator position state. The first resonator is arranged such that a change in the object state causes a change in the first resonator position state and such that the first resonator position state is different from the object state. The first resonator is further arranged to output a resonator signal that is associated with the first resonator position state when an excitation signal with a predetermined frequency range is received by the first resonator.

Abstract: The present invention teaches a computer interface system for providing content to a user using at least two encoded hotspots. A first hotspot is a context hotspot which activates functions in the computer system, selects databases and/or sets selection criteria. A second, content, hotspot is decoded based on its encoded information as well as the information decoded from the context hotspot. Content of the second hotspot includes direction and indirection content and may access data or executable programs.