Abstract: A computerized interactor system uses physical, three-dimensional objects as metaphors for input of user intent to a computer system. When one or more interactors are engaged with a detection field, the detection field reads an identifier associated with the object and communicates the identifier to a computer system. The computer system determines the meaning of the interactor based upon its identifier and upon a semantic context in which the computer system is operating. One specific embodiment of the present invention is a bead interactor system that is a user playable sound and light show system. When an interactor bead is positioned within the detection space of the bead interactor system, a sound sequence begins and continues to play unaltered until the bead interactor is removed or other bead interactors are positioned within or removed from the detection space.

Abstract: Segmentation of background and foreground objects in an image is based upon the joint use of both range and color data. Range-based data is largely independent of color image data, and hence not adversely affected by the limitations associated with color-based segmentation, such as shadows and similarly colored objects. Furthermore, color segmentation is complementary to range measurement in those cases where reliable range data cannot be obtained. These complementary sets of data are used to provide a multidimensional background estimation. The segmentation of a foreground object in a given frame of an image sequence is carried out by comparing the image frames with background statistics relating to range and normalized color, using the sets of statistics in a complementary manner.

Abstract: The methods and systems of the present invention receive video or image data, for example via television broadcast, cable, or satellite television signal, or directly from a video player, and process the data to determine the geometry and material properties of various objects represented in the video image. Geometry and material property information may be deciphered from a video image by reference to various fixed data sources and/or the application of known methods for elucidating such information from video or image data, such as shape-from-motion or shape-from-shading techniques. Alternatively, all or some of this information may be provided to the system together with the video or image data via a preconfigured side channel. The system coordinates and assembles the image data with the data relating to geometry and material properties of the objects and provides a realistic haptic interaction with those objects to the user.

Abstract: In a music synthesis system, a scanning apparatus repeatedly scans a physical attribute of a vibrating object at a sequence of points of the vibrating object so as to repeatedly generate corresponding sequences of values. The music synthesis system generates an audio frequency waveform whose shape corresponds to the sequences of values. The vibrating object may be a physical object or a simulated object. The system may include a sensor for receiving user input, and means for mapping the user input into a stimulus signal that is applied to the vibrating object. In a preferred embodiment, the object vibrates and is manipulated by the user at haptic frequencies (0 to 15 hertz), while the sequences of scanned values are cyclically read at an audio frequencies so as to generate an audio frequency waveform whose timbre varies at the haptic frequencies associated with the object's vibration.

Abstract: The identification of hidden data, such as feature-based control points in an image, from a set of observable data, such as the image, is achieved through a two-stage approach. The first stage involves a learning process, in which a number of sample data sets, e.g. images, are analyzed to identify the correspondence between observable data, such as visual aspects of the image, and the desired hidden data, such as the control points. Two models are created. A feature appearance-only model is created from aligned examples of the feature in the observed data. In addition, each labeled data set is processed to generate a coupled model of the aligned observed data and the associated hidden data. In the second stage of the process, the modeled feature is located in an unmarked, unaligned data set, using the feature appearance-only model. This location is used as an alignment point and the coupled model is then applied to the aligned data, giving an estimate of the hidden data values for that data set.

Abstract: An improved visual user interface enables control of the interaction of a device with a spatial region. The visual user interface includes a display of a control space and a display of a target space. The content of the displayed target space can be a representation of some or all of the spatial region. The content of the displayed control space and displayed target space can also be established such that the displayed target space provides context for the displayed control space. The device is operated in accordance with the state of the displayed control space. The visual user interface enables a user to change the display of the control space, thereby controlling the operation of the device.

Abstract: The deferred scanline converter system in accordance with the present invention receives. triangle data from a front end processor, identifies the triangles that are in competition for a given pixel location, and determines the winning triangle from among the competing triangles to generate the pixel for that pixel location. The system includes a triangle buffer write logic and a scan-out logic. The triangle buffer write logic initially receives triangle data, re-orients the triangle data to top, middle, and bottom vertices, and writes the triangle data to the triangle buffer in accordance with a triangle buffer writing scheme. The writing scheme uses a coverage mask to limit the number of triangles in competition for a given pixel location (i.e., if a triangle cannot be written to the triangle buffer within the confines of the coverage mask, it will be discarded).

Abstract: The present invention improves the human/computer interface by providing printable interfaces that enable a user to invoke and control computer processes. The present invention teaches an encoded physical medium suitable for use in interfacing a computer user and a computer system such that the user can control and/or access a plurality of computer implemented processes such computer applications and web pages. The encoded physical medium has a Linkmark and an instruction mark. Encoded within the Linkmark is machine readable linking information directing to a computer implemented process. Encoded within the instruction mark is a machine readable operating instruction that, when decoded, may be executed by the computer implemented process. The present invention also teaches that the marks can present human readable information related to the nature of the machine readable information stored therein.

Abstract: A method and system for displaying advertisements. The advertisements are displayed on a television having a controlled connected thereto and configured for receiving commands from a viewer of the television. The method includes displaying a first advertisement on the television, receiving a command from the viewer of the television to display a second advertisement, the second advertisement being a variant of the first advertisement, and displaying the second advertisement on the television.

Abstract: An entropy efficient video coder for wavelet pyramids approaches the entropy-limited coding rate of video wavelet pyramids, is fast in both hardware and software implementations, and has low complexity (no multiplies) for use in ASICs. It uses a modified Z-coder to code the zero/non-zero significance function and Huffman coding for the non-zero coefficients themselves. The encoding unit includes a significance function generator that receives coefficients and outputs a single significance bit. A zero coefficient eliminator receives coefficients in parallel with the significance function generator and outputs coefficients if non-zero. Output from the significance function generator is coded using the modified Z-coder. Output from the zero coefficient eliminator is coded using Huffman coding. Both outputs are combined to form the resulting compressed stream.

Abstract: A speech/music discriminator employs data from multiple features of an audio signal as input to a classifier. Some of the feature data is determined from individual frames of the audio signal, and other input data is based upon variations of a feature over several frames, to distinguish the changes in voiced and unvoiced components of speech from the more constant characteristics of music. Several different types of classifiers for labeling test points on the basis of the feature data are disclosed. A preferred set of classifiers is based upon variations of a nearest-neighbor approach, including a K-d tree spatial partitioning technique.

Abstract: A computerized interactor system uses physical, three-dimensional objects as metaphors for input of user intent to a computer system. When one or more interactors are engaged with a detection field, the detection field reads an identifier associated with the object and communicates the identifier to a computer system. The computer system determines the meaning of the interactor based upon its identifier and upon a semantic context in which the computer system is operating. One specific embodiment of the present invention is a bead interactor system that is a user playable sound and light show system. When an interactor bead is positioned within the detection space of the bead interactor system, a sound sequence begins and continues to play unaltered until the bead interactor is removed or other bead interactors are positioned within or removed from the detection space.

Abstract: Quantifying the level of interest of an item of current interest is disclosed. An indication that an item is of current interest is received. The indication is processed to determine an intensity value. The intensity value is stored.

Abstract: The present invention teaches a variety of methods and systems for providing computer/human interfaces. According to one method, the user interfaces with an electronic device such as a computer system by engaging a sensor with desired regions of an encoded physical medium. The encoded physical medium is preferably chosen to provide intuitive meaning to the user, and is thus an improved metaphor for interfacing with the computer system. Suitable examples of the encoded physical medium include a data-linked book magazine, globe, or article of clothing. Some or all of the selected regions have had certain information encoded therein, information suitable for interfacing and controlling the computer system. When the user engages the sensor with a region having a certain encoded information, the certain encoded information is interpreted and an appropriate action taken. For example, the sensor or the computer system may provide suitable feedback to the user.

Abstract: A manual interface combines continuous and discrete control and display capabilities. The manual interface can be embodied by combining a haptic interface providing continuous control and display capabilities with one or more of multiple discrete selectors (such as tagged objects) providing discrete control capabilities. The manual interface can provide finer control and a richer sensory experience than is possible with conventional tagged objects. Further, unlike a conventional haptic interface device, the manual interface can provide easily selectable, multiple interactive possibilities.

Abstract: A user can selectively engage some part or all of the haptic display of a haptic interface device to produce an enhanced interaction with an environment with which the user interacts using the haptic interface device. Further, the haptic interface device can be implemented so that the part of the haptic display that is engaged can be engaged to varying degree. The degree of engagement with the haptic display (together with whether part or all of the haptic display is engaged) determines the manner in which the haptic display is experienced by the user. The selective engagement with the haptic display is enabled by adding a haptic clutch model to the underlying haptic model used to produce the haptic display, the haptic clutch model engaging some part or all of the haptic model in response to user input. The addition of a haptic clutch model to the haptic model used to produce a haptic display provides a richer user interaction than is provided by a haptic display produced by the haptic model alone.

Abstract: The present invention teaches a variety of methods and systems for providing computer/human interfaces. According to one method, the user interfaces with an electronic device such as a computer system by engaging a sensor with desired regions of an encoded physical medium. The encoded physical medium is preferably chosen to provide intuitive meaning to the user, and is thus an improved metaphor for interfacing with the computer system. Suitable examples of the encoded physical medium include a data-linked book, magazine, globe, or article of clothing. Some or all of the selected regions have had certain information encoded therein, information suitable for interfacing and controlling the computer system. When the user engages the sensor with a region having certain encoded information, the certain encoded information is interpreted and an appropriate action taken. For example, the sensor or the computer system may provide suitable feedback to the user.

Abstract: A technique for compressing video images uses temporary compression of blocks during compression, integrated color rotation of compressed images, direct compression of a composite video signal, and border filters to allow blocks to be compressed independently. Temporary compression reduces storage needed in an integrated circuit. An incoming frame is compressed block-by-block and placed in temporary storage. A corresponding block of a later frame is also compressed. Both blocks are decoded back into the transform domain and the two blocks are compared in the transform domain. Color rotation on compressed color information is integrated with overall compression and is performed upon the chrominance transform pyramids after transformation of the video signal rather than performing a rotation on the raw signal itself. Color rotation is performed at any stage and uses serial multiplication (shift and add) for more efficient processing, rather than using parallel multiplication.

Abstract: A haptic interface device produces a haptic display in response to a user's interaction with an environment with which the haptic interface device is associated. The invention enables the resolution of the haptic display produced by the haptic interface device to be changed by the user. In particular, the invention can be implemented so that the haptic display resolution can be changed (readily) as the user interacts with the environment using the haptic interface device. Thus, the invention can enable a user to interact with a particular environment at different levels of detail (i.e., different resolutions) and, in particular, can enable the user to immediately change from interacting with the environment at one level of detail to interacting with the environment at a different level of detail.

Abstract: An attention manager presents information to a person in the vicinity of a display device in a manner that engages at least the peripheral attention of the person. The information is embodied by one or more sets of content data (e.g., video or audio data). Each set of content data is formulated by a content provider and made available for use by content display systems. Upon appropriate activation, each content display system displays images corresponding to the sets of content data in accordance with predetermined scheduling information. The attention manager makes use of “unused capacity” of the display device and the person's attention, providing information to the person that the person might not otherwise expend adequate energy to obtain.