Abstract: A finger device initiates actions on a computer system when placed in contact with a surface. The finger device includes instrumentation that captures images and gestures. When in contact with a surface, the finger device captures images of the surface and gestures made on the surface. The finger device also transmits the images and gesture data to the computer system. An application on the computer system matches the images received from the finger device to a representation of the surface, identifies an action associated with the surface representation and gesture, and executes the action. Instrumenting the finger instead of the surface, allows a user to configure virtually any surface to accept touch input.

Abstract: In one embodiment of the present invention, a method for multiple device interaction includes detecting an orientation of a first device relative to a second device. The method also includes detecting a first gesture performed with either the first device or the second device, wherein the first gesture causes a first action that is based at least in part on the orientation of the first device relative to the second device.

Abstract: Methods are disclosed for dynamic assignment of possible channels in a touch sensitive device having rows and columns. In an embodiment, a method determines a first signal space in which to generate signals for use in the touch sensor. Signals are then generated in the first signal space on separate ones of the rows and a column signal is sensed on a column. The first signal space is replaced with a second signal space, and a second plurality of signals is generated for use in the touch sensor in the second frequency space. The second plurality of signals is sensed to identify a touch event in the touch sensitive device.

Abstract: A low-latency touch sensitive device provides a method for determining a location of a touch event thereon. The touch sensitive device row conductors and column conductors, the path of each of the row conductors crossing the path of each of the column conductors. Each of a set of orthogonal row signals are simultaneously transmitted on a respective one of at least some of the row conductors and an amount of each of the plurality of orthogonal row signals present on each of the plurality of column conductors is detected. A set of orthogonal column signals are simultaneously transmitted on a respective one of at least some of the column conductors. An amount of each of the orthogonal column signals present on each of the plurality of row conductors is detected. The detected amount of each of the plurality of orthogonal row signals and the detected amount of each of the plurality of orthogonal column signals is used to determine the location of a touch event on the device.

Abstract: A system for processing user input includes an input device, an input processing unit, a high-latency subsystem, a low-latency subsystem, input processing unit software for generating signals in response to user inputs, and an output device. The low-latency subsystem processes signals corresponding to at least some events and generates corresponding programmable low-latency output, the programmable output being based, at least in part, on state information being maintained by the high-latency subsystem. The high-latency subsystem processes signals corresponding to at least some events, and generates corresponding output, the output of the high-latency subsystem being higher latency than the output of the low-latency subsystem with respect to a given event.

Abstract: Disclosed are touch sensitive devices and methods of responding to hits in touch sensitive devices that include a graphical user interface having interface elements, each associated with a program element. A hit test map updater is used to process graphical user interface information into a hit test map in connection with the rendering of the graphical user interface, such that the hit test map associates properties with interface elements appearing on the graphical user interface. An input processor is used to receive a location corresponding to an input in connection with an input event, search the hit test map in which values are associated with interface elements appearing in the graphical user interface, and identify a property of the interface element from the values. In an embodiment, the identified property is proved to a central processing system and a user interface event is generated.

Abstract: A low-latency touch sensor is disclosed for use in connection with a touch surface having first and second conductors sensitive to changes in coupling therebetween as a result of touch (and/or near-touch). A signal generator generates unique orthogonal signals, a transmitter transmits the orthogonal signals on each of the first conductors. Receivers connected to the second conductors receive signals during a measurement period. The signals measured during the measurement period are processed to determine, for each measurement period, and for each of the second conductors, a signal strength corresponding to each of the unique orthogonal signals. The signal strengths can be used as a basis to determine touch events.

Abstract: An electronic device tracks, for a user performing a target acquisition movement within a 3D space, movement parameters of a plurality of input devices of the user. The electronic device predicts, for the user, a region of interest within the 3D space, using a regression model, based on the movement parameters. The region of interest includes a plurality of targets in close proximity. The electronic device predicts an endpoint of the target acquisition movement, within the region of interest, using a pointer facilitation technique. In some embodiments, the plurality of input devices includes an eye tracking input device, each input device corresponds to a predefined input device type, and the movement parameters include gaze data from the eye tracking input device. In some embodiments, input devices includes an eye tracking input device, a head-mounted display, and a hand-held controller, and the user's eye, hand, and head movements are coordinated.

Abstract: An electronic device with a display selects a subset of templates from a library of templates. Each of the templates comprises logged movements of one or more predefined input device types in a 3D space and each template includes one or more movement parameters. The electronic device tracks, for a user, movement parameters of at least one input device of the user. The at least one input device corresponds to one of the predefined input device types. The electronic device compares the tracked movement parameters of the at least one input device of the user to the movement parameters for the subset of the templates selected from the library of templates. The electronic device predicts, based on the comparison, a goal target ray, within the 3D space. In some embodiments, the goal target ray is highlighted or visually emphasized according to the prediction.

Abstract: Methods are disclosed for dynamic assignment of possible channels in a touch sensitive device having rows and columns. In an embodiment, a method determines a first signal space in which to generate signals for use in the touch sensor. Signals are then generated in the first signal space on separate ones of the rows and a column signal is sensed on a column. The first signal space is replaced with a second signal space, and a second plurality of signals is generated for use in the touch sensor in the second frequency space. The second plurality of signals is sensed to identify a touch event in the touch sensitive device.

Abstract: A low-latency touch sensitive device provides a method for determining a location of a touch event thereon. The touch sensitive device row conductors and column conductors, the path of each of the row conductors crossing the path of each of the column conductors. Each of a set of orthogonal row signals are simultaneously transmitted on a respective one of at least some of the row conductors and an amount of each of the plurality of orthogonal row signals present on each of the plurality of column conductors is detected. A set of orthogonal column signals are simultaneously transmitted on a respective one of at least some of the column conductors. An amount of each of the orthogonal column signals present on each of the plurality of row conductors is detected. The detected amount of each of the plurality of orthogonal row signals and the detected amount of each of the plurality of orthogonal column signals is used to determine the location of a touch event on the device.

Abstract: A system and method for distinguishing between sources of simultaneous touch events on a touch sensitive device are disclosed. The touch sensitive device includes row conductors and column conductors, the path of each of the row conductors crossing the path of each of the column conductors. Orthogonal row signals are generated on the row conductors and orthogonal column signals are generated on the column conductors. In an embodiment, an amount of each of the plurality of orthogonal row signals present on each of the plurality of row conductors is detected, an amount of each of the plurality of orthogonal column signals present on each of the plurality of column conductors is detected, and at least one of such amounts is used to associate each of the plurality of simultaneous touch events with a discrete source.

Abstract: Methods are disclosed for dynamic assignment of possible channels in a touch sensitive device having rows and columns. In an embodiment, a method determines a first signal space in which to generate signals for use in the touch sensor. Signals are then generated in the first signal space on separate ones of the rows and a column signal is sensed on a column. The first signal space is replaced with a second signal space, and a second plurality of signals is generated for use in the touch sensor in the second frequency space. The second plurality of signals is sensed to identify a touch event in the touch sensitive device.

Abstract: In an embodiment, a touch sensitive device includes a touch interface having rows and columns and a signal generator for generating unique orthogonal signals on a plurality of the rows, respectively. A touch processor identifies touch on the touch interface by processing touch signals present on the columns, and outputting a stream of touch events. A decimator receives the stream of touch events, selectively identifies one or more of the touch events in the stream and assembles information concerning one or more touch events in the stream, and outputs both the selectively identified touch events and the assembled information for use by the touch sensitive device.

Abstract: A system and method are disclosed for using a touch sensing system capable of sensing location of a finger or object above a touch surface to inform a touch response system in an electronic device of a predicted future user input event or motion data in advance of an actual touch event. Current user input is sensed via the touch sensing system and data reflecting hover information is created. A model of user interaction with a touch surface is applied to the data representative of the user input to create data reflecting a prediction of a future user input event. In an embodiment, prior to occurrence of the predicted user input event, a predicted location and a predicted time at which the predicted future user input event will occur are provided to a touch response system.

Abstract: A system and method are disclosed for using a touch sensing system capable of sensing location of a finger or object above a touch surface to inform a touch response system in an electronic device of a predicted future user input event or motion data in advance of an actual touch event. Current user input is sensed via the touch sensing system and data reflecting hover information is created. A model of user interaction with a touch surface is applied to the data representative of the user input to create data reflecting a prediction of a future user input event. In an embodiment, prior to occurrence of the predicted user input event, a predicted location and a predicted time at which the predicted future user input event will occur are provided to a touch response system.

Abstract: A low-latency touch sensor is disclosed for use in connection with a touch surface having first and second conductors sensitive to changes in coupling therebetween as a result of touch (and/or near-touch). A signal generator generates unique orthogonal signals, a transmitter transmits the orthogonal signals on each of the first conductors. Receivers connected to the second conductors receive signals during a measurement period. The signals measured during the measurement period are processed to determine, for each measurement period, and for each of the second conductors, a signal strength corresponding to each of the unique orthogonal signals. The signal strengths can be used as a basis to determine touch events.

Abstract: In an embodiment, a touch sensitive device includes touch interface having rows and columns and a signal generator for generating unique orthogonal signals on a plurality of the rows, respectively. A touch processor identifies touch on the touch interface by processing touch signals present on the columns, and outputting a stream of touch events. A decimator receives the stream of touch events including information as to a pressure of the touch event or the contact area of the touch event, selectively identifies one or more of the touch events in the stream, and outputs a modified stream of touch events for use by the touch sensitive device.

Abstract: A low-latency touch sensitive device provides a method for determining a location of a touch event thereon. The touch sensitive device row conductors and column conductors, the path of each of the row conductors crossing the path of each of the column conductors. Each of a set of orthogonal row signals are simultaneously transmitted on a respective one of at least some of the row conductors and an amount of each of the plurality of orthogonal row signals present on each of the plurality of column conductors is detected. A set of orthogonal column signals are simultaneously transmitted on a respective one of at least some of the column conductors. An amount of each of the orthogonal column signals present on each of the plurality of row conductors is detected. The detected amount of each of the plurality of orthogonal row signals and the detected amount of each of the plurality of orthogonal column signals is used to determine the location of a touch event on the device.

Abstract: System and processes for transmitting orthogonal frequencies on a touch sensor are provided. In one example process, the rows of the sensor panel can have signals transmitted thereon having orthogonal frequencies. The orthogonal frequencies can be separated by a frequency spacing (?f) that is at least the reciprocal of a measurement period ? (e.g., an integration time) of the touch sensor. Touch events cause and correspond to signals on the columns, which can be received by a receive system including appropriate amplifiers. The orthogonal frequencies can be detected by the receiver with a Fourier Transform or filter bank. Separate digitization and signal processing can be implemented for every column. The receiver can measure the quantity of each of the orthogonal transmitted signals present on each column, identifying the rows in touch with each column and may also provide additional (e.g., qualitative) information concerning the touch.