Abstract: The disclosed systems and methods relate in general to the field of user input to a touch sensitive device, and in particular to user input systems and methods which can reduce the latency between a most recent input event and the displaying of a rendered frame reflecting such input.

Abstract: In an embodiment, a latency measuring head is provided for use in measuring touch-to-response latency in a test device, the test device including a capacitive user interface that responds to touch input. The latency measuring head includes a conductive element adapted to be positioned in static proximity with and/or in contact with the capacitive user interface. An electron sink is operatively connected to the conductive element via a normally open switch having an open and a closed position. The electron sink has capacity to hold or dissipate a sufficient charge to trigger a touch event on the test device when the switch is closed. A photosensitive element is positioned in static proximity with and/or in contact with the capacitive user interface such that the photosensitive element can output a signal in response to a change in an optical property of at least a portion of the capacitive user interface.

Abstract: Disclosed are a method and corresponding touch sensitive device that can be altered to change sensitivity and distance over which it interacts with an object. A touch sensor is configured to detect location of a touching object hovering above a touch surface. A ground plane is located behind the touch surface at a predetermined distance from the touch surface. A processor in the touch sensor is configured to control the effective distance between the ground plane and the touch surface and sensitivity of detection of a finger or touching object hovering above the touch surface.

Abstract: Disclosed are a touch sensitive device and corresponding method that utilizes distance fields for frame matching. The device includes a touch interface having row conductors and column conductors. A row signal generator transmits a row signal on at least one of the row conductors. A touch processor is used to process column signals from data received on at least one of the column conductors. The touch processor is configured to use discrete values from the column signals to compute a distance field function and store a representation of a distance field grid for a current frame, use the representation of the distance field grid to determine data representing a state change, and use the data representing a state change to match at least one touch location from a previous frame to at least one touch location in the current frame.

Abstract: A touch sensitive device, comprising touch interface comprising rows and columns, a signal generator for generating a plurality of unique orthogonal signals on at least a plurality of the rows, respectively, capacitive sensors on at least a plurality of the columns for sensing changes in the amount of capacitive coupling between the rows and the columns on the touch interface, and a touch processor for identifying a pressure of touch on the touch interface by processing the amount of pressure applied to the touch interface based on the capacitive coupling. Methods for inferring contact pressure, calculating an inferred touch pressure, and calculating a single gradient value are also presented.

Abstract: Disclosed are a method and corresponding touch sensitive device that detects touch and provides tactile feedback. In an embodiment, the device includes a touch interface having row conductors and column conductors. A first row signal generator transmits a first row signal on a first row conductor. A second row signal generator transmits a second row signal on a second row conductor, the second row signal being orthogonal to the first row signal. A third row signal generator generates an electrotactile discharge signal on at least one of the row conductors. In an embodiment, the electrotactile discharge signal is time multiplexed with at least one of said first row signal or said second row signal. A touch processor identifies a touch event on the touch interface by processing signals present on at least one of the column conductors.

Abstract: A system for processing user input includes an input device, an input processing unit, a high-latency subsystem, a low-latency subsystem, input processing unit software for generating signals in response to user inputs, and an output device. The low-latency subsystem receives the signals and generates low-latency output and the high-latency subsystem processes the signals and generates high-latency output.

Abstract: Disclosed are systems and methods for decreasing latency between an acquisition of touch data and processing of an associated rendering task in a touch sensitive device having a touch sensing system capable of producing touch data at a touch sampling rate and having a display system that displays frames at a refresh rate. In an embodiment, the system estimates at least one of (a) a period of time for sampling touch data from the touch sensing system, (b) a period of time for computing touch event data from sampled touch data, and (c) a period of time for rendering of a frame to a frame buffer. The system determines a period of time Tc for (a) sampling touch data from the touch sensing system, (b) computing touch event data from sampled touch data, and (c) rendering of a frame to a frame buffer, based at least in part on the estimate. The system determines a point in time Tr at which the display system will be refreshed from the frame buffer.

Abstract: Devices and methods are disclosed for utilizing a module running in an operating system to enable communication with decreased latency between a source of input event data and one or more user application processes awaiting input events in a computing device. The module receives a notification that a frame of input event data from a source of input event data is ready to be read. In response, the module reads the frame of input event data from a communication channel such as a named pipe, loads the frame of input event data into a buffer, or into a memory of a dedicated processing unit, and generates a notification to the user application process, thereby causing the user application process to read the frame of input event data from the buffer.

Abstract: Disclosed are touch sensitive devices and methods of responding to hits in touch sensitive devices that include a graphical user interface having interface elements, each associated with a program element. A hit test map updater is used to process graphical user interface information into a hit test map in connection with the rendering of the graphical user interface, such that the hit test map associates properties with interface elements appearing on the graphical user interface. An input processor is used to receive a location corresponding to an input in connection with an input event, search the hit test map in which values are associated with interface elements appearing in the graphical user interface, and identify a property of the interface element from the values. In an embodiment, the identified property is proved to a central processing system and a user interface event is generated.

Abstract: A system and method are disclosed for using a touch sensing system capable of sensing location of a finger or object above a touch surface to inform a touch response system in an electronic device of a predicted future user input event or motion data in advance of an actual touch event. Current user input is sensed via the touch sensing system and data reflecting hover information is created. A model of user interaction with a touch surface is applied to the data representative of the user input to create data reflecting a prediction of a future user input event. In an embodiment, prior to occurrence of the predicted user input event, a predicted location and a predicted time at which the predicted future user input event will occur are provided to a touch response system.

Abstract: An interaction system is described which uses a depth camera to capture a depth image of a physical object placed on, or in vicinity to, an interactive surface. The interaction system also uses a video camera to capture a video image of the physical object. The interaction system can then generate a 3D virtual object based on the depth image and video image. The interaction system then uses a 3D projector to project the 3D virtual object back onto the interactive surface, e.g., in a mirrored relationship to the physical object. A user may then capture and manipulate the 3D virtual object in any manner. Further, the user may construct a composite model based on smaller component 3D virtual objects. The interaction system uses a projective texturing technique to present a realistic-looking 3D virtual object on a surface having any geometry.

Abstract: In an embodiment, a touch sensitive device includes a touch interface having rows and columns and a signal generator for generating unique orthogonal signals on a plurality of the rows, respectively. A touch processor is identifies touch on the touch interface by processing touch signals present on the columns, and outputting a stream of touch events. A decimator receives the stream of touch events, selectively identifies one or more of the touch events in the stream, and outputs a modified stream of touch events for use by the touch sensitive device.

Abstract: A system and method for distinguishing between sources of simultaneous touch events on a touch sensitive device are disclosed. The touch sensitive device includes row conductors and column conductors, the path of each of the row conductors crossing the path of each of the column conductors. Orthogonal row signals are generated on the row conductors and orthogonal column signals are generated on the column conductors. In an embodiment, an amount of each of the plurality of orthogonal row signals present on each of the plurality of row conductors is detected, an amount of each of the plurality of orthogonal column signals present on each of the plurality of column conductors is detected, and at least one of such amounts is used to associate each of the plurality of simultaneous touch events with a discrete source.

Abstract: A method for providing a visual response to input with reduced latency in a computing device includes computing alternative sets of intermediate data for a first graphical user interface element, each alternative set of intermediate data comprising data useful to produce a visual representation of the graphical user interface element. The plurality of alternative sets of intermediate data and a set of intermediate data for a second graphical user interface element are stored in memory. The method creates an index identifying a first one of the plurality of alternative sets of intermediate data for the first graphical user interface element to use in forming a final pixel image. The index, the first set of alternative intermediate data for the graphical user interface element, and the intermediate data for the second graphical user interface element are used to create a first final pixel image for display to a user, the first final pixel image including the first and second graphical user interface elements.

Abstract: A system and method are disclosed for measuring latency in a device. In an embodiment, a device holder is configured to receive the device under test. A mechanical motor is configured to move a proxy device with respect to the device under test. A ground-truth measurement apparatus configured to record input proxy device movement with respect to the device under test and to record a representation of movement generated by a test application running on the device under test. A method for measuring latency includes causing a proxy device to move with respect to the device under test, recording input proxy device movement with respect to the device under test, and recording a representation of movement generated by a test application running on the device under test. Data from the recording of input proxy device movement and data from the recording of the representation of movement are used to generate latency data for the device under test.

Abstract: A system and method for caching and using information about graphical and application state changes in an electronic device is disclosed. In an embodiment, the system and method utilize a model of user input from a touch sensor capable of sensing location of a finger or object above a touch surface. In the electronic device, data representative of current user input to the electronic device is created. The model of user input is applied to the data representative of current user input to create data reflecting a prediction of a future user input event. That data is used to identify at least one particular response associated with the predicted future user input event. Data useful to implement graphical and application state changes is cached in a memory of the electronic device, the data including data reflecting a particular response associated with the predicted future user input. The cached data is retrieved from the memory of the electronic device and is used the data to implement the state changes.

Abstract: A system for processing user input includes an input device, an input processing unit, a high-latency subsystem, a low-latency subsystem, input processing unit software for generating signals in response to user inputs, and an output device. The low-latency subsystem receives the signals and generates low-latency output and the high-latency subsystem processes the signals and generates high-latency output.

Abstract: A system for processing user input includes an input device, an input processing unit, a high-latency subsystem, a low-latency subsystem, input processing unit software for generating signals in response to user inputs, and an output device. The low-latency subsystem receives the signals and generates low-latency output and the high-latency subsystem processes the signals and generates high-latency output.

Abstract: An interaction system is described which uses a depth camera to capture a depth image of a physical object placed on, or in vicinity to, an interactive surface. The interaction system also uses a video camera to capture a video image of the physical object. The interaction system can then generate a 3D virtual object based on the depth image and video image. The interaction system then uses a 3D projector to project the 3D virtual object back onto the interactive surface, e.g., in a mirrored relationship to the physical object. A user may then capture and manipulate the 3D virtual object in any manner. Further, the user may construct a composite model based on smaller component 3D virtual objects. The interaction system uses a projective texturing technique to present a realistic-looking 3D virtual object on a surface having any geometry.