Abstract: Implementations of the disclosed subject matter provide techniques for improved identification of a gesture based on data obtained from multiple devices. A method may include receiving an indication of an onset of a gesture, from a first device, at a gesture coordinating device. Next, first subsequent data describing the gesture may be received from a second device, at the gesture coordinating device. Based on the indication and the first subsequent data, the gesture may be identified. In response to identification of the gesture, an action may be performed based on the gesture identified. In some cases, the gesture coordinating device may be a cloud-based device.

Abstract: Described is a system and technique to supplement speech commands with gestures. A user interface may be improved by providing the ability for a user to intuitively provide speech commands with the aid of gestures. By providing gestures contemporaneously with a speech command, the user may delimit the commencement and end of a command thereby allowing the system to provide an immediate response. In addition, gestures may be detected in order to determine a source of a provided speech command, and accordingly, user specific actions may be performed based on the identity of the source.

Abstract: The present disclosure provides techniques for determining the position and/or orientation of a pointing device relative to the screen on a touchscreen device. A method may include receiving first orientation data from a first device that may include a capacitive touch surface. A touch point may be received indicating a location of a touch by a user on the capacitive touch surface. Second orientation data may be received from a second device. The first and second orientation data may be correlated to determine a relative orientation of the first device to the second device. A position of a pointing device may be determined based on the touch point and the relative orientation of the first and second devices. Additionally, multiple distances relative to a capacitive touch surface may be received, and based on the multiple distances, a position of a user's finger, hand, and/or arm may be determined.

Abstract: The present disclosure provides techniques for determining the position and/or orientation of a pointing device relative to the screen on a touchscreen device. A method may include receiving first orientation data from a first device that may include a capacitive touch surface. A touch point may be received indicating a location of a touch by a user on the capacitive touch surface. Second orientation data may be received from a second device. The first and second orientation data may be correlated to determine a relative orientation of the first device to the second device. A position of a pointing device may be determined based on the touch point and the relative orientation of the first and second devices. Additionally, multiple distances relative to a capacitive touch surface may be received, and based on the multiple distances, a position of a user's finger, hand, and/or arm may be determined.

Abstract: Systems and methods for a situated multi-user environment are provided. In one aspect, the method includes a step for receiving a user event message for a first user based on data received by a data source. The method also includes a step for updating a display based on the received user event message for the first user, wherein the display provides an indication of a relative physical location of the first user amongst a group of users within a certain proximity of each other. The method also includes a step for receiving a command from a first user to share a content item with a second user in the group of users. The method also includes a step for providing access to the shared content item to a device of the second user.

Abstract: Systems, methods and apparatus for using a magnetic controller to control device. In one aspect, a system includes a magnetic controller external to a device, the magnetic controller including: a magnetic device for altering a surrounding magnetic field of a device; one or more input actuators, each operatively coupled to the magnetic device and that when actuated cause the magnetic device alter the surrounding magnetic field according to a predefined change associated with the input actuator; and a model executable by the device and that models as device inputs the differences in the surrounding magnetic field of the device caused by the actuation of the one or more input actuators.

Abstract: An interaction spot is provided that may detect the presence of an electronic device such as a smartphone. A user may make a physical motion with the smartphone proximal to the interaction spot such as moving it upward. The interaction spot may communicate with a second device such as a light or a household appliance. A setting of the second device may be adjusted based on the motion of the electronic device.

Abstract: The present disclosure provides techniques for determining the position and/or orientation of a pointing device relative to the screen on a touchscreen device. A method may include receiving first orientation data from a first device that may include a capacitive touch surface. A touch point may be received indicating a location of a touch by a user on the capacitive touch surface. Second orientation data may be received from a second device. The first and second orientation data may be correlated to determine a relative orientation of the first device to the second device. A position of a pointing device may be determined based on the touch point and the relative orientation of the first and second devices. Additionally, multiple distances relative to a capacitive touch surface may be received, and based on the multiple distances, a position of a user's finger, hand, and/or arm may be determined.

Abstract: The present disclosure provides techniques for improving IMU-based gesture detection by a device using ultrasonic Doppler. A method may include detecting the onset of a gesture at a first device based on motion data obtained from an IMU of the first device. An indication of the detection of the onset of the gesture may be provided to a second device. Next, a first audio signal may be received from the second device. As a result, the gesture may be identified based on the motion data and the received first audio signal. In some cases, a first token encoded within the first audio signal may be decoded and the first token may be provided to a third coordinating device. A confirmation message may be received from the third coordinating device based on the first token provided and identifying the gesture may be further based on the confirmation message.

Abstract: Technology provided here facilitates simulating multi-touch events on a browser system. In one example, a browser system receives low-level touch events from a touch-input system. The browser system generates script-callbacks from the low-level touch events. The browser system converts the script-callbacks into compliant touch events that are compliant with a multi-touch browser standard. The browser system then sends the compliant touch events to a web application. This Abstract is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims.

Abstract: Methods for device pairing via a cloud server are provided. In one aspect, a method includes sending an initial signal from a first device to a second device. The method includes sending a notification from the first device of a set of communication capabilities of the first device. The method also includes receiving an indication of a common communication capability between the first and second devices. The method includes initiating pairing of the first device and the second device using the common communication capability in response to the received indication. Systems and machine-readable media are also provided.

Abstract: Described is a system and technique allowing a user to interact with a device using self-referential gestures. Self-referential gestures allow a user to rely on their inherent knowledge of body positioning to allow movements such as hand movements to be intuitively performed. The disclosure describes determining various reference points on the user and detecting hand movements relative to these reference points. In addition, a device may define axes and/or an origin in a three-dimensional space relative to a position of the user within a field-of-view of a capture device. Accordingly, gesture movements may be detected and/or measured based on references that correspond to the user's body in order to provide a more intuitive interaction experience.

Abstract: A system and machine-implemented method for automatically switching between input modes for a user interface. A user interface is displayed in a first input mode for a first input type. A determination is made that a predetermined event has occurred, wherein the predetermined event is of a type other than the first input type or a second input type. In response to the determination, the user interface is switched from the first input mode for the first input type to a second input mode for the second input type.

Abstract: A user may have a device that contains the user's identity. Rather than log into a second device that user may make use of the fact that the user is already logged into a device as disclosed herein. The user may perform a gesture that may be observed or sensed by one or more sensors on a first device and a second device that contains the user's identity. A correlation between the sensor data may be performed and, if the correlation value exceeds a threshold value, a portion of the user's identity may be shared with the first device.

Abstract: A system and machine-implemented method for automatically switching between input modes for a user interface. A user interface is displayed in a first input mode for a first input type. A determination is made that a predetermined event has occurred, wherein the predetermined event is of a type other than the first input type or a second input type. In response to the determination, the user interface is switched from the first input mode for the first input type to a second input mode for the second input type.

Abstract: Methods, systems and computer-readable storage mediums encoded with computer programs executed by one or more processors for detecting a keyboard event and generating a network event are disclosed. In an embodiment, an input event generated by a keyboard operatively connected to a computing device is detected. It is determined that the input event corresponds to an actionable input event of a network-based application independent of which local application of one or more local applications is active on the computing device as indicated by an input focus. A location of a visual indicator corresponding to the actionable input event is determined on a visual interface of the network-based application. The visual indicator is selected at the location of the visual interface and corresponding signal is transmit to the network-based application.

Abstract: Some embodiments of the present invention provide a system that edits a document. During operation, the system shares the document as a webpage and receives, from the webpage, a comment for the document by a collaborator of the document. Next, the system updates the webpage with the comment and enables responses to the comment by other collaborators of the document from the webpage.