Abstract: A representation of a user can move with respect to a graphical user interface based on input of a user. The graphical user interface comprises a central region and interaction elements disposed outside of the central region. The interaction elements are not shown until the representation of the user is aligned with the central region. A gesture of the user is recognized, and, based on the recognized gesture, the display of the graphical user interface is altered and an application control is outputted.

Abstract: A representation of a user can move with respect to a graphical user interface based on input of a user. The graphical user interface comprises a central region and interaction elements disposed outside of the central region. The interaction elements are not shown until the representation of the user is aligned with the central region. A gesture of the user is recognized, and, based on the recognized gesture, the display of the graphical user interface is altered and an application control is outputted.

Abstract: A representation of a user can move with respect to a graphical user interface based on input of a user. The graphical user interface comprises a central region and interaction elements disposed outside of the central region. The interaction elements are not shown until the representation of the user is aligned with the central region. A gesture of the user is recognized, and, based on the recognized gesture, the display of the graphical user interface is altered and an application control is outputted.

Abstract: A method for use with a head-mounted display in a physical environment includes obtaining depth information of the physical environment and capturing a visual image of the physical environment. The method also includes determining a spatial relationship between a user of the head-mounted display and one or more physical objects included in the physical environment based on the depth information. The visual image is then segmented based on the spatial relationship to generate a segmented image that includes the one or more physical objects. The segmented image is then overlaid on a virtual image to display both the virtual image and the one or more physical objects on the head-mounted display.

Abstract: A representation of a user can move with respect to a graphical user interface based on input of a user. The graphical user interface comprises a central region and interaction elements disposed outside of the central region. The interaction elements are not shown until the representation of the user is aligned with the central region. A gesture of the user is recognized, and, based on the recognized gesture, the display of the graphical user interface is altered and an application control is outputted.

Abstract: A method for use with a head-mounted display in a physical environment includes obtaining depth information of the physical environment and capturing a visual image of the physical environment. The method also includes determining a spatial relationship between a user of the head-mounted display and one or more physical objects included in the physical environment based on the depth information. The visual image is then segmented based on the spatial relationship to generate a segmented image that includes the one or more physical objects. The segmented image is then overlaid on a virtual image to display both the virtual image and the one or more physical objects on the head-mounted display.

Abstract: One example device includes a camera; a display device; a memory; and a processor in communication with the memory to receive audio signals from two or more microphones or a far-end device; receive first location information and second location information, the first location information for a visual identification of an audio source of the received audio signals and the second location information identifying a direction of arrival from the audio source; receive a first adjustment to a first portion of a UI to change either a visual identification or a coordinate direction of a direction focus; in response to the first adjustment, automatically perform a second adjustment to a second portion of the UI to change the other of the visual identification or the coordinate direction of the direction focus; and process the audio signals to filter sounds outside the direction focus, or emphasize sounds within the direction focus.

Abstract: Systems, apparatus and methods for determining a gesture are presented. According to some aspects, disclosed are systems, apparatus and methods for determining a gesture that compares different images and deduces a direction and/or distance based on a relative size change of a palm in the different images. After a reference palm size is registered, subsequent palm sizes are compared to the reference to determine if and/or how much the hand is moving. The hand gesture is determined based on these relative changes in hand movement.

Abstract: Methods and systems according to one or more embodiments are provided for combining touch inputs and offset non-touch gestures. In an embodiment, a method includes concurrently capturing touch input data on a screen of a user device and non-touch gesture input data, the non-touch gesture input data being indicative of a gesture performed in an area offset from the screen of the user device to inhibit obstruction of a user's view of the screen. The method also includes determining an input command based at least in part on a combination of the concurrently captured touch input data and the non-touch gesture input data. In addition, the method further includes affecting an operation of the user device based on the determined input command.

Abstract: Systems, devices, and methods are described for recognizing and focusing on at least one source of an audio communication as part of a communication including a video image and an audio communication derived from two or more microphones when a relative position between the microphones is known. In certain embodiments, linked audio and video focus areas providing location information for one or more sound sources may each be associated with different user inputs, and an input to adjust a focus in either the audio or video domain may automatically adjust the focus in the another domain.

Abstract: Systems, devices, and methods are described for recognizing and focusing on at least one source of an audio communication as part of a communication including a video image and an audio communication derived from two or more microphones when a relative position between the microphones is known. In certain embodiments, linked audio and video focus areas providing location information for one or more sound sources may each be associated with different user inputs, and an input to adjust a focus in either the audio or video domain may automatically adjust the focus in the another domain.

Abstract: Methods and systems according to one or more embodiments are provided for combining touch inputs and offset non-touch gestures. In an embodiment, a method includes concurrently capturing touch input data on a screen of a user device and non-touch gesture input data, the non-touch gesture input data being indicative of a gesture performed in an area offset from the screen of the user device to inhibit obstruction of a user's view of the screen. The method also includes determining an input command based at least in part on a combination of the concurrently captured touch input data and the non-touch gesture input data. In addition, the method further includes affecting an operation of the user device based on the determined input command.

Abstract: Disclosed is a method and apparatus for run-time adaptive non-uniform mapping of user interface events. In one embodiment, the operations implemented may include: categorizing a display area into a plurality of regions of either a first type or a second type; assigning a gravity value to each of the one or more regions of the second type; determining whether a cursor is within a first region of the first type and is being moved toward a second region of the second type that adjoins the first region; and in response to determining that the cursor is within the first region of the first type and is being moved toward the second region of the second type, the second region having a first gravity value, applying an acceleration factor based at least in part on the first gravity value to a cursor movement.

Abstract: Aspects of the disclosed subject matter are related to a method for utilizing touch object orientation with a touch user interface. First, a first location within a text body on the touch interface is determined. Next, a change in an orientation of a touch object is determined while the touch object remains in contact with the touch device. Thereafter, a second location within the text body on the touch user interface different from the first location is determined based at least in part on the first location and the change in the orientation of the touch object.

Abstract: Systems, devices, and methods are described for recognizing and focusing on at least one source of an audio communication as part of a communication including a video image and an audio communication derived from two or more microphones when a relative position between the microphones is known. In certain embodiments, linked audio and video focus areas providing location information for one or more sound sources may each be associated with different user inputs, and an input to adjust a focus in either the audio or video domain may automatically adjust the focus in the another domain.

Abstract: Systems, apparatus and methods for determining a gesture are presented. According to some aspects, disclosed are systems, apparatus and methods for determining a gesture that compares different images and deduces a direction and/or distance based on a relative size change of a palm in the different images. After a reference palm size is registered, subsequent palm sizes are compared to the reference to determine if and/or how much the hand is moving. The hand gesture is determined based on these relative changes in hand movement.