Abstract: A method includes, while presenting an artificial-reality environment that includes a virtual object and a representation of a physical object, detecting, based on data from a first group of sensors of a wrist-wearable device, that the wrist-wearable device is within a first distance of an electronic device responsive to user gestures and within another threshold distance of the virtual object. The electronic device is represented within the artificial-reality environment. The method includes, while the wrist-wearable device is within the first activation-threshold distance of the electronic device and is also within a second activation-threshold distance of the virtual object, determining, based on data from a second set of sensors of the wrist-wearable device, that a gesture corresponds to an operation at the electronic device. And the method includes, based on determining that the user gesture corresponds to the operation, causing the physical electronic device to perform the operation.

Abstract: A method of using time-of-flight sensors for gesture detection and content-rendering determinations in an artificial reality environment is provided. The method includes receiving data, from one or more time-of-flight sensors communicatively-coupled with a wrist-wearable device, about a physical surface, wherein the wrist-wearable device is communicatively-coupled with a head-wearable device that is configured to display a virtual object within an artificial-reality environment presented by the head-wearable device. The method also includes, in accordance with a determination, based on the data, that the physical surface has a curved surface portion, causing display of at least a portion of the virtual object at the curved surface portion, including updating the display of the virtual object in accordance with the curved surface portion.

Abstract: A artificial-reality system, including an optional head-wearable device to display an artificial-reality environment and a wrist-wearable device, identifies and detects shapes of surfaces, and, optionally, the distances of surfaces from the wrist-wearable device, and makes operations, including haptic events, available to users by detecting gestures performed by the user, causing respective operations to be performed based on the type of gestures, and optionally, the distance of the wrist-wearable device from surfaces during performance of the gestures. For example, the wrist-wearable device can be configured to cause performance of a first set of operations corresponding to in-air gestures, which are performed within an in-air threshold distance of a surface, a second set of operations corresponding to near-surface gestures performed within a surface threshold distance of a surface.

Abstract: A method of grasp detection is described. The method includes, capturing, via one or more image sensors of a wearable device, image data including a plurality of frames. The plurality of frames includes an object within a field of view of the one or more image sensors. The method further includes capturing, via one or more non-image sensors of the wearable device, sensor data including a sensed interaction with the object and a user of the wearable device and identifying a grasp action performed by the user based on a combination of the sensor data and the image data.

Abstract: The disclosed apparatus may include a wearable optic ring that features input capabilities relative to a computing system. In various examples, the wearable optic ring may be designed to curve around a wearer's finger and can detect complex interactions between that finger and the wearer's thumb. Moreover, the optical ring may detect such complex interactions based on ultra low-resolution images captured by a miniature optical sensor mounted on the optical ring and bioimpedance measurements taken by one or more electrodes included on the optical ring. Various other implementations are also disclosed.

Abstract: A artificial-reality system, including an optional head-wearable device to display an artificial-reality environment and a wrist-wearable device, identifies and detects shapes of surfaces, and, optionally, the distances of surfaces from the wrist-wearable device, and makes operations, including haptic events, available to users by detecting gestures performed by the user, causing respective operations to be performed based on the type of gestures, and optionally, the distance of the wrist-wearable device from surfaces during performance of the gestures. For example, the wrist-wearable device can be configured to cause performance of a first set of operations corresponding to in-air gestures, which are performed within an in-air threshold distance of a surface, a second set of operations corresponding to near-surface gestures performed within a surface threshold distance of a surface.

Abstract: A method includes, while presenting an artificial-reality environment that includes a virtual object and a representation of a physical object, detecting, based on data from a first group of sensors of a wrist-wearable device, that the wrist-wearable device is within a first distance of an electronic device responsive to user gestures and within another threshold distance of the virtual object. The electronic device is represented within the artificial-reality environment. The method includes, while the wrist-wearable device is within the first activation-threshold distance of the electronic device and is also within a second activation-threshold distance of the virtual object, determining, based on data from a second set of sensors of the wrist-wearable device, that a gesture corresponds to an operation at the electronic device. And the method includes, based on determining that the user gesture corresponds to the operation, causing the physical electronic device to perform the operation.

Abstract: A system may include a wearable dimensioned to be donned by a user of an artificial reality system. The system may also include an energy measuring device incorporated into the wearable. The energy measuring device may measure an electrical energy differential between a body of the user and a surface. The system may further include at least one processing device communicatively coupled to the energy measuring device. The processing device may detect, based at least in part on the electrical energy differential measured by the energy measuring device, an interaction between the user and the surface. In response to this detection, the processing device may generate an input command for the artificial reality system based at least in part on the interaction detected between the user and the surface. Various other systems and methods are also disclosed.

Abstract: A gaze tracking system for use by the driver of a vehicle includes an opaque frame circumferentially enclosing a transparent field of view of the driver, light emitting diodes coupled to the opaque frame for emitting infrared light onto various regions of the driver's eye gazing through the transparent field of view, and diodes for sensing intensity of infrared light reflected off of various regions of the driver's eye.

Abstract: A gaze tracking system for use by the driver of a vehicle includes an opaque frame circumferentially enclosing a transparent field of view of the driver, light emitting diodes coupled to the opaque frame for emitting infrared light onto various regions of the driver's eye gazing through the transparent field of view, and diodes for sensing intensity of infrared light reflected off of various regions of the driver's eye.

Abstract: A gaze tracking system for use in head mounted displays includes an eyepiece having an opaque frame circumferentially enclosing a transparent field of view, light emitting diodes coupled to the opaque frame for emitting infrared light onto various regions of an eye gazing through the transparent field of view, and diodes for sensing intensity of infrared light reflected off of various regions of the eye.

Abstract: A controller is provided that can provide haptic feedback to a user by controlling a separation of a stationary portion and a moveable portion, such as a moveable arm, which can include one or more mounts for one or more of a user's fingers. A sensor can be included on the stationary portion to sense whether the user's thumb is proximate a thumb rest. Different haptic interaction modes can be set depending on whether the user's thumb is not proximate the sensor, such as a touch mode, or is proximate the sensor, such as a grasping or trigger mode. When grasping and trigger modes are provided, they can be determined based on the nature of a virtual object grasped by a user. Additional haptic sensations can be provided, such as to a user's fingertip, such as by a vibratory component or a rotatable object of one or more haptic elements.

Abstract: A controller is provided that can provide haptic feedback to a user by controlling a separation of a stationary portion and a moveable portion, such as a moveable arm, which can include one or more mounts for one or more of a user's fingers. A sensor can be included on the stationary portion to sense whether the user's thumb is proximate a thumb rest. Different haptic interaction modes can be set depending on whether the user's thumb is not proximate the sensor, such as a touch mode, or is proximate the sensor, such as a grasping or trigger mode. When grasping and trigger modes are provided, they can be determined based on the nature of a virtual object grasped by a user. Additional haptic sensations can be provided, such as to a user's fingertip, such as by a vibratory component or a rotatable object of one or more haptic elements.