Abstract: A method includes receiving sensor data from one or more sensors that corresponds to a location of a stylus device and determining that a tip of the stylus device is in contact with a physical surface based on the sensor data. While in contact, the method includes determining a new location of the tip of the stylus device based on the location data, mitigating a tracking error of the determined new location of the tip of the stylus device by translating the new location from a 3D space domain to a 2D space domain that corresponds to the physical surface and adjusting the new location based on a comparison of the new location and historical locations. The stylus device can further ascertain surface characteristics through sensor data and simulate surface characteristics via haptic feedback effects.

Abstract: A method includes receiving sensor data from one or more sensors that corresponds to a location of a stylus device and determining that a tip of the stylus device is in contact with a physical surface based on the sensor data. While in contact, the method includes determining a new location of the tip of the stylus device based on the location data, mitigating a tracking error of the determined new location of the tip of the stylus device by translating the new location from a 3D space domain to a 2D space domain that corresponds to the physical surface and adjusting the new location based on a comparison of the new location and historical locations. The stylus device can further ascertain surface characteristics through sensor data and simulate surface characteristics via haptic feedback effects.

Abstract: An augmented reality or virtual reality (AR/VR) system can include a virtual input device that can be rendered by an HMD, and a wearable impact detection device, such as a ring, smart watch, wristband, etc. with an inertial measurement unit (IMU), that can be used in conjunction with the HMD to track a location of the user's hands relative to the perceived location of the rendered virtual keyboard using, e.g., vision-based tracking via the HMD and determine when an intended input (e.g., button press) is entered by the user by detecting an impact of the user's finger(s) on a physical surface. The AR/VR system can then determine which key is pressed based on the physical location of the user's hands (e.g., using the vision-based tracking) and, more precisely, the user's finger(s) causing the detected impact and the closest key of the virtual input device to the detected point of impact.

Abstract: In certain embodiments, a sensing and tracking system detects objects, such as user input devices or peripherals, and user interactions with them. A representation of the objects and user interactions are then injected into the virtual reality environment. The representation can be an actual reality, augmented reality, virtual representation or any combination. For example, an actual keyboard can be injected, but with the keys pressed being enlarged and lighted.

Abstract: A method includes receiving sensor data from one or more sensors that corresponds to a location of a stylus device and determining that a tip of the stylus device is in contact with a physical surface based on the sensor data. While in contact, the method includes determining a new location of the tip of the stylus device based on the location data, mitigating a tracking error of the determined new location of the tip of the stylus device by translating the new location from a 3D space domain to a 2D space domain that corresponds to the physical surface and adjusting the new location based on a comparison of the new location and historical locations. The stylus device can further ascertain surface characteristics through sensor data and simulate surface characteristics via haptic feedback effects.

Abstract: A method includes receiving sensor data from one or more sensors that corresponds to a location of a stylus device and determining that a tip of the stylus device is in contact with a physical surface based on the sensor data. While in contact, the method includes determining a new location of the tip of the stylus device based on the location data, mitigating a tracking error of the determined new location of the tip of the stylus device by translating the new location from a 3D space domain to a 2D space domain that corresponds to the physical surface and adjusting the new location based on a comparison of the new location and historical locations.

Abstract: In some embodiments, a system comprising one or more processors configured to track a location of an input device within a physical environment via a three-dimensional (3D) tracking system, and modify a tracking parameter of the 3D tracking system while tracking the location of the input device based on the determined location of the input device within the physical environment. The input device may be coupled to a virtual reality display system and tracking the location of the location of the input device can be used for interacting with the virtual reality display system.

Abstract: In certain embodiments, a sensing and tracking system detects objects, such as user input devices or peripherals, and user interactions with them. A representation of the objects and user interactions are then injected into the virtual reality environment. The representation can be an actual reality, augmented reality, virtual representation or any combination. For example, an actual keyboard can be injected, but with the keys pressed being enlarged and lighted.

Abstract: In an embodiment there is provided a user interface device for interfacing a user with a computer, the computer comprising at least one processor to generate instructions for display of a graphical environment of a virtual reality simulation. The user interface device includes a sensor for detecting activation and/or a sensor for detecting proximity of a body part of the user (e.g., hand). At least partially based on detection by one of these sensors, a transition between virtual reality states is triggered.

Abstract: In some embodiments, a system comprising one or more processors configured to track a location of an input device within a physical environment via a three-dimensional (3D) tracking system, and modify a tracking parameter of the 3D tracking system while tracking the location of the input device based on the determined location of the input device within the physical environment. The input device may be coupled to a virtual reality display system and tracking the location of the location of the input device can be used for interacting with the virtual reality display system.

Abstract: In certain embodiments, a sensing and tracking system detects objects, such as user input devices or peripherals, and user interactions with them. A representation of the objects and user interactions are then injected into the virtual reality environment. The representation can be an actual reality, augmented reality, virtual representation or any combination. For example, an actual keyboard can be injected, but with the keys pressed being enlarged and lighted.

Abstract: In some embodiments, a system comprising one or more processors configured to track a location of an input device within a physical environment via a three-dimensional (3D) tracking system, and modify a tracking parameter of the 3D tracking system while tracking the location of the input device based on the determined location of the input device within the physical environment. The input device may be coupled to a virtual reality display system and tracking the location of the location of the input device can be used for interacting with the virtual reality display system.

Abstract: In certain embodiments, a sensing and tracking system detects objects, such as user input devices or peripherals, and user interactions with them. A representation of the objects and user interactions are then injected into the virtual reality environment. The representation can be an actual reality, augmented reality, virtual representation or any combination. For example, an actual keyboard can be injected, but with the keys pressed being enlarged and lighted.

Abstract: In an embodiment there is provided a user interface device for interfacing a user with a computer, the computer comprising at least one processor to generate instructions for display of a graphical environment of a virtual reality simulation. The user interface device includes a sensor for detecting activation and/or a sensor for detecting proximity of a body part of the user (e.g., hand). At least partially based on detection by one of these sensors, a transition between virtual reality states is triggered.

Abstract: An augmented reality or virtual reality (AR/VR) system can include a virtual input device that can be rendered by an HMD, and a wearable impact detection device, such as a ring, smart watch, wristband, etc. with an inertial measurement unit (IMU), that can be used in conjunction with the HMD to track a location of the user's hands relative to the perceived location of the rendered virtual keyboard using, e.g., vision-based tracking via the HMD and determine when an intended input (e.g., button press) is entered by the user by detecting an impact of the user's finger(s) on a physical surface. The AR/VR system can then determine which key is pressed based on the physical location of the user's hands (e.g., using the vision-based tracking) and, more precisely, the user's finger(s) causing the detected impact and the closest key of the virtual input device to the detected point of impact.

Abstract: In an embodiment there is provided a user interface device for interfacing a user with a computer, the computer comprising at least one processor to generate instructions for display of a graphical environment of a virtual reality simulation. The user interface device includes a sensor for detecting activation and/or a sensor for detecting proximity of a body part of the user (e.g., hand). At least partially based on detection by one of these sensors, a transition between virtual reality states is triggered.

Abstract: In some embodiments, a system comprising one or more processors configured to track a location of an input device within a physical environment via a three-dimensional (3D) tracking system, and modify a tracking parameter of the 3D tracking system while tracking the location of the input device based on the determined location of the input device within the physical environment. The input device may be coupled to a virtual reality display system and tracking the location of the location of the input device can be used for interacting with the virtual reality display system.

Abstract: In certain embodiments, a sensing and tracking system detects objects, such as user input devices or peripherals, and user interactions with them. A representation of the objects and user interactions are then injected into the virtual reality environment. The representation can be an actual reality, augmented reality, virtual representation or any combination. For example, an actual keyboard can be injected, but with the keys pressed being enlarged and lighted.

Abstract: In certain embodiments, a sensing and tracking system detects objects, such as user input devices or peripherals, and user interactions with them. A representation of the objects and user interactions are then injected into the virtual reality environment. The representation can be an actual reality, augmented reality, virtual representation or any combination. For example, an actual keyboard can be injected, but with the keys pressed being enlarged and lighted.