Abstract: Aspects of the disclosure provide remote training in a virtual reality (VR) environment. Multiple users may engage in the session. For example, a trainee may practice or be evaluated in performing a virtual version of a training task. A trainer may join the trainee's session. Embodiments enable the trainer to switch from a third-person perspective viewing the environment to the trainee's first-person perspective to see what the trainee is seeing. Virtual objects may be highlighted to guide the trainee's steps. Some embodiments may configure the training module to be engaged at various points out of order. For example, a user may select a specific point in a training sequence and work from there, replay or forward the environment in time to other points so that the trainee can skip or practice parts of the procedure.

Abstract: To facilitate virtual training, employee on-boarding, knowledge transfer and remote assistance, embodiments provide a digital note viewable in a virtual environment which may be attached to a physical machine and viewable when a user is engaged with the system. When a user sees the machine through either an augmented reality device or a virtual reality device, the digital note is displayable and selectable. Selection of the digital note access information stored in association with the note and the object the note is attached to. The note may be modified in one instance, which synchronizes the note in any other instances. For example, modifying a digital note attached to a physical object in an AR environment causes a copy of the digital note to be modified in the same way in a digital twin of the object in a VR environment.

Abstract: A display device system providing augmented reality (AR) and virtual reality (VR) displays in the same device and a method for switching between augmented reality and virtual reality modes in the embodiments of the device are disclosed. The system enables users to view an augmented reality setting, interact with objects, and switch to a virtual reality setting or vice versa without having to switch devices. When switching from virtual reality to augmented reality, a shuttering mechanism may open allowing the user to see the real environment within an augmented setting. Position on the user in the physical reality may be tracked relative to position of the user in the AR or VR. Some actions may be triggered based on the tracked location and orientation of the user.

Abstract: A display device system providing augmented reality (AR) and virtual reality (VR) displays in the same device and a method for switching between augmented reality and virtual reality modes in the embodiments of the device are disclosed. The system enables users to view an augmented reality setting, interact with objects, and switch to a virtual reality setting or vice versa without having to switch devices. When switching from virtual reality to augmented reality, a shuttering mechanism may open allowing the user to see the real environment within an augmented setting. Position on the user in the physical reality may be tracked relative to position of the user in the AR or VR. Some actions may be triggered based on the tracked location and orientation of the user.

Abstract: Systems and methods enabling users to interact with an augmented reality environment are disclosed. Real-world objects may have unique markers which are recognized by mobile devices. A mobile device recognizes the markers and generates a set of virtual objects associated with the markers in the augmented reality environment. Mobile devices employ virtual pointers and virtual control buttons to enable users to interact with the virtual objects. Users may aim the virtual pointer to a virtual object, select the virtual object, and then drag-and-drop the virtual object to a new location. Embodiments enable users to select, move, transform, create and delete virtual objects with the virtual pointer. The mobile device provides users with a means of drawing lines and geometrically-shaped virtual objects.

Abstract: An immersive virtual reality system for larger, theater-sized audiences is disclosed. The system enables multiple users to collaborate or work together as a group, or enable groups to compete. Users interact with the virtual reality system through the manipulation of handheld interactive devices. Each device has multiple lights forming a pattern. Tracking sensors monitor the handheld devices, and the system interprets the motions of the users and dynamically changes the virtual reality environment based on the motions of the users. The system may assign unique roles for users within a group.

Abstract: Systems and methods directed to augmented reality environments on mobile devices having a single camera are disclosed. The single camera of the mobile device captures the images of one or more markers, and based on the relative size of the markers, determines the position of the camera and the absolute distance relative to the markers. The mobile device establishes a zero parallax plane set at the bottom of the 3D virtual object superimposed on the physical marker. Reduced alignment errors occur between the lower end of the virtual object and the real-world markers, and the virtual object appears to be standing on the real-world object. As a result, the augmented reality stereo experience for the user is more comfortable as the display is matched between virtual objects and the real objects to make the overall scene more realistic.

Abstract: An immersive virtual reality system for larger, theater-sized audiences is disclosed. The system enables multiple users to collaborate or work together as a group, or enable groups to compete. Users interact with the virtual reality system through the manipulation of handheld interactive devices. Each device has multiple lights forming a pattern. Tracking sensors monitor the handheld devices, and the system interprets the motions of the users and dynamically changes the virtual reality environment based on the motions of the users. The system may assign unique roles for users within a group.

Abstract: A display device system providing augmented reality and virtual reality displays in the same device and a method for switching between augmented reality and virtual reality modes in the embodiments of the device are disclosed. The system enables users to view an augmented reality setting, interact with objects, and switch to a virtual reality setting or vice versa without having to switch devices. Some embodiments may include a shuttering mechanism that blocks light from an ambient environment when switching from the augmented reality mode to the virtual reality mode so that ambient light or objects do not interrupt the virtual reality landscape. When switching from virtual reality to augmented reality, the shuttering mechanism may open allowing the user to see the real environment within an augmented setting.

Abstract: Systems and methods enabling users to interact with an augmented reality environment are disclosed. Real-world objects may have unique markers which are recognized by mobile devices. A mobile device recognizes the markers and generates a set of virtual objects associated with the markers in the augmented reality environment. Mobile devices employ virtual pointers and virtual control buttons to enable users to interact with the virtual objects. Users may aim the virtual pointer to a virtual object, select the virtual object, and then drag-and-drop the virtual object to a new location. Embodiments enable users to select, move, transform, create and delete virtual objects with the virtual pointer. The mobile device provides users with a means of drawing lines and geometrically-shaped virtual objects.

Abstract: An immersive virtual reality system for larger, theater-sized audiences is disclosed. The system enables multiple users to collaborate or work together as a group, or enable groups to compete. Users interact with the virtual reality system through the manipulation of handheld interactive devices. Each device has multiple lights forming a pattern. Tracking sensors monitor the handheld devices, and the system interprets the motions of the users and dynamically changes the virtual reality environment based on the motions of the users. The system may assign unique roles for users within a group.

Abstract: An immersive virtual reality system for larger, theater-sized audiences is disclosed. The system enables multiple users to collaborate or work together as a group, or enable groups to compete. Users interact with the virtual reality system through the manipulation of handheld interactive devices. Each device has multiple lights forming a pattern. Tracking sensors monitor the handheld devices, and the system interprets the motions of the users and dynamically changes the virtual reality environment based on the motions of the users. The system may assign unique roles for users within a group.