Abstract: Augmented reality (AR) or virtual reality (VR) systems described herein can be configured to record images, video, and/or annotations for concurrent communication to a remote system for display or subsequent access. A communication between a user and an expert user using the system can include an audio communication (unidirectional or bidirectional), a video communication from the user to the expert user (allowing the expert user to see, in real time, the same environment as the user), and a data communication (via which content overlaid over the video communication, such as annotations, may be displayed for both the expert user and the user). The systems can be configured to communicate concurrently while also creating a recording for later review based on a “live” or current issue being faced by a user assisted by an expert where the communication session is recorded for later playback by other users.

Abstract: Systems and methods to provide a mobile computing platform as a physical interface for an interactive space are presented herein. The interactive space may be experienced by a user of a host device (e.g., headset). The interactive space may include views of virtual content. A position and/or heading of the mobile computing platform relative to a perceived position and/or heading of the virtual content of the interactive space may be determined. Remote command information may be determined based on the relative position information and/or user input information conveying user entry and/or selection of one or more input elements of the mobile computing platform. The remote command information may be configured to effectuate user interactions with the virtual content in the interactive space based on user interactions with the mobile computing platform.

Abstract: Augmented reality (AR) or virtual reality (VR) systems described herein can be configured to record images, video, and/or annotations for concurrent communication to a remote system for display or subsequent access. A communication between a user and an expert user using the system can include an audio communication (unidirectional or bidirectional), a video communication from the user to the expert user (allowing the expert user to see, in real time, the same environment as the user), and a data communication (via which content overlaid over the video communication, such as annotations, may be displayed for both the expert user and the user). The systems can be configured to communicate concurrently while also creating a recording for later review based on a “live” or current issue being faced by a user assisted by an expert where the communication session is recorded for later playback by other users.

Abstract: A shared augmented reality system can support the sharing of video captured by a local user, using a head mounted display (HMD), with a remote user. The remote user may add augmented reality annotations (markings, notes, drawings) to certain objects within the environment captured within the video, where the annotations track the movement of those objects within the shared video. An HMD may not, however, provide a convenient interface for performing certain user-interface intensive tasks, which might be better performed on an additional device such as a mobile phone, tablet, or computer. During a shared augmented reality session, the additional device can be configured to communicate with a HMD such that certain tasks can be performed by the user through the additional device, and other tasks can be performed or experienced through the HMD. The additional device, the HMD and the remote user's device can communicatively coordinate during the session.

Abstract: Systems and methods to provide a mobile computing platform as a physical interface for an interactive space are presented herein. The interactive space may be experienced by a user of a host device (e.g., headset). The interactive space may include views of virtual content. A position and/or heading of the mobile computing platform relative to a perceived position and/or heading of the virtual content of the interactive space may be determined. Remote command information may be determined based on the relative position information and/or user input information conveying user entry and/or selection of one or more input elements of the mobile computing platform. The remote command information may be configured to effectuate user interactions with the virtual content in the interactive space based on user interactions with the mobile computing platform.

Abstract: A shared augmented reality system can support the sharing of video captured by a local user, using a head mounted display (HMD), with a remote user. The remote user may add augmented reality annotations (markings, notes, drawings) to certain objects within the environment captured within the video, where the annotations track the movement of those objects within the shared video. An HMD may not, however, provide a convenient interface for performing certain user-interface intensive tasks, which might be better performed on an additional device such as a mobile phone, tablet, or computer. During a shared augmented reality session, the additional device can be configured to communicate with a HMD such that certain tasks can be performed by the user through the additional device, and other tasks can be performed or experienced through the HMD. The additional device, the HMD and the remote user's device can communicatively coordinate during the session.

Abstract: Communication between two electronic devices can be initiated based on detection of an object in the environment of one of the electronic devices. A method for object initiated communication between a user of a device and a remote individual for assisting the user in interacting with the object includes capturing an image with a camera of the device, detecting the object within the captured image, and locating a record for the detected object within a database of objects. The method can also include locating an identifier for initiating the communication with the remote individual, wherein the identifier is associated with the record of the detected object and identifies an address for initiating the communication. The method can also include initiating the communication between the user and the remote individual based on the identifier.