Abstract: Techniques for providing multi-screen interaction in an interactive application. A primary device establishes an application session. The application session includes a virtual environment relating to a physical environment in which the primary user device is located. The primary user device is configured to display a graphical image relating to a primary virtual camera view of the virtual environment. A secondary virtual camera view of the virtual environment, relating to the primary virtual camera view, is determined. The primary user device transmits image data relating to the secondary virtual camera view from the primary user device to a secondary user device, which is configured to display a graphical image based on the image data. Responsive to receiving an interaction request from the secondary user device, the primary user device controls the application session based on the interaction request.

Abstract: Techniques for predicting a virtual camera view in an augmented reality (AR) or virtual reality (VR) application. A first change in position of a user device over a first time period is determined based on analyzing a plurality of frames of image data related to an AR or VR application. A dead reckoning calculation is used to predict a second change in position of the user device over a second time period, based on the first change in position and data received from an Inertial Measurement Unit (IMU) associated with the user device. A plurality of frames of image data are generated for display in the AR or VR application, based on the predicted second change in position of the user device.

Abstract: Embodiments provide for tracking location and resolving drift in Augmented Reality (AR) devices. The AR devices includes computing devices having screens on a first face and cameras on a second, opposite face to project an image onto optical arrangements for viewing by wearers of the AR devices. The AR devices map locations for real objects in the environment to a virtual environment; anchor virtual objects at anchor locations within the virtual environment; capture station keeping images of the environment from a first Field of View via the camera; determine a second, different Field of View in the environment for the wearer of the AR device based on the relative locations of real objects present in the station keeping images; and output images depicting the virtual objects at positions on the screen to depict the virtual objects in the physical environment at the anchor locations.

Abstract: Embodiments provide for tracking location and resolving drift in Augmented Reality (AR) devices. The AR devices includes computing devices having screens on a first face and cameras on a second, opposite face to project an image onto optical arrangements for viewing by wearers of the AR devices. The AR devices map locations for real objects in the environment to a virtual environment; anchor virtual objects at anchor locations within the virtual environment; capture station keeping images of the environment from a first Field of View via the camera; determine a second, different Field of View in the environment for the wearer of the AR device based on the relative locations of real objects present in the station keeping images; and output images depicting the virtual objects at positions on the screen to depict the virtual objects in the physical environment at the anchor locations.

Abstract: Techniques for predicting a virtual camera view in an augmented reality (AR) or virtual reality (VR) application. A first change in position of a user device over a first time period is determined based on analyzing a plurality of frames of image data related to an AR or VR application. A dead reckoning calculation is used to predict a second change in position of the user device over a second time period, based on the first change in position and data received from an Inertial Measurement Unit (IMU) associated with the user device. A plurality of frames of image data are generated for display in the AR or VR application, based on the predicted second change in position of the user device.

Abstract: Techniques for providing multi-screen interaction in an interactive application. A primary device establishes an application session. The application session includes a virtual environment relating to a physical environment in which the primary user device is located. The primary user device is configured to display a graphical image relating to a primary virtual camera view of the virtual environment. A secondary virtual camera view of the virtual environment, relating to the primary virtual camera view, is determined. The primary user device transmits image data relating to the secondary virtual camera view from the primary user device to a secondary user device, which is configured to display a graphical image based on the image data. Responsive to receiving an interaction request from the secondary user device, the primary user device controls the application session based on the interaction request.