Abstract: A method includes obtaining a first frame of image data including a plurality of pixels. Each pixel of the plurality of pixels is associated with a respective color value and a respective depth value. The first frame renders a scene from a first point of view. The method includes generating a three-dimensional (3D) polygon mesh using the plurality of pixels and the respective depth values. The 3D polygon mesh includes a plurality of portions. Each respective portion defines a respective plurality of vertices defining a respective mesh density representative of a density of the respective plurality of vertices. Each vertex is associated with a corresponding pixel of the first frame of image data. The method includes generating a second frame of image data via reprojection using the generated 3D polygon mesh. The second frame of image data has a second point of view different from the first point of view.

Abstract: Systems, methods, and computer program products are described for receiving a request for a head pose prediction for an augmented reality experience, identifying at least one positional indicator and at least one rotational indicator associated with the augmented reality experience, and providing the at least one positional indicator and the at least one rotational indicator to a Recurrent Neural Network (RNN) comprising a plurality of cells. The RNN may include a plurality of recurrent steps that each include at least one of the plurality of cells and at least one fully connected (FC) layer. The RNN may be used to generate at least one pose prediction corresponding to head pose changes for the augmented reality experience for at least one upcoming time period, provide the at least one pose prediction and trigger display of augmented reality content based on the at least one pose prediction.

Abstract: Systems, methods, and computer program products are described for receiving a request for a head pose prediction for an augmented reality experience, identifying at least one positional indicator and at least one rotational indicator associated with the augmented reality experience, and providing the at least one positional indicator and the at least one rotational indicator to a Recurrent Neural Network (RNN) comprising a plurality of cells. The RNN may include a plurality of recurrent steps that each include at least one of the plurality of cells and at least one fully connected (FC) layer. The RNN may be used to generate at least one pose prediction corresponding to head pose changes for the augmented reality experience for at least one upcoming time period, provide the at least one pose prediction and trigger display of augmented reality content based on the at least one pose prediction.

Abstract: Techniques are described herein that are capable of making a state-based determination of information to be displayed on a screen region of a hinge that is coupled to other screen regions. For instance, a state of a hinge that is coupled between a first screen region and a second screen region may be determined. Information that is to be displayed on a third screen region that is provided on the hinge may be determine based at least in part on the state of the hinge.

Abstract: A mobile computing device is provided that includes a processor, an accelerometer, two or more display devices, and a housing including the processor, the accelerometer, and the two or more display devices, determine a current user focus indicating that a first display device of the pair of display devices is being viewed by the user, and that a second display device of the pair of display devices is not being viewed by the user, detect a signature gesture input based on accelerometer data received via the accelerometer detecting that the mobile computing device has been rotated more than a threshold degree, determine that the current user focus has changed from the first display device to the second display device based on at least detecting the signature gesture input, and perform a predetermined action based on the current user focus.

Abstract: Techniques are described herein that are capable of making a state-based determination of information to be displayed on a screen region of a hinge that is coupled to other screen regions. For instance, a state of a hinge that is coupled between a first screen region and a second screen region may be determined. Information that is to be displayed on a third screen region that is provided on the hinge may be determine based at least in part on the state of the hinge.

Abstract: A mobile computing device is provided that includes a processor, an accelerometer, two or more display devices, and a housing including the processor, the accelerometer, and the two or more display devices, determine a current user focus indicating that a first display device of the pair of display devices is being viewed by the user, and that a second display device of the pair of display devices is not being viewed by the user, detect a signature gesture input based on accelerometer data received via the accelerometer detecting that the mobile computing device has been rotated more than a threshold degree, determine that the current user focus has changed from the first display device to the second display device based on at least detecting the signature gesture input, and perform a predetermined action based on the current user focus.

Abstract: Techniques are described herein that are capable of making a state-based determination of information to be displayed on a screen region of a hinge that is coupled to other screen regions. For instance, a state of a hinge that is coupled between a first screen region and a second screen region may be determined. Information that is to be displayed on a third screen region that is provided on the hinge may be determine based at least in part on the state of the hinge.

Abstract: A mobile computing device is provided that includes a processor, an accelerometer, two or more display devices, and a housing including the processor, the accelerometer, and the two or more display devices, determine a current user focus indicating that a first display device of the pair of display devices is being viewed by the user, and that a second display device of the pair of display devices is not being viewed by the user, detect a signature gesture input based on accelerometer data received via the accelerometer detecting that the mobile computing device has been rotated more than a threshold degree, determine that the current user focus has changed from the first display device to the second display device based on at least detecting the signature gesture input, and perform a predetermined action based on the current user focus.

Abstract: A head-mounted display system includes a see-through display that is configured to visually augment an appearance of a physical environment to a user viewing the physical environment through the see-through display. Graphical content presented via the see-through display is created by modeling the ambient lighting conditions of the physical environment.

Abstract: Techniques are described herein that are capable of providing an updated acoustic response for a device based at least in part on a hinge angle. For instance, an angle of a hinge that is coupled between first and second members of a device may be determined. The angle is defined between first and second surfaces of the respective first and second members. A spectral signal has a frequency spectrum that includes multiple portions. An amplitude of each portion of the frequency spectrum is selectively modified to change an acoustic response of the device to an updated acoustic response based at least in part on the angle of the hinge. The acoustic response of the device is associated with a resonance chamber, which is defined by the first surface, the second surface, and a third surface.

Abstract: A mobile computing device is provided that includes a processor, an accelerometer, two or more display devices, and a housing including the processor, the accelerometer, and the two or more display devices, determine a current user focus indicating that a first display device of the pair of display devices is being viewed by the user, and that a second display device of the pair of display devices is not being viewed by the user, detect a signature gesture input based on accelerometer data received via the accelerometer detecting that the mobile computing device has been rotated more than a threshold degree, determine that the current user focus has changed from the first display device to the second display device based on at least detecting the signature gesture input, and perform a predetermined action based on the current user focus.

Abstract: Techniques are described herein that are capable of making a state-based determination of information to be displayed on a screen region of a hinge that is coupled to other screen regions. For instance, a state of a hinge that is coupled between a first screen region and a second screen region may be determined. Information that is to be displayed on a third screen region that is provided on the hinge may be determine based at least in part on the state of the hinge.

Abstract: A system and related methods for visually augmenting an appearance of a physical environment as seen by a user through a head-mounted display device are provided. In one embodiment, a virtual environment generating program receives eye-tracking information, lighting information, and depth information from the head-mounted display. The program generates a virtual environment that models the physical environment and is based on the lighting information and the distance of a real-world object from the head-mounted display. The program visually augments a virtual object representation in the virtual environment based on the eye-tracking information, and renders the virtual object representation on a transparent display of the head-mounted display device.

Abstract: A head-mounted display system includes a see-through display that is configured to visually augment an appearance of a physical environment to a user viewing the physical environment through the see-through display. Graphical content presented via the see-through display is created by modeling the ambient lighting conditions of the physical environment.

Abstract: A head-mounted display system includes a see-through display that is configured to visually augment an appearance of a physical environment to a user viewing the physical environment through the see-through display. Graphical content presented via the see-through display is created by modeling the ambient lighting conditions of the physical environment.

Abstract: A system is disclosed for rendering low latency resource objects by providing the latest position data from a central processing unit for the low latency resource object right before a graphic processing unit is to render the low latency resource object.

Abstract: A method for displaying virtual imagery on a stereoscopic display system having a display matrix. The virtual imagery presents a surface of individually renderable loci viewable to an eye of the user. The method includes, for each locus of the viewable surface, illuminating a pixel of the display matrix. The illuminated pixel is chosen based on a pupil position of the eye as determined by the stereoscopic display system. For each locus of the viewable surface, a virtual image of the illuminated pixel is formed in a plane in front of the eye. The virtual image is positioned on a straight line passing through the locus, the plane, and the pupil position. In this manner, the virtual image tracks change in the user's pupil position.

Abstract: Embodiments are disclosed that relate to calibrating a predetermined eye location in a head-mounted display. For example, in one disclosed embodiment a method includes displaying a virtual marker visually alignable with a real world target at an alignment condition. At the alignment condition, image data is acquired to determine a location of the real world target. From the image data, an estimated eye location relative to a location of the head-mounted display is determined. Based upon the estimated eye location, the predetermined eye location is then calibrated.

Abstract: A blocking image generating system and related methods include a head-mounted display device having an opacity layer. A method may include receiving a virtual image to be presented by display optics in the head-mounted display device. Lighting information and an eye-position parameter may be received from an optical sensor system in the head-mounted display device. A blocking image may be generated in the opacity layer of the head-mounted display device based on the lighting information and the virtual image. The location of the blocking image in the opacity layer may be adjusted based on the eye-position parameter.