Abstract: According to an aspect, a method for sharing a collaborative augmented reality (AR) environment including obtaining, by a sensor system of a first computing system, visual data representing a physical space of an AR environment, where the visual data is used to create a three-dimensional (3D) map of the physical space. The 3D map includes a coordinate space having at least one virtual object added by a user of the first computing system. The method includes broadcasting, by a transducer on the first computing system, an ultrasound signal, where the ultrasound signal includes an identifier associated with the 3D map. The identifier is configured to be detected by a second computing system to join the AR environment.

Abstract: Audiovisual presentations, such as film recordings, may have been originally created having an audio soundtrack with multiple audio tracks mixed for a surround sound system that includes a set of speakers physically surrounding a user. The present disclosure presents systems and methods to remix these soundtracks into 3D audio that when presented to the ears of a user can be perceived as a virtual surround sound system that mimics the physical system. What is more, the disclosed systems and methods can enhance the virtual surround sound system by adjusting virtual speakers of the virtual surround sound system according to video content of the audiovisual presentation. Further enhancement may be possible by adjusting the virtual speakers of the virtual surround sound system according to a sensed position of a user.

Abstract: The present disclosure relates generally to the processing of machine-readable visual encodings in view of contextual information. One embodiment of aspects of the present disclosure comprises obtaining image data descriptive of a scene that includes a machine-readable visual encoding; processing the image data with a first recognition system configured to recognize the machine-readable visual encoding; processing the image data with a second, different recognition system configured to recognize a surrounding portion of the scene that surrounds the machine-readable visual encoding; identifying a stored reference associated with the machine-readable visual encoding based at least in part on one or more first outputs generated by the first recognition system based on the image data and based at least in part on one or more second outputs generated by the second recognition system based on the image data; and performing one or more actions responsive to identification of the stored reference.

Abstract: Systems and methods are described for providing co-presence in an augmented reality environment. The method may include receiving a visual scene within a viewing window depicting a multi-frame real-time visual scene captured by a camera onboard an electronic device associated with the augmented reality environment, identifying a plurality of elements of the visual scene, detecting at least one graphic indicator associated with at least one of the plurality of elements, detecting at least one boundary associated with the at least one element, and generating, in the viewing window and based on the detection of the at least one graphic indicator, Augmented Reality (AR) motion graphics within the detected boundary. In response to determining that content related to the at least one element is available, the method may include retrieving the content and visually indicating an AR tracked control on the at least one element within the viewing window.

Abstract: According to a general aspect, a method can include receiving, by a computing device, an electronic communication. In response to receiving the electronic communication, the method can include determining, by the computing device, a current activity of a user of the computing device, and selecting, based on the determined current activity of the user, a communication channel of the computing device for providing a notification of the electronic communication. The method can also include providing the notification using the selected communication channel of the computing device.

Abstract: Audiovisual presentations, such as film recordings, may have been originally created having an audio soundtrack with multiple audio tracks mixed for a surround sound system that includes a set of speakers physically surrounding a user. The present disclosure presents systems and methods to remix these soundtracks into 3D audio that when presented to the ears of a user can be perceived as a virtual surround sound system that mimics the physical system. What is more, the disclosed systems and methods can enhance the virtual surround sound system by adjusting virtual speakers of the virtual surround sound system according to video content of the audiovisual presentation. Further enhancement may be possible by adjusting the virtual speakers of the virtual surround sound system according to a sensed position of a user.

Abstract: Gaze data collected from eye gaze tracking performed while training text was read may be used to train at least one layout interpretation model. In this way, the at least one layout interpretation model may be trained to determine current text that includes words arranged according to a layout, process the current text with the at least one layout interpretation model to determine the layout, and output the current text with the words arranged according to the layout.

Abstract: The present disclosure relates generally to the processing of machine-readable visual encodings in view of contextual information. One embodiment of aspects of the present disclosure comprises obtaining image data descriptive of a scene that includes a machine-readable visual encoding; processing the image data with a first recognition system configured to recognize the machine-readable visual encoding; processing the image data with a second, different recognition system configured to recognize a surrounding portion of the scene that surrounds the machine-readable visual encoding; identifying a stored reference associated with the machine-readable visual encoding based at least in part on one or more first outputs generated by the first recognition system based on the image data and based at least in part on one or more second outputs generated by the second recognition system based on the image data; and performing one or more actions responsive to identification of the stored reference.

Abstract: A system and method may provide for a computing system including multiple display devices. Data collected by sensors such as, for example, image sensors and positional sensors, of the display devices is leveraged to determine a position and/or an orientation of each of the display devices in the real world environment. This identification and utilization of the relative positioning of the display devices may be used to configure, and reconfigure, display settings, set display priorities, control movement of content, and respond to gesture based commands related to content management.

Abstract: A system and method is provided that provides for the transfer of the execution of content from a user device to an external device for output of the content by the external device. External devices may be detected in a physical space, and identified based on previous connection with the user device, based on a shared network or shared system of connected devices including the user device, based on image information captured by the user device and previously stored anchoring information that identifies the external devices, and the like. An external device may be selected for potential output of the content based on previously stored configuration information associated with the external device including, for example, output capabilities associated with the external device. The identified external device may output the transferred content in response to a user verification input, verifying that the content is to be output by the external device.

Abstract: Systems and methods are described for authenticating devices. The systems and methods may include detecting, by a sensor on a wearable device, at least one cloud anchor that includes an identifier associated with a network and configured for a physical environment. In response to detecting that a location associated with the at least one cloud anchor is within a threshold distance of the wearable device and detecting that the wearable device has access to the at least one cloud anchor, triggering extraction of the identifier from the at least one cloud anchor. The systems and methods may also include joining the wearable device to the network based on a received authentication corresponding to the extracted identifier.

Abstract: Gaze data collected from eye gaze tracking performed while training text was read may be used to train at least one layout interpretation model. In this way, the at least one layout interpretation model may be trained to determine current text that includes words arranged according to a layout, process the current text with the at least one layout interpretation model to determine the layout, and output the current text with the words arranged according to the layout.

Abstract: According to an aspect, a method for sharing a collaborative augmented reality (AR) environment including obtaining, by a sensor system of a first computing system, visual data representing a physical space of an AR environment, where the visual data is used to create a three-dimensional (3D) map of the physical space. The 3D map includes a coordinate space having at least one virtual object added by a user of the first computing system. The method includes broadcasting, by a transducer on the first computing system, an ultrasound signal, where the ultrasound signal includes an identifier associated with the 3D map. The identifier is configured to be detected by a second computing system to join the AR environment.

Abstract: A method including receiving at least one frame of a video targeted for display on a main display (or within the boundary of the main display), receiving metadata associated with the at least one frame of the video, the metadata being targeted for display on a supplemental display (or outside the boundary of the main display), and formatting the metadata for display on the supplemental display (or outside the boundary of the main display).

Abstract: A user may routinely wear or hold more than one computing devices. One of the computing devices may be a head-mounted computing-device configured for augmented reality. The head-mounted computing-device may include a camera. While imaging, the camera can consume power and processing resources that diminish a battery of the head-mounted computing device. To improve a battery life and to enhance a user's privacy, imaging of the camera can be deactivated during periods when the user is not interacting with the head-mounted computing device and activated when the user wishes to interact with the head-mounted computing device. The activation of the camera can be triggered by gestured data collected by a computing device other than the head-mounted computing-device.

Abstract: A head-mounted device (HMD) may be used to determine an access request for accessing a device. An identifier identifying the device may be received at the HMD and from the device. By verifying receipt of the identifier at the HMD, and that access rights associated with the HMD enable granting of the access request, the access request may be granted.

Abstract: Gaze data collected from eye gaze tracking performed while training text was read may be used to train at least one layout interpretation model. In this way, the at least one layout interpretation model may be trained to determine current text that includes words arranged according to a layout, process the current text with the at least one layout interpretation model to determine the layout, and output the current text with the words arranged according to the layout.

Abstract: The present disclosure relates generally to the processing of machine-readable visual encodings in view of contextual information. One embodiment of aspects of the present disclosure comprises obtaining image data descriptive of a scene that includes a machine-readable visual encoding; processing the image data with a first recognition system configured to recognize the machine-readable visual encoding; processing the image data with a second, different recognition system configured to recognize a surrounding portion of the scene that surrounds the machine-readable visual encoding; identifying a stored reference associated with the machine-readable visual encoding based at least in part on one or more first outputs generated by the first recognition system based on the image data and based at least in part on one or more second outputs generated by the second recognition system based on the image data; and performing one or more actions responsive to identification of the stored reference.

Abstract: An example technique may include performing, by a virtual reality application provided on a computing device, video rendering at a first video rendering rate based on updating an entire image on a screen of the computing device at a first update rate, determining that a performance of the video rendering is less than a threshold, performing, based on the determining, video rendering at a second video rendering rate by updating a first portion of the image at the first update rate, and by updating a second portion of the image at a second update rate that is less than the first update rate. Another example technique may include shifting, during an eye blinking period, one or both of a left eye image and a right eye image to reduce a disparity between a left viewed object and a right viewed object.

Abstract: A system and method may provide for a computing system including multiple display devices. Data collected by sensors such as, for example, image sensors and positional sensors, of the display devices is leveraged to determine a position and/or an orientation of each of the display devices in the real world environment. This identification and utilization of the relative positioning of the display devices may be used to configure, and reconfigure, display settings, set display priorities, control movement of content, and respond to gesture based commands related to content management.