Abstract: A wearable spatial audio device is provided. The wearable spatial audio device includes one or more audio speakers, one or more processors, and a storage machine holding instructions executable by the one or more processors. Map data is obtained for a real-world environment that includes one or more dynamic audio objects. A device-specific subset of audio tracks is obtained, and a device-specific spatialized audio mix of the device-specific subset of audio tracks that is based on the map data is obtained. An indication of a change in an environmental condition relative to one or more of the dynamic audio objects is received. The device-specific spatialized audio mix is adjusted based on the change in the environmental condition.

Abstract: A wearable spatial audio device is provided. The wearable spatial audio device includes one or more audio speakers, one or more processors, and a storage machine holding instructions executable by the one or more processors. Map data is obtained for a real-world environment that includes one or more dynamic audio objects. A device-specific subset of audio tracks is obtained, and a device-specific spatialized audio mix of the device-specific subset of audio tracks that is based on the map data is obtained. An indication of a change in an environmental condition relative to one or more of the dynamic audio objects is received. The device-specific spatialized audio mix is adjusted based on the change in the environmental condition.

Abstract: Generally, a scanning device performs a sonic scan of a space by generating an ultrasonic impulse and measuring reflected signals as raw audio data. Sonic scan data including raw audio data and an associated scan location is forwarded to a sonic mapping service, which generates and distributes a 3D map of the space called a sonic map. When multiple devices contribute, the map is a collaborative sonic map. The sonic mapping service is advantageously available as distributed computing service, and can detect acoustic characteristics of the space and/or attribute visual/audio features to elements of a 3D model based on a corresponding detected acoustic characteristic. Various implementations that utilize a sonic map, detected acoustic characteristics, an impacted visual map, and/or an impacted 3D object include mixed reality communications, automatic calibration, relocalization, visualizing materials, rendering 3D geometry, and the like.

Abstract: A wearable spatial audio device is provided. The wearable spatial audio device includes one or more audio speakers, one or more processors, and a storage machine holding instructions executable by the one or more processors. Map data is obtained for a real-world environment that includes one or more dynamic audio objects. A device-specific subset of audio tracks is obtained, and a device-specific spatialized audio mix of the device-specific subset of audio tracks that is based on the map data is obtained. An indication of a change in an environmental condition relative to one or more of the dynamic audio objects is received. The device-specific spatialized audio mix is adjusted based on the change in the environmental condition.

Abstract: A computer device is provided that includes an input device, a sensor device, a display device, and a processor. The processor is configured to detect a physical object in a physical environment based on sensor data received via the sensor device, measure one or more physical parameters of the physical object based on the sensor data, determine a physical behavior of the physical object based on the measured one or more physical parameters, present a graphical representation of the physical behavior of the physical object via the display device, generate a simulation of the physical behavior of the physical object based on the measured one or more physical parameters, receive a user input to modify the one or more physical parameters for the simulation via the input device, and present the simulation with the modified one or more physical parameters via the display device.

Abstract: Methods and devices for creating a sound log of activities may include receiving a detected sound from at least one sensor on a computer device. The methods and devices may include comparing the detected sound to a plurality of audio patterns stored in a sound database. The methods and devices may include identifying a sound event for the detected sound based at least upon the comparison of the detected sound to the plurality of audio patterns. The methods and devices may include identifying context information that provides a context for the sound event. The methods and devices may include updating a sound log with the sound event and the context information.

Abstract: Examples are disclosed relating to providing spatialized audio to multiple users. In one example, a computing device presents spatialized audio to multiple users within an environment via communicative connection to one or more wearable spatial audio output devices. For each communicatively connected wearable spatial audio output device, a user-specific subset of audio tracks is generated from a set of audio tracks for a dynamic audio object positioned within the environment based on one or more user-specific parameters. A location of the wearable spatial audio output device is determined relative to the dynamic audio object, and based upon this location, a device-specific spatialized audio mix is generated that includes the user-specific subset of audio tracks. The device-specific spatialized audio mixes are sent to the wearable spatial output devices, and playback of the device-specific spatialized audio mixes are synchronously initiated at each wearable spatial audio output device.

Abstract: A computer device is provided that includes an input device, a sensor device, a display device, and a processor. The processor is configured to detect a physical object in a physical environment based on sensor data received via the sensor device, measure one or more physical parameters of the physical object based on the sensor data, determine a physical behavior of the physical object based on the measured one or more physical parameters, present a graphical representation of the physical behavior of the physical object via the display device, generate a simulation of the physical behavior of the physical object based on the measured one or more physical parameters, receive a user input to modify the one or more physical parameters for the simulation via the input device, and present the simulation with the modified one or more physical parameters via the display device.

Abstract: Methods and devices for creating a sound log of activities may include receiving a detected sound from at least one sensor on a computer device. The methods and devices may include comparing the detected sound to a plurality of audio patterns stored in a sound database. The methods and devices may include identifying a sound event for the detected sound based at least upon the comparison of the detected sound to the plurality of audio patterns. The methods and devices may include identifying context information that provides a context for the sound event. The methods and devices may include updating a sound log with the sound event and the context information.

Abstract: Generally, a scanning device performs a sonic scan of a space by generating an ultrasonic impulse and measuring reflected signals as raw audio data. Sonic scan data including raw audio data and an associated scan location is forwarded to a sonic mapping service, which generates and distributes a 3D map of the space called a sonic map. When multiple devices contribute, the map is a collaborative sonic map. The sonic mapping service is advantageously available as distributed computing service, and can detect acoustic characteristics of the space and/or attribute visual/audio features to elements of a 3D model based on a corresponding detected acoustic characteristic. Various implementations that utilize a sonic map, detected acoustic characteristics, an impacted visual map, and/or an impacted 3D object include mixed reality communications, automatic calibration, relocalization, visualizing materials, rendering 3D geometry, and the like.

Abstract: Examples are disclosed relating to providing spatialized audio to multiple users. In one example, a computing device presents spatialized audio to multiple users within an environment via communicative connection to one or more wearable spatial audio output devices. For each communicatively connected wearable spatial audio output device, a user-specific subset of audio tracks is generated from a set of audio tracks for a dynamic audio object positioned within the environment based on one or more user-specific parameters. A location of the wearable spatial audio output device is determined relative to the dynamic audio object, and based upon this location, a device-specific spatialized audio mix is generated that includes the user-specific subset of audio tracks. The device-specific spatialized audio mixes are sent to the wearable spatial output devices, and playback of the device-specific spatialized audio mixes are synchronously initiated at each wearable spatial audio output device.

Abstract: A computer system is provided that includes one or more processors configured to receive a stream of data from a plurality of network connected devices configured to measure physical parameters, and store a user profile including user settings for a plurality of notification subscriptions associated with physical parameters measured by the plurality of network connected devices. Each notification subscription includes programming logic for a trigger condition for a candidate notification based on measured physical parameters and an associated component sound for the candidate notification. The one or more processors are further configured to determine that trigger conditions for a plurality of candidate notifications are met based on the received stream of data, and generate a composite sound output including a plurality of component sounds associated with the plurality of notifications rendered.

Abstract: Examples disclosed relate to displaying virtual objects. One example provides, on a display device comprising a camera and a display, a method comprising acquiring, via the camera, image data imaging an environment, receiving a user input requesting display of a three-dimensional virtual object, comparing dimensional information for the three-dimensional virtual object to dimensional information for a field of view of the display device, modifying the three-dimensional virtual object based upon comparing the dimensional information for the three-dimensional virtual object to the dimensional information for the field of view to obtain a modified three-dimensional virtual object, and displaying the modified three-dimensional virtual object via the display.

Abstract: Examples disclosed relate to displaying virtual objects. One example provides, on a display device comprising a camera and a display, a method comprising acquiring, via the camera, image data imaging an environment, receiving a user input requesting display of a three-dimensional virtual object, comparing dimensional information for the three-dimensional virtual object to dimensional information for a field of view of the display device, modifying the three-dimensional virtual object based upon comparing the dimensional information for the three-dimensional virtual object to the dimensional information for the field of view to obtain a modified three-dimensional virtual object, and displaying the modified three-dimensional virtual object via the display.

Abstract: Disclosed are a method and corresponding apparatus to enable a user of a display system to manipulate holographic objects. Multiple holographic user interface objects capable of being independently manipulated by a user are displayed to the user, overlaid on a real-world view of a 3D physical space in which the user is located. In response to a first user action, the holographic user interface objects are made to appear to be combined into a holographic container object that appears at a first location in the 3D physical space. In response to the first user action or a second user action, the holographic container object is made to appear to relocate to a second location in the 3D physical space. The holographic user interface objects are then made to appear to deploy from the holographic container object when the holographic container object appears to be located at the second location.

Abstract: Examples disclosed relate to displaying virtual objects. One example provides, on a display device comprising a camera and a display, a method comprising acquiring, via the camera, image data imaging an environment, receiving a user input requesting display of a three-dimensional virtual object, comparing dimensional information for the three-dimensional virtual object to dimensional information for a field of view of the display device, modifying the three-dimensional virtual object based upon comparing the dimensional information for the three-dimensional virtual object to the dimensional information for the field of view to obtain a modified three-dimensional virtual object, and displaying the modified three-dimensional virtual object via the display.

Abstract: Disclosed are a method and corresponding apparatus to enable a user of a display system to manipulate holographic objects. Multiple holographic user interface objects capable of being independently manipulated by a user are displayed to the user, overlaid on a real-world view of a 3D physical space in which the user is located. In response to a first user action, the holographic user interface objects are made to appear to be combined into a holographic container object that appears at a first location in the 3D physical space. In response to the first user action or a second user action, the holographic container object is made to appear to relocate to a second location in the 3D physical space. The holographic user interface objects are then made to appear to deploy from the holographic container object when the holographic container object appears to be located at the second location.