Abstract: A wearable spatial audio device is provided. The wearable spatial audio device includes one or more audio speakers, one or more processors, and a storage machine holding instructions executable by the one or more processors. Map data is obtained for a real-world environment that includes one or more dynamic audio objects. A device-specific subset of audio tracks is obtained, and a device-specific spatialized audio mix of the device-specific subset of audio tracks that is based on the map data is obtained. An indication of a change in an environmental condition relative to one or more of the dynamic audio objects is received. The device-specific spatialized audio mix is adjusted based on the change in the environmental condition.

Abstract: A wearable spatial audio device is provided. The wearable spatial audio device includes one or more audio speakers, one or more processors, and a storage machine holding instructions executable by the one or more processors. Map data is obtained for a real-world environment that includes one or more dynamic audio objects. A device-specific subset of audio tracks is obtained, and a device-specific spatialized audio mix of the device-specific subset of audio tracks that is based on the map data is obtained. An indication of a change in an environmental condition relative to one or more of the dynamic audio objects is received. The device-specific spatialized audio mix is adjusted based on the change in the environmental condition.

Abstract: Methods and devices for providing a haptic responses to a haptic feedback device may include receiving, by an application providing a virtual environment executing on a computer device, physical movement input based at least on movement of the haptic feedback device that corresponds to a virtual movement interaction with a virtual object in the virtual environment. The methods and devices may include accessing a haptic signature associated with the virtual object. The methods and devices may include determining a haptic response based at least upon the haptic signature to identify the virtual object through the haptic response. The methods and devices may include transmitting the haptic response to the haptic feedback device.

Abstract: A computing system is provided, including a first display device having a first hardware configuration including a first display and a second display device having a second hardware configuration different from the first hardware configuration and including a second display. The computing system may further include a processor configured to receive an input including instructions to launch an application program on the first display device. The application program may include application program hardware specifications indicating hardware used by the application program. Based on the first hardware configuration, the second hardware configuration, and the application program hardware specifications, the processor may be further configured to determine that the second hardware configuration matches the application program hardware specifications more closely than the first hardware configuration. The processor may be further configured to launch the application program on the second display device.

Abstract: Generally, a scanning device performs a sonic scan of a space by generating an ultrasonic impulse and measuring reflected signals as raw audio data. Sonic scan data including raw audio data and an associated scan location is forwarded to a sonic mapping service, which generates and distributes a 3D map of the space called a sonic map. When multiple devices contribute, the map is a collaborative sonic map. The sonic mapping service is advantageously available as distributed computing service, and can detect acoustic characteristics of the space and/or attribute visual/audio features to elements of a 3D model based on a corresponding detected acoustic characteristic. Various implementations that utilize a sonic map, detected acoustic characteristics, an impacted visual map, and/or an impacted 3D object include mixed reality communications, automatic calibration, relocalization, visualizing materials, rendering 3D geometry, and the like.

Abstract: A wearable spatial audio device is provided. The wearable spatial audio device includes one or more audio speakers, one or more processors, and a storage machine holding instructions executable by the one or more processors. Map data is obtained for a real-world environment that includes one or more dynamic audio objects. A device-specific subset of audio tracks is obtained, and a device-specific spatialized audio mix of the device-specific subset of audio tracks that is based on the map data is obtained. An indication of a change in an environmental condition relative to one or more of the dynamic audio objects is received. The device-specific spatialized audio mix is adjusted based on the change in the environmental condition.

Abstract: Methods and devices for creating a sound log of activities may include receiving a detected sound from at least one sensor on a computer device. The methods and devices may include comparing the detected sound to a plurality of audio patterns stored in a sound database. The methods and devices may include identifying a sound event for the detected sound based at least upon the comparison of the detected sound to the plurality of audio patterns. The methods and devices may include identifying context information that provides a context for the sound event. The methods and devices may include updating a sound log with the sound event and the context information.

Abstract: Examples are disclosed relating to providing spatialized audio to multiple users. In one example, a computing device presents spatialized audio to multiple users within an environment via communicative connection to one or more wearable spatial audio output devices. For each communicatively connected wearable spatial audio output device, a user-specific subset of audio tracks is generated from a set of audio tracks for a dynamic audio object positioned within the environment based on one or more user-specific parameters. A location of the wearable spatial audio output device is determined relative to the dynamic audio object, and based upon this location, a device-specific spatialized audio mix is generated that includes the user-specific subset of audio tracks. The device-specific spatialized audio mixes are sent to the wearable spatial output devices, and playback of the device-specific spatialized audio mixes are synchronously initiated at each wearable spatial audio output device.

Abstract: Embodiments relate to enabling a user of data-sharing applications executing on a computing device to indirectly exchange objects between the applications by adding objects from the applications to a journal application that manages a display area. The objects are displayed in the display area. The journal application collects metadata related to the objects and automatically curates lists of the objects according to the metadata. Curation of a list may involve moving objects into a list, merging objects, creating new objects out of content of existing objects, grouping objects according to a commonality thereof, etc. Machine learning services may be invoked to acquire additional metadata about the objects and to make curation decisions.

Abstract: The disclosed technology provides multi-dimensional audio output by providing a relative physical location of an audio transmitting device relative to an audio outputting device in a shared map of physical space shared between the audio transmitting device and the audio outputting device. An orientation of the audio outputting device relative to the audio transmitting device is determined and an audio signal received from the audio transmitting device via a communication network is processed using the determined orientation of the audio outputting device relative to the audio transmitting device and the relative physical location of the audio transmitting device to create an augmented audio signal. The augmented audio signal is output through at least one audio output on the audio outputting device in a manner indicating a relative physical direction of the audio transmitting device to the audio outputting device in the shared map of the physical space.

Abstract: Examples are disclosed that relate to refining virtual mesh models through physical contacts. For example, a hand-mounted mobile device, such as a wearable glove, may be used to create and/or emphasize specific points within a virtual mesh model of a physical environment. An indication of physical contact of an interface of the mobile device with a physical object may be obtained via a touch sensor of the mobile device. A location and/or an orientation of the interface of the mobile device during the physical contact with the physical object may be identified based on sensor data obtained from one or more positioning sensors. Location data indicating the location may be stored in a data storage device from which the location data may be referenced. In an example, refinement of a virtual mesh model of a physical environment containing the physical object may be prioritized based on the location data.

Abstract: A server computing device is provided, including a processor configured to execute a bot server program. The processor may provide a dialog for a first bot of the bot server program, the dialog including at least one trigger condition for transmitting default audio data. The processor may receive an audio data update communication from a bot developer computing device. Based on the audio data update communication, the processor may replace the default audio data with updated audio data. The processor may establish a first communication channel between the first bot and a client computing device. The first communication channel may allow one or more communications to be transmitted between the first bot and the client computing device based on the dialog. The processor may transmit a first communication to the client computing device via the first communication channel. The first communication may include the updated audio data.

Abstract: To address issues of capturing and processing images, a mobile computing device is provided. The mobile computing device may include a two-part housing coupled by a hinge, with first and second parts that include first and second displays, respectively. The hinge may permit the displays to rotate throughout a plurality of angular orientations. The mobile computing device may include one or more sensor devices, processor, first camera, and second camera mounted in the housing. The one or more sensor devices may be configured to measure the relative angular displacement of the housing, and the processor may be configured to process images captured by the first and second cameras according to a selected function based upon the relative angular displacement measured by the one or more sensor devices.

Abstract: Examples are disclosed that relate to a wearable device configured to physically prevent a user from interacting with an identified hazard. One disclosed example provides a wearable device including a motion-restricting system configured to restrict movement of a skeletal joint when activated, a logic subsystem, and memory storing instructions executable by the logic subsystem to receive sensor data from one or more sensors, based at least on the sensor data received, determine whether the wearable device is likely to be in an unsafe state, and when the wearable device is determined likely to be in the unsafe state, send a control signal to the motion-restricting system to activate the motion-restricting system.

Abstract: Examples are disclosed that relate to refining virtual mesh models through physical contacts. For example, a hand-mounted mobile device, such as a wearable glove, may be used to create and/or emphasize specific points within a virtual mesh model of a physical environment. An indication of physical contact of an interface of the mobile device with a physical object may be obtained via a touch sensor of the mobile device. A location and/or an orientation of the interface of the mobile device during the physical contact with the physical object may be identified based on sensor data obtained from one or more positioning sensors. Location data indicating the location may be stored in a data storage device from which the location data may be referenced. In an example, refinement of a virtual mesh model of a physical environment containing the physical object may be prioritized based on the location data.

Abstract: Methods and devices for providing a haptic responses to a haptic feedback device may include receiving, by an application providing a virtual environment executing on a computer device, physical movement input based at least on movement of the haptic feedback device that corresponds to a virtual movement interaction with a virtual object in the virtual environment. The methods and devices may include accessing a haptic signature associated with the virtual object. The methods and devices may include determining a haptic response based at least upon the haptic signature to identify the virtual object through the haptic response. The methods and devices may include transmitting the haptic response to the haptic feedback device.

Abstract: A mobile computing device including a housing having a first part and a second part, the first part including a first display and a first forward facing camera, and the second part including a second display and a second forward facing camera, at least one speaker mounted in the housing, and a processor mounted in the housing and configured to display a first graphical user interface element having an associated first audio stream on the first display and to display a second graphical user interface element having an associated second audio stream on the second display, wherein the processor is configured to perform face detection on a first and a second image, adjust an audio setting based on a result of the face detection, and play the first and second audio streams out of the at least one speaker based on the adjusted audio setting.

Abstract: Examples are disclosed that relate to conducting inventory management via wearable devices. One example provides a wearable device comprising a communication subsystem, one or more sensors, a logic subsystem, and a storage subsystem comprising instructions executable by the logic subsystem to receive an input activating the wearable device, receive via a sensor of the one or more sensors an input of information regarding a mark-out to make to inventory, provide an output confirming that the input of information was sensed, and send the information regarding the mark-out to make to inventory to an external computing device.

Abstract: Methods and devices for creating a sound log of activities may include receiving a detected sound from at least one sensor on a computer device. The methods and devices may include comparing the detected sound to a plurality of audio patterns stored in a sound database. The methods and devices may include identifying a sound event for the detected sound based at least upon the comparison of the detected sound to the plurality of audio patterns. The methods and devices may include identifying context information that provides a context for the sound event. The methods and devices may include updating a sound log with the sound event and the context information.

Abstract: Generally, a scanning device performs a sonic scan of a space by generating an ultrasonic impulse and measuring reflected signals as raw audio data. Sonic scan data including raw audio data and an associated scan location is forwarded to a sonic mapping service, which generates and distributes a 3D map of the space called a sonic map. When multiple devices contribute, the map is a collaborative sonic map. The sonic mapping service is advantageously available as distributed computing service, and can detect acoustic characteristics of the space and/or attribute visual/audio features to elements of a 3D model based on a corresponding detected acoustic characteristic. Various implementations that utilize a sonic map, detected acoustic characteristics, an impacted visual map, and/or an impacted 3D object include mixed reality communications, automatic calibration, relocalization, visualizing materials, rendering 3D geometry, and the like.