Abstract: Various implementations include wearable audio devices configured to record a user's voice without recording other ambient acoustic signals, such as others talking nearby. In some particular aspects, a wearable audio device includes: a frame for contacting a head of a user; an electro-acoustic transducer within the frame and configured to output audio signals; at least one microphone; a voice activity detection (VAD) accelerometer; and a controller coupled with the electro-acoustic transducer, the at least one microphone and the VAD accelerometer, the controller configured in a first mode to: detect that the user is speaking; and record a voice of the user solely with signals from the VAD accelerometer in response to detecting that the user is speaking.

Abstract: An audio system and method for generating improved augmented hearing effects in real-time. The system includes a wearable audio device arranged to obtain audio that includes a voice signal associated with a user and an environmental signal associated with other audio picked up by the wearable audio device that does not includes the user's voice. In some implementations, at least one processor of the wearable audio device is configured to isolate the voice signal from the environmental signal such that augmented hearing effects can be applied to the voice signal and/or the environmental signal, independently. In some implementations, augmented hearing effects are designated by a signal augmentation profile generated or stored in the wearable audio device such that the total time between receipt of the audio signal and the modifications and/or transformations to the respective audio signals does not exceed 100 ms.

Abstract: Processes, methods, systems, and devices are disclosed for synchronizing wirelessly transmitted captured audios to audio output. In an aspect, a user device transmits an audio output associated with the audio playback to a wireless audio device. The user device receives a feedback signal corresponding to the audio output played at the wireless audio device. The user device further receives a captured audio from the wireless audio device. The user device synchronizes the captured audio with the audio output based on the feedback signal. For example, the audio output may be an instrumental soundtrack and the captured audio may be a recording of the user's singing in response to the instrumental soundtrack. In other examples, the audio output may be a soundtrack from a video playback or live streaming. The captured audio may be a commentary or a response to the video playback or the live streaming.

Abstract: An audio system and method for generating improved augmented hearing effects in real-time. The system includes a wearable audio device arranged to obtain audio that includes a voice signal associated with a user and an environmental signal associated with other audio picked up by the wearable audio device that does not includes the user's voice. In some implementations, at least one processor of the wearable audio device is configured to isolate the voice signal from the environmental signal such that augmented hearing effects can be applied to the voice signal and/or the environmental signal, independently. In some implementations, augmented hearing effects are designated by a signal augmentation profile generated or stored in the wearable audio device such that the total time between receipt of the audio signal and the modifications and/or transformations to the respective audio signals does not exceed 100 ms.

Abstract: Various implementations include wearable audio devices configured to record a user's voice without recording other ambient acoustic signals, such as others talking nearby. In some particular aspects, a wearable audio device includes: a frame for contacting a head of a user; an electro-acoustic transducer within the frame and configured to output audio signals; at least one microphone; a voice activity detection (VAD) accelerometer; and a controller coupled with the electro-acoustic transducer, the at least one microphone and the VAD accelerometer, the controller configured in a first mode to: detect that the user is speaking; and record a voice of the user solely with signals from the VAD accelerometer in response to detecting that the user is speaking.

Abstract: Methods and systems for selective image capture based on multi-modal sensor input for a wearable device. Systems comprise a first sensor, a second sensor, and a wearable device. The first sensor is configured to capture a first image, and the second sensor is configured to collect motion data, the motion data corresponding to a relative motion between the user and the wearable device, the relative motion of the wearable device in the environment, or the motion of a body part of the user. The wearable device comprises: a communication module configured to wirelessly transmit the first image to a receiving device; and a processor configured to detect a trigger event based on the motion data collected by the second sensor, the processor further configured to initiate capture of the first image by the first sensor or transmit the first image to the receiving device by the communication module upon detection of the trigger event.

Abstract: An audio system and method for generating improved augmented hearing effects in real-time. The system includes a wearable audio device arranged to obtain audio that includes a voice signal associated with a user and an environmental signal associated with other audio picked up by the wearable audio device that does not includes the user's voice. In some implementations, at least one processor of the wearable audio device is configured to isolate the voice signal from the environmental signal such that augmented hearing effects can be applied to the voice signal and/or the environmental signal, independently. In some implementations, augmented hearing effects are designated by a signal augmentation profile generated or stored in the wearable audio device such that the total time between receipt of the audio signal and the modifications and/or transformations to the respective audio signals does not exceed 100 ms.

Abstract: Systems and methods for establishing a data connection, including a first device having a display screen to display a first image and a portable electronic device including a camera and circuitry to obtain a first characteristic of the first device or the first image via a communication; capture a captured image of the display screen of the first device; analyze the captured image to obtain a captured image characteristic; compare the captured image characteristic with the first characteristic; and, establish a connection between the first device and the portable electronic device if the captured image characteristic and the first characteristic are within a predetermined threshold. Once a connection is established, the portable electronic device is configured to continuously obtain the location, position, orientation, and/or movement of the first device and utilize this information in various applications used by the first device and/or portable electronic device.

Abstract: A development platform for developing a skill for a persistent companion device (PCD) includes an asset development library having an application programming interface (API) configured to enable a developer to at least one of find, create, edit and access one or more content assets utilizable for creating a skill, an expression tool suite having one or more APIs via which are received one or more expressions associated with the skill as specified by the developer wherein the skill is executable by the PCD in response to at least one defined input, a behavior editor for specifying one or more behavioral sequences of the PCD for the skill and a skill deployment facility having an API for deploying the skill to an execution engine of the PCD.

Abstract: A development platform for developing a skill for a persistent companion device (PCD) includes an asset development library having an application programming interface (API) configured to enable a developer to at least one of find, create, edit and access one or more content assets utilizable for creating a skill, an expression tool suite having one or more APIs via which are received one or more expressions associated with the skill as specified by the developer wherein the skill is executable by the PCD in response to at least one defined input, a behavior editor for specifying one or more behavioral sequences of the PCD for the skill and a skill deployment facility having an API for deploying the skill to an execution engine of the PCD.