Abstract: Devices, media, and methods are presented for an audio enhanced augmented reality (AR) experience using an eyewear device. The eyewear device has a microphone system, a presentation system, a support structure configured to be head-mounted on a user, and a processor. The support structure supports the microphone system and the presentation system. The eyewear device is configured to capture, with the microphone system, audio information of an environment surrounding the eyewear device, identify an audio signal within the audio information, detect a direction of the audio signal with respect to the eyewear device, classify the audio signal, and present, by the presentation system, an application associated with the classification of the audio signal.

Abstract: An electronic eyewear device includes a display and a speaker system adapted to present augment reality objects and associated sounds in a scene being viewed by the user. A processor receives one or more audio tracks respectively associated with one or more augmented reality objects, encodes the audio tracks into an aggregated audio track including the audio tracks, a header for each audio track that uniquely identifies each respective audio track, and an aggregate header that identifies the number of tracks in the aggregated audio track. The processor transfers the aggregated audio track to an audio processor that uses the header for each audio track and the aggregate header to separate the audio tracks from the aggregated audio track. The audio processor processes the audio tracks independently in parallel and provides the audio tracks to the speaker system for presentation with the augmented reality objects.

Abstract: Example systems, devices, media, and methods are described for efficiently processing an audio track of a virtual object with a head-related transfer function (HRTF). Audio tracks are processed by determining a current position (direction and optionally distance) of the virtual object with respect to the head of a user, identifying a current audio zone from predefined audio zones responsive to the determined current position where each of the audio zones has a corresponding left predefined filter and a corresponding right predefined filter, applying the left and the right predefined filters corresponding to the current audio zone to the audio track to produce a left audio signal and a right audio signal, and presenting the left audio signal with a first speaker and the right audio signal with a second speaker.

Abstract: Dynamic transcode throttling methods and devices for processing resource management and thermal mitigation in electronic devices such as eyewear devices. An electronic device monitors its temperature and, responsive to the temperature, configures a transcoding service to operate at different rates. A frame delay module is configured to add a delay between read frames prior to the transcoding service. This enables the electronic device to consume less power when temperatures are too high in order to provide thermal mitigation and can be performed without powering down the electronic device.

Abstract: Disclosed is a of monitoring the breathing of a user, comprising receiving a plurality of audio signals from a plurality of microphones and beamforming the plurality of audio signals into a beamformed audio signal. Observed breath-related parameters are derived from the beamformed audio signal and an output of or derived from the observed breath-related parameters is provided to a user of a client device. Breath metrics may be determined by comparing the observed breath-related parameters with reference breath-related parameters, and a breathing score may be derived from the breath metrics. The breathing score may be based on a combination of how closely an observed respiration of the user matches a prompted or desired respiration rate and an observed amount of time that the user's observed respiration rate is within a threshold value of the prompted or desired respiration rate.

Abstract: Example systems, devices, media, and methods are described for efficiently processing an audio track of a virtual object with a head-related transfer function (HRTF). Audio tracks are processed by determining a current position (direction and optionally distance) of the virtual object with respect to the head of a user, identifying a current audio zone from predefined audio zones responsive to the determined current position where each of the audio zones has a corresponding left predefined filter and a corresponding right predefined filter, applying the left and the right predefined filters corresponding to the current audio zone to the audio track to produce a left audio signal and a right audio signal, and presenting the left audio signal with a first speaker and the right audio signal with a second speaker.

Abstract: This disclosure describes systems and methods for a multipoint cable cam (MPCC) of an aerial vehicle. A method includes operations of receiving user input associated with a predetermined path and correlating the received user input with stored global positioning satellite (GPS) data to generate one or more virtual waypoints along the predetermined path. The method includes processing the one or more virtual waypoints to generate a spline-based flight path. The method may include storing the spline-based flight path and transmitting the spline-based flight path to the aerial vehicle.

Abstract: The position of a UAV within a three-dimensional space is changed based on a change in position of a controller of the UAV. First and second sensor data are produced using sensors of the controller to maintain stable altitude output for the UAV. The first sensor data indicates a geolocation of the controller, and the second sensor data indicates a barometric pressure of an environment in which the controller is located. The first and second sensor data are post-processed using a complementary filter based on respective altitude measurements of the first and second sensor data to determine an altitude of the controller. A position of the controller is determined within a three-dimensional space based on the altitude. Data indicative of the position of the controller within the three-dimensional space is then transmitted to the UAV to cause a change in a position of the UAV within the three-dimensional space.

Abstract: This disclosure describes systems and methods for a multipoint cable cam (MPCC) of an aerial vehicle. A method includes operations of receiving user input associated with a predetermined path and correlating the received user input with stored global positioning satellite (GPS) data to generate one or more virtual waypoints along the predetermined path. The method includes processing the one or more virtual waypoints to generate a spline-based flight path. The method may include storing the spline-based flight path and transmitting the spline-based flight path to the aerial vehicle.

Abstract: The position of a UAV within a three-dimensional space is changed based on a change in position of a controller of the UAV. First and second sensor data are produced using sensors of the controller to maintain stable altitude output for the UAV. The first sensor data indicates a geolocation of the controller, and the second sensor data indicates a barometric pressure of an environment in which the controller is located. The first and second sensor data are post-processed using a complementary filter based on respective altitude measurements of the first and second sensor data to determine an altitude of the controller. A position of the controller is determined within a three-dimensional space based on the altitude. Data indicative of the position of the controller within the three-dimensional space is then transmitted to the UAV to cause a change in a position of the UAV within the three-dimensional space.

Abstract: An unmanned aerial vehicle manages storage of data and transfer between other connected devices. The unmanned aerial vehicle captures sensor data from sensors on the unmanned aerial vehicle. The unmanned aerial vehicle transfers the captured sensor data from the unmanned aerial vehicle to a remote controller via a wireless interface. The captured data may be transferred via a TCP link, a UDP link, or a combination thereof. If a loss of link is detected, the captured sensor data is stored to a buffer and a battery level of the unmanned aerial vehicle and a flight status of the unmanned aerial vehicle is monitored. The stored sensor data is transferred from the buffer to a non-volatile storage responsive to the battery level dropping below a predefined threshold or detecting that the unmanned aerial vehicle is stationary and a shutdown may be imminent.

Abstract: An unmanned aerial vehicle manages storage of data and transfer between other connected devices. The unmanned aerial vehicle captures sensor data from sensors on the unmanned aerial vehicle. The unmanned aerial vehicle transfers the captured sensor data from the unmanned aerial vehicle to a remote controller via a wireless interface. The captured data may be transferred via a TCP link, a UDP link, or a combination thereof. If a loss of link is detected, the captured sensor data is stored to a buffer and a battery level of the unmanned aerial vehicle and a flight status of the unmanned aerial vehicle is monitored. The stored sensor data is transferred from the buffer to a non-volatile storage responsive to the battery level dropping below a predefined threshold or detecting that the unmanned aerial vehicle is stationary and a shutdown may be imminent.

Abstract: The position of a UAV within a three-dimensional space is changed based on a change in position of a controller of the UAV. First and second sensor data are produced using sensors of the controller to maintain stable altitude output for the UAV. The first sensor data indicates a geolocation of the controller, and the second sensor data indicates a barometric pressure of an environment in which the controller is located. The first and second sensor data are post-processed using a complementary filter based on respective altitude measurements of the first and second sensor data to determine an altitude of the controller. A position of the controller is determined within a three-dimensional space based on the altitude. Data indicative of the position of the controller within the three-dimensional space is then transmitted to the UAV to cause a change in a position of the UAV within the three-dimensional space.

Abstract: This disclosure describes systems and methods for a multipoint cable cam (MPCC) of an aerial vehicle. A method includes operations of receiving user input associated with a predetermined path and correlating the received user input with stored global positioning satellite (GPS) data to generate one or more virtual waypoints along the predetermined path. The method includes processing the one or more virtual waypoints to generate a spline-based flight path. The method may include storing the spline-based flight path and transmitting the spline-based flight path to the aerial vehicle.

Abstract: An unmanned aerial vehicle manages storage of data and transfer between other connected devices. The unmanned aerial vehicle captures sensor data from sensors on the unmanned aerial vehicle. The unmanned aerial vehicle transfers the captured sensor data from the unmanned aerial vehicle to a remote controller via a wireless interface. The captured data may be transferred via a TCP link, a UDP link, or a combination thereof If a loss of link is detected, the captured sensor data is stored to a buffer and a battery level of the unmanned aerial vehicle and a flight status of the unmanned aerial vehicle is monitored. The stored sensor data is transferred from the buffer to a non-volatile storage responsive to the battery level dropping below a predefined threshold or detecting that the unmanned aerial vehicle is stationary and a shutdown may be imminent.

Abstract: An intermediate device receives a content data message addressed to a receiving device for a communication session between a source device and the receiving device. The intermediate device substitutes adapted content data for content data of the content data message and then sends the adapted content data to the receiving device such that it appears to the receiving device that the adapted content data originated from the source device. The communication from the source device to the receiving device is intercepted by the intermediate device in a manner that is transparent to the source device and receiving device.

Abstract: Data packets to be transferred over a network as part of a temporally ordered content stream are obtained by an adaptive progressive download (APD) server. The APD server divides the data packets of the content stream into epochs of contiguous data, the epochs including a current epoch. The APD server determines a bit rate available on the network for transferring the current epoch and calculates an estimate of a playback time of the content stream buffered at a computer to which the content stream is being transferred and played back. The calculation of the estimate is based at least in part on the bit rate available on the network and an encoding bit rate of the content stream. The APD server controls the transfer of the content stream over the network in accordance with the estimated playback time.

Abstract: An intermediate device receives a content data message addressed to a receiving device for a communication session between a source device and the receiving device. The intermediate device substitutes adapted content data for content data of the content data message and then sends the adapted content data to the receiving device such that it appears to the receiving device that the adapted content data originated from the source device.

Abstract: Data packets to be transferred over a network as part of a temporally ordered content stream are obtained by an adaptive progressive download (APD) server. The APD server divides the data packets of the content stream into epochs of contiguous data, the epochs including a current epoch. The APD server determines a bit rate available on the network for transferring the current epoch and calculates an estimate of a playback time of the content stream buffered at a computer to which the content stream is being transferred and played back. The calculation of the estimate is based at least in part on the bit rate available on the network and an encoding bit rate of the content stream. The APD server controls the transfer of the content stream over the network in accordance with the estimated playback time.

Abstract: A system for finding URLs for sites having information related to topics in a video presentation has an extractor extracting closed-caption (CC) text from the video presentation, a parser parsing the CC text for topic language, and a search function using the topic language from the parser as a search criteria. The search function searches for WEB sites having information matching the topic language, returns URLs for WEB sites found, and associates the URLs with the topic language. In some cases there is a hyperlink generator for creating hyperlinks to the WEB sites returned, and the system displays the hyperlinks with a display of the video presentation. In a preferred embodiment the video presentation is provided in a first window in the display, thumbnails are displayed in a second window, each thumbnail representing a new topic, and the hyperlinks are displayed in a third window.