Abstract: Techniques for isolating audio signals related to audio sources within an audio environment are discussed herein. Examples may include receiving a plurality of audio data objects. Each audio data object includes digitized audio signals captured by a capture device positioned within an audio environment. Examples may also include inputting the audio data objects to a source localizer model that is configured to generate, based on the audio data objects, one or more audio source position estimate objects. Examples may also include inputting the audio data objects and each audio source position estimate object to a source generator model of one or more source generator models. The source generator model is configured to generate, based on the audio source position estimate object, a source isolated audio output component. The source isolated audio output component may include isolated audio signals associated with an audio source within the audio environment.

Abstract: An example immersive audio signal processing system and a computer-implemented method for generating a target arena environment audio stream are provided. The example immersive audio signal processing system includes a plurality of multi-lobe digital sound wave capture devices positioned within the arena environment. The plurality of multi-lobe digital sound wave capture devices is configured to direct first beamformed lobes to a playing region of the arena environment, second beamformed lobes to a spectator region of the arena environment, and third beamformed lobes to a noise source region of the arena environment. A digital signal processor is configured to isolate noise audio components originating from at least the spectator region or the noise source region from the audio signal stream and generate a target arena environment audio stream.

Abstract: Techniques are disclosed herein for providing a multi-threaded video pipeline for video content associated with a video environment. Examples may include detecting a defined event type with respect to raw video data associated with at least one video capture device located within a video environment, configuring respective video processors of a video processor pipeline associated with the at least one video capture device based at least in part on the defined event type, encoding video data associated with the at least one video capture device based at least in part on the configuration of the respective video processors, and outputting the encoded video data to a network device.

Abstract: Techniques are disclosed herein for providing video capture device control based on metadata related to a video environment. Examples may include receiving metadata generated by at least one machine learning model associated with at least one video capture device located within a video environment, generating a view quality score for the video environment based at least in part on the metadata, generating control data for the at least one video capture device based at least in part on the view quality score, and outputting the control data to the at least one video capture device.

Abstract: Various embodiments of the present disclosure provide methods, apparatuses, systems, and/or devices that are configured to separate multi-source audio signal samples into discrete source separated channel audio samples using trained multi-modal audio source channelization models. Multi-source audio signal samples are difficult to separate because they can include multiple target audio sources (e.g., individual speakers) that are often inter-mixed and overlaid with other audio sources such as noise, music, reverberations, and other audio artifacts. The multi-modal audio source channelization models discussed herein are trained to generate source separated channel audio samples based on audio signal samples and on video signal samples.

Abstract: An example immersive audio signal processing system and a computer-implemented method for generating a target arena environment audio stream are provided. The example immersive audio signal processing system includes a plurality of multi-lobe digital sound wave capture devices positioned within the arena environment. The plurality of multi-lobe digital sound wave capture devices is configured to direct first beamformed lobes to a playing region of the arena environment, second beamformed lobes to a spectator region of the arena environment, and third beamformed lobes to a noise source region of the arena environment. A digital signal processor is configured to isolate noise audio components originating from at least the spectator region or the noise source region from the audio signal stream and generate a target arena environment audio stream.

Abstract: Techniques are disclosed herein for providing video content processing based on facial recognition and pose tracking modeling. Examples may include receiving video data captured by at least one video capture device located within a video environment, extracting an image feature set from the video data, inputting the image feature set to a facial recognition model to generate a facial feature set for a facial identifier associated with a target of interest in the video environment, inputting the facial feature set to a pose tracking model to generate a pose tracking feature set for the facial identifier, augmenting the facial feature set with the pose tracking feature set to generate an augmented feature set for the facial identifier, and outputting location information for the facial identifier based at least in part on the augmented feature set.

Abstract: Techniques are disclosed herein for providing neural acoustic modeling for an audio environment. Examples may include receiving audio data and image data associated with an audio environment, generating an image set comprising a plurality of images each associated with audio samples representing acoustic properties of the audio environment, and generating an audio rendering model for the audio environment based at least in part on the image set and the audio samples. The audio rendering model may include a neural rendering volumetric representation of the audio environment augmented with audio encodings.

Abstract: An example immersive audio signal processing system and a computer-implemented method for generating a target arena environment audio stream are provided. The example immersive audio signal processing system includes a plurality of multi-lobe digital sound wave capture devices positioned within the arena environment. The plurality of multi-lobe digital sound wave capture devices is configured to direct first beamformed lobes to a playing region of the arena environment, second beamformed lobes to a spectator region of the arena environment, and third beamformed lobes to a noise source region of the arena environment. A digital signal processor is configured to isolate noise audio components originating from at least the spectator region or the noise source region from the audio signal stream and generate a target arena environment audio stream.

Abstract: Techniques for providing a directionally dependent acoustic structure for audio processing related to at least one microphone sensor are discussed herein. Examples may include transforming an augmented audio signal defined by a directionally dependent acoustic structure positioned proximate to at least one microphone sensor into at least one audio data object set, inputting the at least one audio data object set to a model configured to generate at least one spatialization data structure indicative of spatialization information for at least one audio source located within the audio environment, and generating audio processing data based at least in part on the at least one spatialization data structure.

Abstract: Embodiments provide for employing an audio transformation model to resynthesize speech signals associated with a speaking entity. Examples can receive audio signals comprising speech signals that are captured by an audio capture device. Examples can divide the audio signals into audio segments and input the audio segments into an audio transformation model to generate a voice vector representation and a speech vector representation. The voice vector representation comprises characteristics related to a speaking voice associated with the speaking entity and the speech vector representation comprises one or more words spoken by the speaking entity. The one or more words comprised in the speech vector representation are associated with respective contextual attributes associated with the one or more words. The audio transformation model can utilize the voice vector representation and the speech vector representation to regenerate the speech signals associated with the speaking entity.

Abstract: A solar cell for a solar cell array with one or more grid on a surface thereof, wherein electrical connections are made to the grids in a plurality of locations positioned around the solar cell; and the electrical connections extend to one or more conductors located under the solar cell. The conductors located under the solar cell are buried within a substrate, and each of the conductors comprises a low resistance conducting path that distributes current from the solar cell. The conductors are loops, U-shaped, or have only up or down pathways. The solar cell comprises a full cell that has four cropped corners and the locations are in the cropped corners.

Abstract: An example immersive audio signal processing system and a computer-implemented method for generating a target arena environment audio stream are provided. The example immersive audio signal processing system includes a plurality of multi-lobe digital sound wave capture devices positioned within the arena environment. The plurality of multi-lobe digital sound wave capture devices is configured to direct first beamformed lobes to a playing region of the arena environment, second beamformed lobes to a spectator region of the arena environment, and third beamformed lobes to a noise source region of the arena environment. A digital signal processor is configured to isolate noise audio components originating from at least the spectator region or the noise source region from the audio signal stream and generate a target arena environment audio stream.

Abstract: Various embodiments of the present disclosure provide methods, apparatus, systems, devices, and/or the like for inferring characteristics of a physical enclosure using a plurality of audio signals. The plurality of audio signals may be processed using a feature extraction framework to generate structured audio event data sets, which may be processed using an audio event framework to determine the characteristics of the physical enclosure.

Abstract: Techniques for isolating audio signals related to audio sources within an audio environment are discussed herein. Examples may include receiving a plurality of audio data objects. Each audio data object includes digitized audio signals captured by a capture device positioned within an audio environment. Examples may also include inputting the audio data objects to a source localizer model that is configured to generate, based on the audio data objects, one or more audio source position estimate objects. Examples may also include inputting the audio data objects and each audio source position estimate object to a source generator model of one or more source generator models. The source generator model is configured to generate, based on the audio source position estimate object, a source isolated audio output component. The source isolated audio output component may include isolated audio signals associated with an audio source within the audio environment.

Abstract: A solar cell for a solar cell array with one or more grid on a surface thereof, wherein electrical connections are made to the grids in a plurality of locations positioned around the solar cell; and the electrical connections extend to one or more conductors located under the solar cell. The conductors located under the solar cell are buried within a substrate, and each of the conductors comprises a low resistance conducting path that distributes current from the solar cell. The conductors are loops, U-shaped, or have only up or down pathways. The solar cell comprises a full cell that has four cropped corners and the locations are in the cropped corners.

Abstract: A solar cell for a solar cell array with one or more grid on a surface thereof, wherein electrical connections are made to the grids in a plurality of locations positioned around the solar cell; and the electrical connections extend to one or more conductors located under the solar cell. The conductors located under the solar cell are buried within a substrate, and each of the conductors comprises a low resistance conducting path that distributes current from the solar cell. The conductors are loops, U-shaped, or have only up or down pathways. The solar cell comprises a full cell that has four cropped corners and the locations are in the cropped corners.

Abstract: A solar cell for a solar cell array with one or more grid on a surface thereof, wherein electrical connections are made to the grids in a plurality of locations positioned around the solar cell; and the electrical connections extend to one or more conductors located under the solar cell. The conductors located under the solar cell are buried within a substrate, and each of the conductors comprises a low resistance conducting path that distributes current from the solar cell. The conductors are loops, U-shaped, or have only up or down pathways. The solar cell comprises a full cell that has four cropped corners and the locations are in the cropped corners.