Abstract: An apparatus comprising a plurality of image modules and a plurality of processors. The image modules may each comprise (i) a sensor configured to generate images and (ii) a lens mounted to the sensor. The processors may each be configured to (A) receive the images from a subset of the plurality of image modules and (B) generate a plurality of video streams. Each one of the video streams may be generated by one of the processors in response to the images received from one of the image modules. The subset of the plurality of image modules may comprise at least two distinct image modules of the plurality of image modules. The lenses may be arranged to allow the images to provide coverage for a spherical field of view of a scene surrounding the apparatus.

Abstract: A system comprising a camera and a computing device. The camera may comprise (a) a plurality of capture devices configured to capture images of an environment surrounding the camera to provide a spherical field of view and (b) a first interface. The computing device may comprise (a) a processor and (b) a second interface. The camera may be configured to encode a plurality of video streams based on the captured images. The first interface may be configured to transfer the plurality of video streams to the second interface. The processor may perform a stitching operation on the plurality of video streams to generate a single video signal. The stitching operation may be performed on the plurality of video streams in real time as the plurality of video streams are transferred. The single video signal may be configured to represent an omnidirectional view based on the environment surrounding the camera.

Abstract: A system includes a video source and a computing device. The video source may be configured to generate a plurality of video streams that capture a view of an environment. The computing device generally includes one or more processors configured to (i) perform a stitching operation on the plurality of video streams to generate a video signal representative of a spherical field of view of the environment, (ii) transmit a display signal that represents a projection of the video signal to be displayed to a user utilizing an immersive display, (iii) receive a plurality of commands from the user while the user observes the environment in the immersive display and (iv) adjust a plurality of parameters in one or more of the video source and the stitching operation in real time in response to the commands.

Abstract: An apparatus comprising a plurality of lenses and a frame. The plurality of lenses may be arranged to provide coverage for an omnidirectional field of view of a scene surrounding the apparatus and each have an optical axis directed to provide coverage for a respective area of the omnidirectional field of view. The frame may be configured to hold the plurality of lenses. At least a first one of the lenses and at least a second one of the lenses are neighboring lenses. An orientation of at least two of the neighboring lenses is configured to control parallax effects when the omnidirectional field of view is recorded using the plurality of lenses. The parallax effects are controlled by configuring the optical axes of the neighboring lenses to not line in the same plane.

Abstract: A system comprising a video source, one or more audio sources and a computing device. The video source may be configured to generate a plurality of video streams that capture a view of an environment. The one or more audio sources may be configured to capture audio data of the environment. The computing device may comprise one or more processors configured to (i) perform a stitching operation on the plurality of video streams to generate a video signal representative of an immersive field of view of the environment, (ii) generate a sound field based on the audio data, (iii) identify an orientation for the sound field with respect to the video signal, and (iv) determine a rotation of the sound field based on the orientation. The rotation of the sound field aligns the sound field to the video signal.

Abstract: An apparatus comprising a plurality of image modules and a plurality of processors. The image modules may each comprise (i) a sensor configured to generate images and (ii) a lens mounted to the sensor. The processors may each be configured to (A) receive the images from a subset of the plurality of image modules and (B) generate a plurality of video streams. Each one of the video streams may be generated by one of the processors in response to the images received from one of the image modules. The subset of the plurality of image modules may comprise at least two distinct image modules of the plurality of image modules. The lenses may be arranged to allow the images to provide coverage for a spherical field of view of a scene surrounding the apparatus.

Abstract: A system comprising a video source, one or more audio sources and a computing device. The video source may be configured to generate a plurality of video streams that capture a view of an environment. The one or more audio sources may be configured to capture audio data of the environment. The computing device may comprise one or more processors configured to (i) perform a stitching operation on the plurality of video streams to generate a video signal representative of an immersive field of view of the environment, (ii) generate a sound field based on the audio data, (iii) identify an orientation for the sound field with respect to the video signal, and (iv) determine a rotation of the sound field based on the orientation. The rotation of the sound field aligns the sound field to the video signal.

Abstract: An apparatus comprising a plurality of lenses and a frame. The plurality of lenses may be arranged to provide coverage for a spherical field of view of a scene surrounding the apparatus and each have an optical axis directed to provide coverage for a respective area of the spherical field of view. The frame may be configured to hold a first subset of the plurality of lenses and a second subset of the plurality of lenses. At least one of the lenses in the first subset and at least one of the lenses in the second subset are neighboring lenses. An orientation of at least two of the neighboring lenses is configured to reduce parallax effects when the spherical field of view is recorded using the plurality of lenses. The parallax effects are reduced by configuring the optical axes of the neighboring lenses to not intersect.

Abstract: A system comprising a video source, one or more audio sources and a computing device. The video source may be configured to generate a plurality of video streams that capture a view of an environment. The one or more audio sources may be configured to capture audio data of the environment. The computing device may comprise one or more processors configured to (i) perform a stitching operation on the plurality of video streams to generate a video signal representative of an immersive field of view of the environment, (ii) generate a sound field based on the audio data, (iii) identify an orientation for the sound field with respect to the video signal, and (iv) determine a rotation of the sound field based on the orientation. The rotation of the sound field aligns the sound field to the video signal.

Abstract: A system comprising a camera and a computing device. The camera may comprise (a) a plurality of capture devices configured to capture images of an environment surrounding the camera to provide a spherical field of view and (b) a first interface. The computing device may comprise (a) a processor and (b) a second interface. The camera may be configured to encode a plurality of video streams based on the captured images. The first interface may be configured to transfer the plurality of video streams to the second interface. The processor may perform a stitching operation on the plurality of video streams to generate a single video signal. The stitching operation may be performed on the plurality of video streams in real time as the plurality of video streams are transferred. The single video signal may be configured to represent an omnidirectional view based on the environment surrounding the camera.

Abstract: An apparatus comprising a plurality of image modules and a plurality of processors. The image modules may each comprise (i) a sensor configured to generate images and (ii) a lens mounted to the sensor. The processors may each be configured to (A) receive the images from a subset of the plurality of image modules and (B) generate a plurality of video streams. Each one of the video streams may be generated by one of the processors in response to the images received from one of the image modules. The subset of the plurality of image modules may comprise at least two distinct image modules of the plurality of image modules. The lenses may be arranged to allow the images to provide coverage for a spherical field of view of a scene surrounding the apparatus.

Abstract: A system comprising a video display device, an audio output device and a computing device. The computing device may comprise one or more processors configured to (i) determine orientation angles of a spherical video based on an input, (ii) extract a viewport from the spherical video based on the orientation angles, (iii) output the viewport to the video display device, (iv) render a sound field based on the orientation angles and the audio output device and (v) output the sound field to the audio output device. Sound sources that comprise the sound field are adjusted to align with the viewport. The sound sources outside of the viewport are attenuated.

Abstract: An apparatus comprising a plurality of lenses and a frame. The lenses may be arranged to provide coverage for a spherical field of view of a scene surrounding the apparatus. The frame may be configured to hold (A) a first subset of the lenses, (B) a second subset of the lenses and (C) a third subset of the lenses. At least one of the lenses in the first subset and at least one of the lenses in the second subset may be neighboring lenses arranged around a periphery of the apparatus. At least one of the lenses in the third subset and at least one of the lenses in the first subset or the second subset may be neighboring lenses. At least two of the neighboring lenses may be oriented to adjust parallax effects for a pre-determined purpose when the spherical field of view is recorded.

Abstract: A system comprising a video source, one or more audio sources and a computing device. The video source may be configured to generate a video signal. The audio sources may be configured to generate audio streams. The computing device may comprise one or more processors configured to (i) transmit a display signal that provides a representation of the video signal to be displayed to a user, (ii) receive a plurality of commands from the user while the user observes the representation of the video signal and (iii) adjust the audio streams in response to the commands. The commands may identify a location of the audio sources in the representation of the video signal. The representation of the video signal may be used as a frame of reference for the location of the audio sources.

Abstract: A system comprising a camera and a computing device. The camera may comprise (a) a plurality of capture devices configured to capture images of an environment surrounding the camera to provide a spherical field of view and (b) a first interface. The computing device may comprise (a) a processor and (b) a second interface. The camera may be configured to encode a plurality of video streams based on the captured images. The first interface may be configured to transfer the plurality of video streams to the second interface. The processor may perform a stitching operation on the plurality of video streams to generate a single video signal. The stitching operation may be performed on the plurality of video streams in real time as the plurality of video streams are transferred. The single video signal may be configured to represent an omnidirectional view based on the environment surrounding the camera.

Abstract: A system includes a video source and a computing device. The video source may be configured to generate a plurality of video streams that capture a view of an environment. The computing device generally includes one or more processors configured to (i) perform a stitching operation on the plurality of video streams to generate a video signal representative of a spherical field of view of the environment, (ii) transmit a display signal that represents a projection of the video signal to be displayed to a user utilizing an immersive display, (iii) receive a plurality of commands from the user while the user observes the environment in the immersive display and (iv) adjust a plurality of parameters in one or more of the video source and the stitching operation in real time in response to the commands.

Abstract: An apparatus comprising a plurality of lenses and a frame. The plurality of lenses may be arranged to provide coverage for a spherical field of view of a scene surrounding the apparatus and each have an optical axis directed to provide coverage for a respective area of the spherical field of view. The frame may be configured to hold a first subset of the plurality of lenses and a second subset of the plurality of lenses. At least one of the lenses in the first subset and at least one of the lenses in the second subset are neighboring lenses. An orientation of at least two of the neighboring lenses is configured to reduce parallax effects when the spherical field of view is recorded using the plurality of lenses. The parallax effects are reduced by configuring the optical axes of the neighboring lenses to not intersect.

Abstract: An apparatus comprising a plurality of image modules and a plurality of processors. The image modules may each comprise (i) a sensor configured to generate images and (ii) a lens mounted to the sensor. The processors may each be configured to (A) receive the images from a subset of the plurality of image modules and (B) generate a plurality of video streams. Each one of the video streams may be generated by one of the processors in response to the images received from one of the image modules. The subset of the plurality of image modules may comprise at least two distinct image modules of the plurality of image modules. The lenses may be arranged to allow the images to provide coverage for a spherical field of view of a scene surrounding the apparatus.

Abstract: A system comprising a camera and a computing device. The camera may comprise (a) a plurality of capture devices configured to capture images of an environment surrounding the camera to provide a spherical field of view and (b) a first interface. The computing device may comprise (a) a processor and (b) a second interface. The camera may be configured to encode a plurality of video streams based on the captured images. The first interface may be configured to transfer the plurality of video streams to the second interface. The processor may perform a stitching operation on the plurality of video streams to generate a single video signal. The stitching operation may be performed on the plurality of video streams in real time as the plurality of video streams are transferred. The single video signal may be configured to represent an omnidirectional view based on the environment surrounding the camera.