Abstract: Described are systems and methods for generating synthetic image data including synthetic images, depth information, and optical flow data. Embodiments of the invention assemble image scenes from virtual objects and capture realistic perspectives of images scenes as synthetic images. Realistic perspectives captured in synthetic images are defined by camera views created from camera settings files. To simulate capture performance of smartphone cameras, stereo cameras, and other actual camera devices, capture, calibration, and camera intrinsic parameters included in camera settings files are identical to parameters included in actual cameras. Synthetic image datasets generated by the systems and methods described herein are used to train machine learning systems generating machine learning models for performing computer vision tasks.

Abstract: Embodiments are disclosed for a stereoscopic device (also referred to simply as the “device”) that captures three-dimensional (3D) images and videos with a wide field of view and provides a virtual reality (VR) experience by immersing a user in a simulated environment using the captured 3D images or videos.

Abstract: Described are calibration and rectification systems and methods for 3D cameras. The calibration methods described herein derive calibration parameters in real time for multiple camera settings. Calibration parameters are used to rectify stereo images as part of a process for creating 3D images, videos, and VR or AR experiences. Additionally multi-camera systems for implementing the calibration and rectification methods are disclosed. 3D camera calibration methods involving a limited number of calibration points reduce the cost and complexity of conventional calibration methods while also allowing for higher performing 3D cameras having many possible configurations of camera settings.

Abstract: Described are systems and methods for generating synthetic image data including synthetic images, depth information, and optical flow data. Embodiments of the invention assemble image scenes from virtual objects and capture realistic perspectives of images scenes as synthetic images. Realistic perspectives captured in synthetic images are defined by camera views created from camera settings files. To simulate capture performance of smartphone cameras, stereo cameras, and other actual camera devices, capture, calibration, and camera intrinsic parameters included in camera settings files are identical to parameters included in actual cameras. Synthetic image datasets generated by the systems and methods described herein are used to train machine learning systems generating machine learning models for performing computer vision tasks.

Abstract: Described are image and video processing systems and methods for auto re-calibration of stereo camera devices. The auto re-calibration processes described herein transform image data into re-calibration data used to correct calibration errors in real time. The auto re-calibration processes leverage position data shifting, image data filtering, and disparity analysis to generate one or more calibration profiles that track the position of the camera modules included in stereo camera devices. Calibration profiles are then used to generate pixel shift parameters describing how to modify the position of image pixels and or camera modules to improve rectification and projection of 3D images and video frames. Additionally multi-camera systems implementing the auto re-calibration processes are disclosed.

Abstract: Described are digital camera devices for 3D Imaging. Embodiments of the invention capture and process sensory data including image data to produce 3D content and generate depth information. Digital camera devices improve upon existing camera devices by implementing dynamic calibration processes that improve the quality of image capture and image projection. In some embodiments the digital camera devices include an imaging system for performing computer vision tasks including scene reconstruction, event detection, video tracking, object recognition, 3D pose estimation, learning, indexing, motion estimation, object tracking, facial recognition, object counting, 3D imaging, image enhancement and image restoration.

Abstract: Described are digital camera devices for 3D Imaging. Embodiments of the invention capture and process sensory data including image data to produce 3D content and generate depth information. Digital camera devices improve upon existing camera devices by implementing dynamic calibration processes that improve the quality of image capture and image projection. In some embodiments the digital camera devices include an imaging system for performing computer vision tasks including scene reconstruction, event detection, video tracking, object recognition, 3D pose estimation, learning, indexing, motion estimation, object tracking, facial recognition, object counting, 3D imaging, image enhancement and image restoration.

Abstract: Described are image and video processing systems and methods for auto re-calibration of stereo camera devices. The auto re-calibration processes described herein transform image data into re-calibration data used to correct calibration errors in real time. The auto re-calibration processes leverage position data shifting, image data filtering, and disparity analysis to generate one or more calibration profiles that track the position of the camera modules included in stereo camera devices. Calibration profiles are then used to generate pixel shift parameters describing how to modify the position of image pixels and or camera modules to improve rectification and projection of 3D images and video frames. Additionally multi-camera systems implementing the auto re-calibration processes are disclosed.

Abstract: Described are calibration and rectification systems and methods for 3D cameras. The calibration methods described herein derive calibration parameters in real time for multiple camera settings. Calibration parameters are used to rectify stereo images as part of a process for creating 3D images, videos, and VR or AR experiences. Additionally multi-camera systems for implementing the calibration and rectification methods are disclosed. 3D camera calibration methods involving a limited number of calibration points reduce the cost and complexity of conventional calibration methods while also allowing for higher performing 3D cameras having many possible configurations of camera settings.

Abstract: A computerized system for displaying stereoscopic three-dimensional (3D) video recorded on a stereoscopic camera device includes a computer store containing data. The data includes a stereoscopic video feed of two or more stereoscopic images from a stereoscopic video capture device, wherein the stereoscopic video feed comprises a plurality of contemporaneous metadata feeds, wherein a metadata feed comprises a time sequenced set of metadata obtained from a sensor of the stereoscopic video capture device. The computerized system includes a computer processor in the stereoscopic video capture device, which computer processor is coupled to the computer store and programmed to obtain the stereoscopic video feed from the computer store, parse the plurality of contemporaneous metadata feeds from the stereoscopic video feed, and calibrate the stereoscopic video feed for display in a display of a user's computing device using the plurality of contemporaneous metadata feeds.

Abstract: Embodiments are disclosed for embedding calibration metadata for a stereoscopic video capturing device. The device captures a sequence of stereoscopic images by a plurality of image sensors and combines the captured sequence of stereoscopic images into a stereoscopic video sequence. The device further embeds calibration information into the stereoscopic video sequence in a real time as the sequence of stereoscopic images is being recorded. The calibration information can be used to correct distortion caused by hardware variances of individual video capturing devices. The corrected stereoscopic videos can be used to provide a virtual reality (VR) experience by immersing a user in a simulated environment.

Abstract: Embodiments are disclosed for a stereoscopic device (also referred to simply as the “device”) that captures three-dimensional (3D) images and videos with a wide field of view and provides a virtual reality (VR) experience by immersing a user in a simulated environment using the captured 3D images or videos.

Abstract: Embodiments are disclosed for embedding calibration metadata for a stereoscopic video capturing device. The device captures a sequence of stereoscopic images by a plurality of image sensors and combines the captured sequence of stereoscopic images into a stereoscopic video sequence. The device further embeds calibration information into the stereoscopic video sequence in a real time as the sequence of stereoscopic images is being recorded. The calibration information can be used to correct distortion caused by hardware variances of individual video capturing devices. The corrected stereoscopic videos can be used to provide a virtual reality (VR) experience by immersing a user in a simulated environment.

Abstract: Embodiments are disclosed for a stereoscopic device (also referred to simply as the “device”) that captures three-dimensional (3D) images and videos with a wide field of view and provides a virtual reality (VR) experience by immersing a user in a simulated environment using the captured 3D images or videos.

Abstract: A computerized system for displaying stereoscopic three-dimensional (3D) video recorded on a stereoscopic camera device includes a computer store containing data. The data includes a stereoscopic video feed of two or more stereoscopic images from a stereoscopic video capture device, wherein the stereoscopic video feed comprises a plurality of contemporaneous metadata feeds, wherein a metadata feed comprises a time sequenced set of metadata obtained from a sensor of the stereoscopic video capture device. The computerized system includes a computer processor in the stereoscopic video capture device, which computer processor is coupled to the computer store and programmed to obtain the stereoscopic video feed from the computer store, parse the plurality of contemporaneous metadata feeds from the stereoscopic video feed, and calibrate the stereoscopic video feed for display in a display of a user's computing device using the plurality of contemporaneous metadata feeds.

Abstract: Embodiments are disclosed for embedding calibration metadata for a stereoscopic video capturing device. The device captures a sequence of stereoscopic images by a plurality of image sensors and combines the captured sequence of stereoscopic images into a stereoscopic video sequence. The device further embeds calibration information into the stereoscopic video sequence in a real time as the sequence of stereoscopic images is being recorded. The calibration information can be used to correct distortion caused by hardware variances of individual video capturing devices. The corrected stereoscopic videos can be used to provide a virtual reality (VR) experience by immersing a user in a simulated environment.

Abstract: Embodiments are disclosed for a stereoscopic device (also referred to simply as the “device”) that captures three-dimensional (D) images and videos with a wide field of view and provides a virtual reality (VR) experience by immersing a user in a simulated environment using the captured 3D images or videos.