Abstract: A method for training and using a convolutional neural network with images having on-purpose distortion is disclosed. By distorting on-purpose the image to create zone of interest with higher number of pixels, the resulting output from the neural network is improved. The distorted images are created using an imager device either comprising an optical system specifically designed to output distorted images or comprising software or hardware image distortion manipulation algorithm to create the distorted images from normal images. Also described is a method for training the neural network using a distorted image generator from various existing datasets.

Abstract: A miniature wide-angle imaging lens has a miniaturization ratio, of a total track length from the center of a first surface to a focal plane by an image circle diameter, with a value less than 3.0. The imaging lens includes, starting from an object side of the lens, a first group of at least three optical elements, a second group including an aperture stop and an optical element immediately in front of or behind the aperture stop, and a third group of at least two optical elements.

Abstract: A method to design miniature wide-angle and ultra-wide-angle lenses by using on-purpose distortion to have shorter focal length than usual for a given image sensor size and a desired image projection. This results in optical systems having miniaturization ratio, defined as the ratio between the total track length and the image footprint diameter, smaller than 0.8. The resulting image from these systems having on-purpose distortion can then be processed with a processor to remove the on-purpose distortion and to output an image with the targeted distortion profile.

Abstract: A method for controlling an optical system including at least one active light-controlling element to better control the illumination of a scene when imaged on an image sensor is presented. This active light-controlling element is used to control the amount of light in an image zone depending on an electric signal from a controller. This allows imaging scenes with bright objects without over-exposure or scenes with dark objects without under-exposure on the image sensor. After image processing to reverse the effect of the active light-controlling element, the resulting processed images have an enhanced depth without the drawbacks associated to traditional HDR imaging. The method can use any shape of sub-elements in the active light-controlling element depending on the application. The method can also be used with multiple active light-controlling surfaces to further control the light on the image sensor, including separating the colors in the image.

Abstract: A method for designing a wide-angle optical system having at least one freeform optical surface without rotational symmetry to create a custom 2D object-image mapping. The method is based on iteratively adjusting the at least one freeform optical 2D surface shape to have the exact 2D object-image mapping required and then adjusting the optical element surfaces to meet the other required optical specifications. The iterative method is applied until both the desired 2D object-image mapping and the other required optical specifications are reached.

Abstract: A stereoscopic vision system uses at least two cameras having different parameters to image a scene and create stereoscopic views. The different parameters of the two cameras can be intrinsic or extrinsic, including, for example, the distortion profile of the lens in the cameras, the field of view of the lens, the orientation of the cameras, the positions of the cameras, the color spectrum of the cameras, the frame rate of the cameras, the exposure time of the cameras, the gain of the cameras, the aperture size of the lenses, or the like. An image processing apparatus is then used to process the images from the at least two different cameras to provide optimal stereoscopic vision to a display.

Abstract: A method for enhancing a wide angle image to improve the perspectives and the visual appeal thereof wide-angle images uses custom adaptive dewarping. The method is based on the scene image content of recognized objects in the image, the position of these objects in the image, the depth of these objects in the scene with respect to other objects and the general context of the image.

Abstract: A method for designing an optical system for providing reliable, robust and successful realization of a distortion variation function is presented. In a preferred embodiment, the proposed distortion variation optical system includes at least two non-symmetrical elements, which are moving in the transverse direction. The proposed freeform lens contains two transmissive refractive surfaces. The freeform elements designed with this method have preferably a flat surface and a non-symmetrical freeform surface. The two plano-surfaces are preferably made to face each other, so that a miniature camera can be offered. The value of the non-symmetrical freeform surface is used to produce variable optical power when the two freeform elements undergo a relative movement in the vertical direction. Using this method, an optical system with an active distortion, smaller form factor, and better imaging quality can be obtained.

Abstract: A method for enhancing a wide angle image to improve the perspectives and the visual appeal thereof wide-angle images uses custom adaptive dewarping. The method is based on the scene image content of recognized objects in the image, the position of these objects in the image, the depth of these objects in the scene with respect to other objects and the general context of the image.

Abstract: An optical apparatus captures images of a wide-angle scene with a single camera having a continuous panomorph zoom distortion profile. When combined with a processing unit, the hybrid zoom system creates an output image with constant resolution while allowing continuous adjustment in the magnification and field of view of the image without interpolation like a digital zoom system or without any moving parts like an optical zoom system.

Abstract: A method to design miniature wide-angle and ultra-wide-angle lenses by using on-purpose distortion to have shorter focal length than usual for a given image sensor size and a desired image projection. This results in optical systems having miniaturization ratio, defined as the ratio between the total track length and the image footprint diameter, smaller than 0.8. The resulting image from these systems having on-purpose distortion can then be processed with a processor to remove the on-purpose distortion and to output an image with the targeted distortion profile.

Abstract: A method for designing an optical system for providing reliable, robust and successful realization of a distortion variation function is presented. In a preferred embodiment, the proposed distortion variation optical system includes at least two non-symmetrical elements, which are moving in the transverse direction. The proposed freeform lens contains two transmissive refractive surfaces. The freeform elements designed with this method have preferably a flat surface and a non-symmetrical freeform surface. The two plano-surfaces are preferably made to face each other, so that a miniature camera can be offered. The value of the non-symmetrical freeform surface is used to produce variable optical power when the two freeform elements undergo a relative movement in the vertical direction. Using this method, an optical system with an active distortion, smaller form factor, and better imaging quality can be obtained.

Abstract: A stereoscopic vision system uses at least two cameras having different parameters to image a scene and create stereoscopic views. The different parameters of the two cameras can be intrinsic or extrinsic, including, for example, the distortion profile of the lens in the cameras, the field of view of the lens, the orientation of the cameras, the positions of the cameras, the color spectrum of the cameras, the frame rate of the cameras, the exposure time of the cameras, the gain of the cameras, the aperture size of the lenses, or the like. An image processing apparatus is then used to process the images from the at least two different cameras to provide optimal stereoscopic vision to a display.

Abstract: A method for enhancing a wide angle image to improve the perspectives and the visual appeal thereof wide-angle images uses custom adaptive dewarping. The method is based on the scene image content of recognized objects in the image, the position of these objects in the image, the depth of these objects in the scene with respect to other objects and the general context of the image.

Abstract: An optical apparatus captures images of a wide-angle scene with a single camera having a continuous panomorph zoom distortion profile. When combined with a processing unit, the hybrid zoom system creates an output image with constant resolution while allowing continuous adjustment in the magnification and field of view of the image without interpolation like a digital zoom system or without any moving parts like an optical zoom system.

Abstract: Systems and methods in accordance with the invention allow automatic recording, sharing, and communicating of different parameters associated with images and their imager to define a specific system behavior of a display device or an algorithm unit. Examples of information include imager parameters, environment parameters, image processing and enhancement parameters, coordinates of a section of wide-angle scene image content, display parameters, defined user experience, defined system behavior or any information to be recorded, shared, and communicated. To avoid loss of information, the information is encoded directly in the picture using a marker. This way, the information is robustly transferred from the imager to the display unit. According to the information, the final image can be automatically corrected and enhanced before display, different associated parameters can be displayed on final image or be used with another output.

Abstract: The present invention is a system for assembling panoramic images of a scene captured by a panoramic image capture device having a decoding unit configured to read image content data from the image capture device, an information reading unit configured to extract device parameters about the capture device, and an image processing unit configured to assemble an output image using the image content data and the device parameters.

Abstract: Systems and methods in accordance with the invention allow automatic recording, sharing, and communicating of different parameters associated with images and their imager to define a specific system behavior of a display device or an algorithm unit. Examples of information include imager parameters, environment parameters, image processing and enhancement parameters, coordinates of a section of wide-angle scene image content, display parameters, defined user experience, defined system behavior or any information to be recorded, shared, and communicated. To avoid loss of information, the information is encoded directly in the picture using a marker. This way, the information is robustly transferred from the imager to the display unit. According to the information, the final image can be automatically corrected and enhanced before display, different associated parameters can be displayed on final image or be used with another output.

Abstract: A panoramic camera is provided with an orientation sensor to record orientation along with a panoramic image. The display or print image is selected from the captured panoramic image, a warped, non-scale-correct image. The selection of the display image is done using the orientation sensor. The orientation sensor data can be recorded with the panoramic image as metadata. The orientation sensor can also be used to control an external display and/or panoramic image selection during browsing.

Abstract: A miniature wide-angle imaging lens has a miniaturization ratio, of a total track length from the center of a first surface to a focal plane by an image circle diameter, with a value less than 3.0. The imaging lens includes, starting from an object side of the lens, a first group of at least three optical elements, a second group including an aperture stop and an optical element immediately in front of or behind the aperture stop, and a third group of at least two optical elements.