Abstract: An apparatus and a method are provided. The apparatus includes a light source configured to project light in a changing pattern that reduces the light's noticeability; collection optics through which light passes and forms an epipolar plane with the light source; and an image sensor configured to receive light passed through the collection optics to acquire image information and depth information simultaneously. The method includes projecting light by a light source in a changing pattern that reduces the light's noticeability; passing light through collection optics and forming an epipolar plane between the collection optics and the light source; and receiving in an image sensor light passed through the collection optics to acquire image information and depth information simultaneously.

Abstract: Using the same image sensor to capture a two-dimensional (2D) image and three-dimensional (3D) depth measurements for a 3D object. A laser point-scans the surface of the object with light spots, which are detected by a pixel array in the image sensor to generate the 3D depth profile of the object using triangulation. Each row of pixels in the pixel array forms an epipolar line of the corresponding laser scan line. Timestamping provides a correspondence between the pixel location of a captured light spot and the respective scan angle of the laser to remove any ambiguity in triangulation. An Analog-to-Digital Converter (ADC) in the image sensor operates as a Time-to-Digital Converter (TDC) to generate timestamps. When the epipolar line is misaligned or curved, multiple TDC arrays acquire timestamps of multiple pixels (in multiple rows) substantially simultaneously. Multiple timestamp values are reconciled to obtain a single timestamp value for a light spot.

Abstract: An image sensor operates in a base mode according to a first sampling rate and a first pixel exposure time and includes a light condition detector that extracts illuminance information from a pixel signal received from pixels in a pixel array, and generates a low-illuminance information signal upon detecting that a value of the illuminance information falls within a first range, a sampling controller that changes the first sampling rate to a second sampling rate in response to the low-illuminance information signal, and an exposure time controller that changes the first pixel exposure time to a second pixel exposure time in response to the low-illuminance information signal.

Abstract: A method and a system are disclosed for detecting a depth of an object illuminated by at least one first light pulse. Detection of light reflected from the object illuminated by the at least one first light pulse by a first row of pixels of 2D pixel array is enabled for a first predetermined period of time in which the first row of pixels forms an epipolar line of a scanning line of a first light pulse. Enabling of the detection by the first row of pixels for the first predetermined period of time occurs a second predetermined period of time after a beginning of a pulse cycle T of the at least one first light pulse. Detection signals are generated corresponding to the detected light reflected from the object, and the generated detection signals are used to determine a depth of the object.

Abstract: Embodiments described herein may operate to compare an illuminance corresponding to a signal from an image sensor array (ISA) element in a production imaging system with an illuminance associated with optical flare incident to an ISA from which the ISA element is selected. The ISA element may be identified as unusable if the illuminance corresponding to the signal from the ISA element is less than the illuminance associated with the optical flare incident to the ISA.

Abstract: Using improved Image Signal Processing (ISP) along with a multi-layer Color Filter Array (CFA) architecture to capture both the Red-Green-Blue (RGB) as well as the Red-X-Blue (RXB) images substantially simultaneously on the same Complementary Metal Oxide Semiconductor (CMOS) image sensor chip in a single shot so that subsequent image processing stage(s) can choose between RGB and RXB images to improve the quality of the final image. The color “X” in the RXB image may be a white color, a yellow color, or a cyan color. In contrast to the individual RWB or RGB imaging based conventional CMOS sensors, the disclosed CMOS sensor with one or more layers of specifically-selected CFAs can capture both the RGB and RXB images in a single shot using associated ISP. The multi-layer sensor may be an organic sensor or a stacked X3 sensor. The dual RGB-RXB imaging may reduce colorblindness, chromatic aberration, and saturation artifacts.

Abstract: A pixel array includes color pixels that have a layout, and depth pixels having a layout that starts from the layout of the color pixels. Photodiodes of adjacent depth pixels can be joined to form larger depth pixels, while still efficiently exploiting the layout of the color pixels. Moreover, some embodiments are constructed so as to enable freeze-frame shutter operation of the pixel array.

Abstract: A method for training a neural network to perform assessments of image quality is provided. The method includes: inputting into the neural network at least one set of images, each set including an image and at least one degraded version of the image; performing comparative ranking of each image in the at least one set of images; and training the neural network with the ranking information. A neural network and image signal processing tuning system are disclosed.

Abstract: A method for enhancing at least one image within a series of images is provided. The method includes: selecting the series of images; upscaling each image within the series of images; selecting a reference image among the series of images; performing image registration to align series of images with the reference image; evaluating the series of aligned images for a subset of pixel locations that exhibit high cross-frame variation; performing learning processing to substantially reduce noise and exclude motion biases at the subset of pixel locations; performing pixel fusion from the series of aligned and processed images to produce the super-resolution reference image. A computer program product and an imaging system are disclosed.

Abstract: A method for configuring a neural network is provided. The method includes: selecting a neural network including a plurality of layers, each of the layers including a plurality of neurons for processing an input and providing an output; and, incorporating at least one switch configured to randomly select and disable at least a portion of the neurons in each layer. Another method in the computer program product is disclosed.

Abstract: Using the same image sensor to capture a two-dimensional (2D) image and three-dimensional (3D) depth measurements for a 3D object. A laser point-scans the surface of the object with light spots, which are detected by a pixel array in the image sensor to generate the 3D depth profile of the object using triangulation. Each row of pixels in the pixel array forms an epipolar line of the corresponding laser scan line. Timestamping provides a correspondence between the pixel location of a captured light spot and the respective scan angle of the laser to remove any ambiguity in triangulation. An Analog-to-Digital Converter (ADC) in the image sensor operates as a Time-to-Digital (TDC) converter to generate timestamps. A timestamp calibration circuit is provided on-board to record the propagation delay of each column of pixels in the pixel array and to provide necessary corrections to the timestamp values generated during 3D depth measurements.

Abstract: Two-dimensional (2D) color information and 3D-depth information are concurrently obtained from a 2D pixel array. The 2D pixel array is arranged in a first group of a plurality of rows. A second group of rows of the array are operable to generate 2D-color information and pixels of a third group of the array are operable to generate 3D-depth information. The first group of rows comprises a first number of rows, the second group of rows comprises a second number of rows that is equal to or less than the first number of rows, and the third group of rows comprises a third number of rows that is equal to or less than the second number of rows. In an alternating manner, 2D-color information is received from a row selected from the second group of rows and 3D-depth information is received from a row selected from the third group of rows.

Abstract: Using the same image sensor to capture both a two-dimensional (2D) image of a three-dimensional (3D) object and 3D depth measurements for the object. A laser point-scans the surface of the object with light spots, which are detected by a pixel array in the image sensor to generate the 3D depth profile of the object using triangulation. Each row of pixels in the pixel array forms an epipolar line of the corresponding laser scan line. Timestamping provides a correspondence between the pixel location of a captured light spot and the respective scan angle of the laser to remove any ambiguity in triangulation. An Analog-to-Digital Converter (ADC) in the image sensor generates a multi-bit output in the 2D mode and a binary output in the 3D mode to generate timestamps. Strong ambient light is rejected by switching the image sensor to a 3D logarithmic mode from a 3D linear mode.

Abstract: Pixels of an array capture values for an input image. The captured values correspond to pixel center points of the pixels that captured the values. Additional values about the input image may be further computed from the captured values. These additional values may correspond to additional center points, which can be different from any of the pixel center points. An output image may be constructed from the captured values plus the additional values. These values may be stored together and/or displayed together as the output image. Embodiments are applicable to images such as from multi-layer sensors. Since the output image can be created from a higher total number of values than those captured by the available number of pixels, such image processing can be called super-resolution, and can be applied to image processing within imaging devices, for still pictures, video and motion pictures, and so on.

Abstract: An embodiment includes a system, comprising a first memory; a plurality of first circuits, wherein each first circuit is coupled to the memory; and includes a second circuit configured to generate a first output value in response to an input value received from the first memory; and an accumulator configured to receive the first output value and generate a second output value; and a controller coupled to the memory and the first circuits, and configured to determine the input values to be transmitted from the memory to the first circuits.

Abstract: Pixels of an array capture values for an input image. The captured values correspond to pixel center points of the pixels that captured the values. Additional values about the input image may be further computed from the captured values. These additional values may correspond to additional center points, which can be different from any of the pixel center points. An output image may be constructed from the captured values plus the additional values. These values may be stored together and/or displayed together as the output image. Embodiments are applicable to images such as from multi-layer sensors. Since the output image can be created from a higher total number of values than those captured by the available number of pixels, such image processing can be called super-resolution, and can be applied to image processing within imaging devices, for still pictures, video and motion pictures, and so on.

Abstract: In embodiments, a T-O-F depth imaging device renders a depth image of an object that has corrected depth values. The device includes a pixel array that uses an Electronic Rolling Shutter scheme. The device also includes a light source that transmits towards the object light that is modulated at an operating frequency, and an optical shutter that opens and closes at the operating frequency. The optical shutter further modulates the light that is reflected from the object, before it reaches the pixel array. The transmission of the light and the operation of the shutter change phase relative to each other while at least one of the pixels is sensing the light it receives, which permits a faster frame rate. Depth is determined by the amount of light sensed by the pixels, and a correction is computed to compensate for the changing phase.

Abstract: An image sensor device has a first region configured to sense only infrared illumination and a second region configured to not sense visible and infrared illumination.

Abstract: An imaging device includes at least a first group of pixels. A driver block is configured to generate at least two shutter signals, each having on-phases periodically alternating with off-phases. The shutter signals might not be in phase. The imaging device may have an optical shutter that is partitioned in two or more parts, or a set of two or more optical shutters. The shutter parts, or the shutters, may receive the shutter signals, and accordingly open and close. A design of the driver block requires reduced power, which is highly desirable for mobile applications. Moreover, 3D imaging may be implemented that uses various time-of-flight configurations.

Abstract: Ranging devices, systems, and methods are provided. In embodiments, a device includes a casing with four openings and an array with depth pixels. The depth pixels are arranged in four quadrants, so that pixels in each of the quadrants receive light through one of the four openings. The depth pixels may generate samples in response to the received light. For a certain frame, a controller reads out samples from each of the quadrants before completing reading out the samples of any one of the quadrants. In some embodiments, reading out is performed by using interleaved rolling shutter for the rows.