Abstract: A client device configured with a neural network includes a processor, a memory, a user interface, a communications interface, a power supply and an input device, wherein the memory includes a trained neural network received from a server system that has trained and configured the neural network for the client device. A server system and a method of training a neural network are disclosed.

Abstract: A Time-of-Flight (TOF) technique is combined with analog amplitude modulation within each pixel in a pixel array using multiple Single Photon Avalanche Diodes (SPADs) in conjunction with a single Pinned Photo Diode (PPD) in each pixel. A SPAD may be shared among multiple neighboring pixels. The TOF information is added to the received light signal by the analog domain-based single-ended to differential converter inside the pixel itself. The spatial-temporal correlation among outputs of multiple, adjacent SPADs in a pixel is used to control the operation of the PPD to facilitate recording of TOF values and range of an object. Erroneous range measurements due to ambient light are prevented by stopping the charge transfer from the PPD—and, hence, recording a TOF value—only when two or more SPADs in the pixel are triggered within a pre-defined time interval. An autonomous navigation system with multi-SPAD pixels provides improved vision for drivers under difficult driving conditions.

Abstract: A Time-of-Flight (TOF) technique is combined with analog amplitude modulation within each pixel in a pixel array using multiple Single Photon Avalanche Diodes (SPADs) in conjunction with a single Pinned Photo Diode (PPD) in each pixel. A SPAD may be shared among multiple neighboring pixels. The TOF information is added to the received light signal by the analog domain-based single-ended to differential converter inside the pixel itself. The spatial-temporal correlation among outputs of multiple, adjacent SPADs in a pixel is used to control the operation of the PPD to facilitate recording of TOF values and range of an object. Erroneous range measurements due to ambient light are prevented by stopping the charge transfer from the PPD—and, hence, recording a TOF value—only when two or more SPADs in the pixel are triggered within a pre-defined time interval. An autonomous navigation system with multi-SPAD pixels provides improved vision for drivers under difficult driving conditions.

Abstract: A system for calculating. A scratch memory is connected to a plurality of configurable processing elements by a communication fabric including a plurality of configurable nodes. The scratch memory sends out a plurality of streams of data words. Each data word is either a configuration word used to set the configuration of a node or of a processing element, or a data word carrying an operand or a result of a calculation. Each processing element performs operations according to its current configuration and returns the results to the communication fabric, which conveys them back to the scratch memory.

Abstract: Exemplary embodiments for a biometric camera system for a mobile device, comprise: a near infrared (NIR) light source on the mobile device that flashes a user of the mobile device with near infrared light during image capture; a biometric camera located on the mobile device offset from the NIR light source, the biometric camera comprising: an extended depth of field (EDOF) imaging lens; a bandpass filter located adjacent to the EDOF imaging lens to reject ambient light during image capture; and an imaging sensor located adjacent the bandpass filter that converts an optical image of an object into an electronic signal for image processing; and a processor configured to receive video images of an iris of a user from the image sensor, and attempt to match the video images of the iris with previously registered images stored in an iris database, wherein if a match is found, the user is authenticated.

Abstract: A color-edge contrast preserver includes a demosaicing module, a color-correcting module, a converter module and a chromatic-denoising module. The demosaicing module may demosaic a red-white-blue (RWB) pixel image of the image. The color-correcting module may color correct the demosaiced RWB pixel image and may produce a red-green-blue (RGB) pixel image from the color-corrected demosaiced RWB pixel image. The converter module to convert the RGB pixel image to a hue-saturation-value (HSV) pixel image and to generate a similarity kernel ?Y. The chromatic-denoising module may denoise a red pixel image and a blue pixel image of the RWB pixel image using the similarity kernel ?Y.

Abstract: Using the same image sensor to capture a two-dimensional (2D) image and three-dimensional (3D) depth measurements for a 3D object. A laser point-scans the surface of the object with light spots, which are detected by a pixel array in the image sensor to generate the 3D depth profile of the object using triangulation. Each row of pixels in the pixel array forms an epipolar line of the corresponding laser scan line. Timestamping provides a correspondence between the pixel location of a captured light spot and the respective scan angle of the laser to remove any ambiguity in triangulation. An Analog-to-Digital Converter (ADC) in the image sensor operates as a Time-to-Digital (TDC) converter to generate timestamps. A timestamp calibration circuit is provided on-board to record the propagation delay of each column of pixels in the pixel array and to provide necessary corrections to the timestamp values generated during 3D depth measurements.

Abstract: An imaging device includes at least a first group of pixels. A driver block is configured to generate at least two shutter signals, each having on-phases periodically alternating with off-phases. The shutter signals might not be in phase. The imaging device may have an optical shutter that is partitioned in two or more parts, or a set of two or more optical shutters. The shutter parts, or the shutters, may receive the shutter signals, and accordingly open and close. A design of the driver block requires reduced power, which is highly desirable for mobile applications. Moreover, 3D imaging may be implemented that uses various time-of-flight configurations.

Abstract: Using the same image sensor to capture a two-dimensional (2D) image and three-dimensional (3D) depth measurements for a 3D object. A laser point-scans the surface of the object with light spots, which are detected by a pixel array in the image sensor to generate the 3D depth profile of the object using triangulation. Each row of pixels in the pixel array forms an epipolar line of the corresponding laser scan line. Timestamping provides a correspondence between the pixel location of a captured light spot and the respective scan angle of the laser to remove any ambiguity in triangulation. An Analog-to-Digital Converter (ADC) in the image sensor operates as a Time-to-Digital (TDC) converter to generate timestamps. A timestamp calibration circuit is provided on-board to record the propagation delay of each column of pixels in the pixel array and to provide necessary corrections to the timestamp values generated during 3D depth measurements.

Abstract: An apparatus and a method. The apparatus includes a dynamic vision sensor (DVS) configured to generate a stream of events, where an event includes a location and a binary value indicating a positive or a negative change in luminance; a sampling unit connected to the DVS and configured to sample the stream of events; and an image formation unit connected to the sampling unit and configured to form an image for each sample of the stream of events, wherein a manner of sampling by the sampling unit is adjusted to reduce variations between images formed by the image formation unit.

Abstract: A Time-of-Flight (TOF) technique is combined with analog amplitude modulation within each pixel in a pixel array using multiple Single Photon Avalanche Diodes (SPADs) in conjunction with a single Pinned Photo Diode (PPD) in each pixel. A SPAD may be shared among multiple neighboring pixels. The TOF information is added to the received light signal by the analog domain-based single-ended to differential converter inside the pixel itself. The spatial-temporal correlation among outputs of multiple, adjacent SPADs in a pixel is used to control the operation of the PPD to facilitate recording of TOF values and range of an object. Erroneous range measurements due to ambient light are prevented by stopping the charge transfer from the PPD—and, hence, recording a TOF value—only when two or more SPADs in the pixel are triggered within a pre-defined time interval. An autonomous navigation system with multi-SPAD pixels provides improved vision for drivers under difficult driving conditions.

Abstract: An imaging apparatus may include an image sensor that includes a Bayer color filter array (CFA) of 2-by-2 cell groups each of which includes a red pixel, a blue pixel, and two green pixels, and an image signal processor for processing raw data from the Bayer CFA. The image signal processor corrects the raw data to reduce artifacts such as image contrast degradation caused by using green pixels with wide transmission spectrum.

Abstract: Using the same image sensor to capture both a two-dimensional (2D) image of a three-dimensional (3D) object and 3D depth measurements for the object. A laser point-scans the surface of the object with light spots, which are detected by a pixel array in the image sensor to generate the 3D depth profile of the object using triangulation. Each row of pixels in the pixel array forms an epipolar line of the corresponding laser scan line. Timestamping provides a correspondence between the pixel location of a captured light spot and the respective scan angle of the laser to remove any ambiguity in triangulation. An Analog-to-Digital Converter (ADC) in the image sensor generates a multi-bit output in the 2D mode and a binary output in the 3D mode to generate timestamps. Strong ambient light is rejected by switching the image sensor to a 3D logarithmic mode from a 3D linear mode.

Abstract: A Time-of-Flight (TOF) technique is combined with analog amplitude modulation within each pixel in a pixel array using multiple Single Photon Avalanche Diodes (SPADs) in conjunction with a single Pinned Photo Diode (PPD) in each pixel. A SPAD may be shared among multiple neighboring pixels. The TOF information is added to the received light signal by the analog domain-based single-ended to differential converter inside the pixel itself. The spatial-temporal correlation among outputs of multiple, adjacent SPADs in a pixel is used to control the operation of the PPD to facilitate recording of TOF values and range of an object. Erroneous range measurements due to ambient light are prevented by stopping the charge transfer from the PPD—and, hence, recording a TOF value—only when two or more SPADs in the pixel are triggered within a pre-defined time interval. An autonomous navigation system with multi-SPAD pixels provides improved vision for drivers under difficult driving conditions.

Abstract: A Time-of-Flight (TOF) technique is combined with analog amplitude modulation within each pixel in a pixel array using multiple Single Photon Avalanche Diodes (SPADs) in conjunction with a single Pinned Photo Diode (PPD) in each pixel. A SPAD may be shared among multiple neighboring pixels. The TOF information is added to the received light signal by the analog domain-based single-ended to differential converter inside the pixel itself. The spatial-temporal correlation among outputs of multiple, adjacent SPADs in a pixel is used to control the operation of the PPD to facilitate recording of TOF values and range of an object. Erroneous range measurements due to ambient light are prevented by stopping the charge transfer from the PPD—and, hence, recording a TOF value—only when two or more SPADs in the pixel are triggered within a pre-defined time interval. An autonomous navigation system with multi-SPAD pixels provides improved vision for drivers under difficult driving conditions.

Abstract: An image sensor device has a first region configured to sense only infrared illumination and a second region configured to not sense visible and infrared illumination.

Abstract: Exemplary embodiments for a biometric camera system for a mobile device, comprise: a near infrared (NIR) light source on the mobile device that flashes a user of the mobile device with near infrared light during image capture; a biometric camera located on the mobile device offset from the NIR light source, the biometric camera comprising: an extended depth of field (EDOF) imaging lens; a bandpass filter located adjacent to the EDOF imaging lens to reject ambient light during image capture; and an imaging sensor located adjacent the bandpass filter that converts an optical image of an object into an electronic signal for image processing; and a processor configured to receive video images of an iris of a user from the image sensor, and attempt to match the video images of the iris with previously registered images stored in an iris database, wherein if a match is found, the user is authenticated.

Abstract: In embodiments, a T-O-F depth imaging device renders a depth image of an object that has corrected depth values. The device includes a pixel array that uses an Electronic Rolling Shutter scheme. The device also includes a light source that transmits towards the object light that is modulated at an operating frequency, and an optical shutter that opens and closes at the operating frequency. The optical shutter further modulates the light that is reflected from the object, before it reaches the pixel array. The transmission of the light and the operation of the shutter change phase relative to each other while at least one of the pixels is sensing the light it receives, which permits a faster frame rate. Depth is determined by the amount of light sensed by the pixels, and a correction is computed to compensate for the changing phase.

Abstract: An embodiment includes a method, comprising: pruning a layer of a neural network having multiple layers using a threshold; and repeating the pruning of the layer of the neural network using a different threshold until a pruning error of the pruned layer reaches a pruning error allowance.

Abstract: A color-edge contrast preserver includes a demosaicing module, a color-correcting module, a converter module and a chromatic-denoising module. The demosaicing module may demosaic a red-white-blue (RWB) pixel image of the image. The color-correcting module may color correct the demosaiced RWB pixel image and may produce a red-green-blue (RGB) pixel image from the color-corrected demosaiced RWB pixel image. The converter module to convert the RGB pixel image to a hue-saturation-value (HSV) pixel image and to generate a similarity kernel ?Y. The chromatic-denoising module may denoise a red pixel image and a blue pixel image of the RWB pixel image using the similarity kernel ?Y.