Abstract: A method of detecting an object in an image includes (i) processing, with a machine-learned model, pixel intensities of a pixel pair in a first region of the image, to determine a first confidence score representing a likelihood of the object being present within the first region, and (ii) determining, based on the first confidence score, presence of the object in the first region.

Abstract: Image sensors for Phase-Detection Auto Focus (PDAF) are provided. An image sensor includes a pixel including a plurality of photodiodes disposed in a semiconductor material according to an arrangement. The arrangement defines a first image subpixel comprising a plurality of first photodiodes, a second image subpixel comprising a plurality of second photodiodes, and a third image subpixel including a plurality of third photodiodes, and a phase detection subpixel comprising a first photodiode, a second photodiode, or a third photodiodes. The pixel can include a plurality of first micro-lenses disposed individually overlying at least a subset of the plurality of photodiodes of the first, second and third image subpixels. The pixel can also include a second micro-lens disposed overlying the phase detection subpixel, a first micro-lens of the first micro-lenses having a first radius less than a second radius of the second micro-lens.

Abstract: Half Quad Photodiode (QPD) for improving QPD channel imbalance. In one embodiment, an image sensor includes a plurality of pixels arranged in rows and columns of a pixel array that is disposed in a semiconductor material. Each pixel includes a plurality of subpixels. Each subpixel comprises a plurality of first photodiodes, a plurality of second photodiodes and a plurality of third photodiodes. The plurality of pixels are configured to receive incoming light through an illuminated surface of the semiconductor material. A plurality of small microlenses are individually distributed over individual first photodiodes and individual second photodiodes of each subpixel. A plurality of large microlenses are each distributed over a plurality of third photodiodes of each subpixel. A diameter of the small microlenses is smaller than a diameter of the large microlenses.

Abstract: Quad photodiode microlens arrangements, and associated systems and methods. In one embodiment, a plurality of pixels are arranged in rows and columns of a pixel array disposed in a semiconductor material. The plurality of pixels includes green (G) pixels, red (R) pixels, blue (B) pixels and clear (C) pixels. Each pixel comprises a plurality of photodiodes that are configured to receive incoming light through an illuminated surface of the semiconductor material. A plurality of small microlenses are distributed over individual photodiodes of clear (C) pixels. A plurality of large microlenses are distributed over individual green (G) pixels. A diameter of the small microlenses is smaller than a diameter of the large microlenses.

Abstract: In some embodiments, an image sensor is provided. The image sensor comprises a plurality of photodiodes arranged as a photodiode array. The photodiodes of the photodiode array are arranged into a first quadrant, a second quadrant, a third quadrant, and a fourth quadrant. A first polarization filter and a first telecentric lens are aligned with the first quadrant. A second polarization filter and a second telecentric lens are aligned with the second quadrant. A third polarization filter and a third telecentric lens are aligned with the third quadrant. A fourth telecentric lens is aligned with the fourth quadrant.

Abstract: An image processing method and a device configured to implement the same are disclosed. The method comprises: from an imaging device, obtaining image data that comprises temporally consecutive image frames; performing feature extraction on each of the obtained image frames; dynamically retaining extracted feature data of the obtained image frames in a feature accumulation database by regulating data retention in the feature accumulation database to a selective subset of the extracted feature data from the obtained image frames; performing Random Sample Consensus (RANSAC) operation on the selective subset of the extracted feature data from the feature accumulation database; and generating an estimation model from output of the RANSAC operation based on at least one of an extracted feature data of a current image frame or extracted feature data of one or more temporally preceding image frames of the obtained image frames.

Abstract: An image sensor processor implemented method for retaining pixel intensity, comprising: receiving, by the image processor, a numerical value indicative of a corresponding pixel intensity; determining, by the image processor, whether a least significant portion of the received numerical value is equal to a predetermined numerical value; and responsive to determining the least significant portion of the received numerical value is equal to the predetermined numerical value, rounding, by the image processor, the received numerical value of the corresponding pixel intensity to a higher or lower value depending on a bit sequence, and if the least significant portion of the received numerical value is not equal to the predetermined value, rounding the received numerical value to the higher or lower value based on the received numerical value; and binning the rounded value.

Abstract: The present application discloses an imaging system for detecting human-object interaction and a method for detecting human-object interaction thereof. The imaging system includes an event sensor, an image sensor, and a controller. The event sensor is configured obtain an event data set of the targeted scene according to variations of light intensity sensed by pixels of the event sensor when an event occurs in the targeted scene. The image sensor is configured capture a visual image of the targeted scene. The controller is configured to detect human according to the event data set, trigger the image sensor to capture the visual image when the human is detected, and detect the human-object interaction in the targeted scene according to the visual image and a series of event data sets obtained by the event sensor during the event.

Abstract: A method and apparatus for embedding a digital watermark in image content that is not visible to the human eye is performed on single-sensor digital camera images (often called ‘raw’ images) from a pixel-array. The raw image is transformed to generate preprocessed image coefficients, a watermark message is encrypted using a first key; the encrypted watermark message is randomized using a second key to form a watermark; and the watermark is embedded in randomly selected preprocessed image coefficients.

Abstract: The present application discloses an imaging system for detecting human-object interaction and a method for detecting human-object interaction thereof. The imaging system includes an event sensor, an image sensor, and a controller. The event sensor is configured obtain an event data set of the targeted scene according to variations of light intensity sensed by pixels of the event sensor when an event occurs in the targeted scene. The image sensor is configured capture a visual image of the targeted scene. The controller is configured to detect human according to the event data set, trigger the image sensor to capture the visual image when the human is detected, and detect the human-object interaction in the targeted scene according to the visual image and a series of event data sets obtained by the event sensor during the event.

Abstract: An image processing method and a device configured to implement the same are disclosed. The device comprises: a hybrid imaging device configured to obtain optical input; and a processing device in signal communication with the hybrid imaging device. The processing device comprises: a motion detection circuit that performs feature tracking based on a first component of an obtained optical input; a motion estimation circuit that performs motion compensation based on output of the motion detection unit; a frame reconstruction circuit that reconstructs image frame based on both the output of the motion estimation unit and a second component of the optical input; and an output unit that outputs image frame at a predetermined global frame rate.

Abstract: In some embodiments, an image sensor is provided. The image sensor comprises a plurality of photodiodes arranged as a photodiode array. The photodiodes of the photodiode array are arranged into a first quadrant, a second quadrant, a third quadrant, and a fourth quadrant. A first polarization filter and a first telecentric lens are aligned with the first quadrant. A second polarization filter and a second telecentric lens are aligned with the second quadrant. A third polarization filter and a third telecentric lens are aligned with the third quadrant. A fourth telecentric lens is aligned with the fourth quadrant.

Abstract: An image sensor pixel includes a plurality of photodiodes, a shared microlens, and a plurality of microlenses. The plurality of photodiodes are arranged as a photodiode array with each of the plurality of photodiodes disposed within a semiconductor material. The shared microlens is optically aligned with a group of neighboring photodiodes included in the plurality of photodiodes. Each of the plurality of microlenses are optically aligned with an individual one of the plurality of photodiodes other than the group of neighboring photodiodes. The plurality of microlenses laterally surrounds the shared microlens.

Abstract: An image sensor pixel comprises a subpixel and a polarization pixel. The subpixel includes a group of photodiodes disposed in semiconductor material, a shared microlens optically aligned over the group of photodiodes, and a subpixel color filter disposed between the group of photodiodes and the shared microlens. The polarization pixel includes a first photodiode disposed in the semiconductor material, an unshared microlens optically aligned over the first photodiode, and a polarization filter disposed between the first photodiode and the unshared microlens. The shared microlens has a first lateral area. The unshared microlens has a second lateral area less than the first lateral area of the shared microlens.

Abstract: An image sensor includes a plurality of photodiodes, a plurality of color filters, and a plurality of microlenses. The plurality of photodiodes are arranged as a photodiode array, each of the plurality of photodiodes disposed within respective portions of a semiconductor material with a first lateral area. The plurality of color filters are arranged as a color filter array optically aligned with the photodiode array. Each of the plurality of color filters having a second lateral area greater than the first lateral area. The plurality of microlenses are arranged as a microlens array optically aligned with the color filter array and the photodiode array. Each of the plurality of microlenses have a third later area greater than the first lateral area and less than the second lateral area.

Abstract: In some embodiments, an image sensor is provided. The image sensor comprises a plurality of photodiodes arranged as a photodiode array. The plurality of photodiodes includes a first set of photodiodes configured as phase detection photodiodes, and a second set of photodiodes configured as polarization detection photodiodes. In some embodiments, a controller is provided. The controller comprises circuitry configured to process signals from a first set of photodiodes of a photodiode array to obtain depth information; process signals from a second set of photodiodes of the photodiode array to obtain polarization information; process the polarization information to obtain an ambiguous set of surface normals; and process the ambiguous set of surface normals using the depth information to obtain a three-dimensional shape image.

Abstract: A chart for calibrating a system of multiple cameras, the chart comprising: a background; an array of dots contrasting the background, wherein the array of dots are arranged in rows and columns, wherein the array of dots comprise a first dot array, and a second dot array, wherein the first dot array fully occupies a first region of evenly spaced dots with a first dot density, the second dot array fully occupies a second region of evenly spaced dots with a second dot density, and wherein the second region is enclosed within the first region; a group of first markers in the first region, a group of second markers in the second region, and a third marker at the center of the chart, wherein each second marker is closer to the third marker than each first marker.

Abstract: In some embodiments, an image sensor is provided. The image sensor comprises a plurality of photodiodes arranged as a photodiode array. The plurality of photodiodes includes a first set of photodiodes configured as phase detection photodiodes, and a second set of photodiodes configured as polarization detection photodiodes. In some embodiments, a controller is provided. The controller comprises circuitry configured to process signals from a first set of photodiodes of a photodiode array to obtain depth information; process signals from a second set of photodiodes of the photodiode array to obtain polarization information; process the polarization information to obtain an ambiguous set of surface normals; and process the ambiguous set of surface normals using the depth information to obtain a three-dimensional shape image.

Abstract: An image sensor includes a plurality of photodiodes, a plurality of color filters, and a plurality of microlenses. The plurality of photodiodes are arranged as a photodiode array, each of the plurality of photodiodes disposed within respective portions of a semiconductor material with a first lateral area. The plurality of color filters are arranged as a color filter array optically aligned with the photodiode array. Each of the plurality of color filters having a second lateral area greater than the first lateral area. The plurality of microlenses are arranged as a microlens array optically aligned with the color filter array and the photodiode array. Each of the plurality of microlenses have a third later area greater than the first lateral area and less than the second lateral area.

Abstract: An image sensor pixel comprises a subpixel and a polarization pixel. The subpixel includes a group of photodiodes disposed in semiconductor material, a shared microlens optically aligned over the group of photodiodes, and a subpixel color filter disposed between the group of photodiodes and the shared microlens. The polarization pixel includes a first photodiode disposed in the semiconductor material, an unshared microlens optically aligned over the first photodiode, and a polarization filter disposed between the first photodiode and the unshared microlens. The shared microlens has a first lateral area. The unshared microlens has a second lateral area less than the first lateral area of the shared microlens.