Abstract: An image processing device for performing correction processing on original image data generated by an image-capturing element configured to receive light with a plurality of pixels through a color filter including segments of a red color and at least one complementary color includes a processing circuitry being configured to perform operations including converting the original image data into primary color-based image data represented in a primary color-based color space, acquiring a statistical value of a plurality of pieces of pixel data corresponding to the plurality of pixels from the primary color-based image data, calculating a correction parameter by using the statistical value, and correcting the original image data based on the correction parameter.

Abstract: Technologies and techniques for dynamic fixed pattern correction for an image sensor. A current image and a previous image received in the image sensor is stored and a bias and gain is computed for the current image, wherein the computing includes processing the current image together with a current local average value, the previous image, and a previous local average value. A gain correction value and a bias correction value is generated based on the computing, and the gain correction value and bias correction value are combined with the current image to generate a corrected image. A Bayer image is generated, based on the generated corrected image.

Abstract: Solid-state imaging devices are disclosed. In one example, a solid-state imaging device includes an AD converter that obtains an electric signal from a pixel and performs AD conversion on the electric signal. The electric signal is compared with a reference signal that has a voltage changing with the lapse of time. The reference signal is generated by a reference signal generator with a first current circuit that causes a first current to flow, an output circuit including a first input unit connected to the first current circuit, a second input unit that receives a reference voltage for determining an initial value of the reference signal, and an output unit that outputs the reference signal on the basis of voltages of the first input unit and the second input unit. A first capacitive element changes the reference signal by accumulating or discharging the first current.

Abstract: An imaging device includes: an effective pixel region that includes a plurality of imaging elements-A, amplifies signal charges generated by photoelectric conversion, and reads the signal charges into a drive circuit; and an optical black region that includes a plurality of imaging elements-B, surrounds the effective pixel region, and outputs optical black that serves as the reference for black level. In the imaging device, the photoelectric conversion layer forming the plurality of imaging elements-A and the plurality of imaging elements-B is a common photoelectric conversion layer, the common photoelectric conversion layer is located on an outer side of the optical black region, and extends toward an outer edge region surrounding the optical black region, and an outer edge electrode is disposed in the outer edge region.

Abstract: A processor-implemented method with data processing using a neural network includes: determining a first translated image by translating a first image based on a second image, the first image and a second image that having different distortions, such that a distortion of the first image corresponds to a distortion of the second image; determining a first retranslated image by translating the first translated image such that a distortion of the first translated image corresponds to a distortion of the first image; and training a first deformation field generator configured to determine a first relative deformation field that represents a relative deformation from the first image to the second image and a second deformation field generator configured to determine a second relative deformation field that represents a relative deformation from the second image to the first image, based on a loss between the first retranslated image and the first image.

Abstract: An illumination arrangement in a mobile device is provided that uses an artificial neural network (ANN) to correct an image of a scene. The mobile device has an illumination apparatus with an LED array that emits light to illuminate a scene. The LED array has LEDs, separated by borders, that are independently driven. A camera has a sensor to capture an image of the scene. The ANN has a training mode in which the ANN is trained using a set of images captured by the camera to generate parameters. The ANN is trained offline in a cloud network. A processor uses the trained ANN in an inference mode to correct the image.

Abstract: A photoelectric conversion device includes a plurality of pixels arranged to form a plurality of columns, a plurality of comparison circuits provided corresponding to the plurality of columns and including a first input node to which a pixel signal output from a pixel of a corresponding column is input and a second input node to which a reference signal is input, a plurality of buffer circuits provided between a reference signal line to which the reference signal is supplied and each of the second input nodes of the plurality of comparison circuits, and a first switch circuit configured to set a connection state between output nodes of the plurality of buffer circuits.

Abstract: Integrated-circuit imagers selectively multi-sample pixel array outputs according to luminance level indicated by an initial sample, avoiding the additional power/time required for multi-sampling in high-luminance, shot-noise-dominated conditions and, conversely, multi-sampling in readout-noise-dominated low-luminance conditions.

Abstract: An image sensor includes: a controller; a comparator configured to generate a comparison signal, the comparator comprising a first capacitor that samples a control voltage and a second capacitor which samples a reference voltage, a first switch that adjusts a voltage that is applied to the first capacitor, a second switch that adjusts a voltage that is applied to the second capacitor, a first feedback switch that connects a first output terminal of the comparator to a first input terminal of the comparator, and a second feedback switch that connects a second output terminal of the comparator to a second input terminal of the comparator; and a voltage generator for boosting the control voltage based on the comparison signal. The comparator generates a comparison signal by comparing a voltage of the first capacitor and a voltage of the second capacitor. The controller stores a feedback voltage corresponding to an offset voltage of the comparator.

Abstract: A computer-implemented method for determining whether a camera component of a camera is damaged is described. The method comprises obtaining information relating to one or more damage indicators; obtaining, from the camera, at least one image which has been taken when light from a light source has been incident on the camera component; dividing the image into one or more areas; analysing each area to determine whether it comprises at least one of the one or more damage indicators; and based on said analysing, providing an indication of whether the camera component is classified as damaged or undamaged.

Abstract: A wide dynamic range with single exposure is achieved. A solid-state imaging device according to an embodiment includes a first substrate including a photoelectric conversion element, and a second substrate including a capacitor positioned on a side opposite to a surface of incidence of light to the photoelectric conversion element in the first substrate, and configured to accumulate a charge transferred from the photoelectric conversion element.

Abstract: An imaging device having a semiconductor substrate including: a semiconductor region including an impurity of a first conductivity type, a first diffusion region that is in contact with the semiconductor region, that includes an impurity of a second conductivity type different from the first conductivity type, and that converts incident light into charges, and a second diffusion region that includes an impurity of the second conductivity type and that directly accumulates at least a part of the charges generated in the first diffusion region. The imaging device further includes a contact plug in contact with the second diffusion region, and a capacitive element electrically connected to the second diffusion region through the contact plug.

Abstract: A system for compensating for photodiode errors includes a live photodiode configured to be exposed to a light source and to output a live signal. The system further includes a reference photodiode located proximate to the live photodiode and configured to be isolated from the light source and to output a reference signal. The system further includes a controller configured to generate a compensated output signal by subtracting the reference signal from the live signal.

Abstract: A device and method of controlling a light source in eye tracking using a glint are provided. The method includes transmitting, from a processor to a first camera and a second camera, an activation signal to instruct the first and second cameras to operate according to a pattern, transmitting, to a first light driver and a second light driver, a control command to instruct the first and second light drivers to operate according to a control signal (a first control signal or a second control signal) corresponding to each of the first and second light drivers, and preventing the processor from intervening in a process of turning on and off odd-numbered light sources and even-numbered light sources.

Abstract: An NMOS-only operational transconductance amplifier (OTA) replaces the PMOS transistors with switched capacitor pseudo-resistors in the pixels of an optical sensor such as a dynamic vision sensor or event-based vision sensor. Thus, if a stacked CMOS image sensor (CIS) process is employed, then the upper wafer can be kept free from N-wells, while still having the complete OTA on the upper wafer. Thus, it is possible to have only one wafer-to-wafer connection per pixel. Moreover, by operating the switched capacitor pseudo-resistors as three terminal devices, the gain can further be increased.

Abstract: The disclosed technology relates to graphics processing units (GPU), In one aspect, a GPU includes a general purpose register (GPR) including registers, an arithmetic logic unit (ALU) reading pixels of an image independently of a shared memory, and a level 1 (L1) cache storing pixels to implement a pixel mapping that maps the pixels read from the L1 cache into the registers of the GPR. The pixel mapping includes separating pixels of an image into three regions, with each region including a set of pixels. A first and second set of the pixels are loaded into registers corresponding to two of the three regions horizontally, and a third set of the pixels are loaded into registers corresponding to the third of the three regions vertically. Each of the registers in the first, second, and third registers are loaded as a contiguous ordered number of registers in the GPR.

Abstract: One example described herein includes the digital image sensor having a pixel cell with a photodiode and a quantizer circuit coupled to the pixel cell. The quantizer circuit includes a charge storage device that generates a voltage based on electric charge from the photodiode. The quantizer circuit also includes a single-input comparator that can switch from a first output state to a second output state in response to a ramp signal provided by a ramp generator. The quantizer circuit further includes a memory switch that can cause a counter value from a digital counter to be stored in a digital memory in response to the single-input comparator switching from the first output state to the second output state. The counter value can serve as a digital pixel value associated with the pixel cell.

Abstract: Embodiments for determining an orientation of a scanned image. In an exemplary embodiment, a method comprises receiving image data of an image of one or more objects. Each object of the one or more objects in the image includes a plurality of points on a surface of the object. The method further comprises generating a plurality of subsets of points of the plurality of points and fitting a parametric model to more than one subset of the plurality of subsets to generate a plurality of parametric models. Further, the method identifies a parametric model of the plurality of parametric models that includes the largest number of points and orients the image based on the parametric model that includes the largest number of points.

Abstract: An imaging support device that supports imaging performed by an imaging apparatus includes an acquisition portion that acquires an in-image shift amount between a predetermined position in a captured image obtained by capturing an imaging region by an imaging element and a position of a target subject image showing a target subject, and a focal length of the imaging apparatus, a derivation portion that derives a movement amount required for moving the position of the target subject image to a specific position by a position adjustment portion which adjusts the position of the target subject image in the captured image, based on the in-image shift amount acquired by the acquisition portion, the focal length acquired by the acquisition portion, and information related to a pixel interval of pixels in the imaging element, and an output portion that outputs the movement amount derived by the derivation portion.

Abstract: For example, analog pixel circuitry may include a first input to input an analog pixel signal of the pixel; Sample and Hold (SH) circuitry to provide an analog sample of the pixel based on the analog pixel signal; one or more second inputs to input analog samples of one or more binning pixels, respectively; a plurality of capacitors having capacitor outputs connected to a common output terminal, wherein a capacitor input of a first capacitor is connected to an input terminal to input the analog sample of the pixel from the SH circuitry, wherein capacitor inputs of one or more second capacitors are connected to the one or more second inputs, respectively; and an amplifier configured to provide an amplified analog signal by amplifying an analog signal from the common output terminal.

Abstract: Integrated circuits (ICs) that avoid or mitigate creation of changes in accumulated charge in a silicon-on-insulator (SOI) substrate, particularly an SOI substrate having a trap rich layer. In one embodiment, a FET is configured such that, in a standby mode, the FET is turned OFF while maintaining essentially the same VDS as during an active mode. In another embodiment, a FET is configured such that, in a standby mode, current flow through the FET is interrupted while maintaining essentially the same VGS as during the active mode. In another embodiment, a FET is configured such that, in a standby mode, the FET is switched into a very low current state (a “trickle current” state) that keeps both VGS and VDS close to their respective active mode operational voltages. Optionally, S-contacts may be formed in an IC substrate to create protected areas that encompass FETs that are sensitive to accumulated charge effects.

Abstract: A display device includes a lighting device, a display panel, a memory, and a correction circuit. The lighting device includes a light exit area defined into light exit sections corresponding to light sources. The display panel includes a display area disposed opposite the light exit area and including pixels. The memory stores data of pixel matrix linked to the display sections. The memory stores position data of the pixels that are not disposed opposite the corresponding light exit sections and deviation data when a position error is caused between the light exit area and the display area. The correction circuit is configured to determine whether the memory stores the position data of the pixels and link new pixel matrix units to the corresponding display sections based on the deviation data if a determination result is affirmative.

Abstract: The present invention belongs to the field of image processing and computer vision, and discloses an acceleration method of depth estimation for multiband stereo cameras. In the process of depth estimation, during binocular stereo matching in each band, through compression of matched images, on one hand, disparity equipotential errors caused by binocular image correction can be offset to make the matching more accurate, and on the other hand, calculation overhead is reduced. In addition, before cost aggregation, cost diagrams are transversely compressed and sparsely matched, thereby reducing the calculation overhead again. Disparity diagrams obtained under different modes are fused to obtain all-weather, more complete and more accurate depth information.

Abstract: The present application discloses a light sensor circuit, which comprises a photodiode and a capacitor unit. The cathode of the photodiode is controlled by a capacitive unit to maintain the same or close voltage level as the anode of the photodiode, which significantly reduces the effect of the dark current of the photodiode. Thus, the light sensor circuit can effectively maintain the performance and accuracy of an analog-to-digital converter applying the light sensor circuit. The circuit design difficulty and manufacturing cost are also significantly reduced.

Abstract: An electronic device includes a first transistor, a second transistor, and a sensing circuit coupled to at least one of the first transistor and the second transistor. The sensing circuit includes a diode, a third transistor, and a fourth transistor. The diode has a first terminal. The third transistor has a first terminal and a second terminal. The first terminal of the third transistor is coupled to the first terminal of the diode. The fourth transistor has a first terminal coupled to the second terminal of the third transistor, and a second terminal coupled to a data driver.

Abstract: Systems, apparatuses, and methods for dynamic filtering of high intensity broadband electromagnetic waves in image data from a sensor of a robot are disclosed herein. According to at least one non-limiting exemplary embodiment, sunlight or light emitted from nearby fluorescent lamps may cause a robot to generate false positives of objects nearby the robot as the light may be of high intensity and large bandwidth. These false positives may cause a robot to get stuck or navigate without use of a camera sensor, which may be unsafe.

Abstract: A computational pixel imaging device can include multiple counters per pixel that can be used to acquire in-pixel histogram data representative of a signal detected by a pixels detector. Multiple pixel counters can also be used to execute simultaneous signal-processing threads on acquired image data. The imaging device can also include infinite dynamic range sensing and perform signal down-sampling.

Abstract: An AD conversion device includes a comparison circuit, an upper-level DA conversion circuit, a level shift circuit, a lower-level DA conversion circuit, and a correction device. The comparison circuit includes a first terminal and a second terminal. The comparison circuit is configured to compare a first voltage level of a signal input to the first terminal with a second voltage level of a signal input to the second terminal. The upper-level DA conversion circuit includes a plurality of capacitance elements electrically connected to the second terminal. Capacitive values of the plurality of capacitance elements are weighted by binary numbers. The level shift circuit includes one or more capacitance elements electrically connected to the second terminal. The lower-level DA conversion circuit includes a plurality of capacitance elements electrically connected to the second terminal.

Abstract: A method for removing external light interference according to the present disclosure includes: performing the scan in the state where external light is turned on, performing the scan in the state where the external light and internal light are turned on together, and calculating a brightness value from an obtained image. Further, by subtracting the brightness value obtained in the brightness calculating step from a color value of the image through an operation, it is possible to obtain an image and a three-dimensional scan model with the influence of the external light being minimized.

Abstract: An image sensor includes a substrate including an active pixel region and an inactive pixel region, having a smaller area than the active pixel region; a plurality of active pixels in the active pixel region, each of the plurality of active pixels including a first transfer transistor, a first reset transistor, a first driving transistor, and a first selection transistor; and a plurality of inactive pixels in the inactive pixel region, each of the plurality of inactive pixels including a second transfer transistor, a second reset transistor, a second driving transistor, a second selection transistor, and a switch transistor connected to a node between the second driving transistor and the second select transistor. The plurality of switch transistors, included in the plurality of inactive pixels, are connected to each other by a connection wiring.

Abstract: Provided is a photoelectric conversion device including: a plurality of pixel circuits each including a photoelectric conversion unit configured to generate charges by photoelectric conversion and a transistor configured to transfer the charges from the photoelectric conversion unit; and a plurality of exposure control circuits each including a capacitor configured to hold a signal corresponding to an exposure period in the photoelectric conversion unit and a comparator circuit configured to compare a potential of a first terminal of two terminals of the capacitor with a threshold potential. Each of the plurality of exposure control circuits controls an exposure period of the photoelectric conversion unit by outputting a signal based on a comparison result caused by the comparator circuit to a control terminal of the transistor and driving the transistor.

Abstract: A head-mountable device can include display elements and/or cameras that can be calibrated for accurate recording and visual output. Whereas some aspects of a head-mountable device can be calibrated at the time of production, usage and wear of the head-mountable device can result in certain components becoming misaligned. A case or other reference can be used to calibrate the cameras of the head-mountable device to ensure that the captured images are recorded in a target alignment. The case can be operated with the head-mountable device to calibrate the display elements of the head-mountable device to ensure that the images are output in a target alignment. Such calibration can include consideration of any lenses installed in front of the display elements.

Abstract: It is an object to realize a correcting process for correcting a defective image in a region of interest (ROI) that is a partial region segmented from a captured image. A transmitting apparatus includes a controlling section that controls the holding of defect correcting information for use in correcting a defect in an image included in a ROI and a transmitting section that sends out image data of the image included in the ROI as payload data and sends out ROI information as embedded data.

Abstract: A signal readout circuit is a circuit for reading out a signal from a photodetection element having a plurality of photodetection pixels each generating a detection signal according to light incidence, and includes N light incidence detection units (N is an integer of 2 or more) each for inputting the detection signal from each of N photodetection pixels and outputting a signal indicating the light incidence, and a total value detection unit for detecting a total value of the output signals from the N light incidence detection units. Each light incidence detection unit outputs the signal weighted differently corresponding to each photodetection pixel. A weight thereof is set such that the total values are different for respective photodetection pixels and all combination patterns of the photodetection pixels.

Abstract: A sensing device provided herein includes a first pixel circuit, a readout circuit, a first switch, a second switch, and a first capacitor. The readout circuit is electrically connected to the first pixel circuit. The first switch is electrically connected between the first pixel circuit and the readout circuit. The second switch is electrically connected between the first switch and the readout circuit. The first capacitor includes a first electrode electrically connected to the first switch and the second switch.

Abstract: An image sensor includes a substrate having a first conductivity type, a first charge accumulation region disposed in the substrate and having a second conductivity type, a second charge accumulation region connected with the first charge accumulation region, having the second conductivity type and extending downward from an edge of the first charge accumulation region, a pinning region disposed on the first charge accumulation region and having the first conductivity type, a floating diffusion region spaced laterally from the pinning region, a channel region disposed between the pinning region and the floating diffusion region, and a gate structure disposed on the channel region.

Abstract: An image capturing apparatus comprises a plurality of light-receiving circuits, each outputting a pulse signal in response to a photon being incident; a plurality of counter circuits that count the respective pulse signals output by the plurality of light-receiving circuits; and a correction circuit that corrects counts from the plurality of counter circuits and outputs the corrected counts as image data. The correction circuit calculates a correction coefficient on the basis of counts obtained by the plurality of counter circuits in a state where pulse widths of the pulse signals differ or under conditions where generation frequencies of the pulse signals differ, and performs the correction using the correction coefficient.

Abstract: An electronic device includes a reset circuit and a first image sensing circuit. The reset circuit is used to receive a reset signal and includes a plurality of transistors. The first image sensing circuit is coupled to the reset circuit and includes a photodiode, a first transistor and a second transistor. The photodiode has a first terminal. The first transistor has a first terminal coupled to the first terminal of the photodiode, and a second terminal. The second transistor has a first terminal coupled to the second terminal of the first transistor, and a second terminal configured to receive a row selection signal.

Abstract: An image sensor includes a pixel array; a logic circuit configured to convert an image signal generated from the pixel array during a first period into image data; and a memory. The image data may be written in the memory during a second period, of which at least a portion overlaps the first period. The logic circuit may write dummy data in the memory during a third period overlapping the first period and not overlapping the second period.

Abstract: It is an object of the present technology to provide an image sensor capable of reducing crosstalk in an AD conversion unit. The image sensor includes: capacitors in an even-numbered column region; and a capacitor in an odd-numbered column region disposed facing the capacitors in the even-numbered column region with different areas.

Abstract: An imaging apparatus including a light source is provided. The imaging apparatus includes a light-emitting device and a photoelectric conversion device in a pixel, and a pixel circuit has a function of outputting third data generated by multiplying obtained first data by second data (weight). Calculating the third data externally enables more detailed information on a subject with respect to a specific wavelength to be obtained. In addition, reading out collectively a plurality of pixels to which proper weight is given enables output of difference data between pixels and the like, which allows external calculation to be omitted.

Abstract: The imaging device includes a pixel including a photoelectric converter, an output line, a readout circuit unit connected to the output line, and a control unit. The readout circuit unit includes an amplifier circuit, a first switch for resetting the amplifier circuit, a sample-and-hold circuit, a second switch provided between the amplifier circuit and the sample-and-hold circuit, and a gain switching circuit. The control unit performs a first period of resetting the amplifier circuit by first switch, and a second period of connecting the amplifier circuit and the sample-and-hold circuit by the second switch. The first and second periods at least partially overlap with each other, and a timing at which the second switch transitions from an on state to an off state in the second period is later than a timing at which the first switch transitions from an on state to an off state in the first period.

Abstract: A method of defect pixel correction, includes, receiving at least one center pixel signal in a plurality of frames, receiving a plurality of neighboring pixel signals adjacent the center pixel in the plurality of frames, determining a brightness of the center pixel signal, determining the brightness of the plurality of neighboring pixel signals, determining if the brightness of the center pixel signal exceeds a wounded pixel threshold of the plurality of neighboring pixel signals, determining a location of the center pixel having the brightness greater than the wounded pixel threshold in at least one frame, determining a number of reoccurrences of the center pixel having the brightness greater than the wounded pixel threshold, determining if the number of reoccurrences exceeds a defect pixel threshold and updating the at least one center pixel signal to a mean of the plurality of neighboring pixel signals.

Abstract: An image sensor chip includes an internal voltage generator for generating internal voltages using an external voltage received at a first terminal of the image sensor chip, a temperature sensor for generating a temperature voltage, a selection circuit for outputting one of the external voltage, the internal voltages, and the temperature voltage, a digital code generation circuit for generating a digital code using an output voltage of the selection circuit, and a second terminal for outputting the digital code from the image sensor chip.

Abstract: Provided are a solid state imaging device, an imaging apparatus, and an imaging method that may acquire a desired image without using a frame memory. The solid state imaging device includes: a sensor unit that generates pulses at a frequency in accordance with a frequency of photon reception; a count unit that generates an image signal by counting the number of signals generated from the sensor unit; and a processing unit that performs a predetermined process on a count value obtained in acquisition of a first image signal, and the count unit combines a second image signal and a value obtained by performing a predetermined process on the count value obtained in the acquisition of the first image signal to generate a third image signal.

Abstract: An image processing circuit for correcting a distorted image includes an internal memory and a correction circuit. The internal memory of the image processing circuit is configured to store a radial look-up table (LUT), a set of tangential LUTs, and co-ordinates of a correction center of the distorted image. The radial LUT and the set of tangential LUTs include first and second sets of parameters to correct radial and tangential distortion of the distorted image, respectively. The correction circuit is configured to reconstruct portions of the correction LUT on-the-fly based on the radial LUT, the set of tangential LUTs, and the co-ordinates of the correction center, and correct portions of the distorted image based on the reconstructed portions of correction LUT to generate the portions of the corrected image.

Abstract: Aspects of the disclosure provide a training method and device for an image enhancement model and a storage medium. The method can include inputting each training input image group into the image enhancement model to obtain a predicted image output by the image enhancement model, and training the image enhancement model until convergence through each loss function respectively corresponding to each training pair. Each loss function can include a plurality of gray scale loss components corresponding to a plurality of frequency intervals one to one, and each gray scale loss component is determined based on a difference between a gray scale frequency division image of each predicted image and a gray scale frequency division image of the corresponding target image in each frequency interval, and different gray scale loss components correspond to different frequency intervals.

Abstract: The disclosure extends to methods, systems, and computer program products for producing an image in light deficient environments having cancelled fixed pattern noise.

Abstract: A system and method for processing an image including the steps of receiving an input image having a plurality of pixels, wherein each of the plurality of pixels have one or more pixel characteristics; and processing the input image to generate an enhanced image by applying a pixel/image relationship to each of the plurality of pixels of the input image, wherein the pixel/image relationship is arranged to adjust the one or more pixel characteristics of each of the plurality of pixels of the input image.

Abstract: A method for black-level calibration for an image-sensing device is provided. The image-sensing device includes a pixel array that has a first non-light-sensing region, a second non-light-sensing region, and an image-pixel region. The method includes the following steps: receiving a first analog signal, a second analog signal, and a third analog signal respectively from the first non-light-sensing region, the second non-light-sensing region, and the image-pixel region every predetermined scanning period; utilizing an analog-to-digital converter (ADC) of the image-sensing device to convert the first analog signal, the second analog signal, and the third analog signal to a first digital signal, a second digital signal, and a third digital signal, respectively; and performing a black-level-calibration (BLC) process on the first digital signal, the second digital signal, and the third digital signal to generate a black-level-calibrated digital signal, wherein the BLC process is implemented using a Kalman filter.