Abstract: A display panel is provided with a display region and a non-display region, and includes a plurality of sub-pixels, located in the display region; a plurality of fingerprint recognition units, located in the display region; and ambient-light sensing units, including at least one first light-sensing unit. At least a part of the plurality of fingerprint recognition units is multiplexed as the at least one first light-sensing unit.

Abstract: The invention relates to a method for calibrating cameras. In particular, the invention provides a method that estimates the position of interest points such as corners on images of array patterns, and uses such refined positions in an iterative calibration algorithm. The method can be extended to simultaneously process information from a large number of images from a plurality of cameras that are arranged in a fixed position on a mobile robot, wherein the images are representative of different camera poses. The optimization thereby provides a highly accurate estimate of camera calibration parameters.

Abstract: According to the present invention there is provided a vision sensor comprising, an array of pixels (101) comprising rows and columns of pixels, wherein each pixel has an address assigned thereto which represents the position of the pixel in the array, wherein each pixel in the array of pixels comprises a photodiode (103) which can receive light, and which can output current having an amplitude proportional to the intensity of the received light; a photoreceptor circuit (104) which is electronically connected to the photodiode, and which is configured to convert current which it receives from the photodiode into a voltage; a first storage capacitor (105), and at least a first switch which (106) is positioned between the first storage capacitor and an output of the photoreceptor circuit, wherein the first switch can be selectively closed to electronically connect the output of the photoreceptor circuit to the first storage capacitor, or selectively opened to electronically disconnect the output of the photorec

Abstract: An image processing apparatus includes a main unit configured to convert an input image into information of a first feature amount using a first convolutional neural network having at least two layers, an input unit configured to convert the input image into information of a second feature amount using a second convolutional neural network, and an output unit configured to convert information of a third feature amount generated by adding the information of the first feature amount and the information of the second feature amount to each other, into an output image using a third convolutional neural network.

Abstract: An image processing method includes displaying, by a terminal, a preview image, obtaining, by the terminal, at least one first image in the preview image, receiving, by the terminal, a photographing instruction, obtaining, by the terminal, at least one second image, detecting, by the terminal, a moving target based on the first image and the second image, and splitting, by the terminal, the moving target from the first image and the second image. The method further includes performing fusion processing on the first image and the second image after the splitting.

Abstract: A pixel binning method for processing pixel data acquired from an image sensor comprising a pixel array, the pixel binning method includes performing a first scanning process that is to scan a sensing area of the image sensor, to obtain a first number of pixel data; performing a second scanning process that is to scan the sensing area after the first scanning process is completed, to obtain a second number of pixel data; performing pixel binning on the second number of pixel data according to an offset value and an arithmetic value, wherein the offset value is determined according to the first number of pixel data.

Abstract: An image sensor array and circuit design employs a method of black level compensation to address vertical image shading related to global exposure image capture and rolling row by row readout schemes. An image sensor having the invented black level compensation pixel array and method may be incorporated within a digital camera.

Abstract: An image sensor may include an array of image pixels. The array of image pixel may be coupled to control circuitry and readout circuitry. One or more image pixels in the array may each include a coupled-gates structure coupling a photodiode at one input terminal to a capacitor at a first output terminal and to a floating diffusion region at a second output terminal. The coupled-gates structure may include a first transistor that sets a potential barrier defining overflow portions of the photodiode-generated charge. Second and third transistors in the coupled-gates structure may be modulated to transfer the overflow charge to the capacitor and to the floating diffusion region at suitable times. The second and third transistors may form a conductive path between the capacitor and the floating diffusion region for a low conversion gain mode of operation.

Abstract: An endoscope apparatus includes a processor. The processor performs controlling a focus position of an objective optical system, acquiring images sequentially captured by an image sensor, and combining the images in N frames thus captured into a depth of field extended image in one frame. The processor controls the focus position such that focus positions at timings when the respective images in N frames are captured differ from each other. The processor combines the images in N frames that have been controlled to receive a constant quantity of light emission of illumination light or the images in N frames that have undergone a correction process to make image brightness constant, into the depth of field extended image.

Abstract: A sensor includes a pixel portion having first and second areas; and a controller that controls readout of signals from the pixel portion in units of rows. The controller controls to read out a noise signal and an image signal, from each pixel in the first area, controls to read out a noise signal, a focus detection signal, and an image signal, from each pixel in the second area. Further, a time from when the noise signal is read out to when the image signal is read out from each pixel is controlled to be equal between the first area and the second area, and during that time, at least one of the noise signal and the image signal is read out from another row in the first area.

Abstract: A photoelectric conversion device includes pixels arranged to form columns, comparator circuits for respective columns, and a control circuit that controls the comparator circuits. Each comparator circuit includes a first comparator circuit connected to a first pixel of a first color, a second comparator circuit arranged on a column adjacent to the first comparator circuit and connected to a second pixel of a second color, and a third comparator circuit arranged on a column adjacent to the second comparator circuit and connected to a third pixel of the first color. Each comparator circuit compares a pixel signal on a corresponding column with a reference signal changing with time and outputs a comparison signal indicating a different level whether a difference between these signals is smaller or larger than a threshold. The control circuit controls the threshold to change stepwise in order of the first, third, and second comparator circuits.

Abstract: The present disclosure relates to receiving an input signal; generating an output signal by integrating a leaked signal over an integration time, wherein the leaked signal is obtained based on a dampening signal, a leak factor and the input signal; and providing the output signal.

Abstract: The present disclosure discloses a method for compensating for image quality of an optical system by means of a lens adjustment, applicable to a camera module comprising an adjustable lens or an adjustable lens set, the method comprising the following steps: (A) determining, based on imaging information of a to-be-adjusted optical system, parameters that need to be adjusted for compensating for the image quality; (B) establishing functions of relation between the parameters that need to be adjusted for compensating for the image quality and a to-be-adjusted lens factors; and (C) determining an adjustment mode and an adjustment amount for the to-be-adjusted lens based on the relation between the parameters that need to be adjusted for compensating for the image quality and the to-be-adjusted lens factors.

Abstract: Methods and systems are provided for estimating patient structure prior to a scan by a medical imaging system. As one example, a method may include acquiring depth images of a patient positioned on a table of the medical imaging system, correcting the depth images based on histogram data from the depth images, and extracting a three-dimensional structure of the patient based on the corrected depth images.

Abstract: A fingerprint sensor includes a pixel array, an analog-to-digital converter, and a reference signal generator. The pixel array includes a plurality of unit pixels arranged in rows and columns, and each of the plurality of unit pixels generates an analog signal by detecting a fingerprint of a user. The analog-to-digital converter performs an analog-to-digital conversion operation on the analog signal to generate a digital signal. The analog-to-digital converter is configured to perform the analog-to-digital conversion based on a reference signal. The reference signal generator generates the reference signal such that the reference signal decreases at a first rate from a start voltage, and adjusts a magnitude of the start voltage based on the digital signal.

Abstract: Systems, apparatuses, and methods are described for filtering and/or removing defects from content, such as high dynamic range (HDR) content. A plurality of parameters for filtering one or more pixels may be determined. The parameter(s) may be used to determine one or more filter weights, and the filter weight(s) may be applied to one or more pixels and one or more corresponding prior pixels to generate one or more filtered pixels. The filtered content and/or pixels thereof may later be encoded for storage and/or transmission to users.

Abstract: Imagers and associated devices and systems are disclosed herein. In one embodiment, an imager includes a pixel array and control circuitry operably coupled to the pixel array. The pixel array includes an imaging pixel configured to produce a reset signal and a non-imaging pixel configured to produce a nominal reset signal. The control circuitry is configured to produce an output signal based at least in part on one of (a) the nominal reset signal when distortion at the imaging pixel exceeds a threshold and (b) the reset signal when distortion does not exceed the threshold.

Abstract: It is possible to easily reproduce and edit image data that is a moving image obtained by capturing an image of a non-central projection method, in which distortion correction and blur correction are reflected. For this purpose, an information processing apparatus includes: a distortion correction processing unit that performs distortion correction processing for converting image data as a moving image acquired by capturing an image of a non-central projection method into an image of a central projection method; and a blur correction processing unit that performs blur correction processing of reducing the image blur generated in the image data using posture data of an imaging apparatus for image data that has been subjected to the distortion correction processing. In other words, the blur correction is performed after the distortion correction.

Abstract: A signal processing apparatus includes: an acquisition unit configured to acquire, for each of frames, captured images corresponding to results of a plurality of exposures in the frame obtained by a sensor part including a plurality of pixels arranged in an array; and a generation unit configured to generate an output image on the basis of the captured image corresponding to a result of at least one of the plurality of exposures in the frame, wherein the generation unit, in a case where a camera shake correction function is enabled and an exposure time of at least one of the plurality of exposures is shorter than a threshold, generates a first output image by correcting a brightness of the captured image based on the at least one of the plurality of exposure.

Abstract: An optical fingerprint sensing apparatus is provided. A control circuit controls a first selection circuit to output at least one of fingerprint sensing signals on sensing signal lines, and controls a second selection circuit to output at least one of background noise signals on dummy sensing signal lines, so that the first selection circuit and the second selection circuit simultaneously output the fingerprint sensing signal and the background noise signal, respectively. The signal processing circuit cancels background noise of the fingerprint sensing signals according to the background noise signal.

Abstract: A method and apparatus for image processing, the method comprising obtaining input image data comprising a plurality of pixel intensity values representing a respective plurality of pixel locations, obtaining pixel location data identifying one or more pixel locations represented by compromised pixel intensity values, generating interpolated image data comprising improved pixel intensity values, storing improved image data comprising at least the interpolated image data, and detecting one or more further compromised pixel intensity values based on the improved image data.

Abstract: An example apparatus enabling a dual fisheye model and calibration is described. The apparatus includes at least one memory; and at least one processor to execute instructions to: generate a first set of coefficients for an inverse distortion polynomial, the inverse distortion polynomial indicative of radial distortion of an image captured by a camera; generate a second set of coefficients for an alternative distortion polynomial, the alternative distortion polynomial to enable identification of a first point in the image corresponding to a second point in a three-dimensional space represented by the image; and determine a location of the camera within the three-dimensional space based on at least one of the inverse distortion polynomial or the alternative distortion polynomial.

Abstract: Processing method, processing apparatus, and electronic device are provided. The processing method includes continuously acquiring an image by using an acquisition component and continuously displaying the acquired image by using a display device in response to a first operation; and storing one or more frames of the image by using a storage device in response to a second operation. After the first operation and before storing the one or more frames of the image, there is at least one moment that a first light-emitting component is in an illuminating state and the moment of the first light-emitting component being in the illuminating state is different from a moment that the one or more frames of the image are acquired.

Abstract: An analog-to-digital conversion (ADC) circuit and a CMOS image sensor are disclosed. The ADC circuit includes a first column line configured to receive a first pixel signal from a first pixel, a second column line configured to receive a second pixel signal from a second pixel located adjacent to the first pixel, and a correlated double sampling (CDS) circuit configured to perform a CDS operation by comparing the first pixel signal, the second pixel signal, a first ramp signal, and a second ramp signal with one another. The CDS circuit may perform the CDS operation on the first pixel signal by selecting the first column line in a first operation period, and may perform the CDS operation on the first pixel signal and the second pixel signal by selecting the first column line and the second column line in a second operation period.

Abstract: An image processing method provided by embodiments of the present disclosure includes acquiring, two adjacent frames of original images from a video image data stream; extracting a feature element that produces smear from the two adjacent frames of the original images; generating a reconstructed image frame that does not comprise the feature element by using the two adjacent frames of the original images and the feature element; and inserting the reconstructed image frame between the two adjacent frames of the original images.

Abstract: The present invention provides a solid state image sensor, an image capturing apparatus, and an image capturing method that can realize a wide dynamic range while suppressing an increase in a signal amount. A solid state image sensor includes a sensor that issues pulses at a frequency corresponding to a frequency at which photons are incident; and a counter circuit that thins out the pulses issued from the sensor at a thinning ratio corresponding to the number of pulses issued from the sensor, and counts the pulses.

Abstract: A signal processing unit performs preprocessing, demosaic processing and color reproduction processing on an image signal. A control unit detects an image area having undergone a characteristic change exceeding a predetermined change amount, by using an image signal before the reproduction processing and an image signal after the color reproduction processing. The control unit associates area information indicating the detection result of the image area having undergone a characteristic change exceeding a predetermined change amount with the image signal after the color reproduction processing, and records the area information on a recording medium, or outputs the area information to an external device. Thus, it becomes possible to detect an image area where a control change caused by color reproduction processing is unnatural.

Abstract: Described is a monolithic integrated circuit for use in quantum computing based on single and multiple coupled quantum dot electron- and hole-spin qubits monolithically integrated with the mm-wave spin manipulation and readout circuitry in commercial complementary metal-oxide-semiconductor (CMOS) technology. The integrated circuit includes a plurality of n-channel or p-channel metal-oxide-semiconductor field-effect transistor (MOSFET) cascodes each including a single-spin qubit or two coupled quantum dot qubits formed in an undoped semiconductor film adjacent at least one top gate. There is also a back gate formed in a silicon substrate adjacent a buried oxide layer or the at least one top gate, where the back gate controls the electron or hole entanglement and exchange interaction between the two coupled quantum dot qubits. The monolithic integrated circuits described may be used for monolithically integrated semiconductor quantum processors for quantum information processing.

Abstract: A method for processing an image signal, an image signal processor, and an image sensor chip are disclosed. A method for processing an image signal includes generating Bayer order status information indicating whether a Bayer order of a Bayer pattern image has been changed, based on translation information of gyro information, performing translation correction about the Bayer pattern image using the translation information, and performing interpolation about the Bayer pattern image in which the translation correction has been performed, based on the Bayer order status information.

Abstract: A sound signal control device in a device including an input transducer to detect sound in a space in a vehicle, a sensor to image an occupant in the space, and an output transducer to emit sound into the space includes: a controller to generate information indicating a position of a head of the occupant and information indicating a state of the occupant, based on an image imaged by the sensor; a processor to generate a cancellation signal for cancelling noise at the position based on a sound signal representing sound detected by the input transducer and the information, and generate a control signal for controlling sound at the position based on the cancellation signal; and a converter to cause the output transducer to emit a sound corresponding to the control signal. The processor adjusts a degree to which the noise is cancelled, based on the information indicating the state.

Abstract: An imaging device includes one or more processors; and a computer readable medium storing instructions that, when executed by the one or more processors, cause the imaging device to perform functions including: capturing a first image and thereafter a second image; making a determination of whether or not a difference between the first image and the second image is greater than a threshold value; generating a third image by processing the second image using an image processing algorithm that corresponds to the determination; and displaying the third image.

Abstract: The camera is used in a camera system including the camera that includes an image sensor movable for image blur correction, and a lens apparatus that is detachably attachable to the camera and includes an optical element movable for the image blur correction. The camera includes a setting unit configured to set a ratio of image blur correction amounts provided respectively by movements of the optical element and the image sensor in each of their moving directions, using information on an image circle formed by the lens apparatus, information on a mechanical movable amount of the image sensor, and information on a size of a signal readout area of the image sensor.

Abstract: A method and device for correcting image artifacts. Pixel quotient values of camera images are computed in a first direction by comparing intensity differences between neighboring pixels. Median values of pixel quotient values are computed with respect to time and attenuation factors of pixel lations are computed. Corrected pixel intensities can then be derived by dividing observed pixel intensities by attenuation factors of the respective pixel locations.

Abstract: A method for correcting rolling shutter (RS) effects is presented. The method includes generating a plurality of images from a camera, synthesizing RS images from global shutter (GS) counterparts to generate training data to train the structure-and-motion-aware convolutional neural network (CNN), and predicting an RS camera motion and an RS depth map from a single RS image by employing a structure-and-motion-aware CNN to remove RS distortions from the single RS image.

Abstract: An image processing device, an image processing method, and an image processing program capable of outputting an image with appropriate sharpness for an input image that may include both a dynamic region and a static region. An image processing device includes a static and dynamic information calculator configured to calculate static and dynamic information of an input image; a blend ratio setting unit configured to determine a blend ratio by performing a predetermined operation on the static and dynamic information of the input image; and an image processing unit configured to generate an output image optimized for static and dynamic change by performing image processing on the input image on the basis of the blend ratio.

Abstract: An always-on system with multi-layer power management includes an always-on portion that is powered in shutdown state and all power states while rest portions of the system are not powered in the shutdown state; a memory unit that is powered in sleep state to retain data in the memory unit; an input interface that is powered only in event detection state, in which at least one captured image is received from an image sensor, the event detection state beginning when a trigger signal is issued; an event monitor that detects motion in the captured image; a digital signal processor (DSP) that is powered only in computer vision state to perform image identification on the captured image if motion is detected; and an output interface is powered only in the computer vision state, a result of the DSP being outputted via the output interface.

Abstract: A deposit removal system includes a camera, display means that displays an image that is acquired by the camera, detection means that detects an operation of a user on the display means, deposit removal means that performs a removal action for removing a deposit that is attached to a lens of the camera, and control means that causes the deposit removal means to perform the removal action, based on the operation on an image detected by the detection means.

Abstract: Provided is a method for generating a blurred photo graph, comprising: receiving a blurring adjustment instruction and determining a blurring adjustment signal trajectory of the blurring adjustment instruction; if the trajectory is a dynamic short change, according to a first blurring mapping signal corresponding to the dynamic forward movement of a target object, obtaining a virtual photographing state and adjusting the target object to be in the virtual photographing state; and if the trajectory is a dynamic long change, according to a second blurring mapping signal corresponding to the dynamic back ward movement of the target object, obtaining a virtual photographing state and adjusting the target object to be in the virtual photographing state.

Abstract: There is provided an image processing apparatus for enabling noise reduction in which a color deviation is reduced. The image processing apparatus includes a color value calculation circuit configured to calculate color values from an image signal acquired through imaging, an average value calculation circuit configured to calculate average values of the image signal, and a processing circuit configured to perform noise reduction processing on the image signal, with an intensity according to evaluation values including the color values and the average values.

Abstract: Various techniques are disclosed for separating and removing low-frequency shadow or shading (also referred to herein as “non-uniformity”) from images that have been corrupted by the non-uniformity. A non-uniformity estimate that approximates the non-uniformity effect on the corrupted image may be generated by iteratively adding new blotches of non-uniformity data represented by two-dimensional (2D) functions, such as 2D Gaussian functions, to the non-uniformity estimate and applying filters to smoothen the 2D functions. In each iteration of the non-uniformity estimate generation process, a new non-uniformity update candidate that minimizes a cost function is identified. The corrupted image is processed based on the non-uniformity estimate to generate a corrected image.

Abstract: An image capturing apparatus having an imaging sensor and a processor configured to set n different exposure times for n successive frames, where n is an integer equal to or larger than two; control the imaging sensor to capture the n successive frames with the set n exposure times so as to make a blank period between frames shorter than the n exposure times; acquire n pieces of image data of the n successive frames captured by the imaging sensor; and generate a composite frame for recording or displaying a motion picture of an extended dynamic range from the n pieces of image data, wherein the processor is further configured to set the n exposure times so that a sum of the n exposure times matches a time for n frames for the composite frame or a time for one frame for the composite frame in accordance with a brightness of a photographic subject captured by the imaging sensor.

Abstract: The disclosure extends to methods, systems, and computer program products for digitally imaging with area limited image sensors, such as within a lumen of an endoscope.

Abstract: The present technology improves the image quality of a synthesized image in a device that synthesizes a plurality of images. Disclosed is an image processing device that includes a detection section, a synthesis ratio generation section, and a synthesis section. The detection section detects whether a light source has blinked during an exposure period of a detection target image among a plurality of images captured in chronological order, and outputs a detection result. In a case where the detection result indicates that the light source has blinked, the synthesis ratio generation section generates a synthesis ratio for making the percentage of the detection target image lower than the percentage of an image other than the detection target images. The synthesis section synthesizes the plurality of images at the synthesis ratio.

Abstract: An imaging apparatus includes a first pixel, a second pixel, a controller, and a correction circuit. The first pixel has a first photoelectric conversion portion. The second pixel has a second photoelectric conversion portion. The controller controls to output a first signal based on reset release of the first pixel and a second signal based on reset release of the second pixel in a first period, and to output a third signal based on photoelectric conversion of the first pixel and a fourth signal based on reset release of the second pixel in a second period. The correction circuit corrects a difference between the third signal and the first signal, using a difference between the fourth signal and the second signal.

Abstract: A LIDAR device includes an input node, an output node, and a sample-and-convert circuit. The input node receives a photodetector signal, and the output node generates an output signal indicating a light intensity value of the photodetector signal. The sample-and-convert circuit includes a number of detection channels coupled in parallel between the input node and the output node. In some aspects, each of the detection channels may be configured to sample a value of the photodetector signal during the sample mode and to hold the sampled value during the convert mode using a single capacitor.

Abstract: An information processing device that operates in an imaging device mounted on a mobile unit, and notifies the mobile unit of failed imaging, when imaging performed by the imaging device has failed.

Abstract: A buffered direct injection pixel can be operated such that it is automatically zeroed. The operation includes: during a normal operating mode, controlling a gate voltage of an injection transistor with the output of an amplifier to control a bias of photo-current source, an inverting input of the amplifier being connected to input of the injection transistor through a nulling capacitor; during a nulling operation, closing a first switch to connect the nulling capacitor directly to an output of the amplifier; during the nulling operation, closing a second switch to directly couple the input of the injection transistor to a bias voltage causing the nulling capacitor to store a difference between an output of the amplifier and the bias voltage; and after the nulling operation, providing the voltage stored on the nulling capacitor to the inverting input by opening the first and second switches.

Abstract: The present technology relates to an image processing apparatus, an image processing method, an imaging apparatus, and a program that enable motion correction to be performed more appropriately. Provided are a synthesizing unit that synthesizes a plurality of images captured at different timings; and a motion correction unit that performs correction that reduces influence on the images relating to motion, in which the motion correction unit sets a criterion of a section for which motion amount information relating to a motion amount supplied at a predetermined interval is referred to, on the basis of a synthesis ratio when the plurality of images is synthesized, and refers to the motion amount information according to the set criterion to perform the correction.

Abstract: An image synthesis system is disclosed for synthesizing a global shutter image based on a rolling shutter image. The rolling shutter image is captured by an aerial camera system having at least one rolling shutter camera and the rolling shutter image has a plurality of scanlines, the scanlines having associated different position and pose information. The image synthesis system is arranged to project a rolling shutter image captured by a rolling shutter camera to object space by projecting each scanline of the rolling shutter image using position and pose information associated with the scanline, and subsequently from object space to a synthetic global shutter image.

Abstract: The present subject matter proposes a novel pulse compression favourable non-periodic thermal wave imaging that enhance the energy concentration capabilities and defect detection sensitivity and resolution in comparison with presently used pulse compression favourable thermal wave imaging approaches. This is due to most of the supplied energy is concentrated in the main lobe and very less energy will be redistributed to side lobes by the proposed Complimentary Golay coded excited thermal wave imaging.