Abstract: An imaging apparatus changes a multiplication factor of an avalanche photodiode (APD) at one of (i) a first timing subsequent to an exposure period of a first frame in a first vertical scanning period and a readout period of the first frame in a second vertical scanning period, and previous to an exposure period of a second frame in a third vertical scanning period, and (ii) a second timing subsequent to an exposure period of the first frame in the first vertical scanning period, and previous to a readout period of the first frame and an exposure period of the second frame which are provided in parallel in the second vertical scanning period.

Abstract: Imagers and associated devices and systems are disclosed herein. In one embodiment, an imager includes a pixel array and control circuitry operably coupled to the pixel array. The pixel array includes an imaging pixel configured to produce a reset signal and a non-imaging pixel configured to produce a nominal reset signal. The control circuitry is configured to produce an output signal based at least in part on one of (a) the nominal reset signal when distortion at the imaging pixel exceeds a threshold and (b) the reset signal when distortion does not exceed the threshold.

Abstract: A method, a head-up display and a display system for the perspective transformation and displaying of rendered image content, as well as a corresponding vehicle, are provided. In the perspective transformation and outputting method, the image content to be displayed is subdivided into a plurality of tiles, and the individual tiles are each transformed in perspective using perspective transformation. The individual tiles that have been transformed in perspective are then combined to form a transformed image content, and the image content transformed in perspective is projected onto a projection area of the head-up display or displayed on a display unit.

Abstract: An image processing method and apparatus, a control method are provided. A part of the color-block image within the fixed region is converted into a first image using a first interpolation algorithm. The first image includes first simulation pixels arranged in an array. A part of the color-block image beyond the fixed region is converted into a second image using a second interpolation algorithm. The second image includes second simulation pixels arranged in an array, and a complexity of the second interpolation algorithm is less than that of the first interpolation algorithm. The first image and the second image are merged into a simulation image corresponding to the color-block image. With the image processing method, by processing different parts of the image respectively with the first interpolation algorithm and the second, the time for processing the image is reduced while the image quality is improved, thus improving the user satisfaction.

Abstract: A camera has a sensor, a signal generator, and a transmitter. The sensor detects a mobile airborne device within a field of view of a primary camera, where a three-dimensional physical space is within the field of view of the primary camera. The signal generator generates a signal that, when received by the mobile airborne device, causes the mobile airborne device to exit the three-dimensional physical space. The transmitter transmits the signal to the mobile airborne device to cause the mobile airborne device to exit the three-dimensional physical space that is within the field of view of the primary camera.

Abstract: A signal observation device includes: an observation unit that observes a volume of a target signal by using compressed sensing; a filter having a plurality of elements that are arranged in a matrix and that are capable of individually restricting the volume of the target signal to be transmitted to the observation unit; and a control unit that causes the observation unit to observe the volume of the target signal transmitted via the filter by using first control for controlling the elements of the filter on the basis of a first observation matrix in which values of matrix elements are predetermined and that causes the observation unit to observe the volume of the target signal transmitted via the filter using second control for controlling the elements of the filter on the basis of a second observation matrix in which values of matrix elements are based on random numbers.

Abstract: An image processing method includes the steps of: generating, based on data of a plurality of images acquired by performing imaging using a same image sensor, a weight coefficient corresponding to each image so that a weight coefficient corresponding to an image of which a brightness change is smooth is relatively large; integrating the data of the plurality of images using the weight coefficients to generate data of an integrated image; applying smoothing to the data of the integrated image to generate data of a smoothed integrated image; and generating, based on the data of the integrated image and the data of the smoothed integrated image, data of estimated fixed-pattern noise which is an estimated value of fixed-pattern noise attributable to the image sensor.

Abstract: Some embodiments include determining a value of an identified pixel of a plurality of pixels of an image from a detector; determining a noise value based on the value of the identified pixel and the detector; determining a range based on the noise value and the value of the identified pixel; comparing the range and a value of at least one pixel of the pixels other than the identified pixel; and adjusting the value of the identified pixel in response to the comparison.

Abstract: A solid state imaging device includes a pixel unit and an output unit. The pixel unit has a first pixel and a second pixel different from the first pixel. The output unit has a first capacitance to which a first pixel signal read from the first pixel is input, a second capacitance to which a second pixel signal read from the second pixel is input, and an operational amplifier outputting an output signal in accordance with the first capacitance and the second capacitance.

Abstract: Provided are an image processing device and an electronic endoscope system that can acquire a high-quality endoscope observation image by performing sufficient noise reduction processing even if an image capture environment changes. A noise reduction processing unit sets a pixel of interest and a neighboring pixel out of a plurality of pixels that constitute an endoscope observation image, and performs noise reduction processing on the pixel of interest according to a magnitude relationship between: a difference in pixel value between the pixel of interest and the neighboring pixel; and a reference threshold value. A reference threshold value changing processing unit changes the reference threshold value for noise reduction processing based on a ratio between at least two color components that are included in the pixel of interest.

Abstract: According to an embodiment, an information processing apparatus includes a memory and processing circuitry. The processing circuitry configured to acquire an input image captured by an image-capturing device installed in a specific location. The processing circuitry configured to perform adaptation processing of adapting an estimation model, which is used for detecting positions or the number of objects contained in an image, to the specific location by sequentially selecting a parameter of the estimation model from a lower level toward a higher level, and by modifying the selected parameter in such a manner to reduce an estimation error in the positions or the number of the objects contained in the input image. The processing circuitry configured to acquire a termination condition for the adaptation processing. The processing circuitry configured to terminate the adaptation processing when the termination condition is satisfied.

Abstract: An electronic device such as a head-mounted display or other display system may have a pair of adjustable focal length lenses. Control circuitry in the head-mounted display may adjust the adjustable focal length lenses so that the adjustable focal length lenses exhibit a series of different focal lengths. A graphics processor may generate undistorted image frames. The adjustable focal length lenses may exhibit a different amount of lens distortion at each focal length. To compensate for these different amounts of lens distortion, a distortion compensation circuit may predistort the undistorted image frames by an appropriate amount for each focal length. The distortion compensation circuit may include mapping and interpolation circuitry and look-up tables that store mapping and interpolation data for each of the focal lengths.

Abstract: An image processing apparatus includes: an acquisition unit configured to acquire image data and noise information including one of positional information on a reading circuit in which blinking defect noise caused by the reading circuit occurs and positional information on each of pixels; and a correction unit configured to set the image data acquired by the acquisition unit as correction target image data, and correct a pixel value of a pixel of interest of the correction target image data based on the noise information and reference image data that is based on image data acquired at a time different from the correction target image data.

Abstract: An image generation device performs coordinate transformation, based on a coordinate transformation table, to a two-dimensional first image having a span in a horizontal direction and a vertical direction and acquired by overlooking and imaging an object from a first viewpoint at a first depression angle, and generates and outputs a second image which was obtained by overlooking the object from a second viewpoint which is different from the first viewpoint at a second depression angle which is different from the first depression angle. The coordinate transformation table is a table for transforming coordinates of a plurality of first selected pixels selected from a plurality of first pixels constituting the first image into coordinates of second selected pixels corresponding to a plurality of second pixels constituting the second image.

Abstract: An image sensor may include: an active pixel region in which a plurality of active pixels are arranged; and one or more optical black regions positioned adjacent to the active pixel region, and each including a first region in which a plurality of first pixels are arranged and a second region in which a plurality of second pixels having a different pixel size from the first pixels are arranged.

Abstract: An image sensor operable in global shutter mode may include an array of image pixels. Each image pixel may include a photodiode for detecting incoming light and a separate storage diode for temporarily storing charge. To maximize the efficiency of the image pixel array, image pixels may include light guide structures and light shield structures. The light guide structures may be used to funnel light away from the storage node and into the photodiode, while the light shield structures may be formed over storage nodes to block light from entering the storage nodes. The light guide structures may fill cone-shaped cavities in a dielectric layer, or the light guide structures may form sidewalls having a ring-shaped horizontal cross section. Metal interconnect structures in the dielectric layer may be arranged in concentric annular structures to form a near-field diffractive element that funnels light towards the appropriate photodiode.

Abstract: To generate a low noise image signal, even in image capturing in a low light intensity environment. In a signal processing device of an image capturing device; a noise reduction section removes noise from one of an invisible light signal and a color difference signal and from a luminance signal, and generates a group of signals from which noise is removed; and an image signal generation section generates an image signal including an adjusted luminance signal and an adjusted color difference signal at a ratio that is substantially equal to a ratio between the luminance signal and the color difference signal by adjusting the luminance signal and the color difference signal, and generates one of the adjusted luminance signal and the adjusted color difference signal based on the invisible light signal and the group of signals from which the noise is removed.

Abstract: There is disclosed an image processing method in which a video signal is inputted from an imaging optical system in which astigmatism remains, and is displayed on a two-dimensional display apparatus. Based on the circumferential direction modulation factor and radial direction modulation factor of a lens used in the imaging optical system, a signal including the amount of vertical or horizontal modulation factor correction proportional to an nth power (n is an integer greater than 1) of a distance from a center position of a screen of the two-dimensional display apparatus is outputted for at least one vertical or horizontal frequency of the two-dimensional display apparatus.

Abstract: An image processing apparatus comprising, a circuitry configured to perform operations of, setting a target value in a case of correcting degradation in image quality of an image caused by an optical member, based on a characteristic of the optical member, the image being generated by an image sensor by photoelectrically converting an optical image of a subject that has passed through the optical member, acquiring information regarding a state of the optical member, setting first correction values for correcting the degradation in image quality of the image caused by the optical member, based on the target value and the information regarding the state, and correcting the image based on the first correction values.

Abstract: A digital camera includes an imaging element (5) having an imaging surface (50) where pixels (51) are arranged in two dimensions in a row direction X and in a column direction Y, an AF processing unit (19) that determines whether a focus lens is in a focused state using detection signals obtained from respective pixels (51) of a first pixel group including plural pixels (51) arranged in the row direction X and a second pixel group including pixels (51) arranged at the same distance in one direction that crosses the row direction X with respect to each of the plural pixels (51) of the first pixel group, in a state where the focus lens is at an arbitrary position, and a system control unit (11) that moves the focus lens until the AF processing unit (19) determines that the focus lens is in the focused state.

Abstract: A radiographic imaging device includes a radiation detection element including plural same sized hexagonal shaped pixels that detect radiation and are arrayed in a honeycomb pattern, and a pixel density conversion section that performs interpolation processing such that first image data obtained from the radiation detection element is converted into second image data representing an image in which plural pixels are arrayed in a square grid pattern, wherein when d1max denotes the length of the longest diagonal of the hexagonal shaped pixels, S1 denotes the surface area of the hexagonal shaped pixels, and d2max denotes the length of the diagonals of the square grid of the second image data, d1max is equal to or greater than d2max, and d2max is equal to or greater than the value of the square root of S1.

Abstract: An image processing pipeline may dynamically determine filtering strengths for noise filtering of image data. Statistics may be collected for an image at an image processing pipeline. The statistics may be accessed and evaluated to generate a filter strength model that maps respective filtering strengths to different portions of the image. A noise filter may determine a filtering strength for image data received at the noise filter according to the filter strength model. The noise filter may then apply a filtering technique according to the determined filtering strength.

Abstract: An image processing apparatus, which captures and records a moving image and which can generate still image data from moving image data, evaluates validity of image capturing conditions related to imaging parameters such as focus, exposure, white balance, and image blur, generates a degree of appropriateness corresponding to each imaging parameter, and based on at least one of the degrees of appropriateness, changes characteristics of control of imaging parameters corresponding to the other degrees of appropriateness.

Abstract: An electronic device may be provided with a display mounted in a housing. The display may have an array of pixels that form an active area and may have an inactive area that runs along an edge of the active area. A color ambient light sensor may gather ambient light measurements through a window in an opaque masking layer in the inactive area. The color ambient light sensor may have photodiodes with different spectral sensitivities and may have a dark current photodiode that is insensitive to light. A set of analog-to-digital converters may be used to digitize photodiode signals from the photodiodes. A switch array may be used to distribute signals from the photodiodes to each of the analog-to-digital converters. This allows the output of each photodiode to be averaged over multiple analog-to-digital converters to remove any impact of variations in performance between converters.

Abstract: A method of inspecting patterns formed the manufacturing of semiconductor devices or the like includes producing an image of the patterns, producing a boundary image including a plurality of boundary patterns corresponding to first and second boundaries of each of the patterns, combining the pattern image and the boundary image to produce an overlapping image including overlapping patterns in which the patterns fill regions between the boundary patterns, and binarizing the overlapping image to produce a binary image including binary patterns corresponding to the overlapping patterns.

Abstract: In various embodiments, an electronic image sensor having extended dynamic range comprises, for example, a pixel circuit and a column readout circuit. The column readout circuit includes, for example, a correlated double-sampling (CDS) capacitor, one or more CDS clamp switches, a single slope analog-to-digital converter (ADC) circuit, and a column memory. Other devices and methods are disclosed.

Abstract: An image processing apparatus that generates a virtual viewpoint image based on one or more captured images out of a plurality of captured images by a plurality of cameras, the apparatus comprising an acquisition unit configured to acquire virtual viewpoint information including information related to a position and a direction of a virtual viewpoint, a determination unit configured to determine whether occlusion is occurring in at least one image captured by at least one of the cameras, a decision unit configured to, based on a position and direction of the virtual viewpoint and on a result of the occlusion determination in relation to the at least one image, decide one or more captured images to be used for generation of a virtual viewpoint image, and a generation unit configured to generate a virtual viewpoint image using the decided one or more captured images.

Abstract: A plenoptic imaging system includes imaging optics, a microlens array and a sensor array. A method for generating a preview image of a plenoptic image captured by the plenoptic imaging system includes the following. A plenoptic image of an object captured by the plenoptic imaging system is accessed. The plenoptic image includes many superpixels. Each superpixel includes many subpixels. For each superpixel, a set of reliable subpixels is selected based at least in part on vignetting of the subpixels. A preview image is generated from the sets of reliable subpixels. The preview image includes pixels corresponding to the superpixels. The pixels in the preview image are generated from the set of reliable subpixels for the corresponding superpixels.

Abstract: Various embodiments of the present technology may comprise a method and apparatus for a power management unit. The power management unit may be configured to operate in conjunction other integrated circuits to mitigate power dissipation. The power management unit may receive temperature information from a temperature sensor and deploy various power management schemes to reduce the leakage power of an SRAM. The power management schemes may be based on the particular characteristics of the SRAM.

Abstract: An image-filtering device for filtering an image that includes a pixel difference computing module, an adaptive brightness adjusting module, a weighting computing module and a filter computing module is provided. The pixel difference computing module uses any one of the pixels as a central pixel within a pixel window to compute pixel absolute differences between the central pixel and every pixels within the pixel window. The adaptive brightness adjusting module multiplies each of the pixel absolute differences with an adjusting parameter to generate adjusted pixel absolute differences. The weighting computing module generates weighting values according to the adjusted pixel absolute differences. The filter computing module performs convolution according to the pixel value of each of the pixels within the pixel window and the corresponding weighting values to generate a filtering result of the central pixel.

Abstract: An image sensor includes a pixel array including a plurality of unit pixels in a matrix including rows and columns, a selection unit configured to select outputs of some of the columns of the pixel array and output selection output signals, and an analog-digital conversion block including a plurality of analog-digital conversion units corresponding to the columns of the pixel array. First ones of the plurality of analog-digital conversion units include analog-digital conversion blocks configured to convert the selection output signals and output digital data. When the first analog-digital conversion units convert the selection output signals, second ones of the plurality of analog-digital conversion units are turned off.

Abstract: In an information processing apparatus, a conversion unit converts position information indicated by a line or a figure set onto a corrected captured image generated through distortion correction processing executed on at least a part of a captured image captured by an image capturing apparatus into position information in the captured image by at least using information relating to a condition for executing analysis processing for analyzing the captured image. A control unit controls an analysis unit to execute the analysis processing using the position information converted by the conversion unit.

Abstract: A noise extracting device includes first and second microphones that are provided at spatially different positions and pick up sounds, a first noise signal extractor that extracts a first noise signal included in a first signal obtained by subjecting output signals of the first and second microphones to directionality combining, a second noise signal extractor that obtains a second noise signal included in a second signal different from the first signal in a condition of the directionality combining, and a noise signal separator that separates the first and second noise signals into individual noise signals indicating noises generated in the respective first and second microphones.

Abstract: An image processing method and an electronic device are disclosed. The image processing method includes obtaining distance information of at least one portion of pixels in an image acquired by the image acquiring unit, the distance information indicating a distance from the image acquiring unit to a shot object to which each pixel among the at least one portion of pixels corresponds; determining magnifications of the at least one portion of pixels based on the distance information and optical characteristics of the image acquiring unit; and adjusting the image based on the magnifications of the at least one portion of pixels.

Abstract: An apparatus is disclosed for structural fixed pattern noise reduction in a video stream. A method may include, for each target pixel in a first image frame, defining a first target pixel patch, and defining a first search area comprising the first target pixel patch; for each pixel in the first search area, comparing a first pixel patch around the pixel with the first target pixel patch, and using the pixel when calculating an average for the target pixel. The method may include, in a second image frame, localizing a second target pixel, and defining a second search area comprising the second target pixel; for each pixel in the second search area, comparing a second pixel patch around the pixel of the second search area with the first target pixel patch, and using the pixel in the second search area when calculating an average for the target pixel.

Abstract: Display pre-distortion methods and apparatus for HMDs are disclosed. A disclosed example method includes determining a position of a pupil relative to a lens of the head-mounted display (HMD), determining, based on the determined position, a pre-distortion map for an image to be displayed on a display screen of the HMD, and displaying the image on the display screen of the HMD, wherein the image is modified by the pre-distortion map.

Abstract: An imaging device includes a plurality of pixels each of which outputs at least one of an imaging signal and a ranging signal and performs a first readout operation that reads the imaging signal from a first pixel group of the plurality of pixels, and a second readout operation that, after the first readout operation and before a readout operation for next acquiring the imaging signal, reads the ranging signal from a second pixel group of the plurality of pixels. In the first readout operation, the imaging signal is not read from a third pixel group of the plurality of pixels, in a period from a reset of the first pixel group to a next reset of the first pixel group, the third pixel group is reset, and the second pixel group is selected from the third pixel group based on the imaging signal read by the first readout operation.

Abstract: Information indicating at least one defective pixel in an imaging device for obtaining a radiographic image, based on characteristic information indicating an output fluctuation of each pixel caused by an accumulation state of an electric charge by a dark current in the imaging device. The radiographic image is corrected based on the information indicating the defective pixel.

Abstract: A pixel includes detection portions which detect transferred charges, a reset portion which resets the plurality of detection portions, a connection/separation control portion which controls connection and separation of the detection portions, and an output portion which outputs a signal corresponding to the potential of a detection portion. In a state where the connection/separation control portion connects the detection portions, the output portion outputs a connection-state reset level signal and a connection-state output signal and, in a state where the connection/separation control portion separates the detection portions, the output portion outputs a separation-state reset level signal and a separation-state output signal. A first pixel signal is generated by a difference between the connection-state reset level signal and the connection-state output signal, and a second pixel signal is generated by a difference between the separation-state reset level signal and the separation-state output signal.

Abstract: An image sensor includes a pixel array including at least one unit pixel configured to generate accumulated charges, a correlated double sampler configured to perform a correlated double sampling operation to extract an effective signal component based on a signal component and a reset component from the unit pixel for at least first and second read-out periods, the correlated double sampler configured to read out an image signal during the first read-out period and to read out a light noise signal during the second read-out period, an analog-digital converter configured to convert the image signal into a first digital signal and to convert the light noise signal into a second digital signal and an image compensator configured to generate a compensated image signal based on the second digital signal and the first digital signal.

Abstract: Examples are disclosed that relate to depth-aware late-stage reprojection. One example provides a computing system configured to receive and store image data, receive a depth map for the image data, processing the depth map to obtain a blurred depth map, and based upon motion data, determine a translation to be made to the image data. Further, for each pixel, the computing system is configured to translate an original ray extending from an original virtual camera location to an original frame buffer location to a reprojected ray extending from a translated camera location to a reprojected frame buffer location, determine a location at which the reprojected ray intersects the blurred depth map, and sample a color of a pixel for display based upon a color corresponding to the location at which the reprojected ray intersects the blurred depth map.

Abstract: A method for reducing image disturbances caused by reconstructed defective pixel clusters located in signal-gradient affected diagnostic image regions. An individually adapted central symmetrical pair reconstruction (CSP) kernel is composed for a defective image pixel based on a kernel-pair candidate order encoded in a model thereby using the pixel's validity state. The image impacted by defective pixels is corrected in real-time by statistical filtering or spatial convolution of the kernel-associated image data accessible via a predetermined CSP kernels image-offsets structure.

Abstract: Implementations pertaining to dynamic noise reduction for high dynamic range (HDR) in digital imaging are described. A method may involve receiving a data related to digital imaging. The method may also involve determining a respective HDR enhancement ratio for each of one or more portions of a plurality of portions of the data. The method may further involve determining a respective level of noise reduction corresponding to the respective HDR enhancement ratio for each of the one or more portions of the data. The method may additionally involve performing noise reduction up to the respective level of noise reduction for each of the one or more portions of the data.

Abstract: In order to objectively and efficiently measure, visualize and evaluate the quality of images in terms of sharpness, a method for determining a sharpness metric (S) of an image is described. The method includes performing edge detection that results in gradients for the pixels of the image, determining a value representing a contrast metric C of the image, calculating at least three different thresholds (t1,t2,t3) from the image content, and classifying the pixels according to their gradient into at least four groups defined by the thresholds. The sharpness metric (S) is calculated from relationships between the amounts of pixels in the different groups and a multiplicative factor (m) between the at least three thresholds.

Abstract: An image processing apparatus includes an image decomposing unit that decomposes a pixel value of each pixel forming an original image into an illumination component and a reflectance component to generate an illumination component image, and an image composing unit that reflects the illumination component on a sample image serving as a sample of image, and combines the sample image with the illumination component reflected thereon to the original image.

Abstract: A restoration filter generation device which generates a restoration filter for performing a restoration process on luminance system image data, the restoration process being based on a point-image distribution in an optical system, the luminance system image data being image data relevant to luminance and being generated based on image data for each color of multiple colors, the restoration filter generation device including an MTF acquisition device which acquires a modulation transfer function MTF for the optical system; and a restoration filter generation device which generates the restoration filter based on the modulation transfer function MTF, the restoration filter suppressing an MTF value of image data for each color of the multiple colors to 1.0 or less at least in a region of a particular spatial frequency or less, the image data for each color of the multiple colors corresponding to the luminance system image data after the restoration process.

Abstract: Apparatuses and methods for temperature related error management are described. One or more apparatuses for temperature related error management can include an array of memory cells and a write temperature indicator appended to at least one predetermined number of bytes of the stored data in the array of memory cells. The apparatuses can include a controller configured to determine a numerical temperature difference between the write temperature indicator and a read temperature indicator and determine, from stored operations, an error management operation for the stored data based, at least in part, on comparison of the numerical temperature difference to a temperature difference threshold.

Abstract: An imaging device comprising: a pixel comprising a photoelectric converter and a reset transistor having a source and a drain one of which is electrically connected to the photoelectric converter; a first voltage generating circuit for generating a first voltage; a second voltage generating circuit for generating a second voltage identical or equivalent to the first voltage; and a first switching circuit having a first input terminal electrically connected to the first voltage generating circuit, a second input terminal electrically connected to the second voltage generating circuit, a first output terminal electrically connected to the other of the source and the drain of the reset transistor. The first switching circuit electrically connects one of the first and second input terminals to the first output terminal selectively in a period when the photoelectric converter is reset. The photoelectric converter is reset by use of the first voltage or the second voltage.

Abstract: The deterioration of image quality due to the mixture of light during pixel mixture is prevented. A filter that transmits a green light component is formed on a light receiving surface of a photoelectric conversion element and a filter that transmits a red light component is formed on a light receiving surface of a photoelectric conversion element. Light which is vertically incident on the filter is incident on the corresponding photoelectric conversion element. However, light which is obliquely incident on the filter is mixed with a photoelectric conversion element adjacent to the corresponding photoelectric conversion element. When pixel mixture is performed, mixed pixel data is reduced from the data of a mixed pixel to perform mixture correction.

Abstract: When distribution image data indicating a defocus distribution is generated from a plurality of sets of image data including pupil-divided image data that is captured image data corresponding to part of an exit pupil, reduced image data is used. Further, based on the distribution image data, pixel data that is to be subjected to the image processing is extracted from the pupil-divided image data corresponding to the distribution image data. The extracted pixel data, the defocus distribution image data, and captured image data corresponding to the entirety of the exit pupil are recorded or output to an external device.