Abstract: Image synthesis system are disclosed for synthesizing a global shutter image based on a rolling shutter image. The rolling shutter image is captured by an aerial camera system having at least one rolling shutter camera and the rolling shutter image has a plurality of scanlines, the scanlines having associated different position and pose information. The image synthesis system is arranged to project a rolling shutter image captured by a rolling shutter camera to object space, such as by projecting each scanline of the rolling shutter image using position and pose information associated with the scanline, and subsequently from object space to a synthetic global shutter image.

Abstract: A method, performed by a device, of processing an image, may include obtaining a circular image generated by photographing a target space through a fisheye lens; generating metadata including lens shading compensation information for correcting color information of the obtained circular image; and transmitting the obtained circular image and the metadata to a terminal.

Abstract: An electronic device includes an electronic display configured to present an image based on image data and a display pipeline having image processing circuitry to process the image data for display on the electronic display by receiving the image data, referencing a lookup table (LUT) to determine output values based on a plurality of input value sets associated with the image data, the LUT including entries respectively mapping an output value to a defined input value set, determining whether an input value set of the plurality of input value sets is represented by the entries of the LUT, performing curvature interpolation to determine an interpolated output value associated with the input value set in response to determining the input value set of the image data is not represented by the entries of the LUT, and applying the interpolated output value to the input value set to generate updated image data.

Abstract: A computing system may determine, for a current frame, a viewer's current eye position with respect to a waveguide of a display, identify eye positions that collectively form a grid of eye positions surrounding the current eye position, obtain, from a memory on the display, compressed arrays of scaling factors for correcting non-uniformities of the waveguide at the identified eye positions, perform interpolation based on the compressed arrays to generate an array of scaling factors for the current eye position, adjust pixel values of the current frame based on the customized array, and output the current frame with the adjusted pixel values to the display. The compression operation may include dithering or converting pixel values to a different color space. The interpolation may be performed on the compressed arrays or on results of a decompression operation. The customized array may be up-sampled prior to adjusting the pixel values.

Abstract: A method includes projecting an augmented reality (AR) user interface (UI) at a first position on a surface of a head-mounted display (HMD) device through which a view of a real-world scene is seen by a viewer, and detecting a motion of the HMD device corresponding to a head motion of the viewer. The method further includes, in response to the motion of the HMD device, moving the projected AR UI across the surface of the HMD device to a second position, the movement of the projected AR UI spatially and or temporally lagging the head motion.

Abstract: An electronic apparatus and a method by which the electronic apparatus provides recommendation information related to photography are provided. The method includes identifying a subject included in a preview image recognized by a first camera, obtaining information of the identified subject, obtaining information related to light in surroundings of the identified subject, determining a recommended photographing composition based on the information of the identified subject and the information related to the light in the surroundings of the subject, and providing information about the determined recommended photographing composition.

Abstract: An image sensor may include adaptive filtering circuitry that is used to correct for row noise. In one example, the image sensor may include a single reference pixel or a column of reference pixels that are shielded from incident light. The adaptive filtering circuitry may estimate row noise based on data from the reference pixel(s). Row noise correction circuitry may then subtract the estimated row noise from imaging pixel outputs to correct for row noise. If the row noise is dominated by supply noise, the reference pixels may be omitted entirely and the adaptive filtering circuitry may estimate row noise based only on the power supply voltage. The adaptive filtering circuitry may undergo a training phase to optimize coefficients for the adaptive filtering circuitry.

Abstract: An image sensing device includes first and anterior comparators and first and second posterior comparators. The first anterior comparator generates a first anterior comparison signal based on a first pixel signal and a ramp signal. The first posterior comparator performs a first comparison that compares the first anterior comparison signal with a first reference signal under a first comparison precondition and generates a first posterior comparison signal corresponding to a result of the first comparison. The second anterior comparator generates a second anterior comparison signal based on a second pixel signal and the ramp signal. The second posterior comparator performs a second comparison that compares the second anterior comparison signal with a second reference signal under a second comparison precondition different from the first comparison precondition. The second posterior comparator generates a second posterior comparison signal corresponding to a result of the second comparison.

Abstract: An image sensing device includes a first test block, a second test block, and a readout block. The first test block includes a plurality of first image sensing pixels structured to convert incident light carrying an image into a first pixel signal indicative of the image, and a first heating element structured to transmit heat to the first image sensing pixels. The second test block includes a plurality of second image sensing pixels that each include a light blocking structure to be shielded from receiving incident light to generate a second pixel signal without being directly exposed to the incident light, and a second heating element structured to transmit heat to the second image sensing pixels. The readout block processes the first pixel signal output from the first test block and the second pixel signal output from the second test block.

Abstract: State of the art techniques in the domain of video analysis have limitations in terms of capability to extract the spatial and temporal information. This limitation in turn affects interpretation of the video data. The disclosure herein generally relates to video analysis, and, more particularly, to a method and system for video analysis to extract spatio-temporal information from a video being analyzed. The system uses a neural network architecture which has multiple layers to extract spatial and temporal information from the video being analyzed. The method of training the neural network that extracts a micro-scale information from a latent representation of the video is presented. This is generated using an attention network, which is then used to extract spatio-temporal information corresponding to the collected video, which is then used in multiple video analysis applications such as searching actions in videos, action detection and localization.

Abstract: A system for detecting specular surfaces, the system including an image sensor that captures image data from an area, a first light emitter that emits a first light into the area from a first position, a second light emitter that emits a second light into the area from a second position, and control circuitry. The control circuitry operates to acquire first image data from the image sensor while the first light emitter is active and the second light emitter is inactive, acquire second image data from the image sensor while the second light emitter is active and the first light emitter is inactive, and process the first image data with the second image data to identify non-overlapping image data between the first image data and the second image data as a specular surface.

Abstract: An analog-to-digital conversion circuit includes a convertor configured to perform a first comparison operation for sensing a noise based on a reset signal and to perform a second comparison operation for sensing raw data to output data which is obtained by removing the noise from the raw data, and a ramp voltage generator configured to generate a ramp voltage used for the first comparison operation and the second comparison operation and to output the ramp voltage to the convertor. The ramp voltage generator includes a first current source for supplying a bias current for generating the ramp voltage in response to a first control signal, a second current source for supplying a boost current for generating the ramp voltage in response to a second control signal, and a generation circuit for generating the ramp voltage based on the bias current and the boost current.

Abstract: Imagers and associated devices and systems are disclosed herein. In one embodiment, an imager includes a pixel array and control circuitry operably coupled to the pixel array. The pixel array includes an imaging pixel configured to produce a reset signal and a non-imaging pixel configured to produce a nominal reset signal. The control circuity is configured to produce an output signal based at least in part on one of (a) the nominal reset signal when distortion at the imaging pixel exceeds a threshold and (b) the reset signal when distortion does not exceed the threshold.

Abstract: In a terminal, a selecting unit selects one generation method from a plurality of generation methods for reference signals (sounding reference signals (SRSs)). A radio transmitting unit transmits reference signals (SRSs) generated in accordance with the selected generation method.

Abstract: When imaging bright objects, a conventional detector array can saturate, making it difficult to produce an image with a dynamic range that equals the scene's dynamic range. Conversely, a digital focal plane array (DFPA) with one or more m-bit counters can produce an image whose dynamic range is greater than the native dynamic range. In one example, the DFPA acquires a first image over a relatively brief integration period at a relatively low gain setting. The DFPA then acquires a second image over longer integration period and/or a higher gain setting. During this second integration period, counters may roll over, possibly several times, to capture a residue modulus 2m of the number of counts (as opposed to the actual number of counts). A processor in or coupled to the DFPA generates a high-dynamic range image based on the first image and the residues modulus 2m.

Abstract: An imaging system for generating a high dynamic range (HDR) image includes a pixel array that includes first pixels and second pixels, a driver circuit configured to control the first pixels based on a first exposure time and control the second pixels based on a second exposure time, an output circuit configured to output first pixel values of the first pixels and second pixel values of the second pixels from the pixel array, and a processing device configured to generate the HDR image based on a first Bayer image and a second Bayer image, where the first Bayer image is generated based on the first pixel values and the second Bayer image is generated based on the second pixel values and third pixel values of the first Bayer image. The quantity of pixels of the first pixels may be greater than the quantity of pixels of the second pixels.

Abstract: A prediction image correcting device comprises a predictor (108) configured to predict a target image block obtained by dividing a present image frame by using a plurality of reference images to generate a prediction image corresponding to the target image block a prediction accuracy evaluator (109) configured to evaluate prediction accuracy of the prediction image based on a degree of similarity between the plurality of reference images used for generating the prediction image and a corrector (110) configured to perform correction processing on the prediction image by using a decoded neighboring block adjacent to the target image block, wherein the corrector is configured to control the correction processing based at least on an evaluation result of the prediction accuracy evaluator.

Abstract: Provided is an imaging device that includes a rear display and an electronic viewfinder and is excellent in operability to a touch panel when an electronic viewfinder is used. When a user performs a touch manipulation on a touch panel installed in a rear display in order to set a focus area, an effective detection area for detecting a touch position is different between when the rear display is used and when the electronic viewfinder is used. When the rear display is used, the effective detection area is set to coincide with the entire display screen, and when the electronic viewfinder is used, the effective detection area is set to be reduced to an area of a part of the display screen of the rear display.

Abstract: An imaging device according to the present disclosure includes an imaging unit, a connector, and a converter. The imaging unit includes a first signal line, a first pixel, a second signal line, and a second pixel. The first pixel outputs a first pixel voltage to the first signal line. The first pixel voltage corresponds to an amount of received light. The second pixel outputs a second pixel voltage to the second signal line. The second pixel voltage corresponds to the amount of received light. The connector includes a connection line, a first connection switch, a first control circuit, a second connection switch, and a second control circuit. The converter is coupled to the first signal line and the second signal line. The converter performs AD conversion on the basis of each of the first pixel voltage and the second pixel voltage.

Abstract: A photoelectric conversion apparatus includes a control unit configured to change a voltage of an input node from a first voltage toward a predetermined voltage during a predetermined time period after the voltage of the input node changes to the first voltage and before the voltage of the input node changes to a second voltage. A method of driving the photoelectric conversion apparatus includes controlling changing of the voltage of the input node from the first voltage toward the predetermined voltage during the predetermined time period.

Abstract: The present technology relates to an imaging apparatus, an imaging method, and a program that perform appropriate exposure control, to thereby enable a desired object to be appropriately imaged. The present technology includes: an imaging unit including a plurality of pixels having different spectral characteristics; and an exposure control unit setting information associated with exposure control on the plurality of pixels depending on specification information for specifying a kind of a measurement target. Alternatively, the present technology includes: an imaging unit including a plurality of pixels having different spectral characteristics; and an exposure control unit setting information associated with exposure control on the plurality of pixels on the basis of a predicted output value of each of the plurality of pixels based on a spectral characteristic related to a measurement target. The present technology is applicable to an imaging apparatus which senses vegetation, for example.

Abstract: This invention provides an imaging apparatus comprising a storage storing correction values, a correction circuit which corrects captured image data based on the correction values, a first memory and a second memory, a transferring circuit which transfers the correction values in the storage to the correction circuit, a write circuit which writes the transferred correction values to either the first memory or the second memory, and a controller which controls, in a case where a transfer time of the correction values is longer than a time for image capture processing of one frame, so that, over an image capturing period of a plurality of frames, the write circuit writes new correction values to one of the first and second memory and the correction circuit corrects the captured image data using the current correction values in the other memory.

Abstract: Disclosed is an image sensing device including a current supply circuit coupled between a supply terminal of a first voltage and a pair of output terminals, an input circuit coupled between the pair of output terminals and a common node, and suitable for receiving a pixel signal and a ramp signal, and a mirroring circuit coupled between the common node and a supply terminal of a second voltage, and suitable for compensating for an operating current, which flows between the common node and the supply terminal of the second voltage, based on a reference current when generating the operating current by mirroring the reference current.

Abstract: A Light Detection and Ranging (LIDAR) apparatus includes one or more optical elements configured to direct incident light in one or more directions, and a detector array including a plurality of detector pixels configured to output detection signals responsive to light provided thereto by the one or more optical elements. The light includes scattered light that is redirected relative to the one or more directions. A circuit is configured to receive the detection signals and generate corrected image data based on the detection signals and an expected spread function for the light. Related devices and methods of operation are also discussed.

Abstract: An apparatus includes a memory and a processing circuit. The memory may be configured to store image data of an image. The processor circuit may be configured to (a) copy the image data of the image from the memory to a first memory buffer of the processor circuit, (b) calculate first vector values for each pixel location in the image using the image data stored in the first memory buffer, (c) calculate second vector values for each pixel location in the image using the image data stored in the first memory buffer and the first vector values, (d) transform the image data stored in the first memory buffer by adding the second vector values to corresponding image data, (e) storing the transformed image data to the memory, and (f) repeating steps (a) through (e) until the image data of the image has been transformed.

Abstract: An imaging device includes a pixel array with a plurality of pixels each configured to generate a reset signal and an image signal, a sampling circuit including a plurality of samplers connected to column lines, where each sampler generates a first comparison signal by comparing the reset signal with a ramp signal and generates a second comparison signal by comparing the image signal with the ramp signal. An ADC converts each of the first and second comparison signals into a digital signal. Each sampler performs an auto-zero operation for initializing itself before performing the comparing with respect to the reset signal in a first mode, and performs a respective auto-zero operation before performing the comparing for each of the reset signal and the image signal in a second mode.

Abstract: A material generation apparatus includes an acquisition unit configured to acquire a plurality of camera images, and a material data generation unit configured to generate, based on a camera image selected from among the camera images, at least one of a foreground image and a background image as material data to be used for generation of an image corresponding to a designated viewpoint.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for deblurring an image captured by a robot-mounted camera. One of the methods comprises capturing, using a camera that is attached to an arm of a robot, an image at a first time, wherein the image exhibits motion blur, and wherein the exhibited blur was caused by movement of the arm of the robot at the first time; receiving, from a robot control system of the robot, motion data characterizing the movement of the arm of the robot at the first time; generating a motion kernel using the received motion data; and generating a deblurred image by processing the image using the motion kernel.

Abstract: An image sensor including a pixel of a first tap. a pixel of a second tap. an operational amplifier configured to perform an auto zeroing operation with a pixel signal of the pixel of the second tap applied, and perform an operation for comparison between a ramp voltage and a signal output from the pixel of the first tap, with a pixel signal of the pixel of the first tap applied, and a counter circuit configured to generate a digital code in response to an output of the operational amplifier.

Abstract: An imaging device includes: an effective pixel region that includes a plurality of imaging elements-A, amplifies signal charges generated by photoelectric conversion, and reads the signal charges into a drive circuit; and an optical black region that includes a plurality of imaging elements-B, surrounds the effective pixel region, and outputs optical black that serves as the reference for black level. In the imaging device, the photoelectric conversion layer forming the plurality of imaging elements-A and the plurality of imaging elements-B is a common photoelectric conversion layer, the common photoelectric conversion layer is located on an outer side of the optical black region, and extends toward an outer edge region surrounding the optical black region, and an outer edge electrode is disposed in the outer edge region.

Abstract: An imaging device includes a pixel unit having a plurality of pixels forming a plurality of rows and a plurality of columns, and a readout unit that divides the pixel unit into a plurality of pixel blocks based on a division pattern, each pixel block including at least two pixels, and combines signals from the at least two pixels included in one pixel block to generate one signal for each of the pixel blocks. A detection unit detects a change in signal values between a plurality of signals sequentially generated by the readout unit of the one pixel block. A control unit controls the readout unit to output a signal individually from each of the pixels included in at least one pixel block in response to detecting a change in the signal values, and controls the readout unit so that the division patterns are different in at least two frames.

Abstract: An imaging device includes pixels each including a photoelectric converter, and a control unit that controls an accumulation period for charge in the pixels. The pixels are divided into pixel blocks, the control unit is configured to control the accumulation period for each pixel block, the pixel blocks include first and second pixel blocks and a third pixel block arranged between the first and second pixel blocks, and the control unit includes a mode to commonly control the accumulation period in the first and third pixel blocks and control the accumulation period in the second pixel block independently of that of the first and third pixel blocks, and a mode to commonly control the accumulation period in the second and third pixel blocks and control the accumulation period in the first pixel block independently of that of the second and third pixel blocks.

Abstract: An image sensor, includes: a plurality of pixels arranged along a first direction, each of which includes a photoelectric conversion unit that generates an electric charge through photoelectric conversion of light, and outputs a signal generated based upon the electric charge generated in the photoelectric conversion unit; a first signal line to which signals from one or more pixels among the plurality of pixels are output; a second signal line to which a signal from another pixel among the plurality of pixels is output; and an arithmetic unit that executes an arithmetic operation with a signal generated by combining the signals from the one or more pixels output to the first signal line and the signal output to the second signal line.

Abstract: An imaging device includes: a photoelectric converter including a first electrode, a second electrode, and a photoelectric conversion layer that generates a signal charge; a charge accumulator connected to the first electrode to accumulate the signal charge; a first voltage supply circuit connected to the second electrode and that selectively supplies at least two different voltages including a first voltage and a third voltage greater than the first voltage; and a second voltage supply circuit that is connected to the charge accumulator via capacitance and that selectively supplies at least two different voltages including a second voltage and a fourth voltage less than the second voltage, where in a first period in which the first voltage supply circuit supplies the first voltage, the first period being included in an accumulation period for accumulating the signal charge in the charge accumulator, the second voltage supply circuit supplies the second voltage.

Abstract: A column analog-to-digital converter and the local counting method is provided. The column analog-to-digital converter includes a plurality of analog-to-digital converters in parallel. Each of the analog-to-digital converters includes a comparator and a counting circuit. The comparator compares the ramp voltage with one of the plurality of column signals to generate a comparator output signal. The counting circuit triggers a delay line circuit of the counting circuit to generate first delay data according to the comparator output signal, re-triggers the delay line circuit to generate first re-trigger delay data according to a base clock, and compares the first delay data with the first re-trigger delay data to generate a first counting output.

Abstract: A solid-state imaging device includes a plurality of pixels each of which includes a photoelectric conversion unit that generates charges by photoelectrically converting light, and a transistor that reads a pixel signal of a level corresponding to the charges generated in the photoelectric conversion unit. A phase difference pixel which is at least a part of the plurality of pixels is configured in such a manner that the photoelectric conversion unit is divided into a plurality of photoelectric conversion units and an insulated light shielding film is embedded in a region for separating the plurality of photoelectric conversion units, which are divided, from each other.

Abstract: To make it possible to obtain a natural virtual viewpoint image in which a structure or the like existing within an image capturing scene is represented three-dimensionally so as to be the same as a real one while suppressing a network load at the time of transmission of multi-viewpoint image data. The generation device according to the present invention generates a virtual viewpoint image based on three-dimensional shape data corresponding to an object, three-dimensional shape data corresponding to a structure, background data corresponding to a background different at least from the object and the structure, and information indicating a virtual viewpoint.

Abstract: A camera module includes a lens, a first magnet and a second magnet mounted on a mobile body including the lens, a coil portion arranged near the first magnet and configured to move the first magnet in a first direction, and the magnetic sensor arranged near the second magnet and configured to detect the position of the second magnet in the first direction as a detection direction.

Abstract: An electronic device is disclosed. An electronic device according to various embodiments may comprise a memory, a communication module, and a processor, wherein the processor is configured to: identify a raw image; on the raw image, perform image processing according to a designated first image signal processing set; transmit the raw image, for which the image processing according to the designated first image signal processing set has at least partially been performed, to an external electronic device by using the communication module during the image processing; and transmit information corresponding to the at least partial processing to the external electronic device so as to allow the external electronic device to omit, by using the raw image, for which the image processing has at least partially been performed, processing corresponding to the at least partial processing among a designated second image signal processing set included in the external electronic device.

Abstract: A camera module includes: a lens module including a plurality of lenses; a housing accommodating the lens module; a reflection module disposed in front of the lens module; an image sensor module configured to receive light passing through the lens module; and a light blocking portion disposed in the housing and positioned in a space between the lens module and the image sensor module. The light blocking portion includes: a first light blocking plate including a first window having a first opening through which the light is allowed to pass; and a second light blocking plate including a second window having a second opening through which the light is allowed to pass. The first window includes a first inner wall including a first inclined surface, and the second window includes a second inner wall including a second inclined surface.

Abstract: An imaging sensor comprising: an imaging chip in which a plurality of pixel are arranged in a matrix; and a signal processing chip that is each provided for one or more pixel columns or one or more pixel rows, has a device that performs signal processing on a pixel signal output from a pixel, and is stacked with the imaging chip is provided. For example, the device that performs signal processing is an A/D converter that converts a pixel signal output from the pixel into a digital signal, and when a pixel signal output from the pixel is converted into a digital signal, at least two or more A/D converters among the A/D converters are controlled in parallel.

Abstract: A processing device comprises a memory configured to store data and a processor. The processor is configured to control an exposure timing of a rolling shutter image sensor and an IR illumination timing of an object, by an IR light emitter, by switching between a first operation mode and a second operation mode. In the first operation mode, a sequence of video frames, each having a plurality of pixel lines, comprises a frame in which each pixel line is exposed to IR light emitted by the IR light emitter; a frame which is partially exposed to the IR light and a frame in which no pixel line is exposed to the IR light. In the second operation mode, alternating video frames of the sequence comprise one of a frame in which each pixel line is exposed to the IR light and a frame in which no pixel line is exposed to the IR light.

Abstract: In implementations of correcting dust and scratch artifacts in digital images, an artifact correction system receives a digital image that depicts a scene and includes a dust or scratch artifact. The artifact correction system generates, with a generator of a generative adversarial neural network (GAN), a feature map from the digital image that represents features of the dust or scratch artifact and features of the scene. A training system can train the generator adversarially to reduce visibility of dust and scratch artifacts in digital images against a discriminator, and train the discriminator to distinguish between reconstructed digital images generated by the generator and real-world digital images. The artifact correction system generates, from the feature map and with the generator, a reconstructed digital image that depicts the scene of the digital image and reduces visibility of the dust or scratch artifact of the digital image.

Abstract: An image processing apparatus comprises reduction unit configured to reduce predetermined disturbance in a frame image shot by an image sensor; estimation unit configured to estimate from at least one first frame image from which the disturbance is reduced, a second frame image of a point of time after the first frame image using a learning model; and addition unit configured to add the disturbance to the second frame image.

Abstract: An apparatus includes an optical sensor configured to capture a plurality of input images. The apparatus also includes an analog circuit configured to produce a difference of Gaussians image for each of the input images. The apparatus further includes at least one processor configured to (i) determine motion error in the input images based on comparing the difference of Gaussians image and (ii) adjust at least some of the input images based on the determined motion error.

Abstract: A pixel array including a first pixel having a first transistor having: its control node coupled to a first photodiode; a first of its main conducting nodes coupled to a voltage output rail; and a second of its main conducting nodes coupled to a further voltage rail; a variable impedance coupling the voltage output rail to a first supply rail of the pixel array; and a current source coupling the further voltage rail to a second supply rail of the pixel array, wherein the variable impedance is controlled based on the voltage level on the further voltage rail.

Abstract: Devices, systems and methods are described. A method includes driving a first light source to generate a visible light pulse having a first intensity for a first duration to illuminate a scene. An image sensor is used to record a visible-spectrum image of the scene illuminated by the first light pulse. A second light source is driven to generate a second light pulse having a second intensity that exceeds the first intensity by at least 100% for a second duration that is at most 10% of the first duration to illuminate the scene during the first duration. An image sensor is used to record a monochrome image of the scene illuminated by the second light pulse. Image processing is performed on a visible-spectrum image and the monochrome image to obtain the digital image of the scene.

Abstract: An image sensor pixel noise suppression circuit having a source follower transistor based pixel circuit, a power supply voltage and noise mirror circuit, a power supply voltage and noise gain circuit, and a comparator circuit. An output of the comparator circuit provides an image related output signal wherein the noise component of the source follower signal has been suppressed. The invention further includes a CMOS image sensor containing the image sensor pixel noise suppression circuit.

Abstract: A request to play a media content item is received. It is determined whether the play request is ambiguous. Responsive to determining that the play request is ambiguous, then it is determined whether to play a suspended media content item or an alternate media content item. The determination can be made based on a length of time that the suspended media content item has been suspended, a media content item type, or a state, among other factors. Responsive to the determination, playback of the suspended or alternate media content item is initiated.

Abstract: A display panel is provided with a display region and a non-display region, and includes a plurality of sub-pixels, located in the display region; a plurality of fingerprint recognition units, located in the display region; and ambient-light sensing units, including at least one first light-sensing unit. At least a part of the plurality of fingerprint recognition units is multiplexed as the at least one first light-sensing unit.