Abstract: A method for increasing a dynamic range of a dual-pixel image sensor is described. The method includes detecting an intensity level of a full pixel from a plurality of pixels of an optical sensor, one or more full pixels of the plurality of pixels includes at least two sub-pixels, detecting an intensity level of one or more sub-pixels, detecting that the intensity level of the full pixel of the optical sensor has reached a saturation level of the full pixel, and in response to detecting that the intensity level of the full pixel of the optical sensor has reached the saturation level of the full pixel, computing an extrapolated intensity level of the full pixel based on the intensity level of the one or more sub-pixels.

Abstract: Disclosed are an imaging system and an imaging method thereof. The system includes a light source, a light source modulator, an objective lens, a sensor array, a sensor read-write module and an imaging display module connected with the sensor read-write module. The light source modulator is configured for modulating the light source to a preset frequency; the objective lens is configured for imaging an optical signal reflected by a surface of a target object on the sensor array; the sensor array is configured for converting the received optical signal into an analog alternating current electrical signal; the sensor read-write module is configured for amplifying the analog alternating current electrical signal and extracting a target signal, converting the target signal into a digital signal and storing the digital signal; and the imaging display module is configured for restoring and displaying an image of the target object according to the digital signal.

Abstract: The present technology relates to an image pickup element, a control method, and an image pickup device which realize easier and more diversified data output. In one aspect of the present technology, a plurality of signal lines for transmitting a pixel signal read from a pixel is allocated to each column, and different reading modes of the pixel signals are respectively allocated to the signal lines of each column. Regarding each column of the pixel array connected to the pixel corresponding to the mode, the pixel signal is read from the pixel connected to the signal line corresponding to the reading mode of the pixel signal in the mode, and the read pixel signal is transmitted via the signal line. The present technology is applied to, for example, an image pickup element and an image pickup device.

Abstract: An image sensor may include a polydimethylsiloxane (PDMS) layer that is subwavelength, hydrophobic, and/or antireflective. The PDMS layer may be fabricated to include a surface having a plurality of nanostructures (e.g., an array of convex protuberances and/or an array of concave recesses). The nanostructures may be formed through the use of a porous anodic aluminum oxide (AAO) template that uses a plurality of nanopores to form the array of convex protuberances and/or the array of concave recesses. The nanostructures may each have a respective width that is less than the wavelength of incident light that is to be collected by the image sensor to increase light absorption by increasing the angle of incidence for which the image sensor is capable of collecting incident light. This may increase the quantum efficiency of the image sensor and may increase the sensitivity of the image sensor.

Abstract: A method of determining a focus setting for an image capture device. The method comprises, for each of a plurality of image zones: obtaining a first value of a focus metric for the respective image zone using a first image captured with a first focus setting for the image capture device; obtaining a second value of the focus metric for the respective image zone using a second image captured with a second focus setting for the image capture device; and processing the first value and the second value to obtain an estimated focus setting for the respective image zone. The focus setting is determined by performing a weighted sum of the estimated focus setting for at least two of the plurality of image zones.

Abstract: An image sensor including: a pixel array including a plurality of pixels and a row driver configured to drive the pixel array, wherein each of the plurality of pixels includes at least one photodiode, a transmission transistor, a selection transistor, a device isolation structure, and a bulk area, and the row driver is configured to adjust, for each of preset periods, sizes and application timings of a negative voltage applied to the device isolation structure and a bulk control voltage applied to the bulk area while a first pixel is driven.

Abstract: Systems and methods are presented for capturing a video in real-time by an image capture device using a skeletal pose system. The skeletal pose system identifies first pose information in the video, applies a first virtual effect to the video in response to identifying the first pose information, identifies second pose information in the video, and applies a second virtual effect to the video in response to identifying the first pose information.

Abstract: An arithmetic logic unit (ALU) includes a front end latch stage coupled to a signal latch stage coupled to a Gray code (GC) to binary stage. First inputs of an adder stage are coupled to receive outputs of the GC to binary stage. Outputs of the adder stage are generated in response to the first inputs and second inputs of the adder stage. A pre-latch stage is coupled to latch outputs of the adder stage. A feedback latch stage is coupled to latch outputs of the pre-latch stage. The second inputs of the adder stage are coupled to receive outputs of the feedback latch stage. The feedback stage includes first conversion gain feedback latches configured to latch outputs of the pre-latch stage having a first conversion gain and second conversion gain feedback latches configured to latch outputs of the pre-latch stage having a second conversion gain.

Abstract: A system for recording video in a wearable device is provided. The system includes: a barrel to provide mechanical support for one or more components in the system, a camera, disposed inside the barrel, wherein the camera includes a front lens with a field of view pointed to an onlooker outside of the wearable device, a cover glass mounted on the barrel, the cover glass configured to protect the front lens and one or more components in the system, a light emitting device, disposed inside the barrel, and a light pipe configured to receive a light from the light emitting device and to transmit the light through an overlap area on the cover glass and to the onlooker, when the camera is recording a scene outside of the wearable device, within the field of view, wherein the camera field of view comprises at least a portion of the overlap area.

Abstract: A video may be captured by an image capture device in motion. A stabilized view of the video may be generated by providing a punchout of the video. The punchout of the video may compensate for rotation of the image capture device during capture of the video. The size of the punchout of the video may be changed based on different rotational positions of to provide a view that includes different extents of the captured visual content. The changes in the size of the punchout may simulate changes in zoom of the visual content.

Abstract: Apparatus and method for filming a scene using a plurality of strobable lighting setups in rapid sequence to concurrently record a plurality of motion picture clips of the scene, one motion picture clip for each strobable lighting setup. The apparatus includes a plurality of strobable light sources that are coordinated to form the plurality of lighting setups, a controller to actuate the strobable lighting setups at a constant rate in a sequence that repeats multiple times during each macro frame, and a camera to capture a burst sequence of images within each macro frame. The burst sequence of images shows the scene illuminated by each one of the plurality of lighting setups in sequence during each macro frame. Since the constant rate is above the flicker threshold, people on set viewing the scene illuminated by the repeating sequence of strobable lighting setups perceive apparently continuous (non-flickering) illumination of the scene.

Abstract: Disclosed in one embodiment is a sensor driving device comprising: a first sensor for outputting first incline information; a fixing unit including a plurality of magnets; a plurality of coils arranged to face the plurality of magnets; and a second sensor for outputting second incline information, and also comprising: a moving unit arranged to be spaced from the fixing unit; an image sensor coupled to the moving unit; a support unit of which one end is connected to the fixing unit and the other end is connected to the moving unit, and which elastically supports the moving unit; and a control unit for controlling an electric signal provided to the plurality of coils by using the first incline information and the second incline information.

Abstract: A method of artificial neural network computations, including: receiving image data having pixel values; generating, from the pixel values, a column of inputs to a set of artificial neurons; identifying a region of memory cells of the integrated circuit device having threshold voltages programmed to represent a weight matrix for the set of artificial neurons; instructing voltage drivers in the integrated circuit device to apply voltages to the region of memory cells according to the column of inputs; obtaining, based on the region of memory cells responsive to the applied voltages, a first column of data from an operation of multiplication and accumulation applied on the weight matrix and the column of inputs; and applying activation functions of the set of artificial neurons to the first column of data to generate a second column of data representative of outputs of the set of artificial neuron.

Abstract: There is provided an image pickup element including a non-planar layer having a non-planar light incident surface in a light receiving region, and a microlens of an inorganic material which is provided on a side of the light incident surface of the non-planar layer, and collects incident light.

Abstract: A photoelectric conversion apparatus includes a pixel, an A/D conversion portion and an output circuit. The pixel includes first and second photoelectric conversion portions and an accumulation portion configured to accumulate a signal charge in a location other than the photoelectric conversion portions. The A/D conversion portion is configured to perform A/D conversions on signals based on signal charges generated in the photoelectric conversions. The output circuit reads out first and second signals based on first and second signal charges accumulated in the first and second photoelectric conversion portions during an electric charge accumulation period and a third signal based on a third signal charge generated in the second photoelectric conversion portion and accumulated in the accumulation portion during the electric charge accumulation period. Conversion periods for analog-to-digital conversion to be performed on at least two of the first, second, or third signals have different lengths.

Abstract: An electronic device is provided, which includes a display; an under display camera (UDC); a processor; and a memory that stores instructions, which when executed, causes the processor to receive a first image from the UDC, generate a second image by lowering a resolution of the first image, obtain a third image representing a difference between the second image and an image corresponding to the second image in which artifacts are not present, generate a fourth image by increasing the resolution of the third image, and generate a fifth image by subtracting the fourth image from the first image.

Abstract: Imaging devices are disclosed. In one example, an imaging device includes a pixel array with light-receiving pixels that are separated pixel lines, and that accumulating electric charge in an accumulation period. An exposure controller sets time lengths of the accumulation such that the time lengths repeat in predetermined order. The accumulation period includes a first accumulation period and a second accumulation period each having a first time length, and a third accumulation period and a fourth accumulation period each having a second time length. A processor generates image data by adding pixel values based on the accumulation result in a first pixel line in the first accumulation period, the accumulation result in a second pixel line in the second accumulation period, the accumulation result in the first pixel line in the third accumulation period, and the accumulation result in the second pixel line in the fourth accumulation period.

Abstract: In some examples, a sensor apparatus comprises: a pixel cell configured to generate a voltages, the pixel cell including a photodiode configured to generate charge in response to incoming light, and a charge storage device to convert the charge to a voltage; an integrated circuit configured to: determine a first captured voltage converted by the charge storage device during a first time period; compare the first captured voltage to a threshold voltage value; and in response to determining that the first captured voltage meets or exceeds the threshold voltage value: determine first time data corresponding to the first time period; and prevent the charge storage device from further generating a charge; and an analog-to-digital converter (ADC) configured to generate a digital pixel value based on the first captured voltage, and a memory to store the digital pixel value and the first time data.

Abstract: Analog power savings is achieved by pre-charging only those pixels of a sensor array that are needed as determined responsive to any one of a power configuration, image size, image position of interest, desired/selected frame rate, desired/selected resolution, etc. To that end, the solution presented herein selects one or more sensor segments, each comprising a subset of pixels of the sensor array, and only pre-charges the pixels in the selected segment(s). In so doing, the solution presented herein provides a power savings proportional to the number of uncharged pixel circuits.

Abstract: Provided are a vision sensor, an image processing device including the vision sensor, and an operating method of the vision sensor. The vision sensor includes a plurality of pixels arranged in a matrix form, wherein each of the plurality of pixels includes: a sensing circuit configured to output an output voltage by sensing a change of light; a comparison circuit configured to output a comparison signal indicating whether an event has occurred by comparing the output voltage to an event threshold; and an event detection circuit configured to generate internal event signals by sampling the comparison signal at each of a plurality of sampling time points, and configured to output a valid event signal based on the internal event signals.