Abstract: An illustrative apparatus may determine a color-skew metric for an image frame captured by an image capture system. The color-skew metric may be indicative of an extent to which the image frame skews to a particular color. Based on the color-skew metric and an adaptive target control function, the apparatus may determine a frame auto-exposure target. Based on the frame auto-exposure target, the apparatus may update one or more auto-exposure parameters for use by the image capture system to capture an additional image frame. Corresponding apparatuses, systems, and methods for managing auto-exposure of image frames are also disclosed.

Abstract: In one embodiment, a method includes a computing system collecting first sensor data, of a particular geographic location, from a first type of sensor. The computing system may process the first sensor data to identify one or more first objects at the particular geographic location. The computing system may access an existing high-definition (HD) map associated with the particular geographic location. The existing HD map includes one or more second objects and is generating using second sensor data collected with a second type of sensor. The computing system may determine whether the one or more first objects are included in the existing HD map. In response to determining that the one or more first objects are not included in the existing HD map, the computing system may update the existing HD map to generate an updated HD map that includes the first objects and the second objects.

Abstract: Embodiments include systems and methods for generating 2D and 3D layouts from a physical 3D space captured by a capturing device, the layouts having an identical scale to the physical 3D space, and estimating measurements of the physical 3D space from the layouts. The capturing device captures a point cloud or 3D mesh of the physical 3D space, from which one or more planes are identified. These one or more planes can then be used to create a virtual 3D reconstruction of the captured 3D space. In other embodiments, one plane may be identified as a floor plane, and features from the point cloud or 3D mesh that are above the floor plane may be projected onto the floor plane to create a top down view and 2D layout. Other embodiments are described.

Abstract: An image display method includes obtaining a plurality of frames of an image and displaying a first image including a first area and a second area. The first area includes a first object identified by an electronic device, and the first object is obtained from a first frame number of an image in the plurality of frames. An image of the second area is obtained from a second frame number of an image in the plurality of frames, and the first frame number is less than the second frame number.

Abstract: Systems and methods of the invention merge information from multiple image sensors to provide a high dynamic range (HDR) video. The present invention provides for real-time HDR video production using multiple sensors and pipeline processing techniques. According to the invention, multiple sensors with different exposures each produces an ordered stream of frame-independent pixel values. The pixel values are streamed through a pipeline on a processing device. The pipeline includes a kernel operation that identifies saturated ones of the pixel values. The streams of pixel values are merged to produce an HDR video.

Abstract: An imaging method is provided that includes: taking an image of an object to generate an image signal of the object; generating a taken image of the object on a basis of the image signal; detecting motion information of the object on the basis of the image signal; taking an image of the object on a basis of the motion information multiple times so as to differentiate an exposure amount thereof; and generating an HDR synthetic image of the object on the basis of a plurality of image signals whose exposure amounts are different from each other.

Abstract: In an embodiment, a system comprises a first camera including a first filter having a spectral response, a first meta-optic lens, and a first sensor. The system comprises a second camera including a second filter having a spectral response different than the spectral response of the first filter, a second meta-optic lens, and a second sensor. The system also comprises a processor configured to receive a representation of a first image of a scene captured by the first camera, receive a representation of a second image of the scene captured by the second camera, and generate a representation of a superposed image of the scene based on the representation of the first image and the representation of the second image, the representation of the superposed image having an aberration lesser than an aberration of the representation of the first image and an aberration of the representation of the second image.

Abstract: Multiple regions of a scene are identified, for example through user inputs to a touchscreen while the touchscreen displays preview frames of the scene. Multiple exposure settings are determined based on the identified regions. Each exposure setting is determined based on one of the identified regions, for instance to optimally expose that region. Multiple image frames are captured of the scene, with each image frame captured at a different one of the determined exposure settings. A high dynamic range (HDR) image of the scene is generated by merging the multiple image frames of the scene.

Abstract: A method includes displaying a face image of a user collected by a camera; obtaining makeup contours corresponding to a target makeup effect image, recognizing makeup areas corresponding to the makeup contours from the face image, and adaptively superimposing and displaying the makeup contours on the makeup areas corresponding to the makeup contours to enable the user to perform makeup based on the makeup contours.

Abstract: An image processing apparatus that composites a plurality of images that have been captured with different exposure amounts, the image processing apparatus comprising at least one processor and/or circuit configured to function as following units: a specification unit configured to specify a signal value indicating an upper limit value of an output dynamic range with respect to at least one of the plurality of images; and a decision unit configured to decide on composition percentages of the plurality of images based on the signal value specified by the specification unit.

Abstract: An imaging device (1) according to the present disclosure includes a pixel array unit (10) that includes a pixel, an analog signal generation unit, an A/D conversion unit (23), and a switch. The analog signal generation unit generates an analog signal based on a temperature around the pixel array unit (10). The A/D conversion unit (23) converts the analog signal into a digital signal. The switch cuts off the analog signal to be supplied to the A/D conversion unit.

Abstract: An image capturing apparatus comprises an image sensor configured to be capable of outputting a plurality of images with different gains with a single exposure; an acquisition unit configured to acquire, by performing a plurality of times of image capturing with different exposure times using the image sensor, a plurality of images with different gains in each of the plurality of times of image capturing; and a combining unit configured to combine the images acquired by the acquisition unit, wherein the combining unit uses an image obtained by image capturing with a longer exposure time among the plurality of times of image capturing with the different exposure times for combining for a region of a flicker light source.

Abstract: An optical tool measurement device for a machine tool is described. The device includes a light source for directing light towards a tool-sensing region and a sensor for detecting light from the tool-sensing region. A shutter assembly for selectively protecting the sensor from contamination is also provided. The shutter assembly is to provide a closed configuration in which the sensor is covered by the shutter assembly thereby preventing contamination of the sensor and an open configuration in which light can pass to the sensor through a first aperture of the shutter assembly. Furthermore, the shutter assembly is configured to additionally provide a constricted configuration in which light can pass to the sensor through a second aperture of the shutter assembly, the second aperture being smaller than the first aperture. In this manner, the device has enhanced resistance to contaminants, such as swarf and coolant, present in the machine tool environment.

Abstract: Methods and apparatus for post-processing in-camera stabilized video. Embodiments of the present disclosure reconstruct and re-stabilize an in-camera stabilized video to provide for improved stabilization (e.g., a wider crop, etc.) In-camera sensor data may be stored and used to re-calculate orientation metadata in post-production. In-camera stabilization provides several benefits (e.g., the ability to share stabilized videos from the camera without additional post-processing as well as reduced file sizes of the shared videos). Camera-aware post-processing can reuse portions of the in-camera stabilized videos while providing additional benefits (e.g., the ability to regenerate the original captured videos in post-production and re-stabilize the videos). Camera-aware post-processing can also improve orientation metadata and remove sensor error. The disclosed techniques also enable assisted optical flow-based stabilization using the refined metadata.

Abstract: An example imaging sensor comprises a bulk silicon substrate and a pixel array. The pixel array comprises an active pixel region including an active pixel subarray, an optical black pixel region including an optical black pixel subarray, and an optical black dummy pixel region including an optical black dummy pixel subarray, the optical black dummy pixel region positioned between the active pixel region and the optical black pixel region. A near-infrared absorber is positioned between the active pixel region and the optical black pixel region, the near-infrared absorber comprising a material having a higher near-infrared absorption coefficient than that of silicon.

Abstract: There is provided an image processing device including a light sensor and a processor. The light sensor is used to detect light and output an image frame. The processor identifies intensity of ambient light according to an image parameter associated with the image frame. When the ambient light is identified to be strong enough, the processor performs an object identification directly using the image frame. When the ambient light is identified to be not enough, the processor firstly converts the image frame to a converted image using a machine learning model, and then performs the object identification using the converted image.

Abstract: An image capturing apparatus that is capable of accurately acquiring motion vectors according to a photographing environment and performing blur correction with high accuracy. The image capturing apparatus includes an image sensor, and a photometry unit that performs photometry of a photographing environment. A motion vector calculation section calculates motion vectors based on images acquired by the image sensor. A camera system controller calculates a reliability of the motion vectors. A photographing condition determination section determines photographing conditions for consecutively photographing a plurality of images by the image sensor, according to a photometry result and the calculated reliability.

Abstract: A method for automatic exposure (AE) control is provided that includes receiving statistics for AE control for an image from an image signal processor (ISP) coupled to an image sensor generating the image, computing an exposure value at a current time t (EV(t)) using a cost function based on target characteristics of an image, wherein computation of the cost function uses the statistics, and computing AE settings for the image sensor based on EV(t).

Abstract: The present invention is directed to predicting and optimizing the exposure value of cameras in order to properly capture images, achieve robust and efficient calibration, and detect faults. The present invention features a method comprising displaying one or more reference images and using the camera to capture the reference image at one or more camera exposures. This allows an optimal camera exposure and an optimal reference image to be determined. The method may further comprise estimating ambient light. The method may further comprise the display device displaying an input image and identifying relative properties of the input image in comparison to the reference image. The method may further comprise predicting an optimal exposure based on the relative properties of the input image, ambient light, and the optimal reference exposure, adjusting the exposure value of the camera based on the optimal exposure, and capturing the input image at the proper exposure.

Abstract: A method of decompression includes decompressing a compressed image according to a power curve to generate a partially decompressed image, wherein the compressed image is decompressed from a second bit depth that is lower than a first bit-depth at which the image was generated.

Abstract: An imaging device may have an array of image pixels that includes red, green, blue, and infrared pixels. The imaging device may include a dual-band filter that allows transmission of light in the visible band and in the near-infrared band and may include color processing circuitry that produces a color image with marked infrared regions. The color processing circuitry may include a standard color processing pipeline with a color correction matrix that produces a tone-mapped standard red, green, and blue image and may include infrared marking circuitry. The infrared marking circuitry may include hue angle determination circuitry, cell means determination circuitry, and near-infrared determination circuitry that determine portions of the image with high infrared reflectance to be marked. The infrared-marked tone-mapped standard red, green, and blue image may be output to a machine vision system to identify objects in the imaged scene with high infrared reflection.

Abstract: There is provided an optical sensor that acquires a first image frame corresponding to a first flicker period and acquires a second image frame corresponding to a second flicker period. The optical sensor respectively adds pixel data of every two pixels in neighboring rows of the first image frame and the second image frame to generate a low-resolution image frame for the motion detection.

Abstract: An example method includes determining, by a controller of an image capture system, a plurality of sets of exposure parameter values for one or more exposure parameters. The plurality of sets of exposure parameter values are determined at an exposure determination rate. The method further includes capturing, by an image capture device of the image capture system, a plurality of images. Each image of the plurality of images is captured according to a set of exposure parameter values of the plurality of sets of exposure parameter values. The method also includes sending, by the controller of the image capture system to an image processing unit, a subset of the plurality of images. Each subset of images is sent at a sampling rate, and the sampling rate is less than the exposure determination rate.

Abstract: A method for image combination may include obtaining a first image and a second image; dividing the first image into a plurality of first image blocks and dividing the second image into a plurality of second image blocks; for each of the plurality of first image blocks, determining a first block weight based on edge information of the first image block and determining a second block weight based on overall information of the first image block; for each of the plurality of second image blocks, determining a third block weight based on overall information of the second image block; determining an exposure gain ratio based on the second block weights and the third block weights; determining a first combination weight and a second combination weight based on the exposure gain ratio; generating a third image based on the first combination weights and the second combination weights.

Abstract: The present technology relates to an imaging device, a signal processing device, a signal processing method, a program, and an imaging apparatus that are designed to reduce flicker in the imaging apparatus that does not use any imaging lens. The imaging device includes: a pixel region in which a plurality of pixels including a pixel that receives incident light and outputs one detection signal indicating an output pixel value modulated depending on the incident angle of the incident light is arranged in a row direction and a column direction, and is sequentially exposed row by row, the incident light entering from an object via neither an imaging lens nor a pinhole; and a plurality of detection regions that are disposed in different rows in the pixel region, and are used for flicker detection. The present technology can be applied to an imaging apparatus, for example.

Abstract: In one embodiment, a method of useful for generating a symmetric key includes the step of obtaining a sensor signal from a sensor of a mobile device. The method includes the step of determining one or more sampling points on said sensor signal. The method includes the step of extracting a sensor signal value at the sampling points. The method includes the step of generating the symmetric key from the sampled sensor signal value.

Abstract: The disclosure relates to a method and an associated device for detecting uneven surfaces in vehicle environments. The method comprises emitting a first ultrasonic pulse or first ultrasonic burst and emitting a second ultrasonic pulse or second ultrasonic burst, and receiving a first reflection signal of the first ultrasonic pulse or a first reflection signal of the first ultrasonic burst and receiving a second reflection signal of the second ultrasonic pulse or a second reflection signal of the second ultrasonic burst. In the further course of the method, a comparison is made of the first reflection signal with the second reflection signal, and the presence of a surface unevenness in the vehicle's environment, or the presence of a surface curvature in the vehicle's environment, is determined.

Abstract: There is provided with an image capturing device. An image capturing unit is capable of controlling an exposure condition for each region. A first acquisition unit acquires information representing a moving object region within an imaging range of the image capturing unit. A second acquisition unit acquires brightness information of each region within the imaging range of the image capturing unit. A setting unit sets the exposure condition used by the image capturing unit for each region by using the information representing the moving object region and the brightness information.

Abstract: A video capture method includes: controlling an image sensor to capture a plurality of first sensor output frames at a first frame rate during a first period; during the first period, checking if a motion blur condition is met; in response to the motion blur condition being met during the first period, controlling the image sensor to capture a plurality of second sensor output frames at a second frame rate during a second period following the first period, wherein the second frame rate is higher than the first frame rate; and processing consecutive sensor output frames captured by the image sensor during the first period and the second period, to generate a plurality of output frames.

Abstract: A display driving integrated circuit performs an adaptive frame operation. An operation method of the display driving integrated circuit includes outputting current frame data to an external display panel, starting to receive next frame data from an external device after a first time point, the first time point being a time point when a first time period elapses, the first time period immediately following a second time point at which the current frame data are completely output, and generating a vertical synchronization signal at a third time point synchronized with a cycle of an emission control signal, in response to starting to receive the next frame data.

Abstract: Systems and methods of the invention merge information from multiple image sensors to provide a high dynamic range (HDR) video. The present invention provides for real-time HDR video production using multiple sensors and pipeline processing techniques. According to the invention, multiple sensors with different exposures each produces an ordered stream of frame-independent pixel values. The pixel values are streamed through a pipeline on a processing device. The pipeline includes a kernel operation that identifies saturated ones of the pixel values. The streams of pixel values are merged to produce an HDR video.

Abstract: Imaging methods and imagers for image capture devices. Still images are captured by gathering ambient light data using an ambient light sensor of the image capture device, selecting a frame rate for the imager corresponding to the gathered ambient light data, determining optimal image capture parameters for the imager by executing an auto exposure algorithm with a processor using the selected frame rate as an initialization parameter for the auto exposure algorithm, and capturing a still image with the imager after execution of the auto exposure algorithm using the selected frame rate.

Abstract: A head-mounted display system and a 6-degree-of-freedom tracking method and apparatus thereof are disclosed. The method includes: controlling two channels of tracking cameras so that central moments of exposure durations of each frame of the two channels of tracking cameras are same, and controlling so that a lightening moment of the LED lights on the handle controller is synchronized with the middle moment of the exposure duration of an even-number frame of the two channels of tracking cameras; calculating 6-degree-of-freedom tracking data of the head-mounted display device in a three-dimensional space in real time according to acquired image data of an odd-number frame of the two channels of tracking cameras; and calculating 6-degree-of-freedom tracking data of the handle controller in the three-dimensional space in real time according to acquired image data of an even-number frame of the two channels of tracking cameras.

Abstract: To prevent the capture and transmission of excluded data, a short time-delay between an object recognition sensor and the video camera is exploited to recognize disallowed objects and control the video camera to interrupt and stop images from being transferred into the memory chip where the video signal is formed. The time-delay can also be used to enforce an alignment condition of the video camera to an allowed object. The time-delay can be implemented in real or near real time with a delay line or temporary memory chip positioned between the video camera's ROIC and memory chip. The time-delay prevents the excluded data from entering the video signal and reaching circuitry or being processed downstream of the memory chip.

Abstract: An image processing apparatus that generates, from an image data obtained through shooting, image data for display that depends on a display mode being set is disclosed. The image processing apparatus applies, in generation of the image data for display, a tone characteristic that depends on the display mode being set, to the image data. The image processing apparatus controls strength of noise reduction processing and/or sharpness processing depending on a combination of a tone characteristic applied to the image data and a display mode being set.

Abstract: An imaging device is provided. The device comprises: an imaging unit in which a plurality of pixels each including a photoelectric conversion element are arranged; a signal processor configured to process a signal output from the imaging unit; and a storage device configured to store the signal output from the imaging unit and transfer the signal to the signal processor. The storage device stores a plurality of image signals output by the plurality of pixels arranged in the imaging unit as a plurality of sub-frames and then outputs a sub-frame satisfying a predetermined condition out of the plurality of sub-frames as a signal for configuring a single frame.

Abstract: The present invention relates to a mobile terminal and a method for controlling same, the mobile terminal comprising: a camera for recording a video; a display unit for displaying a recording screen of the video being recorded through the camera; and a control unit for, when a portion of the video being recorded satisfies a video upload requirement of at least one video upload service that can be provided from the mobile terminal, controlling to display an item indicating the video upload services for which the requirement is satisfied. The present invention provides the effect of allowing a user to quickly recognize an SNS to which a recorded portion of a video currently being recorded in real time can be uploaded, and easily upload the recorded portion to the SNS.

Abstract: A video camera system includes a video capture device and a camera controller. The video capture device includes a sensor that receives light, a shutter that selectively permits the light to be received at the sensor based on a shutter speed, and a frame processor that generates a plurality of video frames based on the light. The camera controller includes a frame parameter calculator that calculates a luminance parameter of the plurality of frames, a frequency domain analyzer that executes a frequency domain analysis based on the luminance parameter to generate a plurality of luminance amplitude values mapped to a plurality of frequencies, and a control signal generator that generates a target shutter speed based on the plurality of luminance amplitude values mapped to the plurality of frequencies, and transmits a control signal based on the target shutter speed to cause the shutter to operate at the target shutter speed.

Abstract: The embodiments of the disclosure relate to an image acquisition method, a handle device, a head-mounted device and a head-mounted system. The handle device comprises a shell and a control module arranged in the shell. A switch control end of an infrared circuit is connected with the control module, and infrared light beads of the infrared circuit penetrate outwards through the shell; and a switch control end of a visible light circuit is connected with the control module, and visible light strips of the visible light circuit penetrate outwards through the shell. Through visible light and infrared light set on the handle, the position of the handle device can be judged, and the tracking accuracy is extremely high.

Abstract: An apparatus comprising a memory and a processor. The memory may comprise first parameters for an image sensor and second parameters for a LED. The processor may be configured to receive a first temperature from the image sensor, receive a second temperature from the LED, present a first adjustment to the image sensor and present a second adjustment to the LED. The first adjustment may be configured to scale the first parameters based on a difference between the first temperature and the predetermined temperature. The second adjustment may be configured to scale the second parameters based on a difference between the second temperature and the predetermined temperature. The processor may scale the first parameters and the second parameters in order to compensate for performance degradation of the image sensor caused by changes in the first temperature and the LED caused by changes in the second temperature.

Abstract: A projection method including specifying a first correspondence between a projector coordinate system and a camera coordinate system, based on a first picked-up image and a first image, determining a second correspondence between the projector coordinate system and the camera coordinate system, based on a second picked-up image and a second image, generating correction information, based on one or a plurality of first feature points in a third image acquired by converting the first picked-up image into the projector coordinate system, based on the first correspondence, and one or a plurality of second feature points corresponding to the one or plurality of the first feature points, in a fourth image acquired by converting the second picked-up image into the projector coordinate system, based on the second correspondence, and projecting the projection image that is corrected based on the correction information.

Abstract: A method of de-smearing an image includes capturing image data from an imaging sensor and collecting motion data indicative of motion of the sensor while capturing the image data. The motion data is collected at a higher frequency than an exposure frequency at which the image data is captured. The method includes modeling motion of the sensor based on the motion data, wherein motion is modeled at the higher frequency than the exposure frequency. The method also includes modeling optical blur for the image data, modeling noise for the image data, and forming a de-smeared image as a function of the modeled motion, the modeled blur, and the modeled noise, and the image data captured from the imaging sensor.

Abstract: An apparatus configured to divide a captured image into a plurality of regions and carry out imaging under a different exposure condition for each of the regions, includes an acquisition unit configured to acquire an exposure value for each of the regions in the captured image, a detection unit configured to detect a motion region based on the captured image, and a determination unit configured to determine an exposure time and a gain based on the exposure value for each of the regions and a result of detection of the motion region, wherein the determination unit sets a limitation on an adjustment range of at least any of the exposure time and the gain based on the result.

Abstract: An image sensor includes image sensor cells generating an image signal in response to one or more control signals, and a first driver generating a first control signal. The first driver includes a first positive supply terminal connected to a first power supply node. The image sensor also includes a voltage generator generating a first voltage at the first power supply node, where the voltage generator includes charge pump cells to receive clock signals and to source charge to the first power supply node, a delay line including delay line elements generating clock signals, where a first charge pump cell receives a first clock signal generated by a first delay line element, where a second charge pump cell receives a second clock signal generated by a second delay line element, and where a delay between the first clock signal and the second clock signal is determined by the delay line.

Abstract: Methods and systems are provided for obtaining cleaned sequences showing trajectories of movement of a center of gravity and for estimating a biometric information pattern or value of a target. One of the methods includes removing noises from initial sequences showing trajectories of movement of a center of gravity to obtain the cleaned sequences. Another one of the methods includes reading cleaned sequences of the target into a memory, extracting features from the cleaned sequences, and estimating a biometric information pattern or value of the target from the extracted features, using a classification or regression model of biometric information patterns or values. The biometric information pattern may be a pattern derived from respiratory or circulatory organs of a target.

Abstract: An imaging system and a method of creating composite images are provided. The imaging system includes one or more lens assemblies coupled to a sensor. When reflected light from an object enters the imaging system, incident light on the metalens filter systems creates filtered light, which is turned into composite images by the corresponding sensors. Each metalens filter system focuses the light into a specific wavelength, creating the metalens images. The metalens images are sent to the processor, wherein the processor combines the metalens images into one or more composite images. The metalens images are combined into a composite image, and the composite image has reduced chromatic aberrations.

Abstract: There is provided an image processing device including a light sensor and a processor. The light sensor is used to detect light and output an image frame. The processor identifies intensity of ambient light according to an image parameter associated with the image frame. When the ambient light is identified to be strong enough, the processor performs an object identification directly using the image frame. When the ambient light is identified to be not enough, the processor firstly converts the image frame to a converted image using a machine learning model, and then performs the object identification using the converted image.

Abstract: A control method in an imaging device is provided. The imaging device includes a pixel-cell array including a plurality of photosensitive pixel-units, each photosensitive pixel-unit of the photosensitive pixel-units includes at least two exposure pixels including at least one medium-exposure pixel. The method includes determining an ambient brightness level of a photographing environment; adjusting a first ratio to be a first value, in response to a brightness level of the photographing environment belonging to a high-level or a low-level, wherein the first ratio indicates a ratio of the at least one medium-exposure pixel in the each photosensitive pixel-unit; and adjusting the first ratio to be a second value, in response to the brightness level of the photographing environment belonging to a medium-level, wherein the low-level, the medium-level, and the high-level are in an ascending order, and the first value is greater than the second value.

Abstract: A method comprising receiving data representing light intensity values corresponding to a flicker pattern of a reference light source powered by an alternating current (AC); operating a controllable illumination source, based, at least in part, on said data; capturing, using an imaging device, a sequence of images of a scene illuminated, at least in part, by said controllable illumination source; estimating an intensity value for at least one pixel in said array, correspondingly in each of said images in said sequence of images; and determining a temporal point in said flicker pattern of said reference light source, based, at least in part, on said estimating.

Abstract: The various implementations described herein include methods, devices, and systems for implementing high dynamic range and automatic exposure functions in a video system. In one aspect, a method is performed at a video camera device and includes, while operating in a non-high dynamic range (HDR) mode: capturing first video data of a scene with the image sensor; determining whether a minimum number of pixels of the first video data meets one or more first color intensity criteria; and in accordance with the determination that the minimum number of pixels of the first video data meets the one or more first color intensity criteria, switching operation from the non-HDR mode to an HDR mode.