Abstract: An image capturing system includes a light source configured to emit light toward an object or scene that is to be imaged. The system also includes a time-of-flight image sensor configured to receive light signals based on reflected light from the object or scene. The system also includes a processor operatively coupled to the light source and the time-of-flight image sensor. The processor is configured to perform compressive sensing of the received light signals. The processor is also configured to generate an image of the object or scene based at least in part on the compressive sensing of the received light signals.

Abstract: The present technology relates to a solid-state imaging device and an electronic apparatus that enable simultaneous acquisition of a signal for generating a high dynamic range image and a signal for detecting a phase difference. The solid-state imaging device includes a plurality of pixel sets each including color filters of the same color, for a plurality of colors, each pixel set including a plurality of pixels. Each pixel includes a plurality of photodiodes PD. The present technology can be applied, for example, to a solid-state imaging device that generates a high dynamic range image and detects a phase difference, and the like.

Abstract: An optical sensor according to one or more embodiments is an optical sensor including an optical member including a plurality of focusing units, each focusing unit focusing light from a subject, and a plurality of image capturing devices, each image capturing device including a plurality of light-receiving elements, each image capturing device being provided corresponding to one of the focusing units, and each image capturing device configured to receive light focused by the corresponding focusing unit and form a captured image of the subject. The light-receiving elements, of the plurality of light-receiving elements, that are to be used to form the captured image are set for each of the image capturing devices.

Abstract: To satisfactorily detect an edge detection signal of a high frequency band from a captured image signal at all times. A filtering unit extracts an edge detection signal of a high frequency band from an image signal obtained from imaging, and a band control unit controls the high frequency band on the basis of lens information. For example, the filtering unit includes a first high-pass filter with a first cutoff frequency, a second high-pass filter with a second cutoff frequency that is lower than the first cutoff frequency, and an ? blending unit that performs ? blending on output of the first high-pass filter and output of the second high-pass filter. Even if the frequency of the edge detection signal included in the captured image signal varies due to a change in a zoom position, a lens model number, an F value or the like, the edge detection signal can be satisfactorily detected at all times.

Abstract: An image processing apparatus is operable to determine a focus target area of an image capturing apparatus. The apparatus comprises: an obtainment unit configured to obtain a first area to be a focus target in a first image captured by the image capturing apparatus at a first point in time, a detection unit configured to detect a second area to be a focus target candidate from a second image captured by the image capturing apparatus at a second point in time succeeding a first point in time; and a determination unit configured to determine, based on the first area and the second image, a focus target area in the second image from among one or more partial areas in the second area.

Abstract: Apparatus and methods for applying motion blur to overcapture content. In one embodiment, the motion blur is applied by selecting a number of frames of the captured image content for application of motion blur; selecting a plurality of pixel locations within the number of frames of the captured image content for the application of motion blur; applying motion blur to the captured image content in accordance with the selected number of frames and the selected plurality of pixel locations; and outputting the captured image content with the applied motion blur. In some implementations, motion blur is applied via implementation of a virtualized neutral density filter. Computerized devices and computer-readable apparatus for the application of motion blur are also disclosed.

Abstract: A detection unit detects a subject area that partially includes a subject to be detected in a shooting range. An obtainment unit obtains a plurality of defocus amounts corresponding to a plurality of ranging points inside a ranging area that includes the subject area. A categorization unit categorizes the ranging area into a plurality of partial areas based on the plurality of defocus amounts. Each of the plurality of partial areas corresponds to a different one of partial ranges in a range of the plurality of defocus amounts. A control unit performs shooting control based on the plurality of partial areas. The shooting control is performed so that a contribution of a partial area with a first subject degree is larger than a contribution of a partial area with a second subject degree that is lower than the first subject degree.

Abstract: A focus detection apparatus comprises a determination unit that determines whether a first signal output from an image sensor satisfies a predetermined condition, and outputs first information indicating a result of the determination, a calculation unit that performs filter processing on a plurality of the first signals using predetermined coefficients at a predetermined cycle and outputs a second signal, a generation unit that generates second information showing an effect of the first signal which satisfies the predetermined condition on the second signal using the coefficients and plural pieces of the first information corresponding to the plurality of the first signals used in the filter processing, and a focus detection unit that detects a focus state based on a plurality of the second signals and the second information.

Abstract: Apparatus and methods employing a PDAF optical system are disclosed herein. An example apparatus includes an image sensor comprising a plurality of pixels. The plurality of pixels include a set of pixels configurable to be imaging pixels or focus pixels. The image sensor is configured to generate image data of a scene based on received light at the plurality of pixels. The example apparatus also includes a processor coupled to the image sensor. The processor may be configured to receive first image data of a first frame of the scene, determine at least one region of interest or region of non-interest of the first frame, select, based on the determined at least one region of interest or region of non-interest, a subset of the set of pixels to be focus pixels, and cause the selected subset of the set of pixels to operate as focus pixels.

Abstract: Methods and systems for providing a video stream along with a slow motion video showing a particular event depicted in the video stream are described herein. The method includes generating a first video stream and generating a second video stream, which is a slow motion video stream, from the first video stream by modifying a playback speed of the first video stream. The method includes monitoring content of the first video stream to identify an event trigger of a predefined set of event triggers. Each event trigger indicates a presence in the first video stream of an event that is to be generated for display using the second video stream. The method includes determining, based on the identifying of the event trigger, to transmit the second video stream along with the first video stream, and simultaneously transmitting both the first video stream and the second video stream.

Abstract: A method of an apparatus includes detecting a focusing state based on an output from a sensor, setting a step width of a focus position, and controlling to perform a plurality of times of image capturing based on a result of focus detection by the detecting and the set step width by the setting. In the setting, a step width from an in-focus position based on the result of focus detection by the detecting toward an infinity side is set to a value different from a step width from the in-focus position based on the result of focus detection by the detecting toward a closest side.

Abstract: The present technology relates to a solid-state imaging device and an electronic apparatus that enable simultaneous acquisition of a signal for generating a high dynamic range image and a signal for detecting a phase difference. The solid-state imaging device includes a plurality of pixel sets each including color filters of the same color, for a plurality of colors, each pixel set including a plurality of pixels. Each pixel includes a plurality of photodiodes PD. The present technology can be applied, for example, to a solid-state imaging device that generates a high dynamic range image and detects a phase difference, and the like.

Abstract: A sensor device includes an array sensor having a plurality of detection elements arrayed in one or two dimensional manner, a signal processing unit configured to acquire a detection signal by the array sensor and perform signal processing, and a calculation unit. The calculation unit detects an object from the detection signal by the array sensor, and gives an instruction for making a frame rate of the detection signal from the array sensor variable on the basis of the detection of the object.

Abstract: An image processing device includes a memory and a color correction circuit. The memory stores first correction information that used for correcting first pixel values among a plurality of pixel values. The plurality of pixel values are received from an auto-focus image sensor including first pixels configured to detect a phase difference and second pixels configured to detect an image. The first pixel values are obtained from the first pixels and correspond to a first color. The first correction information is used for correcting the first pixel values to correspond to a second color different from the first color. The color correction circuit receives first image frame data including the plurality of pixel values from the auto-focus image sensor, loads the first correction information from the memory, and generates first corrected image frame data by correcting the first pixel values included in the first image frame data to correspond to the second color based on the first correction information.

Abstract: A light emitting element detecting method includes the steps of generating a first control signal to open a shutter of an image capturing device which captures an image toward a light outlet of a light emitting element, generating a pulse signal to light up the light emitting element, generating a second control signal to close the shutter of the image capturing device and obtaining a detection image, and determining the light emitting status of the light outlet of the light emitting element according to the detection image. As a result, the present invention can accurately detect whether the light outlet of the light emitting element has the problem of emitting no light or flashing.

Abstract: Improved fluoresced imaging (FI) and other sensor data imaging processes, devices, and systems are provided to enhance use of endoscopes with FI and visible light capabilities. A first optical device is provided for endoscopy imaging in a white light and a fluoresced light mode with an image sensor assembly including one or more image sensors. A mechanism in the first optical device to automatically adjust the focus of the first optical device wherein the automatic focus adjustment compensates for a chromatic focal difference between the white light image and the fluoresced light image caused by the dispersive or diffractive properties of the optical materials or optical design employed in the construction of the first or second optical devices, or both. Adjustment mechanisms are provided using liquid lenses or repositioning sensors. The design may be integrated with a scope or detachable.

Abstract: Auto-focus method and a remote sensing satellite are disclosed. The satellite comprises at least a focal plane assembly (FPA) and a focus adjusting apparatus, the auto-focus method comprises: processing a point spread function (PSF) estimation to a multiple regions of a first image to generate multiple first estimated point spread functions; generating a first average point spread function according to the first estimated point spread functions; processing a Gaussian curve fitting to the first average PSF function and defining a first focus number; processing a PSF estimation to multiple regions of a second image to generate multiple second estimated PSF functions; generating a second average point spread function according to the second estimated point spread functions; processing a Gaussian curve fitting to the second average point spread function and defining a second focus number; and comparing the first focus number and the second focus number.

Abstract: An imaging device in which an autofocus function can be performed without using brightness information is provided. In an imaging device according to one aspect, a density of points obtained by plotting two-dimensional point data of a plurality of event data as points on a plane, the event data outputted from an imaging element in a predetermined period in a state in which a focal point of a light receiving lens is adjusted by an adjustment mechanism, is calculated as a point density. When the point density is calculated, a control unit drives and controls the adjustment mechanism based on comparison results between the point density currently calculated and the point density last calculated to thereby adjust the focal point toward the in-focus position. In another aspect, an imaging device having an autofocus function can be provided without using event data.

Abstract: A robotic system automatically aligns, and/or tests alignment of, a lens to a digital camera or other workpiece. The system includes an optical target, an intermediate lens and a plurality of collimators peripheral to the intermediate lens to accommodate a wide range of fields of view of the workpieces, without requiring changes in equipment hardware. When manufacturing or testing a workpiece with a relatively narrow field of view, the entire field of view of the workpiece can be filled with a view of the target through the intermediate lens, and the collimators need not be used. However, when manufacturing or testing a camera having a relatively large field of view, the intermediate lens is used to fill a central portion of the field of view with an image of the target, and the collimators are used to fill a remaining portion of the field of view with images of reticles.

Abstract: An image capturing method is provided. The method includes: shooting a monitoring scene at the same time through multiple image capturing devices to capture multiple images corresponding to multiple focal lengths at a same time point; recognizing a target area of each of the captured images according to multiple focal sections; keeping multiple target sub-images in the target areas of the images, in which multiple object images in the target sub-images are all focused; directly generated a single reconstructed image corresponding to the time point according to the target sub-images; and outputting the reconstructed image.

Abstract: Examples of the present disclosure disclose data processing methods, apparatuses and storage media. The data processing method includes: obtaining a plurality of video images of a target site within a predetermined time range; performing pedestrian identification processing on the plurality of video images to obtain, based on the identification result, a customer counting result for a first region in the target site and a customer counting result for a second region in the target site; and determining a degree of association between the second region and the first region based on the customer counting result for the first region and the customer counting result for the second region.

Abstract: The present disclosure describes systems and techniques directed to producing an all-in-focus image with a camera of a mobile device, in particular, cameras with shallow depth-of-field. User equipment includes a sensor for determining distance to an object in a camera's field-of-view. Based on a depth map of the field-of-view, a plurality of segments is inferred, each segment defining a unique focus area within the camera's field-of-view. An autofocus lens of the camera sweeps to a respective focal distance associated with each of the plurality of segments. The camera captures sample images at each focal distance swept by the autofocus lens. The user equipment produces an all-in-focus image by combining or merging portions of the captured sample images.

Abstract: The present disclosure discloses a method for compensating for image quality of an optical system by means of a lens adjustment, applicable to a camera module comprising an adjustable lens or an adjustable lens set, the method comprising the following steps: (A) determining, based on imaging information of a to-be-adjusted optical system, parameters that need to be adjusted for compensating for the image quality; (B) establishing functions of relation between the parameters that need to be adjusted for compensating for the image quality and a to-be-adjusted lens factors; and (C) determining an adjustment mode and an adjustment amount for the to-be-adjusted lens based on the relation between the parameters that need to be adjusted for compensating for the image quality and the to-be-adjusted lens factors.

Abstract: This invention provides a removably mountable lens assembly for a vision system camera that includes an integral auto-focusing liquid lens unit, in which the lens unit compensates for focus variations by employing a feedback control circuit that is integrated into the body of the lens assembly. The feedback control circuit receives motion information related to the bobbin of the lens from a position sensor (e.g. a Hall sensor) and uses this information internally to correct for motion variations that deviate from the lens setting position at a desired lens focal distance setting. Illustratively, the feedback circuit can be interconnected with one or more temperature sensors that adjust the lens setting position for a particular temperature value. In addition, the feedback circuit can communicate with an accelerometer that reads a direction of gravity and thereby corrects for potential sag in the lens membrane based upon the spatial orientation of the lens.

Abstract: An apparatus for viewing a biological sample that functions as both a microscope and an interferometer. A short-coherence light source directs light onto the sample. A Fourier transform lens and a pixel-array detector are positioned to collect light scattered by the sample. An optic fiber assembly conveys a reference beam from the short-coherence light source. The detector collects the reference beam and the signal beam and uses coherence gating to acquire interferometric image data. In some embodiments the axis of the incident light striking the sample and the axis of collected scattered signal light form an angle of less than 180 degrees and advantageously an angle between 120 and 150 degrees. A method of converting a microscope into an interferometer is also disclosed.

Abstract: The present disclosure relates to an image processing apparatus and method, a program, and an image processing system that enable detection of a positional and directional shift of a camera while the vehicle is running. An image processing IC performs a calibration process on four cameras, using image signals from the four cameras, sensing information from a sensing chip, and information detected from a drive system unit or the like from a control microcomputer. For example, the image processing calibrates at least the orientations of the cameras disposed at the front and the rear, in accordance with the infinite point in the running background. Using the correction values obtained through the orientation calibration, the image processing IC generates overhead images of the respective cameras.

Abstract: An imaging apparatus and method enables an automated extended depth of field capability that automates and simplifies the process of creating extended depth of field images. An embodiment automates the acquisition of an image “stack” or sequence and stores metadata at the time of image acquisition that facilitates production of a composite image having an extended depth of field from at least a portion of the images in the acquired sequence. An embodiment allows a user to specify, either at the time of image capture or at the time the composite image is created, a range of distances that the user wishes to have in focus within the composite image. An embodiment provides an on-board capability to produce a composite, extended depth of field image from the image stack. One embodiment allows the user to import the image stack into an image-processing software application that produces the composite image.

Abstract: An image processing apparatus combines a partial area of a first image with a second image. The partial area to be combined with the second image is determined based on distance information with regard to a plurality of partial areas of the first image.

Abstract: Embodiments of the present invention are directed toward providing refocusable image. Refocusable images are images that, after being captured, can be refocused, or adjusted to have a different focal length. The embodiments described herein can utilize a mobile user device, such as a smartphone, without the need for specialized hardware. A camera of the mobile device can be configured to take a series of images in succession over a short period of time in which the focal length of the camera is varied so that each image has a different focal length. An image stack is created by aligning the images, and images are processed to determine which image has the highest contrast (i.e., is in focus) for each region of the image stack. Embodiments can further include displaying a first image of the series of images.

Abstract: An imaging apparatus includes an imaging unit including a plurality of pixels each including a first photoelectric conversion unit, a second photoelectric conversion unit, and a microlens collecting light to the first photoelectric conversion unit and the second photoelectric conversion unit, and a first mixing unit configured to mix output signals from the first photoelectric conversion units of the plurality of pixels to generate a first signal and configured to output the first signal and a second signal based on the output signal from the first photoelectric conversion unit and an output signal from the second photoelectric conversion unit from each of the plurality of pixels, an image processing unit configured to generate an image based or the second signal, and a focus detection processing unit configured to perform focus detection based on the first signal and the second signal.

Abstract: Image pickup information output apparatus which outputs information about image pickup condition derived from combination of positions/states of condition decision members serving as optical members that affect fulfillment of the condition, comprising: setting unit for setting a condition setting value as the condition to be fulfilled; controller for driving one of the condition decision members to control its position/state based on the condition setting value, condition calculator for calculating information about the condition as calculated condition based on the combination of positions/states of the condition decision members; determination unit for determining whether or not the condition setting value changed; decision unit for determining the information about condition to be output, based on the calculated condition and the determination made by the determination unit as to whether or not the condition setting value changed; and output unit for outputting information about the condition to be output

Abstract: A system for improved camera focusing systems using subject location tags. More particularly, the disclosed subject matter relates to providing a system comprising camera accessories and in-lens technologies that allows for the continuous, automated focus of a subject by measuring the distance between the camera and a subject that has been “tagged” with a locator beacon.

Abstract: A method, process, and associated systems for automatically selecting and masking areas of a still image or frame of a video clip as a function of depth-information metadata embedded into the image or frame. An image-editing or video-editing workstation receives an image or frame into which has been embedded a set of depth values. Each depth value identifies a distance from the camera position of an object depicted by a pixel of the image or frame. When a user directs the workstation to automatically select or mask a region of the image or frame, the workstation uses the depth values, optionally in conjunction with other graphical properties of each pixel, to automatically select which pixels to include in the selection or mask such that the selection or mask identifies an approximate area of the image or frame that represents a three-dimensional object.

Abstract: The present disclosure provides a mobile terminal comprising: a main body of the terminal; a holography module attached to the main body of the terminal and positioned so as to output a holographic image into a preset space; and a first camera module arranged in the direction of the preset space so as to film the holographic image. Also, the present invention provides a system for controlling holography comprising the mobile terminal and a target apparatus. The target apparatus is configured so as to film the holographic image by communicating with the mobile terminal or to analyze the holographic image and generate an operational command corresponding thereto.

Abstract: An information processing method and an electronic device are provided. The method includes: controlling a first lens of a first image acquisition unit to move from a first position in a first direction, and controlling a second lens of a second image acquisition unit to move from the first position in a second direction opposite to the first direction; obtaining at least one first focus value in a first focus area corresponding to the first image acquisition unit during said moving in the first direction, and obtaining at least one second focus value in a second focus area corresponding to the second image acquisition unit during said moving in the second direction; performing a first calculation on the at least one first focus value and the at least one second focus value to obtain a third focus value; and controlling the first and second image acquisition units to implement focusing based on the third focus value.

Abstract: An imaging device, comprising an interchangeable lens having a photographing optical system whose focal length can be varied, comprises a zoom position detection section for detecting a zoom position in accordance with focal length of the imaging optical system, and a lens control section for controlling movement of a focus lens contained in the imaging optical system, wherein the lens control section corrects position that the focus lens is moved to in accordance with the zoom position before movement of the focus lens and zoom position during movement of the focus lens.

Abstract: The present invention provide an imaging device that includes an image generation device, a boundary change device configured to change a position of a boundary between the first image and the second image in the second image for display, in a direction orthogonal to the boundary, a selection device configured to select any one of the first image and the second image for each of a plurality of divisions in the second image for display, divided by the boundary changed by the boundary change device, a display device, and a display control device configured to allow the display device to display the first image for display, and allows the second image for display in which a position of the boundary is changed by the boundary change device to be displayed in a display area in the first image for display.

Abstract: In order to trigger an out of focus alert when the focus level of a video frame meets a focus criteria, a method is performed including the operations of: receiving a video frame, partitioning the video frame into a plurality of blocks, calculating an array of discrete cosign transformation (DCT) coefficients for at least one of the plurality of blocks using a DCT, classifying each of the at least one of the plurality of blocks based on the array of DCT coefficients for that block, calculating a focus level of the video frame from the block classifications, and triggering an out of focus alert if the focus level meets a focus criteria.

Abstract: Processing images of a scene taken with different focus includes, for each of at least some of the images, determining at least one portion of the image having a predetermined characteristic. A representation of the scene is generated that includes an array of elements, where each of at least some of the elements corresponds to a determined portion of at least one of the images. An element of the array is based on a correspondence between a distance associated with a determined portion of at least one image and a focused distance associated with at least one image. The generated representation is stored or provided as output.

Abstract: A method for displaying a visual warning signal to warn a driver of a vehicle about a traffic situation that is determined to be critical. The visual warning signal displayed to the driver is based on sensor data furnished by at least one sensor unit that determines a line of sight of the driver. A display unit for displaying the visual warning signal is selected from a group of at least two separately controllable display units depending on the line of sight of the driver.

Abstract: In order to trigger an out of focus alert when the focus level of a video frame meets a focus criteria, a method is performed including the operations of: receiving a video frame, partitioning the video frame into a plurality of blocks, calculating an array of discrete cosine transformation (DCT) coefficients for at least one of the plurality of blocks using a DCT, classifying each of the at least one of the plurality of blocks based on the array of DCT coefficients for that block, calculating a focus level of the video frame from the block classifications, and triggering an out of focus alert if the focus level meets a focus criteria.

Abstract: An image pickup apparatus which can reduce the time required for automatic focus scanning. The size of the face is determined based on information on a subject's face, which is detected from image data acquired by shooting by an image pickup device. The subject distance is estimated based on the determined size of the face. The depth of field is calculated. A range over which the focus lens is driven varies according to the estimated subject distance and the calculated depth of field.

Abstract: The prevent invention is to provide a solid-state imaging device having a electrode configuration applicable to a progressive scan, and able to reduce a obstruction of incident light at the periphery of a light receiving portion, a method of producing the same, a camera including the same. A first transfer electrode, a second transfer electrode, and a third transfer electrode which have a single layer transfer electrode configuration are repeatedly arranged in a vertical direction. The first transfer electrodes are connected in a horizontal direction by an inter-pixel interconnection formed in the same layer. Shunt interconnections are formed in the horizontal direction and in the vertical direction above the transfer layers. The shunt interconnection connected to the second transfer interconnection is formed on the inter-pixel interconnection. The shunt interconnection connected to the third transfer electrode is formed above the transfer electrodes.

Abstract: A camera having a depth of field which can be modified to produce desired photographic effects. The camera determines the depth of field for a subject when the subject is focused upon. A modification to the depth of field is determined based upon the distance to the subject, and the depth of field is modified to produce the desired photographic effect. In one embodiment, the depth of field is reduced, while, in another embodiment, the depth of field is shifted to place the subject slightly out of focus and to alter the focus of the background.

Abstract: An auto-focus apparatus including an evaluation value calculator periodically calculating evaluation values using high frequency components of image signals in a specific region of a subject image, a distance measurement unit measuring a distance to a subject and output a distance measurement result, a control unit outputting instruction values based on the evaluation values and determining whether a subject image is in-focus or out-of-focus, and a storage storing the distance measurement results and lens positions. In the apparatus, after searching the peak of the evaluation values, the control unit returns the lens to the position at which the relative maximum has been detected, obtains evaluation values, stores lens positions and distance measurement results when the evaluation values satisfy a prescribed condition, and retrieves distance measurement results and lens positions when the number of times that results are stored reaches a prescribed number, and computes a correction amount.

Abstract: An auto focusing device for a camera includes a focus detecting section which detects a focused state of an image taking lens an AF mode setting section sets an AF mode of the camera to either a first AF mode or a second AF mode. An auxiliary light emitting section emits an auxiliary light to the object in association with the focus detecting operation by the focus detecting section if the object has a low luminance. An emission control section limits the number of times that the auxiliary light emitting section emits the auxiliary light to the object to one per a predetermined number of operations by the focus detecting section if the AF mode setting section has set the AF mode to the second AF mode.