Abstract: The technique of dynamic mode decomposition (DMD) is disclosed herein for the purpose of robustly separating video frames into background (low-rank) and foreground (sparse) components in real-time. Foreground/background separation is achieved at the computational cost of just one singular value decomposition (SVD) and one linear equation solve, thus producing results orders of magnitude faster than robust principal component analysis (RPCA). Additional techniques, including techniques for analyzing the video for multi-resolution time-scale components, and techniques for reusing computations to allow processing of streaming video in real time, are also described herein.

Abstract: A high-speed and high-resolution pan-tilt device capable of changing a height comprises a pan unit, a tilt unit, a support bar, and a base frame. The pan unit includes a pan motor and a pan screw for rotating a camera leftward and rightward. The tilt unit includes a tilt motor and a tilt screw for rotating the camera upward and downward, and moves the entirety of the pan unit upward and downward. The support bar has a tip portion and a rear end portion. The camera is mounted on the tip portion, and is capable of being panned and tilted when an angle of the support bar is changed. The base frame supports the pan unit and the tilt unit.

Abstract: A focus detection apparatus detects a focus state of a subject using first and second pixel signals obtained by performing photoelectric conversion on subject light beams which have passed through different pupil regions of an imaging optical system. The focus state of a subject is detected from the first and second pixel signals. Further, each of the first pixel signals and second pixel signals are added by a predetermined addition number, and then the added first pixel signals and second pixel signals are relatively shifted. Thereafter, an evaluation value is calculated based on a signal obtained by adding the shifted first pixel signals and the second pixel signals and a defocus amount is detected from the evaluation value. The predetermined addition number is set in accordance with the focus state.

Abstract: An image processing apparatus for processing image signals that are obtained from an image pickup element. A correlation operation unit operates a correlation of the image signals of two images that are obtained from the image pickup element, and operates an image shift amount between images that are picked up by photoelectric conversion units, on the basis of the correlation. A detection unit detects whether or not an image signal reaches a predetermined level, and produces count information in a case that the image signal reaches the predetermined level. A controller controls the correlation operation unit, in which the controller normalizes the correlation that is used for the operation of the image shift amount, on the basis of the count information.

Abstract: An image sensor includes a pixel array disposed in a first semiconductor die. The pixel array is partitioned into a plurality of pixel sub-arrays. Each one of the plurality of pixel sub-arrays is arranged into a plurality of pixel groups. Each one of the plurality of pixel groups is arranged into a p×q array of pixel cells. A plurality of readout circuits is disposed in a second semiconductor die. An interconnect layer is stacked between the first semiconductor die and the second semiconductor die. The interconnect layer includes a plurality of conductors. Each one of the plurality of pixel sub-arrays is coupled to a corresponding one of the plurality of readout circuits through a corresponding one of the plurality of conductors.

Abstract: Disclosed is an image sensor that includes a pixel array including a plurality of unit pixels in a matrix having rows and columns, a binning sampling unit configured to (i) amplify with different gains signals from unit pixels selected from the unit pixels in each of the columns, and (ii) output a binning sampling signal according to an average of the amplified signals, and an analog-to-digital converter configured to convert the binning sampling signal to a digital signal.

Abstract: An image sensor architecture with multi-bit sampling is implemented within an image sensor system. A pixel signal produced in response to light incident upon a photosensitive element is converted to a multiple-bit digital value representative of the pixel signal. If the pixel signal exceeds a sampling threshold, the photosensitive element is reset. During an image capture period, digital values associated with pixel signals that exceed a sampling threshold are accumulated into image data.

Abstract: An image processing apparatus include a first acquirer (201, 203) configured to acquire first image data from one of a first pixel (J110a) and a second pixel (J110b) that share a single micro lens and receive light passing through different pupil areas of an optical system, a second acquirer (205) configured to acquire second image data as a sum of image data obtained from the first pixel and image data obtained from and the second pixel, and an image synthesizer (206) configured to synthesize the first image data and the second image data to generate a synthesized image, depending on an object brightness.

Abstract: Disclosed is a portable device including a first camera unit configured to capture a first image and a second camera unit configured to capture a second image; a communication unit configured to transmit and receive data to and from an external device; and a processor configured to control the first camera unit, the second camera unit, and the communication unit, wherein the processor is further configured to: detect a state of a third camera unit contained in the external device when activating at least one of the first camera unit and the second camera unit, the state of the third camera unit including an active state and an inactive state, detect a direction of the third camera unit when the third camera unit is in the active state, and activate at least one of the first camera unit and the second camera unit in a different direction from the detected direction of the third camera unit.

Abstract: A mobile terminal which is capable of capturing an image focused on according to a distance from an object, includes a camera configured to sense an object using a plurality of lenses, a display unit configured to display an image received through the camera, and a controller that is configured to recognize capturing distances between the plurality of lenses and the object using sensing information on the object, generate a focal zone, defined by focal distances corresponding to some of the recognized capturing distances, and control a display unit to output an image focusing on at least one object included in the focal zone.

Abstract: A dual-aperture zoom digital camera operable in both still and video modes. The camera includes Wide and Tele imaging sections with respective lens/sensor combinations and image signal processors and a camera controller operatively coupled to the Wide and Tele imaging sections. The Wide and Tele imaging sections provide respective image data. The controller is configured to combine in still mode at least some of the Wide and Tele image data to provide a fused output image from a particular point of view, and to provide without fusion continuous zoom video mode output images, each output image having a given output resolution, wherein the video mode output images are provided with a smooth transition when switching between a lower zoom factor (ZF) value and a higher ZF value or vice versa, and wherein at the lower ZF the output resolution is determined by the Wide sensor while at the higher ZF value the output resolution is determined by the Tele sensor.

Abstract: Disclosed are an image capture apparatus that includes an image sensor capable of acquiring parallax images, and calculates the amount of parallax while reducing the amount of data that is to be transmitted or recorded, and a method for controlling the same. The image capture apparatus less frequently outputs a second image signal than a first image signal, wherein the first image signal is generated based on all of the photoelectric signals of the plurality of photoelectric conversion units of each pixel, and wherein the second image signal is generated based on at least one of but not all of the photoelectric signals.

Abstract: A solid-state imaging device includes: an R pixel provided with an R filter for transmitting red-color light; a B pixel provided with a B filter for transmitting blue-color light; an S1 pixel which is provided with an S1 filter with a visible light transmittance independent of wavelengths in a visible light region and has a sensitivity higher than that of the R pixel; and an S2 pixel which is provided with an S2 filter with a visible light transmittance independent of wavelengths in the visible light region and lower than the visible light transmittance of the S1 filter and has a sensitivity lower than the sensitivity of the S1 pixel.

Abstract: An electronic apparatus is described. The electronic apparatus includes: an image sensor including a plurality of image pixels and a plurality of focal point detection pixels; an auto-focus (AF) detection unit that detects an AF value based on a first focal point detection signal output from a first focal point detection pixel from the plurality of focal point detection pixels and a second focal point detection signal output from a virtual second focal point detection pixel corresponding to the first focal point detection pixel; and a control unit that generates image data based on an image signal output from the plurality of image pixels and the AF value detected by the AF detection unit.

Abstract: A telescoping monopod apparatus including a holder configured to hold an image acquisition module having a field of vision, and a support holding a mirror to be in proximity to a lens of the image acquisition module, the mirror is configured to enable the image acquisition module to capture an image outside the field of vision, and a body housing a control component and an electronic component configured to actuate the telescoping monopod apparatus and the support. The body is operatively connected to the holder. A tracking method including receiving an input from a user, detecting, by an image acquisition module, a feature, and adjusting a mirror to track the feature.

Abstract: Disclosed herein is an image pickup circuit including: amplifying means for amplifying a charge corresponding to an amount of light received by a photodetector, and outputting a pixel signal; ramp signal generating means for generating a ramp signal whose voltage drops with a fixed slope from a predetermined initial voltage; and comparing means for comparing the pixel signal output by the amplifying means with the ramp signal output by the ramp signal generating means. A reference potential of the pixel signal output by the amplifying means and a reference potential of the ramp signal output by the ramp signal generating means are at a same level.

Abstract: A stacked-type solid-state image sensor including a first semiconductor layer in which an imaging pixel portion is implemented, and a second semiconductor layer in which a digital signal processing unit is implemented, comprises a first timing control unit configured to generate a drive timing signal of the imaging pixel portion, an A/D converter configured to convert an analog signal output from each pixel of the imaging pixel portion into a digital signal, a second timing control unit configured to generate a drive timing signal of the A/D converter; and a status generation unit configured to receive an event signal generated by at least one of the first timing control unit and the second timing control unit and generate a status signal to restrict an operation of the digital signal processing unit.

Abstract: A solid-state imaging apparatus includes: a pixel unit (1) configured to perform imaging of a plurality of frames by a photoelectric conversion; an exposure amount calculating unit (9) configured to calculate exposure amounts of the plurality of frames imaged in a flicker cycle of a light source; and a control unit (12) configured to control the exposure amount of each of the frames imaged by the pixel unit based on the exposure amounts of the plurality of frames calculated by the exposure amount calculating unit.

Abstract: According to one of aspects, an electronic device includes: a camera; a controller configured to determine whether a measured value of a healthcare device is included in an image captured by the camera; and a communication unit configured to transmit information related to the measured value to an information providing device when the measured value is included in the image.

Abstract: Image processing apparatus and method of calculating distance information and size information of an object within an image frame are provided. The method of processing an image includes: sequentially moving a focus lens from infinity to a short distance; overlapping and storing frames including an object focused at each movement location of the focus lens; and displaying a synthesis frame that synthesizes the overlapped frames in one frame, and simultaneously, calculating relative distance information of objects focused at different locations of the focus lens based on an object focused at an arbitrary location of the focus lens, and displaying the relative distance information in the synthesis frame.