Abstract: Identifying activity in an area even during periods of poor visibility using a video camera and an audio sensor are disclosed. The video camera is used to identify visible events of interest and the audio sensor is used to capture audio occurring temporally with the identified visible events of interest. A sound profile is determined for each of the identified visible events of interest based on sounds captured by the audio sensor during the corresponding identified visible event of interest. Then, during a time of poor visibility, a subsequent sound event is identified in a subsequent audio stream captured by the audio sensor. One or more sound characteristics of the subsequent sound event are compared with the sound profiles associated with each of the identified visible events of interest, and if there is a match, one or more matching sound profiles are filtered out from the subsequent audio stream.

Abstract: A method of image analysis is provided for recognition of a pattern in an image. The method includes receiving a plurality of images acquired by a camera, where the plurality of images include a plurality of optical patterns in an arrangement. The method also includes matching the arrangement to a pattern template, wherein the pattern template is a predefined arrangement of optical patterns. The method also includes identifying an optical pattern of the plurality of optical patterns as a selected optical pattern based on a position of the selected optical pattern in the arrangement. The method also includes decoding the selected optical pattern to generate an object identifier and storing the object identifier in a memory device.

Abstract: A memory device is provided including instructions that, when executed, cause one or more processors to perform the steps including receiving a plurality of images acquired by a camera, the plurality of images including a plurality of optical patterns, wherein an optical pattern of the plurality of optical patterns encodes an object identifier. The steps include presenting the plurality of images comprising the plurality of optical patterns on a display, and presenting a plurality of visual indications overlying the plurality of optical patterns in the plurality of images. The steps also include identifying a selected optical pattern of the plurality of optical patterns based on a user action and a position of the selected optical pattern in one or more of the plurality of images. The steps also include decoding the selected optical pattern to generate the object identifier and storing the object identifier in a second memory device.

Abstract: Provided is a method of reconstructing an integral image based on computational integral imaging reconstruction (CIIR), the method including determining a crop ratio of an original elemental image array (EIA), cropping each elemental image in the original EIA according to the determined crop ratio to generate a cropped and translated EIA, magnifying each elemental image in the cropped and translated EIA according to an adjustable magnification factor (k), overlapping the magnified elemental images with an overlapping number that is adjusted according to the adjustable magnification factor (k), and normalizing the overlapping elemental images to generate a reconstructed image.

Abstract: Methods of calibrating a light-field imaging system, a light-field imaging system to perform the calibration methods, a calibration target for the calibration methods, and methods of projecting a light-field image into object space with a calibrated light-field imaging system. An exemplary calibration method is performed with a light-field imaging system including a microlens array and an image sensor. A z-stack of light-field images of a calibration target may be captured using the image sensor, while the calibration target is on the stage and located at a plurality of different z-positions. A total magnification of the imaging system and a microlens magnification of the microlens array may be determined from each light-field image of the z-stack.

Abstract: A method of capturing video includes instructing a microphone to initiate an audio scan of different areas of interest to detect audio activity. The method also includes receiving a feedback signal from the microphone in response to initiating the audio scan. The feedback signal indicates audio activity in a particular area of interest. The method further includes adjusting targeting characteristics of a device based on the feedback signal to focus the device on the particular area of interest.

Abstract: An image capturing apparatus including an audio input unit and a driving unit attenuates or disables driving sounds of the driving unit and post-driving sounds as appropriate to reduce unnecessary sounds and improve usefulness of audio data, and an image capturing apparatus including an image capturing unit, a panning/tilting unit configured to change an image capturing direction, and an audio input unit attenuates or disables an audio-related function while the panning/tilting unit is driving and until a predetermined determination condition is satisfied after the driving.

Abstract: Systems and methods for synthesizing high resolution images using image deconvolution and depth information in accordance embodiments of the invention are disclosed. In one embodiment, an array camera includes a processor and a memory, wherein an image deconvolution application configures the processor to obtain light field image data, determine motion data based on metadata contained in the light field image data, generate a depth-dependent point spread function based on the synthesized high resolution image, the depth map, and the motion data, measure the quality of the synthesized high resolution image based on the generated depth-dependent point spread function, and when the measured quality of the synthesized high resolution image is within a quality threshold, incorporate the synthesized high resolution image into the light field image data.

Abstract: An accelerometer includes a controller, a light source operatively coupled to the controller, and a bifurcated waveguide coupled to the light source and configured to receive light output by the light source. The bifurcated waveguide includes a first waveguide portion and a second waveguide portion. The accelerometer also includes a first resonator operatively coupled to the controller and configured to receive light from the first waveguide portion, and a second resonator operatively coupled to the controller and configured to receive light from the second waveguide portion. The first resonator includes a first proof mass, and the second resonator includes a second proof mass.

Abstract: Provided are an image pickup apparatus and method capable of improving a resolution of an image having depth information. The image pickup apparatus may include: a main lens configured to refract incident light; an image sensor comprising a plurality of two-dimensional (2D)-arranged pixels configured to output an image signal according to the incident light; a micro lens array between the main lens and the image sensor and comprising a plurality of 2D-arranged micro lenses; and a controller configured to receive the image signal from the image sensor and to generate an image according to the received image signal, wherein the controller is configured to obtain a plurality of images having different depths of field by changing a distance between the main lens and the image sensor and to obtain at least one depth map from the at least one of the obtained plurality of images.

Abstract: A described example system may include a connection engine, a capture engine, and a command engine. In that example, the connection engine wirelessly connects to an imaging device having a media location for placing media; the capture engine captures an image of media at the media location; and the command engine coordinates movement of the media in response to a capture operation or in preparation to perform the capture operation. In another example, an imaging device includes a media tray, a pick, a processor resource, and a memory resource having executable instructions that cause coordination of the pick to, in response to an indication that a sheet of media is captured from a capture device, generate movement of the sheet of media away from the media tray or movement the sheet of media on to the media tray.

Abstract: Device for providing a playable sequence in renderable manner comprises: a providing unit for providing defined functions, said functions for applying playable effects to objects, a time unit for adding time boundaries to said functions, to provide time bounded functions, an ordering unit for ordering said time bounded functions into a sequence, and a translation unit for applying translations to said objects in accordance with said effects.

Abstract: An imaging device for photoelectric conversion includes a plurality of pixels receiving light fluxes from an exit pupil of an optical system. At least part of the pixels are ranging pixels, each including a plurality of photoelectric conversion sections configured to receive light fluxes from a plurality of pupil areas in the exit pupil and a waveguide formed by a core and a clad that guides the light fluxes to the photoelectric conversion section. At least some of the ranging pixels include respective attenuating members arranged in the clad at a position opposite to the photoelectric conversion sections corresponding to pupil areas containing a large number of light fluxes representing a large angle relative to the normal at the pixel center of the ranging pixel having the attenuating member with regard to the pupil division direction on the ranging pixel corresponding to the displacement direction of the pupil areas.

Abstract: An image pickup element includes a pixel matrix, a pupil dividing portion, and a shielding portion. Pixels in the pixel matrix include a photoelectric conversion portion, and are arranged in units of a matrix of a predetermined number of the pixels. The pupil dividing portion is arranged on a side of a light receiving surface of the photoelectric conversion portion of each pixel to divide a pupil region. The shielding portion arranged between the pupil dividing portion and the photoelectric conversion portion shields a predetermined region of the light receiving surface of the photoelectric conversion portion. The predetermined region of each pixel corresponds to any one of the divided pupil regions obtained when the pupil region is divided by the pupil dividing portion. A proportion of the predetermined region is smaller than a proportion of a region not-shielded by the shielding portion in the light receiving surface.

Abstract: An imaging apparatus includes: an imaging device; a lens optical system including a focus lens for condensing light toward the imaging device; a driving section configured to driving one of the imaging device and the focus lens to change a position to which a focus is adjusted on an object side; a shutter provided at at least one of the imaging device and a position between the lens optical system and the imaging device; and a control unit configured to control the shutter and the driving section, wherein the control unit drives the imaging device or the focus lens such that a focus is adjusted to each of first to third focusing positions of different object distances and controls the shutter and the driving section such that image signals of first to third object images at the first to third focusing positions are obtained by the imaging device.

Abstract: Light field image processing includes generating a projected image using a light source, wherein the projected image includes a sharp feature, capturing a first light field image of a scene including the projected image, and determining, using a circuit block, a distance for the sharp feature from the first light field image.

Abstract: According to one embodiment, a camera module includes a second imaging optical system and an image processing section. The second imaging optical system forms an image piece. The image processing section has at least one of an alignment adjustment section, a resolution restoration section, and a shading correction section and has a stitching section. The stitching section joins the image pieces, subjected to at least one of alignment adjustment, resolution restoration, and shading correction, together to form a subject image.

Abstract: An apparatus and method improve sight. The apparatus includes a first sight configured to view a scene. A second sight is configured to alter content representative of the scene in a first manner to form first altered content. A third sight is configured to alter content representative of the scene in a second manner to form second altered content. An image combiner is configured to combine the second altered content with the first altered content to form combined altered scene content.

Abstract: By a conventional technique, it is not possible to provide an image refocused accurately at a desired subject distance. An image processing device is characterized by including an image data acquiring unit configured to acquire calibration image data obtained by an image capturing device including an aperture to adjust an amount of incident light, a lens array in which a plurality of lenses is arranged, and an image sensing element to photoelectrically convert an image of a subject via the lens array and obtained in a state where the aperture is stopped down in accordance with an instruction of calibration; and a unit configured to acquire a position of an image on the image sensing element corresponding to each of the lenses based on the calibration image data.

Abstract: Disclosed are systems and methods for synthesizing a high resolution image associated with a large imaging aperture using an optical imaging apparatus having a smaller aperture. In certain implementations, introduction of a coherent homodyne reference beam to a coherent imaging of an object can result in formation of a Fourier space side lobe that includes information about a portion of a spectrum representative of the object's Fourier spectrum. Images can be obtained at a number of different orientations to yield a number of such side lobe images so as to allow construction of the object's spectrum. A synthesized image corresponding to such a constructed spectrum can have an improved resolution that exceeds the performance limit imposed by the aperture of the optical imaging apparatus.

Abstract: Methods and systems for a compressive optical display and imager using optical scanning and selection and three-dimensional beamforming optics. Standard pixel data can generate a compressed image data set having custom pixel sizes, locations, and intensities. A 3-D beamformer optic adjusts its focus to produce the largest focused beam spot on the display screen corresponding to an image zone compressed pixel. Using scan mirror angular controls, display image space is painted using minimal numbers of laser beam spots whose sizes depend on the compressed sensed image. The imager includes movable reflecting optics to reflect an optical image and controllable imaging optics to pass the reflected optical image toward a digital micromirror that reflects +/?? optical beams into +/? ? optical beam paths. A controller controls reflecting optics and agile front end imaging optics to receive an electronic image signal corresponding to detected +/?? optical beams.

Abstract: Methods and apparatus for super-resolution in integral photography are described. Several techniques are described that, alone or in combination, may improve the super-resolution process and/or the quality of super-resolved images that may be generated from flats captured with a focused plenoptic camera using a super-resolution algorithm. At least some of these techniques involve modifications to the focused plenoptic camera design. In addition, at least some of these techniques involve modifications to the super-resolution rendering algorithm. The techniques may include techniques for reducing the size of pixels, techniques for shifting pixels relative to each other so that super-resolution is achievable at more or all depths of focus, and techniques for sampling using an appropriate filter or kernel. These techniques may, for example, reduce or eliminate the need to perform deconvolution on a super-resolved image, and may improve super-resolution results and/or increase performance.

Abstract: Various approaches to imaging involve selecting directional and spatial resolution. According to an example embodiment, images are computed using an imaging arrangement to facilitate selective directional and spatial aspects of the detection and processing of light data. Light passed through a main lens is directed to photosensors via a plurality of microlenses. The separation between the microlenses and photosensors is set to facilitate directional and/or spatial resolution in recorded light data, and facilitating refocusing power and/or image resolution in images computed from the recorded light data. In one implementation, the separation is varied between zero and one focal length of the microlenses to respectively facilitate spatial and directional resolution (with increasing directional resolution, hence refocusing power, as the separation approaches one focal length).

Abstract: A method for a compressive sampling to capture an image of the object by using a spatial light modulator and a photo-detector, the method includes driving the spatial light modulator in a first rough sampling mode which is executed by using first coded patterns; detecting signals from the photo-detector to obtain a first data at t=t1; detecting signals from the photo-detector to obtain a second data at t=t2, where t2>t1; and changing the first rough sampling mode to a second rough sampling mode which is executed by using second coded patterns finer than the first coded patterns when a difference between the first data and the second data is greater than a threshold value.

Abstract: For noise correction in connection with a flat-panel x-ray detector, noise signals of a dark reference area are checked for deviations exceeding a specified threshold which, if any are present, will be taken into consideration separately for calculating the correction factor derived from the noise signal. Image artifacts due, for example, to high-contrast objects such as, for instance, cardiac pacemakers or metallic implants, in the x-ray image will be avoided through this measure.

Abstract: Various approaches to imaging involve selecting directional and spatial resolution. According to an example embodiment, images are computed using an imaging arrangement to facilitate selective directional and spatial aspects of the detection and processing of light data. Light passed through a main lens is directed to photosensors via a plurality of microlenses. The separation between the microlenses and photosensors is set to facilitate directional and/or spatial resolution in recorded light data, and facilitating refocusing power and/or image resolution in images computed from the recorded light data. In one implementation, the separation is varied between zero and one focal length of the microlenses to respectively facilitate spatial and directional resolution (with increasing directional resolution, hence refocusing power, as the separation approaches one focal length).

Abstract: A sighting system is disclosed, comprising a housing with small upper mirror mounted in its upper center, redirecting light from a single objective lens set, and a larger lower mirror mounted coaxially relative to the lens set and upper mirror, both mirrors set at 45° and redirecting light at 90° angles to the lens set. The smaller mirror is positioned closer than the lower mirror to the lens set. A night camera system is used for receiving an image through the lens set redirected by the lower mirror and amplified through an intensifier before transmission to a video display monitor(s). A day camera system receiving the image from the lens set redirected by the smaller mirror transmits the image to the monitor(s) for separate display of the image, enabling simultaneous capture of the optimum amount of light by each camera, maximizing the housing's diametrical space to receive incoming light.

Abstract: An imaging device includes: an optical system, for focusing light from subjects; color imaging element including a plurality of types of light receiving sections that detect light of different wavelength bands, for imaging focused images of the subjects; and an image processing section, for performing filtering processes to remove blur caused by the optical system from data output by the imaging element. The pitch among specified light receiving sections that contribute most to brightness signals is set smaller than that among other light receiving sections. The point spread diameter of the optical system on the specified light receiving sections is set to be greater than the pitch among the specified light receiving sections for wavelengths detected thereby, and less than the pitches among the other light receiving sections for wavelengths detected thereby. The image processing section performs the filtering process only on data output by the specified light receiving sections.

Abstract: An image processing apparatus obtains information of an effective pixel of an image pickup element and information of a pixel on the periphery thereof, sets a position where image data of the peripheral pixel is multiplexed in accordance with a transmission method, generates a data stream by multiplexing image data of the effective pixel and the image data of the peripheral pixel in accordance with the set multiplexing position and the transmission method, and multiplexes information on the set multiplexing position and information on the peripheral pixel area to the data stream.

Abstract: An imaging apparatus includes: a light receiving device having a micro lens array in which a plurality of micro lenses are arrayed two-dimensionally, and a plurality of photoelectric conversion elements that are provided for the plurality of micro lenses, and that outputs a plurality of photoreception signals that are obtained by receiving optical flux from an optical system via the micro lenses; a detection device that, based on the photoreception signals, detects an amount of displacement between an image plane obtained from the optical system and an image plane obtained from the light receiving device; a focal point adjustment device that performs focal point adjustment on the optical system based on the displacement amount; and a control device that, when an image plane that corresponds to the displacement amount is contained within an image plane range within which it is possible to create an image that is based on the photoreception signal, creates an image of the image plane that corresponds to the dis

Abstract: An image pickup apparatus includes: an image pickup lens; an image pickup device to obtain image pickup data; a microlens array on an image forming plane of the image pickup lens; and an image processing section producing an image based on the image pickup data. The microlens array includes microlenses each provided corresponding to pixels of the image pickup device. The image processing section includes a parallax image producing section and a resizing section. The parallax image producing section extracts pixel data from the image pickup data and synthesizes the pixel data to produce a plurality of parallax images. Each of the extracted pixel data corresponds to each of pixels located at the same position in image pickup regions of the image pickup device, each region corresponding to each microlens. The resizing section resizes each parallax image to change the resolutions thereof.

Abstract: The present invention provides an apparatus for fetching optical images. Images from multiple channels are obtained. A device is used to automatically switch the images. The switching is based on time-sharing multiplexing (TSM). Thus, the images are formed on another device. The images are then integrated and displayed to be used in an optical vehicle safety assistant system.

Abstract: Methods and apparatus for reducing plenoptic camera artifacts. A first method is based on careful design of the optical system of the focused plenoptic camera to reduce artifacts that result in differences in depth in the microimages. A second method is computational; a focused plenoptic camera rendering algorithm is provided that corrects for artifacts resulting from differences in depth in the microimages. While both the artifact-reducing focused plenoptic camera design and the artifact-reducing rendering algorithm work by themselves to reduce artifacts, the two approaches may be combined.

Abstract: Disclosed herein is an imaging device, including: an imaging lens configured to have an aperture stop; an imaging element configured to include a plurality of pixels that each have a rectangular shape as a planar shape and are arranged in a matrix as a whole, and acquire imaging data based on received light; and a lens array unit configured to be disposed on an image forming plane of the imaging lens and include a plurality of lenses, a respective one of the lenses being assigned to n, n is an integer equal to or larger than 2, pixels arranged along a shorter-side direction of the pixels having the rectangular shape in the imaging element.

Abstract: A phase-difference detecting image pickup element performs focus detection even if the position of an exit pupil with respect to the image pickup element changes. A pixel pair receives an object light beam transmitted through a pair of portion areas whose areas become the same in an exit pupil at a particular distance from the image pickup element. The pixel pair includes light-intercepting portions that define the pair of portion areas. A different pixel pair whose light-intercepting portions are different so that the areas of the pair of portion areas in the exit pupil the particular distance from the image pickup element are the same. By this, even if the position of the exit pupil is changed by, for example, a lens replacement, focus detection can be performed by a phase-difference detection method by selecting a pixel pair in accordance with the position of the exit pupil.

Abstract: The invention relates to matrix image sensors, and it relates more particularly to a method for correcting the spatial noise generated by the dispersion of the physical properties of the different individual sensitive dots, or pixels, of the matrix. For each pixel, in an individual electronic circuit associated with the pixel, a recursively digital method is used to determine an approximate value (Mij,n) of an average of the signal Sij,n obtained from the pixel during this large number of images; the signal obtained from each pixel is corrected according to the determined approximate average value and according to a reference average value (M0), and a corrected signal S*ij,n is transmitted from the circuit associated with the pixel.

Abstract: An electromagnetic field high speed imaging apparatus, using an image sensing element having a filter function for each pixel, converts a local polarization state in detection light containing a difference frequency component ?f (|fLO?fRF|) between the modulation frequency fLO of irradiated light and the frequency fRF of the electromagnetic field emitted from a subject into local intensity of light, and captures it by an image sensor of an imaging unit to generate a two-dimensional image of distribution of the near electromagnetic field emitted from the subject. Each pixel of the image sensor comprises a photoelectric conversion element for converting the detection light from the optical unit into an electric charge, a plurality of charge storages, and a charge splitting part for dividing the electric charge generated in the photoelectric conversion element between the plurality of charge storages.

Abstract: Various approaches to imaging involve selecting directional and spatial resolution. According to an example embodiment, images are computed using an imaging arrangement to facilitate selective directional and spatial aspects of the detection and processing of light data. Light passed through a main lens is directed to photosensors via a plurality of microlenses. The separation between the microlenses and photosensors is set to facilitate directional and/or spatial resolution in recorded light data, and facilitating refocusing power and/or image resolution in images computed from the recorded light data. In one implementation, the separation is varied between zero and one focal length of the microlenses to respectively facilitate spatial and directional resolution (with increasing directional resolution, hence refocusing power, as the separation approaches one focal length).

Abstract: Methods and apparatus for reducing plenoptic camera artifacts. A first method is based on careful design of the optical system of the focused plenoptic camera to reduce artifacts that result in differences in depth in the microimages. A second method is computational; a focused plenoptic camera rendering algorithm is provided that corrects for artifacts resulting from differences in depth in the microimages. While both the artifact-reducing focused plenoptic camera design and the artifact-reducing rendering algorithm work by themselves to reduce artifacts, the two approaches may be combined.

Abstract: An image pickup optical system including: a first prism including: a first incident surface where subject beam enters; a division surface for dividing the beam from the first incident surface into image-pickup beam and focus-detection beam; and a first exit surface from which reflection beam reflected on the division surface, the image-pickup beam or the focus-detection beam, exits; and a second prism including: a second incident surface on which transmission beam passing through the division surface, the image-pickup beam or focus-detection beam, enters; and a second exit surface from which the transmission beam exits, wherein the reflection beam is reflected on the division surface, reflected on the first incident surface, and reflected on the division surface to reach the first exit surface, and satisfying 0.1<DA/DB<0.5, where DA and DB indicate beam diameters of beams toward the image pickup elements for focus detection and for image pickup.

Abstract: An integrated system comprises a light valve and an image sensor for image display and image capture. The image sensor and the light valve share a common dual-function lens by positioning the light valve and image sensor at locations offset from the optical axis of the dual-function lens.

Abstract: An image sensor includes: a plurality of first pixels that receive a light flux having passed through an optical system and output pixel signals to be used as image signals; a plurality of second pixels that receive a light flux having passed through the optical system and output pixel signals to be used as signals other than the image signals; a plurality of first pixel rows, each of which includes an array made up with a plurality of first pixels; at least one second pixel row that includes an array made up with first pixels and second pixels; an output circuit that outputs a read signal in response to which pixel signals output at the first pixels are read out from the first pixel rows over first pixel intervals and pixel signals output at the second pixels are read out from the second pixel row over second pixel intervals, different from the first pixel intervals, the output circuit outputting externally the pixel signals having been read out; and a switching device that selects a specific pixel row, eith

Abstract: An image capturing apparatus includes a first image sensor unit, a second image sensor unit, and a spatial frequency reduction unit. The first image sensor unit is capable of subjecting an object image formed by an imaging lens to a photoelectric conversion to output a first image signal having a first resolution and constituted by a first number of colors. The second image sensor unit is capable of subjecting the object image formed by the imaging lens to a photoelectric conversion to output a second image signal having a second resolution that is lower than the first resolution and constituted by a second number of colors that is larger than the first number of colors. The spatial frequency reduction unit reduces a spatial frequency of the object image formed on a light receiving surface of the second image sensor unit by the imaging lens.

Abstract: An imaging device includes a housing including first and second photographing apertures which are open toward opposite directions; an image pickup device provided in the housing; a main optical system forming incident light from the first photographing aperture onto an imaging surface of the image pickup device; and an insertable optical element movable between an insertion position in an optical path of a main optical system and a removed position out of the optical path of the main optical system, the insertable optical element constituting at least a part of a sub-optical system which forms incident light from the second photographing aperture onto the imaging surface when at the insertion position. When the insertable optical element is positioned in the insertion position, the sub-optical axis is offset from the main optical axis toward the removed position of the insertable optical element in the inserting/removing direction.

Abstract: An image processing device and an image processing method capable of generating a moving image having a high resolution and a high frame rate are provided by suppressing the reduction in the amount of light incident on each camera.

Abstract: The shooting, recording and playback system 100 of the present invention receives incoming light 101, stores an image shot, and then subjects the image shot to be reproduced to resolution raising processing, thereby outputting RGB images with high spatial resolution and high temporal resolution (ROUT GOUT BOUT) 102. The system 100 includes a shooting section 103, a color separating section 104, an R imaging sensor section 105, a G imaging sensor section 106, a B imaging sensor section 107, an image shot storage section 108, an image shot writing section 109, a memory section 110, an image shot reading section 111, a spatial resolution upconverter section 112, a temporal resolution upconverter section 113, an output section 114, and a line recognition signal generating section 185. The system can get image data with high spatial resolution and high temporal resolution without getting the camera configuration complicated and without decreasing the optical efficiency.

Abstract: For noise correction in connection with a flat-panel x-ray detector (2), noise signals of a dark area (6) are checked for deviations exceeding a specified threshold (g) which, if any are present, will be taken into consideration separately for calculating the correction factor derived from the noise signal. Image artifacts due, for example, to high-contrast objects such as, for instance, cardiac pacemakers or metallic implants, in the x-ray image will be avoided through this measure.

Abstract: Method and apparatus for a fast (low F/number) computational camera that incorporates two arrays of lenses. The arrays include a lenslet array in front of a photosensor and an objective lens array of two or more lenses. Each lens in the objective lens array captures light from a subject. Each lenslet in the lenslet array captures light from each objective lens and separates the captured light to project microimages corresponding to the objective lenses on a region of the photosensor under the lenslet. Thus, a plurality of microimages are projected onto and captured by the photosensor. The captured microimages may be processed in accordance with the geometry of the objective lenses to align the microimages to generate a final image. One or more other algorithms may be applied to the image data in accordance with radiance information captured by the camera, such as automatic refocusing of an out-of-focus image.

Abstract: A camera assembly that generates a high-quality self portrait may include a plurality of reflecting surfaces, such as an array of mirrors or a multi-faceted reflecting element. Each reflecting surface may be arranged so as to assist the user align the camera by rotational movement and/or translated movement to achieve a different field of view for the camera assembly for each reflecting surface. In this manner, the user may sequentially use the various reflecting surfaces to capture an image corresponding to each reflecting surface so that each image corresponds to a different portion of a scene. These portions of the scene may have some overlap and may be stitched together to form a panoramic self portrait that includes the user and portions of the scene behind the user.

Abstract: The shooting, recording and playback system 100 of the present invention receives incoming light 101, stores an image shot, and then subjects the image shot to be reproduced to resolution raising processing, thereby outputting RGB images with high spatial resolution and high temporal resolution (ROUT GOUT BOUT) 102. The system 100 includes a shooting section 103, a color separating section 104, an R imaging sensor section 105, a G imaging sensor section 106, a B imaging sensor section 107, an image shot storage section 108, an image shot writing section 109, a memory section 110, an image shot reading section 111, a spatial resolution upconverter section 112, a temporal resolution upconverter section 113, an output section 114, and a line recognition signal generating section 185. The system can get image data with high spatial resolution and high temporal resolution without getting the camera configuration complicated and without decreasing the optical efficiency.