Abstract: Methods and apparatus for capturing images using a camera device including multiple camera modules, e .g., multiple optical chains, in an efficient manner are described. Different camera devices in the camera device may capture images corresponding to different size fields of view of a scene area. User input is used to identify an object of interest. A first type camera module having a large field of view is used to track the identified object of interest. Sets of second type camera modules having a smaller field of view are used to capture images of the object of interest. Different sets of second type camera modules may be used at different times as a function of object of interest location. In some embodiments, at least some second type camera modules include the capability to adjust, e.g., move, image capture area, e.g., by changing a mirror angle inclination and/or a mirror rotation.

Abstract: Methods and apparatus for implementing optical chains, e.g., camera modules, which can be used in a camera device are described as well as camera devices including multiple camera modules. In various embodiments one or more camera modules include mirror assemblies which support a movable mirror. The mirror is driven in some embodiments by a linear actuator, e.g., piezo electric actuator with the linear motion of the actuator's push rod being converted into angular mirror rotation by use of hinge, e.g., pivot on which the mirror is mounted. A return spring provide a force contrary to that provided by the actuator. A recess is included in a mounting board to allow the bottom of the mirror or a portion of the mirror mounting hinge to be placed below the surface of the mounting board to which the camera module is secured.

Abstract: Methods and apparatus for generating a sharp image are described. A camera device includes a plurality of camera modules, e.g., optical chains, where at least some of the camera modules have different depths of field. Multiple images of a scene are captured using the plurality of camera modules. Portions of the multiple images which correspond to the same scene area are identified. Image portion sharpness levels are determined for individual image portions. Image portions with high sharpness levels are selected and included in a composite image.

Abstract: Various features relating to reducing and/or eliminating noise from images are described. In some embodiments depth based denoising is used on images captured by one or more camera modules based on depth information of a scene area and optical characteristics of the one or more camera modules used to captures the images. In some embodiments by taking into consideration the camera module optics and the depth of the object included in the image portion, a maximum expected frequency can be determined and the image portion is then filtered to reduce or remove frequencies above the maximum expected frequency. In this way noise can be reduced or eliminated from image portions captured by one or more camera modules. The optical characteristic of different camera modules may be different. In some embodiments a maximum expected frequency is determined on a per camera module and depth basis.

Abstract: Metrics for characterizing the focusing of a plenoptic imaging system. In one aspect, the metric is based on the high frequency content and/or the blurring of the plenoptic image.

Abstract: Illumination methods and apparatus are described. In some embodiments a lighting device includes one or more lighting modules. At least some but not necessarily all lighting modules include a light source, e.g., LED or bulb, a collimating lens positioned in front of said light source for generating a beam of light from light output by said light source and a beam flattening lens for flattening the beam of light in at least a first direction as it passes through the first beam flattening lens. In some but not necessarily all embodiments lighting modules are controlled based on which portion of a scene is being captured at a point in time thereby avoiding the need to illuminate the entire scene for the full duration of an image capture period. The lighting device may be used in combination with a rolling shutter and a sensor used to capture one or more images.

Abstract: Methods and apparatus for processing images captured by a camera device including multiple optical chains, e.g., camera modules, are described. Three, 4, 5 or more optical chains maybe used. Different optical chains capture different images due to different perspectives. Multiple images, e.g., corresponding to different perspectives, are captured during a time period and are combined to generate a composite image. In some embodiments one of the captured images or a synthesized image is used as a reference image during composite image generation. The image used as the reference image is selected to keep the perspective of sequentially generated composite images consistent despite unintentional came movement and/or in accordance with an expected path of travel. Thus, which camera module provides the reference image may vary over time taking into consideration unintended camera movement. Composite image generation may be performed external to the camera device or in the camera device.

Abstract: Methods and apparatus for controlling exposure in a camera device are described. A depth map is used in combination with user selection of a portion of scene as part of an exposure control operation. Exposure control is based on portions of the scene, e.g., in a local window surrounding the user selected point, at the same depth as the user selected portion of the scene with other portions of the scene being excluded from consideration when controlling exposure or being given less weight than the portion or portions at the same depth as the user selected scene portion. Color maybe and in some embodiments is used in combination with depth information to identify an object of interest identified by the user selection. The identified object is then used in some embodiments in making exposure control determinations with portions of a scene outside the object being ignored or given less weight in determining an exposure to be used than the portions corresponding to the identified object.

Abstract: A camera device with a sensor which is mounted at an angle relative to a mounting surface or other reference surface is described. Camera modules, which include mirrors for light redirection, which are mounted at different angles in the camera device have sensors with different amounts of rotation. In some embodiments modules without mirrors use camera modules without rotated sensors while camera modules with mirrors may or may not use sensors which are rotated depending on the angle at which the modules are mounted in the camera device. By rotating the sensors of some camera modules rotation that maybe introduced by the angle at which a camera module is mounted can be offset. The images captured by different camera modules are combined in some embodiments without the need for computationally rotating an image thanks to the rotation of the sensor in the camera module used to capture the image.

Abstract: In various embodiments a camera with multiple optical chains, e.g., camera modules, is controlled to operate in one of a variety of supported modes of operation. The modes include a non-motion mode, a motion mode, a normal burst mode and/or a reduced data burst mode. Motion mode is well suited for capturing an image including motion, e.g., moving object(s) with some modules being used to capture scene areas using a shorter exposure time than other modules and the captured images then being combined taking into consideration locations of motion. A reduced data burst mode is supported in some embodiments in which camera modules with different focal lengths capture images at different rates. While the camera modules of different focal length operate at different image capture rates in the reduced data burst mode, images are combined to support a desired composite image output rate, e.g., a desired frame rate.

Abstract: In various embodiments a camera with multiple optical chains, e.g., camera modules, is controlled to operate in one of a variety of supported modes of operation. The modes include a non-motion mode, a motion mode, a normal burst mode and/or a reduced data burst mode. Motion mode is well suited for capturing an image including motion, e.g., moving object(s) with some modules being used to capture scene areas using a shorter exposure time than other modules and the captured images then being combined taking into consideration locations of motion. A reduced data burst mode is supported in some embodiments in which camera modules with different focal lengths capture images at different rates. While the camera modules of different focal length operate at different image capture rates in the reduced data burst mode, images are combined to support a desired composite image output rate, e.g., a desired frame rate.

Abstract: The spatial resolution of captured plenoptic images is enhanced. In one aspect, the plenoptic imaging process is modeled by a pupil image function (PIF), and a PIF inversion process is applied to the captured plenoptic image to produce a better resolution estimate of the object.

Abstract: The spatial resolution of captured plenoptic images is enhanced. In one aspect, the plenoptic imaging process is modeled by a pupil image function (PIF), and a PIF inversion process is applied to the captured plenoptic image to produce a better resolution estimate of the object.

Abstract: A camera device includes multiple sensors with each sensor including an integrated multi-element filter. Because of the use of different filters in different sensors, a wide variety of filter patterns can be supported in a single camera device without the need for moveable or otherwise changeable filters. While multiple optical chains and sensors are included which sensors are used during a given time period are determined based on the whether a power save mode of operation is active and/or the image capture mode being used. Fewer optical chains are used during power save mode for capturing images corresponding to the image mode in use, e.g., color, IR, or monochrome. While the camera device may include a large number of optical modules, e.g., 4, 10 or more, in some embodiments sensors of optical chains not selected for use during a given time period are intentionally powered down to conserve power.

Abstract: The present application relates to image capture and generation methods and apparatus and, more particularly, to methods and apparatus which detect and/or indicate a dirty lens condition. One embodiment of the present invention includes a method of operating a camera including the steps of capturing a first image using a first lens of the camera; determining, based on at least the first image, if a dirty camera lens condition exists; and in response to determining that a dirty lens condition exists, generating a dirty lens condition notification or initiating an automatic camera lens cleaning operation. In some embodiments multiple captured images with overlapping image regions are compared to determine if a dirty lens condition exists.

Abstract: An adjustable multimode lightfield imaging system. A non-homogeneous filter module is positioned at the pupil plane of the lightfield imaging system and provides the multimode capability. The filter module can be moved relative to the imaging system with the exposure conditions adjusted accordingly, thus allowing adjustment of the multimode capability.

Abstract: Passive RFID devices are disclosed that perform image recognition. The device includes an antenna, circuitry, and a camera. The antenna receives a radio frequency (RF) signal from a RFID reader. The circuitry stores image data for objects that is used for image recognition. To operate, the circuitry derives power from the RF signal. With the power derived from the RF signal, the camera captures an image. The circuitry then identifies an object in the captured image based on the image data for the objects, and outputs information for the identified object, such as to the RFID reader.

Abstract: Calibration for plenoptic imaging systems. The calibration preferably is performed automatically by a processor. In one approach, the processor accesses a plenoptic image captured by the plenoptic imaging system. The plenoptic image is analyzed to determine reference points for superpixels of the plenoptic imaging system, for example the centers of the superpixels. The reference points are used to determine a location of each superpixel relative to the detector array.

Abstract: The spatial resolution of captured plenoptic images is enhanced. In one aspect, the plenoptic imaging process is modeled by a pupil image function (PIF), and a PIF inversion process is applied to the captured plenoptic image to produce a better resolution estimate of the object.

Abstract: Illumination methods and apparatus which are well suited for use with camera devices are described. The methods are well suited for use with a rolling shutter. In some embodiments, plurality of lighting elements are provided and controlled in a manner which is synchronized with operation of the rolling shutter. While the portion of an area which is being captured by the sensor is illuminated during the image capture process, lighting elements corresponding to portions of the area which are not being captured are not activated when the corresponding area portion is not being captured. In this manner the entire area is not illuminated at the same level for the entire image capture period and energy is used more efficiently as compared to devices which illuminate a complete area at a consistent illumination level for the full duration of an image capture time period in which a rolling shutter is used.