Abstract: Methods and apparatus for controlling exposure in a camera device are described. A depth map is used in combination with user selection of a portion of scene as part of an exposure control operation. Exposure control is based on portions of the scene, e.g., in a local window surrounding the user selected point, at the same depth as the user selected portion of the scene with other portions of the scene being excluded from consideration when controlling exposure or being given less weight than the portion or portions at the same depth as the user selected scene portion. Color maybe and in some embodiments is used in combination with depth information to identify an object of interest identified by the user selection. The identified object is then used in some embodiments in making exposure control determinations with portions of a scene outside the object being ignored or given less weight in determining an exposure to be used than the portions corresponding to the identified object.

Abstract: A camera device with a sensor which is mounted at an angle relative to a mounting surface or other reference surface is described. Camera modules, which include mirrors for light redirection, which are mounted at different angles in the camera device have sensors with different amounts of rotation. In some embodiments modules without mirrors use camera modules without rotated sensors while camera modules with mirrors may or may not use sensors which are rotated depending on the angle at which the modules are mounted in the camera device. By rotating the sensors of some camera modules rotation that maybe introduced by the angle at which a camera module is mounted can be offset. The images captured by different camera modules are combined in some embodiments without the need for computationally rotating an image thanks to the rotation of the sensor in the camera module used to capture the image.

Abstract: In various embodiments a camera with multiple optical chains, e.g., camera modules, is controlled to operate in one of a variety of supported modes of operation. The modes include a non-motion mode, a motion mode, a normal burst mode and/or a reduced data burst mode. Motion mode is well suited for capturing an image including motion, e.g., moving object(s) with some modules being used to capture scene areas using a shorter exposure time than other modules and the captured images then being combined taking into consideration locations of motion. A reduced data burst mode is supported in some embodiments in which camera modules with different focal lengths capture images at different rates. While the camera modules of different focal length operate at different image capture rates in the reduced data burst mode, images are combined to support a desired composite image output rate, e.g., a desired frame rate.

Abstract: In various embodiments a camera with multiple optical chains, e.g., camera modules, is controlled to operate in one of a variety of supported modes of operation. The modes include a non-motion mode, a motion mode, a normal burst mode and/or a reduced data burst mode. Motion mode is well suited for capturing an image including motion, e.g., moving object(s) with some modules being used to capture scene areas using a shorter exposure time than other modules and the captured images then being combined taking into consideration locations of motion. A reduced data burst mode is supported in some embodiments in which camera modules with different focal lengths capture images at different rates. While the camera modules of different focal length operate at different image capture rates in the reduced data burst mode, images are combined to support a desired composite image output rate, e.g., a desired frame rate.

Abstract: The spatial resolution of captured plenoptic images is enhanced. In one aspect, the plenoptic imaging process is modeled by a pupil image function (PIF), and a PIF inversion process is applied to the captured plenoptic image to produce a better resolution estimate of the object.

Abstract: The spatial resolution of captured plenoptic images is enhanced. In one aspect, the plenoptic imaging process is modeled by a pupil image function (PIF), and a PIF inversion process is applied to the captured plenoptic image to produce a better resolution estimate of the object.

Abstract: A camera device includes multiple sensors with each sensor including an integrated multi-element filter. Because of the use of different filters in different sensors, a wide variety of filter patterns can be supported in a single camera device without the need for moveable or otherwise changeable filters. While multiple optical chains and sensors are included which sensors are used during a given time period are determined based on the whether a power save mode of operation is active and/or the image capture mode being used. Fewer optical chains are used during power save mode for capturing images corresponding to the image mode in use, e.g., color, IR, or monochrome. While the camera device may include a large number of optical modules, e.g., 4, 10 or more, in some embodiments sensors of optical chains not selected for use during a given time period are intentionally powered down to conserve power.

Abstract: The present application relates to image capture and generation methods and apparatus and, more particularly, to methods and apparatus which detect and/or indicate a dirty lens condition. One embodiment of the present invention includes a method of operating a camera including the steps of capturing a first image using a first lens of the camera; determining, based on at least the first image, if a dirty camera lens condition exists; and in response to determining that a dirty lens condition exists, generating a dirty lens condition notification or initiating an automatic camera lens cleaning operation. In some embodiments multiple captured images with overlapping image regions are compared to determine if a dirty lens condition exists.

Abstract: An adjustable multimode lightfield imaging system. A non-homogeneous filter module is positioned at the pupil plane of the lightfield imaging system and provides the multimode capability. The filter module can be moved relative to the imaging system with the exposure conditions adjusted accordingly, thus allowing adjustment of the multimode capability.

Abstract: Passive RFID devices are disclosed that perform image recognition. The device includes an antenna, circuitry, and a camera. The antenna receives a radio frequency (RF) signal from a RFID reader. The circuitry stores image data for objects that is used for image recognition. To operate, the circuitry derives power from the RF signal. With the power derived from the RF signal, the camera captures an image. The circuitry then identifies an object in the captured image based on the image data for the objects, and outputs information for the identified object, such as to the RFID reader.

Abstract: Calibration for plenoptic imaging systems. The calibration preferably is performed automatically by a processor. In one approach, the processor accesses a plenoptic image captured by the plenoptic imaging system. The plenoptic image is analyzed to determine reference points for superpixels of the plenoptic imaging system, for example the centers of the superpixels. The reference points are used to determine a location of each superpixel relative to the detector array.

Abstract: The spatial resolution of captured plenoptic images is enhanced. In one aspect, the plenoptic imaging process is modeled by a pupil image function (PIF), and a PIF inversion process is applied to the captured plenoptic image to produce a better resolution estimate of the object.

Abstract: Camera holder device methods and apparatus are described. The camera holder can be held in a hand and used to automatically stabilize a camera, e.g., a camera designed to be held in one hand. The stabilization is provided by gyroscopes alone or in combination with closed loop camera orientation control which can use information from one or more sensors included in the camera. The camera holder is designed so that, at least for some but not necessarily all cameras which may be placed in the camera holder, controllable axis of rotation intersect with the center of mass of the camera when the camera is present the holder thereby requiring little power to control and/or maintain camera orientation.

Abstract: Illumination methods and apparatus which are well suited for use with camera devices are described. The methods are well suited for use with a rolling shutter. In some embodiments, plurality of lighting elements are provided and controlled in a manner which is synchronized with operation of the rolling shutter. While the portion of an area which is being captured by the sensor is illuminated during the image capture process, lighting elements corresponding to portions of the area which are not being captured are not activated when the corresponding area portion is not being captured. In this manner the entire area is not illuminated at the same level for the entire image capture period and energy is used more efficiently as compared to devices which illuminate a complete area at a consistent illumination level for the full duration of an image capture time period in which a rolling shutter is used.

Abstract: Zoom and focus control user interface methods and apparatus are described. Acceleration is monitored and interpreted to detect camera motion. Acceleration indicative of camera motion in a forward or backward direction is used to control zoom in or zoom out operations when a zoom function is enabled. The zoom function can be enabled by touching a touch sensor or pressing a button. Thus, by activating the zoom function and making intuitive movements forward or backward which can be detected through the use of sensors, a user can control zoom in and zoom out operations in an intuitive manner with little risk of shaking the camera or interfering with image capture that might occur if a touch display or other zoom control was used to control zoom operation while capturing one or more images. The zoom control function is well suited for use with still cameras and video cameras.

Abstract: Illumination methods and apparatus are described. In some embodiments a lighting device includes one or more lighting modules. At least some but not necessarily all lighting modules include a light source, e.g., LED or bulb, a collimating lens positioned in front of said light source for generating a beam of light from light output by said light source and a beam flattening lens for flattening the beam of light in at least a first direction as it passes through the first beam flattening lens. In some but not necessarily all embodiments lighting modules are controlled based on which portion of a scene is being captured at a point in time thereby avoiding the need to illuminate the entire scene for the full duration of an image capture period. The lighting device may be used in combination with a rolling shutter and a sensor used to capture one or more images.

Abstract: Methods and apparatus that facilitate or implement focus control in a camera and/or can be used to set the camera focus distance, e.g., the distance between the camera and an object which will appear in focus when the objects picture is taken by the camera. A depth map is generated for an image area, e.g., an area corresponding to an image which is captured by the camera. Based on said depth map, in various exemplary embodiments, a visual indication of which portions of an image captured by the camera device are in focus is generated. A user may indicate a change in the desired focus distance by touching a portion of the screen corresponding to an object at the desired focus distance or by varying a slider or other focus distance control.

Abstract: A method for designing the spatial partition of a filter module used in an aperture-multiplexed imaging system. The filter module is spatially partitioned into filter cells, and the spatial partition is designed by considering data captured at the sensor in light of an application-specific performance metric.

Abstract: Methods and apparatus for processing images captured by a camera device including multiple optical chains, e.g., camera modules, are described. Three, 4, 5 or more optical chains maybe used. Different optical chains capture different images due to different perspectives. Multiple images, e.g., corresponding to different perspectives, are captured during a time period and are combined to generate a composite image. In some embodiments one of the captured images or a synthesized image is used as a reference image during composite image generation. The image used as the reference image is selected to keep the perspective of sequentially generated composite images consistent despite unintentional came movement and/or in accordance with an expected path of travel. Thus, which camera module provides the reference image may vary over time taking into consideration unintended camera movement. Composite image generation may be performed external to the camera device or in the camera device.

Abstract: Methods and apparatus for processing images captured by a camera device including multiple optical chains, e.g., camera modules, are described. Three, 4, 5 or more optical chains maybe used. Different optical chains capture different images due to different perspectives. Multiple images, e.g., corresponding to different perspectives, are captured during a time period and are combined to generate a composite image. In some embodiments one of the captured images or a synthesized image is used as a reference image during composite image generation. The image used as the reference image is selected to keep the perspective of sequentially generated composite images consistent despite unintentional came movement and/or in accordance with an expected path of travel. Thus, which camera module provides the reference image may vary over time taking into consideration unintended camera movement. Composite image generation may be performed external to the camera device or in the camera device.