Abstract: Methods and apparatus for processing images captured by a camera device including multiple optical chains, e.g., camera modules, are described. Three, 4, 5 or more optical chains maybe used. Different optical chains capture different images due to different perspectives. Multiple images, e.g., corresponding to different perspectives, are captured during a time period and are combined to generate a composite image. In some embodiments one of the captured images or a synthesized image is used as a reference image during composite image generation. The image used as the reference image is selected to keep the perspective of sequentially generated composite images consistent despite unintentional came movement and/or in accordance with an expected path of travel. Thus, which camera module provides the reference image may vary over time taking into consideration unintended camera movement. Composite image generation may be performed external to the camera device or in the camera device.

Abstract: A plenoptic otoscope enables three-dimensional and/or spectral imaging of the inside of the ear to assist in improved diagnosis of inflammations and infections. The plenoptic otoscope includes a primary imaging system and a plenoptic sensor. The primary imaging system includes an otoscope objective and relay optics, which cooperate to form an image of an inside of an ear at an intermediate image plane. The plenoptic sensor includes a microimaging array positioned at the intermediate image plane and a sensor array positioned at a conjugate of the pupil plane. An optional filter module may be positioned at the pupil plane or one of its conjugates to facilitate three-dimensional and/or spectral imaging.

Abstract: A device for eye tracking is disclosed. The device includes a first depth profiler configured to determine a distance from the first depth profiler to a surface of an eye. The device may also include a display device configured to display one or more images selected based on a position of the eye. The position of the eye is determined based on the determined distance. Also disclosed is a method for eye tracking. The method includes determining, with a first depth profiler, a distance from the first depth profiler to a surface of an eye. A position of the eye is determined based on the determine distance. One or more images selected based on the position of the eye are displayed on a display device.

Abstract: Methods and apparatus provide for simulated, e.g., synthetic, aperture control. In some embodiments a user, after a camera autofocus or user selection of an object to focus on, sets a blur level and views the effect. Once the user controlled blur setting is complete, images are captured with the in-focus, e.g., autofocus, setting and other images are captured with the focus set to capture a blurred image based on the set blur level. In focus and out of focus images are captured in parallel using different camera modules in some embodiments. A composite image is generated by combining portions of one or more sharp and blurred images. Thus a user can capture portions of images with a desired level of blurriness without risking blurring other portions of an image while controlling how the captured images are combined to form a composite image with in-focus and blurred portions.

Abstract: Methods and apparatus for compensating for motion and/or changing light conditions during image capture, e.g., in video, through use of multiple camera modules and/or images captured by multiple camera modules are described. During image capture time periods a plurality of camera modules capture images. During a first image capture time period a first camera module captures an image including a complete image of a user selected scene area of interest. During an additional image capture time period the first camera module captures an image including a portion of the scene area of interest; however, a portion of the scene area image is missing from the captured image, e.g., due to camera motion, occlusion and/or lighting conditions. Captured images from other camera modules and/or from during different image capture time periods which include the missing portion are identified and ranked; the highest ranked image is used in generating a composite image.

Abstract: Methods and apparatus relating to a camera including one or more optical chains with a light redirection device, e.g., mirror, and an outer protective cover are described. The cover maybe a flat or sloped surface or a lens. Features avoid stray light rays from reaching an image sensor of an optical chain. In some but not all embodiments a 2-sided anti-reflection coating is used on the cover to avoid or reduce back reflections from the cover into the optical system. In some embodiments mirror angles are limited to a range in which stray light reflections are directed away from the camera module. In some embodiments a tilted cover configuration is used where the cover is sloped relative to a face of the camera and/or camera module. Different features such as the sloped cover glass, control of mirror angle, and/or antireflective coating can be used alone or in combination.

Abstract: A plenoptic otoscope enables three-dimensional and/or spectral imaging of the inside of the ear to assist in improved diagnosis of inflammations and infections. The plenoptic otoscope includes a primary imaging system and a plenoptic sensor. The primary imaging system includes an otoscope objective and relay optics, which cooperate to form an image of an inside of an ear at an intermediate image plane. The plenoptic sensor includes a microimaging array positioned at the intermediate image plane and a sensor array positioned at a conjugate of the pupil plane. An optional filter module may be positioned at the pupil plane or one of its conjugates to facilitate three-dimensional and/or spectral imaging.

Abstract: A display device includes a two-dimensional array of tiles. Each tile includes a two-dimensional array of pixels and a lens of a two-dimensional array of lenses. Each pixel is configured to output light so that the two-dimensional array of pixels outputs a respective pattern of light. Each lens is configured to direct at least a portion of the respective pattern of light from the two-dimensional array of pixels to a pupil of an eye of a user. The display device also includes an array of sensors for determining a location of the pupil of the eye of the user.

Abstract: Methods and apparatus that facilitate or implement focus control in a camera and/or can be used to set the camera focus distance, e.g., the distance between the camera and an object which will appear in focus when the objects picture is taken by the camera. A depth map is generated for an image area, e.g., an area corresponding to an image which is captured by the camera. Based on said depth map, in various exemplary embodiments, a visual indication of which portions of an image captured by the camera device are in focus is generated. A user may indicate a change in the desired focus distance by touching a portion of the screen corresponding to an object at the desired focus distance or by varying a slider or other focus distance control.

Abstract: Methods and apparatus for controlling exposure in a camera device are described. A depth map is used in combination with user selection of a portion of scene as part of an exposure control operation. Exposure control is based on portions of the scene, e.g., in a local window surrounding the user selected point, at the same depth as the user selected portion of the scene with other portions of the scene being excluded from consideration when controlling exposure or being given less weight than the portion or portions at the same depth as the user selected scene portion. Color maybe and in some embodiments is used in combination with depth information to identify an object of interest identified by the user selection. The identified object is then used in some embodiments in making exposure control determinations with portions of a scene outside the object being ignored or given less weight in determining an exposure to be used than the portions corresponding to the identified object.

Abstract: Methods and apparatus for implementing a camera device including multiple camera modules and which supports zoom operations are described. A plurality of moveable camera modules are included with the position of the moveable camera modules being controlled as a function of a zoom setting. One or more fixed camera modules are also included to facilitate image combining. A fixed camera module having a smaller focal length than the movable camera modules is used in some embodiments to capture a scene area including scene area portions which will be captured by movable camera modules. The image captured by the fixed camera module, with the small focal length, is used in aligning images captured by the movable camera modules during generation of a composite image. The camera may also include another fixed camera module, e.g., having the same focal length as the movable camera modules, for capturing the center of a scene.

Abstract: A method for designing the spatial partition of a filter module used in an aperture-multiplexed imaging system. The filter module is spatially partitioned into filter cells, and the spatial partition is designed by considering data captured at the sensor in light of an application-specific performance metric.

Abstract: Methods and apparatus for processing images captured by a camera device including multiple optical chains, e.g., camera modules, are described. Three, 4, 5 or more optical chains maybe used. Different optical chains capture different images due to different perspectives. Multiple images, e.g., corresponding to different perspectives, are captured during a time period and are combined to generate a composite image. In some embodiments one of the captured images or a synthesized image is used as a reference image during composite image generation. The image used as the reference image is selected to keep the perspective of sequentially generated composite images consistent despite unintentional came movement and/or in accordance with an expected path of travel. Thus, which camera module provides the reference image may vary over time taking into consideration unintended camera movement. Composite image generation may be performed external to the camera device or in the camera device.

Abstract: Various features relating to reducing and/or eliminating noise from images are described. In some embodiments depth based denoising is used on images captured by one or more camera modules based on depth information of a scene area and optical characteristics of the one or more camera modules used to captures the images. In some embodiments by taking into consideration the camera module optics and the depth of the object included in the image portion, a maximum expected frequency can be determined and the image portion is then filtered to reduce or remove frequencies above the maximum expected frequency. In this way noise can be reduced or eliminated from image portions captured by one or more camera modules. The optical characteristic of different camera modules may be different. In some embodiments a maximum expected frequency is determined on a per camera module and depth basis.

Abstract: Methods and apparatus for capturing images using a camera device including multiple camera modules, e .g., multiple optical chains, in an efficient manner are described. Different camera devices in the camera device may capture images corresponding to different size fields of view of a scene area. User input is used to identify an object of interest. A first type camera module having a large field of view is used to track the identified object of interest. Sets of second type camera modules having a smaller field of view are used to capture images of the object of interest. Different sets of second type camera modules may be used at different times as a function of object of interest location. In some embodiments, at least some second type camera modules include the capability to adjust, e.g., move, image capture area, e.g., by changing a mirror angle inclination and/or a mirror rotation.

Abstract: Methods and apparatus for implementing optical chains, e.g., camera modules, which can be used in a camera device are described as well as camera devices including multiple camera modules. In various embodiments one or more camera modules include mirror assemblies which support a movable mirror. The mirror is driven in some embodiments by a linear actuator, e.g., piezo electric actuator with the linear motion of the actuator's push rod being converted into angular mirror rotation by use of hinge, e.g., pivot on which the mirror is mounted. A return spring provide a force contrary to that provided by the actuator. A recess is included in a mounting board to allow the bottom of the mirror or a portion of the mirror mounting hinge to be placed below the surface of the mounting board to which the camera module is secured.

Abstract: Methods and apparatus for generating a sharp image are described. A camera device includes a plurality of camera modules, e.g., optical chains, where at least some of the camera modules have different depths of field. Multiple images of a scene are captured using the plurality of camera modules. Portions of the multiple images which correspond to the same scene area are identified. Image portion sharpness levels are determined for individual image portions. Image portions with high sharpness levels are selected and included in a composite image.

Abstract: Metrics for characterizing the focusing of a plenoptic imaging system. In one aspect, the metric is based on the high frequency content and/or the blurring of the plenoptic image.

Abstract: Illumination methods and apparatus are described. In some embodiments a lighting device includes one or more lighting modules. At least some but not necessarily all lighting modules include a light source, e.g., LED or bulb, a collimating lens positioned in front of said light source for generating a beam of light from light output by said light source and a beam flattening lens for flattening the beam of light in at least a first direction as it passes through the first beam flattening lens. In some but not necessarily all embodiments lighting modules are controlled based on which portion of a scene is being captured at a point in time thereby avoiding the need to illuminate the entire scene for the full duration of an image capture period. The lighting device may be used in combination with a rolling shutter and a sensor used to capture one or more images.

Abstract: Methods and apparatus for processing images captured by a camera device including multiple optical chains, e.g., camera modules, are described. Three, 4, 5 or more optical chains maybe used. Different optical chains capture different images due to different perspectives. Multiple images, e.g., corresponding to different perspectives, are captured during a time period and are combined to generate a composite image. In some embodiments one of the captured images or a synthesized image is used as a reference image during composite image generation. The image used as the reference image is selected to keep the perspective of sequentially generated composite images consistent despite unintentional came movement and/or in accordance with an expected path of travel. Thus, which camera module provides the reference image may vary over time taking into consideration unintended camera movement. Composite image generation may be performed external to the camera device or in the camera device.