Patents Assigned to Light Labs Inc.
-
Patent number: 11180117Abstract: A wiper is controlled to sweep a surface area, e.g., a portion of a windshield, in front of a camera, e.g., a camera mounted inside a vehicle. An image captured from the camera after the wiper completes, e.g., immediately completes, the sweep of the surface area in front of the camera is used in generating a depth map. In some embodiments a first wiper is controlled to clear a surface area in front of a first camera while a second wiper is controlled to clear a surface area in front of second camera at the same time, and the first and second cameras are synchronized to initiate image capture at the same time, capturing images through recently cleared area, and the captured images are used to generate a depth map. A vehicle control operation, e.g., a direction, braking or speed control operation is performed based on the depth map.Type: GrantFiled: December 11, 2019Date of Patent: November 23, 2021Assignee: Light Labs Inc.Inventors: Atul Maharshi, Pablo A Anigstein, Rajiv Laroia
-
Patent number: 11064124Abstract: Methods and apparatus for supporting zoom operations using a plurality of optical chain modules, e.g., camera modules, are described. Switching between use of groups of optical chains with different focal lengths is used to support zoom operations. Digital zoom is used in some cases to support zoom levels corresponding to levels between the zoom levels of different optical chain groups or discrete focal lengths to which optical chains may be switched. In some embodiments optical chains have adjustable focal lengths and are switched between different focal lengths. In other embodiments optical chains have fixed focal lengths with different optical chain groups corresponding to different fixed focal lengths. Composite images are generate from images captured by multiple optical chains of the same group and/or different groups. Composite image is in accordance with a user zoom control setting. Individual composite images may be generated and/or a video sequence.Type: GrantFiled: January 6, 2020Date of Patent: July 13, 2021Assignee: Light Labs Inc.Inventor: Rajiv Laroia
-
Patent number: 10931866Abstract: A camera device including multiple optical chains receives user input indicating one or more user selectable control option setting(s), e.g., a user selected depth of field control option setting and an aspect ratio control option setting. The indicated control option settings are stored in memory in the camera device. Multiple optical chains of the camera device capture an image during an image capture time interval. A set of captured images are stored in a file along with metadata including the user indicated control option settings. A composite image is generated from a set of captured images in accordance with the stored indicated control option settings, e.g., generating a composite image with a user selected depth of field and/or a user selected aspect ratio. In some embodiments, at least some of the user selected control option settings are not used during image capture operations but are used in subsequent image processing.Type: GrantFiled: October 18, 2016Date of Patent: February 23, 2021Assignee: Light Labs Inc.Inventors: Rajiv Laroia, Fan Sai Kuok, Jannie Lai, Jared Torres Calinisan, Feng Li
-
Patent number: 10670858Abstract: Methods and apparatus for maintaining, adjusting and/or accurately determining the position of a moveable element, e.g., a moveable shaft mounted component are described. The moveable component may be, for example, a mirror or mirror support of a camera module. A hall sensor is used to measure distance to the moveable component. To facilitate the distance measurement a magnet is secured to the moveable component. The hall sensor is used to determine the distance between the magnet and sensor. A metal plate is placed along a side of one of the supports used to support the shaft to which the moveable component is attached. The magnet which facilitates distance measurement is attracted to the plate reducing the risk of side to side movement even when the shaft fits loosely in the supports and is rotated. The magnet facilitates distance measurements and reliable control of position relative to the sidewall plate.Type: GrantFiled: May 21, 2017Date of Patent: June 2, 2020Assignee: Light Labs Inc.Inventors: James Schmieder, Liang-Jiun Lin
-
Patent number: 10674050Abstract: A camera device with a sensor which is mounted at an angle relative to a mounting surface or other reference surface is described. Camera modules, which include mirrors for light redirection, which are mounted at different angles in the camera device have sensors with different amounts of rotation. In some embodiments modules without mirrors use camera modules without rotated sensors while camera modules with mirrors may or may not use sensors which are rotated depending on the angle at which the modules are mounted in the camera device. By rotating the sensors of some camera modules rotation that maybe introduced by the angle at which a camera module is mounted can be offset. The images captured by different camera modules are combined in some embodiments without the need for computationally rotating an image thanks to the rotation of the sensor in the camera module used to capture the image.Type: GrantFiled: June 12, 2018Date of Patent: June 2, 2020Assignee: Light Labs Inc.Inventors: Rajiv Laroia, Sapna A. Shroff
-
Patent number: 10531007Abstract: Methods and apparatus for supporting zoom operations using a plurality of optical chain modules, e.g., camera modules, are described. Switching between use of groups of optical chains with different focal lengths is used to support zoom operations. Digital zoom is used in some cases to support zoom levels corresponding to levels between the zoom levels of different optical chain groups or discrete focal lengths to which optical chains may be switched. In some embodiments optical chains have adjustable focal lengths and are switched between different focal lengths. In other embodiments optical chains have fixed focal lengths with different optical chain groups corresponding to different fixed focal lengths. Composite images are generate from images captured by multiple optical chains of the same group and/or different groups. Composite image is in accordance with a user zoom control setting. Individual composite images may be generated and/or a video sequence.Type: GrantFiled: July 3, 2018Date of Patent: January 7, 2020Assignee: Light Labs Inc.Inventor: Rajiv Laroia
-
Patent number: 10516834Abstract: Methods and apparatus provide for simulated, e.g., synthetic, aperture control. In some embodiments a user, after a camera autofocus or user selection of an object to focus on, sets a blur level and views the effect. Once the user controlled blur setting is complete, images are captured with the in-focus, e.g., autofocus, setting and other images are captured with the focus set to capture a blurred image based on the set blur level. In focus and out of focus images are captured in parallel using different camera modules in some embodiments. A composite image is generated by combining portions of one or more sharp and blurred images. Thus a user can capture portions of images with a desired level of blurriness without risking blurring other portions of an image while controlling how the captured images are combined to form a composite image with in-focus and blurred portions.Type: GrantFiled: August 28, 2017Date of Patent: December 24, 2019Assignee: Light Labs Inc.Inventor: Sapna A. Shroff
-
Patent number: 10419672Abstract: In various embodiments a camera with multiple optical chains, e.g., camera modules, is controlled to operate in one of a variety of supported modes of operation. The modes include a non-motion mode, a motion mode, a normal burst mode and/or a reduced data burst mode. Motion mode is well suited for capturing an image including motion, e.g., moving object(s) with some modules being used to capture scene areas using a shorter exposure time than other modules and the captured images then being combined taking into consideration locations of motion. A reduced data burst mode is supported in some embodiments in which camera modules with different focal lengths capture images at different rates. While the camera modules of different focal length operate at different image capture rates in the reduced data burst mode, images are combined to support a desired composite image output rate, e.g., a desired frame rate.Type: GrantFiled: March 6, 2018Date of Patent: September 17, 2019Assignee: Light Labs Inc.Inventors: Rajiv Laroia, Nitesh Shroff, Sapna A. Shroff
-
Patent number: 10274706Abstract: Methods and apparatus for controlling the read out of rows of pixel values from sensors corresponding to different optical chains used to capture portions of the same image area are described. The readout is controlled based on user input and/or determinations with regard to the rate of motion in captured images or portions of captured images. For a low rate of motion i, the readout rate of a sensor corresponding to a small focal length is slowed down while the pixel row readout rate of one or more sensors corresponding to one or more optical chains have larger focal lengths are allowed to proceed at a normal rate. For a high rate of motion, the read out rate of the sensor corresponding to the optical chain having the smaller focal length is allowed to proceed at the normal rate.Type: GrantFiled: January 16, 2017Date of Patent: April 30, 2019Assignee: Light Labs Inc.Inventor: Rajiv Laroia
-
Patent number: 10225445Abstract: Methods and apparatus for providing a user of a camera information about the status of one or more lenses and/or providing a subject of a photograph an indicator of where to look during image capture are described. In some embodiments different sets of camera modules are used for taking photographs depending on user input and/or the distance to the objects to be captured. In various embodiments an indicator, e.g., light emitting element, is associated with each of the different sets of camera modules which maybe used to indicate where a subject should look during image capture by the corresponding set of camera modules. In some embodiment dirty lenses of the camera are detected and the user is notified of the dirty lenses through an audible and/or visual indication. In some embodiments the indication of which lens/lenses are dirty is provided by illuminating light emitting elements corresponding to the dirty lens(es).Type: GrantFiled: December 21, 2015Date of Patent: March 5, 2019Assignee: Light Labs Inc.Inventor: Bradley Lautenbach
-
Patent number: 10205862Abstract: Camera methods and apparatus are described where the camera device includes multiple optical chains. In various embodiments two or more of the optical chains include light redirection devices such as mirrors or prisms. Sensors corresponding to multiple different optical chains, but not necessarily all optical chains, are parallel to each other. In some embodiments sensors corresponding to different optical chains are located in the same plane at the front or rear of the camera. However other sensor mounting positions are also possible.Type: GrantFiled: August 28, 2017Date of Patent: February 12, 2019Assignee: Light Labs Inc.Inventor: Rajiv Laroia
-
Patent number: 10191356Abstract: The present application relates to image capture and generation methods and apparatus and, more particularly, to methods and apparatus which detect and/or indicate a dirty lens condition. One embodiment of the present invention includes a method of operating a camera including the steps of capturing a first image using a first lens of the camera; determining, based on at least the first image, if a dirty camera lens condition exists; and in response to determining that a dirty lens condition exists, generating a dirty lens condition notification or initiating an automatic camera lens cleaning operation. In some embodiments multiple captured images with overlapping image regions are compared to determine if a dirty lens condition exists.Type: GrantFiled: July 3, 2015Date of Patent: January 29, 2019Assignee: Light Labs Inc.Inventors: Rajiv Laroia, Sapna A. Shroff
-
Patent number: 10129483Abstract: Methods and apparatus for implementing a camera device including multiple camera modules and which supports zoom operations are described. A plurality of moveable camera modules are included with the position of the moveable camera modules being controlled as a function of a zoom setting. One or more fixed camera modules are also included to facilitate image combining. A fixed camera module having a smaller focal length than the movable camera modules is used in some embodiments to capture a scene area including scene area portions which will be captured by movable camera modules. The image captured by the fixed camera module, with the small focal length, is used in aligning images captured by the movable camera modules during generation of a composite image. The camera may also include another fixed camera module, e.g., having the same focal length as the movable camera modules, for capturing the center of a scene.Type: GrantFiled: June 23, 2016Date of Patent: November 13, 2018Assignee: Light Labs Inc.Inventor: Sapna A Shroff
-
Patent number: 10120159Abstract: Methods and apparatus for performing a zoom operation are described using multiple optical chains in a camera device. At least one optical chain in the camera device includes a moveable light redirection device, said light redirection device being one of a substantially plane mirror or a prism. The moveable light redirection device is moved to a position in accordance with a zoom setting, and a portion of a scene area of interest in captured. Different discrete zoom setting values correspond to different positions of the moveable light redirection device resulting in different capture areas. In some embodiments, multiple optical chains with moveable light redirection devices are used to capture different portions of a scene of interest. A composite image is generated from a plurality of captured images corresponding to different optical chains. A higher zoom setting corresponds to more overlap between captured images of different optical chains.Type: GrantFiled: August 1, 2016Date of Patent: November 6, 2018Assignee: Light Labs Inc.Inventor: Rajiv Laroia
-
Patent number: 10110794Abstract: A camera device includes multiple sensors with each sensor including an integrated multi-element filter. Because of the use of different filters in different sensors, a wide variety of filter patterns can be supported in a single camera device without the need for moveable or otherwise changeable filters. While multiple optical chains and sensors are included which sensors are used during a given time period are determined based on the whether a power save mode of operation is active and/or the image capture mode being used. Fewer optical chains are used during power save mode for capturing images corresponding to the image mode in use, e.g., color, IR, or monochrome. While the camera device may include a large number of optical modules, e.g., 4, 10 or more, in some embodiments sensors of optical chains not selected for use during a given time period are intentionally powered down to conserve power.Type: GrantFiled: July 9, 2015Date of Patent: October 23, 2018Assignee: Light Labs Inc.Inventors: Rajiv Laroia, Sapna A. Shroff
-
Camera methods and apparatus using optical chain modules which alter the direction of received light
Patent number: 10101566Abstract: Methods and apparatus for capturing or generating images using multiple optical chains operating in parallel are described. Pixel values captured by individual optical chains corresponding to the same scene area are combined to provide an image with at least some of the benefits which would have been provided by capturing an image of the scene using a larger lens than that of the individual lenses of the optical chain modules. By using multiple optical chains in parallel at least some benefits normally obtained from using a large lens can be obtained without the need for a large lens. Furthermore in at least some embodiments, a wide dynamic range can be supported through the use of multiple sensors with the overall supported dynamic range being potentially larger than that of the individual sensors. Some lens and/or optical chain configurations are designed for use in small handheld devices, e.g., cell phones.Type: GrantFiled: June 27, 2017Date of Patent: October 16, 2018Assignee: Light Labs Inc.Inventor: Rajiv Laroia -
Patent number: 10091447Abstract: Methods and apparatus for reading out pixel values from sensors in a synchronized manner are described. Readout of rows of pixel values from different sensors are controlled so that pixel values of different sensors corresponding to the same portion of a scene are read out in a way that the same portions of a scene are captured at the same or nearly the same time by different sensors. In one embodiment a first sensor which captures a large scene area alternates between reading out rows of pixel values from a top portion and a bottom portion of the first sensor while sensors corresponding to smaller areas of the scene read out rows of pixel values in a consecutive manner. Sensors may read out rows of pixel values at the same rate despite corresponding to optical chains with different focal lengths. The image captured by the first sensor facilitates image combining.Type: GrantFiled: April 16, 2016Date of Patent: October 2, 2018Assignee: Light Labs Inc.Inventors: Rajiv Laroia, Nitesh Shroff
-
Patent number: 10075651Abstract: Methods and apparatus for capturing images using a camera device including multiple camera modules, e.g., multiple optical chains, in an efficient manner are described. Different camera devices in the camera device may capture images corresponding to different size fields of view of a scene area. User input is used to identify an object of interest. A first type camera module having a large field of view is used to track the identified object of interest. Sets of second type camera modules having a smaller field of view are used to capture images of the object of interest. Different sets of second type camera modules may be used at different times as a function of object of interest location. In some embodiments, at least some second type camera modules include the capability to adjust, e.g., move, image capture area, e.g., by changing a mirror angle inclination and/or a mirror rotation.Type: GrantFiled: April 22, 2015Date of Patent: September 11, 2018Assignee: Light Labs Inc.Inventors: Rajiv Laroia, Sapna A. Shroff
-
Patent number: 10048472Abstract: Methods and apparatus for implementing a camera having a depth which is less than the maximum length of the outer lens of at least one optical chain of the camera are described. In some embodiments a light redirection device, e.g., a mirror, is used to allow a relatively long optical chain with a relatively large non-circular outer lens. In some embodiments the light redirection device has a depth, e.g., front of camera to back of camera dimension, which is less than the maximum length of the aperture of the outer lens in the aperture's direction of maximum extent. Multiple optical chains with non-circular outer lenses arranged in different directions may and in some embodiments are used to capture images with the captured images being combined to generate a composite image.Type: GrantFiled: January 10, 2017Date of Patent: August 14, 2018Assignee: Light Labs Inc.Inventor: Rajiv Laroia
-
Patent number: 10051182Abstract: Methods and apparatus for compensating for motion and/or changing light conditions during image capture, e.g., in video, through use of multiple camera modules and/or images captured by multiple camera modules are described. During image capture time periods a plurality of camera modules capture images. During a first image capture time period a first camera module captures an image including a complete image of a user selected scene area of interest. During an additional image capture time period the first camera module captures an image including a portion of the scene area of interest; however, a portion of the scene area image is missing from the captured image, e.g., due to camera motion, occlusion and/or lighting conditions. Captured images from other camera modules and/or from during different image capture time periods which include the missing portion are identified and ranked; the highest ranked image is used in generating a composite image.Type: GrantFiled: October 5, 2016Date of Patent: August 14, 2018Assignee: Light Labs Inc.Inventors: Kari Pulli, Nitesh Shroff, Sapna A. Shroff