Patents Assigned to Light Labs Inc.
  • Patent number: 11180117
    Abstract: A wiper is controlled to sweep a surface area, e.g., a portion of a windshield, in front of a camera, e.g., a camera mounted inside a vehicle. An image captured from the camera after the wiper completes, e.g., immediately completes, the sweep of the surface area in front of the camera is used in generating a depth map. In some embodiments a first wiper is controlled to clear a surface area in front of a first camera while a second wiper is controlled to clear a surface area in front of second camera at the same time, and the first and second cameras are synchronized to initiate image capture at the same time, capturing images through recently cleared area, and the captured images are used to generate a depth map. A vehicle control operation, e.g., a direction, braking or speed control operation is performed based on the depth map.
    Type: Grant
    Filed: December 11, 2019
    Date of Patent: November 23, 2021
    Assignee: Light Labs Inc.
    Inventors: Atul Maharshi, Pablo A Anigstein, Rajiv Laroia
  • Patent number: 11064124
    Abstract: Methods and apparatus for supporting zoom operations using a plurality of optical chain modules, e.g., camera modules, are described. Switching between use of groups of optical chains with different focal lengths is used to support zoom operations. Digital zoom is used in some cases to support zoom levels corresponding to levels between the zoom levels of different optical chain groups or discrete focal lengths to which optical chains may be switched. In some embodiments optical chains have adjustable focal lengths and are switched between different focal lengths. In other embodiments optical chains have fixed focal lengths with different optical chain groups corresponding to different fixed focal lengths. Composite images are generate from images captured by multiple optical chains of the same group and/or different groups. Composite image is in accordance with a user zoom control setting. Individual composite images may be generated and/or a video sequence.
    Type: Grant
    Filed: January 6, 2020
    Date of Patent: July 13, 2021
    Assignee: Light Labs Inc.
    Inventor: Rajiv Laroia
  • Patent number: 10931866
    Abstract: A camera device including multiple optical chains receives user input indicating one or more user selectable control option setting(s), e.g., a user selected depth of field control option setting and an aspect ratio control option setting. The indicated control option settings are stored in memory in the camera device. Multiple optical chains of the camera device capture an image during an image capture time interval. A set of captured images are stored in a file along with metadata including the user indicated control option settings. A composite image is generated from a set of captured images in accordance with the stored indicated control option settings, e.g., generating a composite image with a user selected depth of field and/or a user selected aspect ratio. In some embodiments, at least some of the user selected control option settings are not used during image capture operations but are used in subsequent image processing.
    Type: Grant
    Filed: October 18, 2016
    Date of Patent: February 23, 2021
    Assignee: Light Labs Inc.
    Inventors: Rajiv Laroia, Fan Sai Kuok, Jannie Lai, Jared Torres Calinisan, Feng Li
  • Patent number: 10674050
    Abstract: A camera device with a sensor which is mounted at an angle relative to a mounting surface or other reference surface is described. Camera modules, which include mirrors for light redirection, which are mounted at different angles in the camera device have sensors with different amounts of rotation. In some embodiments modules without mirrors use camera modules without rotated sensors while camera modules with mirrors may or may not use sensors which are rotated depending on the angle at which the modules are mounted in the camera device. By rotating the sensors of some camera modules rotation that maybe introduced by the angle at which a camera module is mounted can be offset. The images captured by different camera modules are combined in some embodiments without the need for computationally rotating an image thanks to the rotation of the sensor in the camera module used to capture the image.
    Type: Grant
    Filed: June 12, 2018
    Date of Patent: June 2, 2020
    Assignee: Light Labs Inc.
    Inventors: Rajiv Laroia, Sapna A. Shroff
  • Patent number: 10670858
    Abstract: Methods and apparatus for maintaining, adjusting and/or accurately determining the position of a moveable element, e.g., a moveable shaft mounted component are described. The moveable component may be, for example, a mirror or mirror support of a camera module. A hall sensor is used to measure distance to the moveable component. To facilitate the distance measurement a magnet is secured to the moveable component. The hall sensor is used to determine the distance between the magnet and sensor. A metal plate is placed along a side of one of the supports used to support the shaft to which the moveable component is attached. The magnet which facilitates distance measurement is attracted to the plate reducing the risk of side to side movement even when the shaft fits loosely in the supports and is rotated. The magnet facilitates distance measurements and reliable control of position relative to the sidewall plate.
    Type: Grant
    Filed: May 21, 2017
    Date of Patent: June 2, 2020
    Assignee: Light Labs Inc.
    Inventors: James Schmieder, Liang-Jiun Lin
  • Patent number: 10531007
    Abstract: Methods and apparatus for supporting zoom operations using a plurality of optical chain modules, e.g., camera modules, are described. Switching between use of groups of optical chains with different focal lengths is used to support zoom operations. Digital zoom is used in some cases to support zoom levels corresponding to levels between the zoom levels of different optical chain groups or discrete focal lengths to which optical chains may be switched. In some embodiments optical chains have adjustable focal lengths and are switched between different focal lengths. In other embodiments optical chains have fixed focal lengths with different optical chain groups corresponding to different fixed focal lengths. Composite images are generate from images captured by multiple optical chains of the same group and/or different groups. Composite image is in accordance with a user zoom control setting. Individual composite images may be generated and/or a video sequence.
    Type: Grant
    Filed: July 3, 2018
    Date of Patent: January 7, 2020
    Assignee: Light Labs Inc.
    Inventor: Rajiv Laroia
  • Patent number: 10523872
    Abstract: Methods and apparatus for implementing a camera device including multiple camera modules and which supports zoom operations are described. A plurality of moveable camera modules are included with the position of the moveable camera modules being controlled as a function of a zoom setting. One or more fixed camera modules are also included to facilitate image combining. A fixed camera module having a smaller focal length than the movable camera modules is used in some embodiments to capture a scene area including scene area portions which will be captured by movable camera modules. The image captured by the fixed camera module, with the small focal length, is used in aligning images captured by the movable camera modules during generation of a composite image. The camera may also include another fixed camera module, e.g., having the same focal length as the movable camera modules, for capturing the center of a scene.
    Type: Grant
    Filed: October 16, 2018
    Date of Patent: December 31, 2019
    Assignee: LIGHT LABS INC.
    Inventor: Sapna A Shroff
  • Patent number: 10516834
    Abstract: Methods and apparatus provide for simulated, e.g., synthetic, aperture control. In some embodiments a user, after a camera autofocus or user selection of an object to focus on, sets a blur level and views the effect. Once the user controlled blur setting is complete, images are captured with the in-focus, e.g., autofocus, setting and other images are captured with the focus set to capture a blurred image based on the set blur level. In focus and out of focus images are captured in parallel using different camera modules in some embodiments. A composite image is generated by combining portions of one or more sharp and blurred images. Thus a user can capture portions of images with a desired level of blurriness without risking blurring other portions of an image while controlling how the captured images are combined to form a composite image with in-focus and blurred portions.
    Type: Grant
    Filed: August 28, 2017
    Date of Patent: December 24, 2019
    Assignee: Light Labs Inc.
    Inventor: Sapna A. Shroff
  • Patent number: 10509208
    Abstract: Methods and apparatus for implementing a camera having a depth which is less than the maximum length of the outer lens of at least one optical chain of the camera are described. In some embodiments a light redirection device, e.g., a mirror, is used to allow a relatively long optical chain with a relatively large non-circular outer lens. In some embodiments the light redirection device has a depth, e.g., front of camera to back of camera dimension, which is less than the maximum length of the aperture of the outer lens in the aperture's direction of maximum extent. Multiple optical chains with non-circular outer lenses arranged in different directions may and in some embodiments are used to capture images with the captured images being combined to generate a composite image.
    Type: Grant
    Filed: August 14, 2018
    Date of Patent: December 17, 2019
    Assignee: LIGHT LABS INC.
    Inventor: Rajiv Laroia
  • Patent number: 10491806
    Abstract: Various features for allowing a user to control a camera in an intuitive manner are described. Various features allow a user to control one or more camera settings via a touch screen. In some embodiments a rotating wheel is simulated on the display screen to show user selectable camera setting values with the values being displayed as if on the surface of the wheel with a currently selected value being closest to the user, e.g., in the center, and values above and below the currently selected value being shown using a smaller size as if further away from the user. A current setting for the feature being controlled is displayed near the center of the screen in some embodiments. A currently selected value is sometimes shown larger than other user selectable settings. The camera settings include an ISO setting, a focal length, e.g., zoom setting, and/or an exposure control setting.
    Type: Grant
    Filed: October 5, 2015
    Date of Patent: November 26, 2019
    Assignee: LIGHT LABS INC.
    Inventors: Jannie Lai, Joseph Engel, Jared Calinisan, Fan Sai Kuok
  • Patent number: 10419672
    Abstract: In various embodiments a camera with multiple optical chains, e.g., camera modules, is controlled to operate in one of a variety of supported modes of operation. The modes include a non-motion mode, a motion mode, a normal burst mode and/or a reduced data burst mode. Motion mode is well suited for capturing an image including motion, e.g., moving object(s) with some modules being used to capture scene areas using a shorter exposure time than other modules and the captured images then being combined taking into consideration locations of motion. A reduced data burst mode is supported in some embodiments in which camera modules with different focal lengths capture images at different rates. While the camera modules of different focal length operate at different image capture rates in the reduced data burst mode, images are combined to support a desired composite image output rate, e.g., a desired frame rate.
    Type: Grant
    Filed: March 6, 2018
    Date of Patent: September 17, 2019
    Assignee: Light Labs Inc.
    Inventors: Rajiv Laroia, Nitesh Shroff, Sapna A. Shroff
  • Patent number: 10365480
    Abstract: Methods and apparatus relating to a camera including one or more optical chains with a light redirection device, e.g., mirror, and an outer protective cover are described. The cover maybe a flat or sloped surface or a lens. Features avoid stray light rays from reaching an image sensor of an optical chain. In some but not all embodiments a 2-sided anti-reflection coating is used on the cover to avoid or reduce back reflections from the cover into the optical system. In some embodiments mirror angles are limited to a range in which stray light reflections are directed away from the camera module. In some embodiments a tilted cover configuration is used where the cover is sloped relative to a face of the camera and/or camera module. Different features such as the sloped cover glass, control of mirror angle, and/or antireflective coating can be used alone or in combination.
    Type: Grant
    Filed: June 28, 2016
    Date of Patent: July 30, 2019
    Assignee: LIGHT LABS INC.
    Inventors: Rajiv Laroia, Sapna A Shroff, James Schmieder
  • Patent number: 10353195
    Abstract: Methods and apparatus for implementing optical chains, e.g., camera modules, which can be used in a camera device are described as well as camera devices including multiple camera modules. In various embodiments one or more camera modules include mirror assemblies which support a movable mirror. The mirror is driven in some embodiments by a linear actuator, e.g., piezo electric actuator with the linear motion of the actuator's push rod being converted into angular mirror rotation by use of hinge, e.g., pivot on which the mirror is mounted. A return spring provide a force contrary to that provided by the actuator. A recess is included in a mounting board to allow the bottom of the mirror or a portion of the mirror mounting hinge to be placed below the surface of the mounting board to which the camera module is secured.
    Type: Grant
    Filed: December 25, 2017
    Date of Patent: July 16, 2019
    Assignee: LIGHT LABS INC.
    Inventors: Harpuneet Singh, James Schmieder, Sapna A. Shroff
  • Patent number: 10306218
    Abstract: An exemplary camera calibration apparatus includes a movable, e.g., rotatable, support structure which is controllably positioned to allow for image capture of different test patterns and image capture of the same pattern at different distances by a mounted camera. A first test pattern is mounted on a wall, e.g., a pyramid shaped 4 sided wall formed by panels surrounding the camera under calibration. The movable support structure has a first mirror attached to a first side and has a second test pattern attached to a second side. A second mirror mounted on an internal sidewall of the calibration apparatus housing facilities a different image path distance between the camera capturing the image of the first test pattern and the first test pattern. The exemplary camera calibration apparatus is well suited for efficiently calibrating camera devices including a plurality of camera modules, e.g., optical chains, in a relatively small area.
    Type: Grant
    Filed: June 24, 2016
    Date of Patent: May 28, 2019
    Assignee: LIGHT LABS INC.
    Inventors: Nitesh Shroff, Weiguang Si, Nagilla Dikpal Reddy, John Sasinowski, Nghi Phan, Jiamin Bai, Harpuneet Singh, Rajiv Laroia
  • Patent number: 10274706
    Abstract: Methods and apparatus for controlling the read out of rows of pixel values from sensors corresponding to different optical chains used to capture portions of the same image area are described. The readout is controlled based on user input and/or determinations with regard to the rate of motion in captured images or portions of captured images. For a low rate of motion i, the readout rate of a sensor corresponding to a small focal length is slowed down while the pixel row readout rate of one or more sensors corresponding to one or more optical chains have larger focal lengths are allowed to proceed at a normal rate. For a high rate of motion, the read out rate of the sensor corresponding to the optical chain having the smaller focal length is allowed to proceed at the normal rate.
    Type: Grant
    Filed: January 16, 2017
    Date of Patent: April 30, 2019
    Assignee: Light Labs Inc.
    Inventor: Rajiv Laroia
  • Patent number: 10225445
    Abstract: Methods and apparatus for providing a user of a camera information about the status of one or more lenses and/or providing a subject of a photograph an indicator of where to look during image capture are described. In some embodiments different sets of camera modules are used for taking photographs depending on user input and/or the distance to the objects to be captured. In various embodiments an indicator, e.g., light emitting element, is associated with each of the different sets of camera modules which maybe used to indicate where a subject should look during image capture by the corresponding set of camera modules. In some embodiment dirty lenses of the camera are detected and the user is notified of the dirty lenses through an audible and/or visual indication. In some embodiments the indication of which lens/lenses are dirty is provided by illuminating light emitting elements corresponding to the dirty lens(es).
    Type: Grant
    Filed: December 21, 2015
    Date of Patent: March 5, 2019
    Assignee: Light Labs Inc.
    Inventor: Bradley Lautenbach
  • Patent number: 10205862
    Abstract: Camera methods and apparatus are described where the camera device includes multiple optical chains. In various embodiments two or more of the optical chains include light redirection devices such as mirrors or prisms. Sensors corresponding to multiple different optical chains, but not necessarily all optical chains, are parallel to each other. In some embodiments sensors corresponding to different optical chains are located in the same plane at the front or rear of the camera. However other sensor mounting positions are also possible.
    Type: Grant
    Filed: August 28, 2017
    Date of Patent: February 12, 2019
    Assignee: Light Labs Inc.
    Inventor: Rajiv Laroia
  • Patent number: 10191356
    Abstract: The present application relates to image capture and generation methods and apparatus and, more particularly, to methods and apparatus which detect and/or indicate a dirty lens condition. One embodiment of the present invention includes a method of operating a camera including the steps of capturing a first image using a first lens of the camera; determining, based on at least the first image, if a dirty camera lens condition exists; and in response to determining that a dirty lens condition exists, generating a dirty lens condition notification or initiating an automatic camera lens cleaning operation. In some embodiments multiple captured images with overlapping image regions are compared to determine if a dirty lens condition exists.
    Type: Grant
    Filed: July 3, 2015
    Date of Patent: January 29, 2019
    Assignee: Light Labs Inc.
    Inventors: Rajiv Laroia, Sapna A. Shroff
  • Patent number: 10129483
    Abstract: Methods and apparatus for implementing a camera device including multiple camera modules and which supports zoom operations are described. A plurality of moveable camera modules are included with the position of the moveable camera modules being controlled as a function of a zoom setting. One or more fixed camera modules are also included to facilitate image combining. A fixed camera module having a smaller focal length than the movable camera modules is used in some embodiments to capture a scene area including scene area portions which will be captured by movable camera modules. The image captured by the fixed camera module, with the small focal length, is used in aligning images captured by the movable camera modules during generation of a composite image. The camera may also include another fixed camera module, e.g., having the same focal length as the movable camera modules, for capturing the center of a scene.
    Type: Grant
    Filed: June 23, 2016
    Date of Patent: November 13, 2018
    Assignee: Light Labs Inc.
    Inventor: Sapna A Shroff
  • Patent number: 10120159
    Abstract: Methods and apparatus for performing a zoom operation are described using multiple optical chains in a camera device. At least one optical chain in the camera device includes a moveable light redirection device, said light redirection device being one of a substantially plane mirror or a prism. The moveable light redirection device is moved to a position in accordance with a zoom setting, and a portion of a scene area of interest in captured. Different discrete zoom setting values correspond to different positions of the moveable light redirection device resulting in different capture areas. In some embodiments, multiple optical chains with moveable light redirection devices are used to capture different portions of a scene of interest. A composite image is generated from a plurality of captured images corresponding to different optical chains. A higher zoom setting corresponds to more overlap between captured images of different optical chains.
    Type: Grant
    Filed: August 1, 2016
    Date of Patent: November 6, 2018
    Assignee: Light Labs Inc.
    Inventor: Rajiv Laroia