Patents by Inventor Sapna Shroff

Sapna Shroff has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20180359394
    Abstract: A camera device with a sensor which is mounted at an angle relative to a mounting surface or other reference surface is described. Camera modules, which include mirrors for light redirection, which are mounted at different angles in the camera device have sensors with different amounts of rotation. In some embodiments modules without mirrors use camera modules without rotated sensors while camera modules with mirrors may or may not use sensors which are rotated depending on the angle at which the modules are mounted in the camera device. By rotating the sensors of some camera modules rotation that maybe introduced by the angle at which a camera module is mounted can be offset. The images captured by different camera modules are combined in some embodiments without the need for computationally rotating an image thanks to the rotation of the sensor in the camera module used to capture the image.
    Type: Application
    Filed: June 12, 2018
    Publication date: December 13, 2018
    Inventors: Rajiv Laroia, Sapna A. Shroff
  • Patent number: 10129483
    Abstract: Methods and apparatus for implementing a camera device including multiple camera modules and which supports zoom operations are described. A plurality of moveable camera modules are included with the position of the moveable camera modules being controlled as a function of a zoom setting. One or more fixed camera modules are also included to facilitate image combining. A fixed camera module having a smaller focal length than the movable camera modules is used in some embodiments to capture a scene area including scene area portions which will be captured by movable camera modules. The image captured by the fixed camera module, with the small focal length, is used in aligning images captured by the movable camera modules during generation of a composite image. The camera may also include another fixed camera module, e.g., having the same focal length as the movable camera modules, for capturing the center of a scene.
    Type: Grant
    Filed: June 23, 2016
    Date of Patent: November 13, 2018
    Assignee: Light Labs Inc.
    Inventor: Sapna A Shroff
  • Patent number: 10110794
    Abstract: A camera device includes multiple sensors with each sensor including an integrated multi-element filter. Because of the use of different filters in different sensors, a wide variety of filter patterns can be supported in a single camera device without the need for moveable or otherwise changeable filters. While multiple optical chains and sensors are included which sensors are used during a given time period are determined based on the whether a power save mode of operation is active and/or the image capture mode being used. Fewer optical chains are used during power save mode for capturing images corresponding to the image mode in use, e.g., color, IR, or monochrome. While the camera device may include a large number of optical modules, e.g., 4, 10 or more, in some embodiments sensors of optical chains not selected for use during a given time period are intentionally powered down to conserve power.
    Type: Grant
    Filed: July 9, 2015
    Date of Patent: October 23, 2018
    Assignee: Light Labs Inc.
    Inventors: Rajiv Laroia, Sapna A. Shroff
  • Publication number: 20180270419
    Abstract: In various embodiments a camera with multiple optical chains, e.g., camera modules, is controlled to operate in one of a variety of supported modes of operation. The modes include a non-motion mode, a motion mode, a normal burst mode and/or a reduced data burst mode. Motion mode is well suited for capturing an image including motion, e.g., moving object(s) with some modules being used to capture scene areas using a shorter exposure time than other modules and the captured images then being combined taking into consideration locations of motion. A reduced data burst mode is supported in some embodiments in which camera modules with different focal lengths capture images at different rates. While the camera modules of different focal length operate at different image capture rates in the reduced data burst mode, images are combined to support a desired composite image output rate, e.g., a desired frame rate.
    Type: Application
    Filed: March 6, 2018
    Publication date: September 20, 2018
    Inventors: Rajiv Laroia, Nitesh Shroff, Sapna A. Shroff
  • Patent number: 10075651
    Abstract: Methods and apparatus for capturing images using a camera device including multiple camera modules, e.g., multiple optical chains, in an efficient manner are described. Different camera devices in the camera device may capture images corresponding to different size fields of view of a scene area. User input is used to identify an object of interest. A first type camera module having a large field of view is used to track the identified object of interest. Sets of second type camera modules having a smaller field of view are used to capture images of the object of interest. Different sets of second type camera modules may be used at different times as a function of object of interest location. In some embodiments, at least some second type camera modules include the capability to adjust, e.g., move, image capture area, e.g., by changing a mirror angle inclination and/or a mirror rotation.
    Type: Grant
    Filed: April 22, 2015
    Date of Patent: September 11, 2018
    Assignee: Light Labs Inc.
    Inventors: Rajiv Laroia, Sapna A. Shroff
  • Patent number: 10051182
    Abstract: Methods and apparatus for compensating for motion and/or changing light conditions during image capture, e.g., in video, through use of multiple camera modules and/or images captured by multiple camera modules are described. During image capture time periods a plurality of camera modules capture images. During a first image capture time period a first camera module captures an image including a complete image of a user selected scene area of interest. During an additional image capture time period the first camera module captures an image including a portion of the scene area of interest; however, a portion of the scene area image is missing from the captured image, e.g., due to camera motion, occlusion and/or lighting conditions. Captured images from other camera modules and/or from during different image capture time periods which include the missing portion are identified and ranked; the highest ranked image is used in generating a composite image.
    Type: Grant
    Filed: October 5, 2016
    Date of Patent: August 14, 2018
    Assignee: Light Labs Inc.
    Inventors: Kari Pulli, Nitesh Shroff, Sapna A. Shroff
  • Publication number: 20180188523
    Abstract: Methods and apparatus for implementing optical chains, e.g., camera modules, which can be used in a camera device are described as well as camera devices including multiple camera modules. In various embodiments one or more camera modules include mirror assemblies which support a movable mirror. The mirror is driven in some embodiments by a linear actuator, e.g., piezo electric actuator with the linear motion of the actuator's push rod being converted into angular mirror rotation by use of hinge, e.g., pivot on which the mirror is mounted. A return spring provide a force contrary to that provided by the actuator. A recess is included in a mounting board to allow the bottom of the mirror or a portion of the mirror mounting hinge to be placed below the surface of the mounting board to which the camera module is secured.
    Type: Application
    Filed: December 25, 2017
    Publication date: July 5, 2018
    Inventors: Harpuneet Singh, James Schmieder, Sapna A. Shroff
  • Patent number: 9998638
    Abstract: A camera device with a sensor which is mounted at an angle relative to a mounting surface or other reference surface is described. Camera modules, which include mirrors for light redirection, which are mounted at different angles in the camera device have sensors with different amounts of rotation. In some embodiments modules without mirrors use camera modules without rotated sensors while camera modules with mirrors may or may not use sensors which are rotated depending on the angle at which the modules are mounted in the camera device. By rotating the sensors of some camera modules rotation that maybe introduced by the angle at which a camera module is mounted can be offset. The images captured by different camera modules are combined in some embodiments without the need for computationally rotating an image thanks to the rotation of the sensor in the camera module used to capture the image.
    Type: Grant
    Filed: December 21, 2015
    Date of Patent: June 12, 2018
    Assignee: Light Labs Inc.
    Inventors: Rajiv Laroia, Sapna A Shroff
  • Patent number: 9979878
    Abstract: Zoom and focus control user interface methods and apparatus are described. Acceleration is monitored and interpreted to detect camera motion. Acceleration indicative of camera motion in a forward or backward direction is used to control zoom in or zoom out operations when a zoom function is enabled. The zoom function can be enabled by touching a touch sensor or pressing a button. Thus, by activating the zoom function and making intuitive movements forward or backward which can be detected through the use of sensors, a user can control zoom in and zoom out operations in an intuitive manner with little risk of shaking the camera or interfering with image capture that might occur if a touch display or other zoom control was used to control zoom operation while capturing one or more images. The zoom control function is well suited for use with still cameras and video cameras.
    Type: Grant
    Filed: February 20, 2015
    Date of Patent: May 22, 2018
    Assignee: Light Labs Inc.
    Inventors: Rajiv Laroia, Sapna A Shroff
  • Patent number: 9967535
    Abstract: Various features relating to reducing and/or eliminating noise from images are described. In some embodiments depth based denoising is used on images captured by one or more camera modules based on depth information of a scene area and optical characteristics of the one or more camera modules used to captures the images. In some embodiments by taking into consideration the camera module optics and the depth of the object included in the image portion, a maximum expected frequency can be determined and the image portion is then filtered to reduce or remove frequencies above the maximum expected frequency. In this way noise can be reduced or eliminated from image portions captured by one or more camera modules. The optical characteristic of different camera modules may be different. In some embodiments a maximum expected frequency is determined on a per camera module and depth basis.
    Type: Grant
    Filed: September 18, 2015
    Date of Patent: May 8, 2018
    Assignee: Light Labs Inc.
    Inventors: Rajiv Laroia, Nitesh Shroff, Sapna A Shroff
  • Patent number: 9948858
    Abstract: Methods and apparatus for processing images captured by a camera device including multiple optical chains, e.g., camera modules, are described. Three, 4, 5 or more optical chains maybe used. Different optical chains capture different images due to different perspectives. Multiple images, e.g., corresponding to different perspectives, are captured during a time period and are combined to generate a composite image. In some embodiments one of the captured images or a synthesized image is used as a reference image during composite image generation. The image used as the reference image is selected to keep the perspective of sequentially generated composite images consistent despite unintentional came movement and/or in accordance with an expected path of travel. Thus, which camera module provides the reference image may vary over time taking into consideration unintended camera movement. Composite image generation may be performed external to the camera device or in the camera device.
    Type: Grant
    Filed: August 22, 2016
    Date of Patent: April 17, 2018
    Assignee: Light Labs Inc.
    Inventors: Rajiv Laroia, Sapna A Shroff
  • Patent number: 9912864
    Abstract: In various embodiments a camera with multiple optical chains, e.g., camera modules, is controlled to operate in one of a variety of supported modes of operation. The modes include a non-motion mode, a motion mode, a normal burst mode and/or a reduced data burst mode. Motion mode is well suited for capturing an image including motion, e.g., moving object(s) with some modules being used to capture scene areas using a shorter exposure time than other modules and the captured images then being combined taking into consideration locations of motion. A reduced data burst mode is supported in some embodiments in which camera modules with different focal lengths capture images at different rates. While the camera modules of different focal length operate at different image capture rates in the reduced data burst mode, images are combined to support a desired composite image output rate, e.g., a desired frame rate.
    Type: Grant
    Filed: October 17, 2015
    Date of Patent: March 6, 2018
    Assignee: Light Labs Inc.
    Inventors: Rajiv Laroia, Nitesh Shroff, Sapna A. Shroff
  • Patent number: 9912865
    Abstract: In various embodiments a camera with multiple optical chains, e.g., camera modules, is controlled to operate in one of a variety of supported modes of operation. The modes include a non-motion mode, a motion mode, a normal burst mode and/or a reduced data burst mode. Motion mode is well suited for capturing an image including motion, e.g., moving object(s) with some modules being used to capture scene areas using a shorter exposure time than other modules and the captured images then being combined taking into consideration locations of motion. A reduced data burst mode is supported in some embodiments in which camera modules with different focal lengths capture images at different rates. While the camera modules of different focal length operate at different image capture rates in the reduced data burst mode, images are combined to support a desired composite image output rate, e.g., a desired frame rate.
    Type: Grant
    Filed: October 17, 2015
    Date of Patent: March 6, 2018
    Assignee: Light Labs Inc.
    Inventors: Rajiv Laroia, Nitesh Shroff, Sapna A Shroff
  • Publication number: 20180048832
    Abstract: Methods and apparatus provide for simulated, e.g., synthetic, aperture control. In some embodiments a user, after a camera autofocus or user selection of an object to focus on, sets a blur level and views the effect. Once the user controlled blur setting is complete, images are captured with the in-focus, e.g., autofocus, setting and other images are captured with the focus set to capture a blurred image based on the set blur level. In focus and out of focus images are captured in parallel using different camera modules in some embodiments. A composite image is generated by combining portions of one or more sharp and blurred images. Thus a user can capture portions of images with a desired level of blurriness without risking blurring other portions of an image while controlling how the captured images are combined to form a composite image with in-focus and blurred portions.
    Type: Application
    Filed: August 28, 2017
    Publication date: February 15, 2018
    Inventor: Sapna A. Shroff
  • Patent number: 9857584
    Abstract: Methods and apparatus for implementing optical chains, e.g., camera modules, which can be used in a camera device are described as well as camera devices including multiple camera modules. In various embodiments one or more camera modules include mirror assemblies which support a movable mirror. The mirror is driven in some embodiments by a linear actuator, e.g., piezo electric actuator with the linear motion of the actuator's push rod being converted into angular mirror rotation by use of hinge, e.g., pivot on which the mirror is mounted. A return spring provide a force contrary to that provided by the actuator. A recess is included in a mounting board to allow the bottom of the mirror or a portion of the mirror mounting hinge to be placed below the surface of the mounting board to which the camera module is secured.
    Type: Grant
    Filed: October 6, 2015
    Date of Patent: January 2, 2018
    Assignee: Light Labs Inc.
    Inventors: Harpuneet Singh, James Schmieder, Sapna A. Shroff
  • Patent number: 9824427
    Abstract: Methods and apparatus for generating a sharp image are described. A camera device includes a plurality of camera modules, e.g., optical chains, where at least some of the camera modules have different depths of field. Multiple images of a scene are captured using the plurality of camera modules. Portions of the multiple images which correspond to the same scene area are identified. Image portion sharpness levels are determined for individual image portions. Image portions with high sharpness levels are selected and included in a composite image.
    Type: Grant
    Filed: April 17, 2015
    Date of Patent: November 21, 2017
    Assignee: Light Labs Inc.
    Inventors: Kari Pulli, Nitesh Shroff, Sapna A. Shroff, Rajiv Laroia
  • Patent number: 9749549
    Abstract: Methods and apparatus provide for simulated, e.g., synthetic, aperture control. In some embodiments a user, after a camera autofocus or user selection of an object to focus on, sets a blur level and views the effect. Once the user controlled blur setting is complete, images are captured with the in-focus, e.g., autofocus, setting and other images are captured with the focus set to capture a blurred image based on the set blur level. In focus and out of focus images are captured in parallel using different camera modules in some embodiments. A composite image is generated by combining portions of one or more sharp and blurred images. Thus a user can capture portions of images with a desired level of blurriness without risking blurring other portions of an image while controlling how the captured images are combined to form a composite image with in-focus and blurred portions.
    Type: Grant
    Filed: October 6, 2015
    Date of Patent: August 29, 2017
    Assignee: LIGHT LABS INC.
    Inventor: Sapna A. Shroff
  • Patent number: 9741100
    Abstract: The spatial resolution of captured plenoptic images is enhanced. In one aspect, the plenoptic imaging process is modeled by a pupil image function (PIF), and a PIF inversion process is applied to the captured plenoptic image to produce a better resolution estimate of the object.
    Type: Grant
    Filed: March 25, 2014
    Date of Patent: August 22, 2017
    Assignee: Ricoh Company, Ltd.
    Inventors: Sapna A. Shroff, Kathrin Berkner, Lingfei Meng
  • Publication number: 20170223286
    Abstract: Illumination methods and apparatus which are well suited for use with camera devices are described. The methods are well suited for use with a rolling shutter. In some embodiments, plurality of lighting elements are provided and controlled in a manner which is synchronized with operation of the rolling shutter. While the portion of an area which is being captured by the sensor is illuminated during the image capture process, lighting elements corresponding to portions of the area which are not being captured are not activated when the corresponding area portion is not being captured. In this manner the entire area is not illuminated at the same level for the entire image capture period and energy is used more efficiently as compared to devices which illuminate a complete area at a consistent illumination level for the full duration of an image capture time period in which a rolling shutter is used.
    Type: Application
    Filed: February 8, 2017
    Publication date: August 3, 2017
    Inventors: Rajiv Laroia, Sapna A Shroff
  • Patent number: D802646
    Type: Grant
    Filed: April 17, 2015
    Date of Patent: November 14, 2017
    Assignee: Light Labs Inc.
    Inventors: Rajiv Laroia, Harpuneet Singh, James Schmieder, Sapna A. Shroff