Patents Assigned to FotoNation
  • Patent number: 9767539
    Abstract: A hand-held or otherwise portable or spatial or temporal performance-based image capture device includes one or more lenses, an aperture and a main sensor for capturing an original main image. A secondary sensor and optical system are for capturing a reference image that has temporal and spatial overlap with the original image. The device performs an image processing method including capturing the main image with the main sensor and the reference image with the secondary sensor, and utilizing information from the reference image to enhance the main image. The main and secondary sensors are contained together within a housing.
    Type: Grant
    Filed: October 24, 2014
    Date of Patent: September 19, 2017
    Assignee: FotoNation Limited
    Inventors: Adrian Zamfir, Petronel Bigioi, Peter Corcoran, Alexandru Drimbarean, Eran Steinberg
  • Publication number: 20170257562
    Abstract: Systems and methods for the generating compressed light field representation data using captured light fields in accordance embodiments of the invention are disclosed. In one embodiment, an array camera includes a processor and a memory connected configured to store an image processing application, wherein the image processing application configures the processor to obtain image data, wherein the image data includes a set of images including a reference image and at least one alternate view image, generate a depth map based on the image data, determine at least one prediction image based on the reference image and the depth map, compute prediction error data based on the at least one prediction image and the at least one alternate view image, and generate compressed light field representation data based on the reference image, the prediction error data, and the depth map.
    Type: Application
    Filed: May 19, 2017
    Publication date: September 7, 2017
    Applicant: FotoNation Cayman Limited
    Inventors: Karlik VENKATARAMAN, Dan LELESCU, Gabriel MOLINA
  • Patent number: 9754422
    Abstract: Systems and methods for the manipulation of captured light fields and captured light field image data in accordance with embodiments of the invention are disclosed. In one embodiment of the invention, a system for manipulating captured light field image data includes a processor, a display, a user input device, and a memory, wherein a depth map includes depth information for one or more pixels in the image data, and wherein an image manipulation application configures the processor to display a first synthesized image, receive user input data identifying a region within the first synthesized image, determine boundary data for the identified region using the depth map, receive user input data identifying at least one action, and perform the received action using the boundary data and the captured light field image data.
    Type: Grant
    Filed: May 6, 2015
    Date of Patent: September 5, 2017
    Assignee: FotoNation Cayman Limited
    Inventors: Andrew Kenneth John McMahon, Kartik Venkataraman, Robert Mullis
  • Patent number: 9749568
    Abstract: Systems and methods for controlling the parameters of groups of focal planes as focal plane groups in an array camera are described. One embodiment includes a plurality of focal planes, and control circuitry configured to control the capture of image data by the pixels within the focal planes. In addition, the control circuitry includes: a plurality of parameter registers, where a given parameter register is associated with one of the focal planes and contains configuration data for the associated focal plane; and a focal plane group register that contains data identifying focal planes that belong to a focal plane group. Furthermore, the control circuitry is configured to control the imaging parameters of the focal planes in the focal plane groups by mapping instructions that address virtual register addresses to the addresses of the parameter registers associated with focal planes within specific focal plane groups.
    Type: Grant
    Filed: September 16, 2015
    Date of Patent: August 29, 2017
    Assignee: FotoNation Cayman Limited
    Inventor: Andrew Kenneth John McMahon
  • Patent number: 9749547
    Abstract: Systems and methods for implementing array cameras configured to perform super-resolution processing to generate higher resolution super-resolved images using a plurality of captured images and lens stack arrays that can be utilized in array cameras are disclosed. An imaging device in accordance with one embodiment of the invention includes at least one imager array, and each imager in the array comprises a plurality of light sensing elements and a lens stack including at least one lens surface, where the lens stack is configured to form an image on the light sensing elements, control circuitry configured to capture images formed on the light sensing elements of each of the imagers, and a super-resolution processing module configured to generate at least one higher resolution super-resolved image using a plurality of the captured images.
    Type: Grant
    Filed: November 16, 2015
    Date of Patent: August 29, 2017
    Assignee: FotoNation Cayman Limited
    Inventors: Kartik Venkataraman, Amandeep S. Jabbi, Robert H. Mullis, Jacques Duparre, Shane Ching-Feng Hu
  • Publication number: 20170244960
    Abstract: Systems and methods for dynamically calibrating an array camera to accommodate variations in geometry that can occur throughout its operational life are disclosed. The dynamic calibration processes can include acquiring a set of images of a scene and identifying corresponding features within the images. Geometric calibration data can be used to rectify the images and determine residual vectors for the geometric calibration data at locations where corresponding features are observed. The residual vectors can then be used to determine updated geometric calibration data for the camera array. In several embodiments, the residual vectors are used to generate a residual vector calibration data field that updates the geometric calibration data. In many embodiments, the residual vectors are used to select a set of geometric calibration from amongst a number of different sets of geometric calibration data that is the best fit for the current geometry of the camera array.
    Type: Application
    Filed: September 29, 2015
    Publication date: August 24, 2017
    Applicant: FotoNation Cayman Limited
    Inventors: Florian Ciurea, Dan Lelescu, Priyam Chatterjee
  • Patent number: 9743001
    Abstract: A method operable within an image capture device for stabilizing a sequence of images captured by the image capture device is disclosed. The method comprises, using lens based sensors indicating image capture device movement during image acquisition, performing optical image stabilization (OIS) during acquisition of each image of the sequence of images to provide a sequence of OIS corrected images. Frame-to-frame movement of the device for each frame during which each OIS corrected image is captured is determined using inertial measurement sensors. At least an estimate of OIS control performed during acquisition of an image is obtained. The estimate is removed from the frame-to-frame movement determined for the frame during which the OIS corrected image was captured to provide a residual measurement of movement for the frame. Electronic image stabilization (EIS) of each OIS corrected image based on the residual measurement is performed to provide a stabilized sequence of images.
    Type: Grant
    Filed: February 19, 2016
    Date of Patent: August 22, 2017
    Assignee: FotoNation Limited
    Inventor: Piotr Stec
  • Patent number: 9743051
    Abstract: Systems and methods in accordance with embodiments of the invention implement modular array cameras using sub-array modules. In one embodiment, an X×Y sub-array module includes: an X×Y arrangement of focal planes, where X and Y are each greater than or equal to 1; and an X×Y arrangement of lens stacks, the X×Y arrangement of lens stacks being disposed relative to the X×Y arrangement of focal planes so as to form an X×Y arrangement of cameras, where each lens stack has a field of view that is shifted with respect to the field-of-views of each other lens stack so that each shift includes a sub-pixel shifted view of the scene; and image data output circuitry that is configured to output image data from the X×Y sub-array module that can be aggregated with image data from other sub-array modules so that an image of the scene can be constructed.
    Type: Grant
    Filed: February 1, 2016
    Date of Patent: August 22, 2017
    Assignee: FotoNation Cayman Limited
    Inventors: Kartik Venkataraman, Paul Gallagher, Dan Lelescu, Andrew Kenneth John McMahon, Jacques Duparre, Bedabrata Pain
  • Patent number: 9741118
    Abstract: Systems and methods for calibrating an array camera are disclosed. Systems and methods for calibrating an array camera in accordance with embodiments of this invention include the detecting of defects in the imaging components of the array camera and determining whether the detected defects may be tolerated by image processing algorithms. The calibration process also determines translation information between imaging components in the array camera for use in merging the image data from the various imaging components during image processing. Furthermore, the calibration process may include a process to improve photometric uniformity in the imaging components.
    Type: Grant
    Filed: August 31, 2015
    Date of Patent: August 22, 2017
    Assignee: FotoNation Cayman Limited
    Inventor: Robert Mullis
  • Patent number: 9733486
    Abstract: Imager arrays, array camera modules, and array cameras in accordance with embodiments of the invention utilize pixel apertures to control the amount of aliasing present in captured images of a scene. One embodiment includes a plurality of focal planes, control circuitry configured to control the capture of image information by the pixels within the focal planes, and sampling circuitry configured to convert pixel outputs into digital pixel data. In addition, the pixels in the plurality of focal planes include a pixel stack including a microlens and an active area, where light incident on the surface of the microlens is focused onto the active area by the microlens and the active area samples the incident light to capture image information, and the pixel stack defines a pixel area and includes a pixel aperture, where the size of the pixel apertures is smaller than the pixel area.
    Type: Grant
    Filed: July 30, 2015
    Date of Patent: August 15, 2017
    Assignee: FotoNation Cayman Limited
    Inventors: Dan Lelescu, Kartik Venkataraman
  • Patent number: 9736370
    Abstract: A hand-held digital camera has a touch-sensitive display screen (“touch screen”) for image preview and user control of the camera, and a user-selectable panorama mode. Upon entering panorama mode the camera superimposes upon the touch screen a horizontal rectangular bar whose width and/or height are user-adjustable by interaction with the touch screen to select a desired horizontal sweep angle. After the sweep angle is set the camera automatically captures successive horizontally overlapping images during a sweep of the device through the selected sweep angle. Subsequently the camera synthesizes a panoramic image from the successively captured images, the panoramic image having a width corresponding to the selected sweep angle.
    Type: Grant
    Filed: November 21, 2013
    Date of Patent: August 15, 2017
    Assignee: FotoNation Limited
    Inventors: Igor Barcovschi, George Susanu, Serghei Carateev
  • Patent number: 9728945
    Abstract: A cable guide for guidance of at least one cable through a patch panel system, including a housing having front, back, left, and right sides, and at least one patch panel device including a tray and one or more adapters, the cable guide comprising an advancing member having a first end for coupling to the back side of the housing, a second end for coupling to the tray of the patch panel device, and a guide member disposed between the first and second ends, wherein the advancing member is transitionable between a first and second state, wherein, when the first and second ends are coupled respectively to the back side and the tray, in the first state, the guide member is positioned at least partially external to the housing at one of the left or right sides; and in the second state, the guide member is positioned within the housing.
    Type: Grant
    Filed: March 5, 2014
    Date of Patent: August 8, 2017
    Assignee: Go!Foton Holdings, Inc.
    Inventors: Kenichiro Takeuchi, Haiguang Lu
  • Patent number: 9720200
    Abstract: Methods, systems, and apparatuses that facilitate installation of a communications cable, e.g., an optical fiber cable, are disclosed. The system may include a communications cable and an adhesive for securing the cable to a surface. The method may include the use of an adhesive to secure the communications cable to a surface. The apparatus may include a pathway to avoid over-bending of the communications cable, which may otherwise result in transmission loss and compromise the performance of the cable.
    Type: Grant
    Filed: May 12, 2016
    Date of Patent: August 1, 2017
    Assignee: Go!Foton Holdings, Inc.
    Inventors: Haiguang Lu, Kenichiro Takeuchi
  • Patent number: 9712759
    Abstract: A camera array, an imaging device and/or a method for capturing image that employ a plurality of imagers fabricated on a substrate is provided. Each imager includes a plurality of pixels. The plurality of imagers include a first imager having a first imaging characteristics and a second imager having a second imaging characteristics. The images generated by the plurality of imagers are processed to obtain an enhanced image compared to images captured by the imagers. Each imager may be associated with an optical element fabricated using a wafer level optics (WLO) technology.
    Type: Grant
    Filed: August 22, 2016
    Date of Patent: July 18, 2017
    Assignee: FotoNation Cayman Limited
    Inventors: Kartik Venkataraman, Amandeep S. Jabbi, Robert H. Mullis
  • Patent number: 9712743
    Abstract: A technique for processing a digital image uses face detection to achieve one or more desired image processing parameters. A group of pixels is identified that corresponds to a face image within the digital image. A skin tone is detected for the face image by determining one or more default color or tonal values, or combinations thereof, for the group of pixels. Values of one or more parameters are adjusted for the group of pixels that correspond to the face image based on the detected skin tone.
    Type: Grant
    Filed: December 5, 2016
    Date of Patent: July 18, 2017
    Assignee: FotoNation Limited
    Inventors: Peter Corcoran, Igor Barcovschi, Eran Steinberg, Yury Prilutsky, Petronel Bigioi
  • Patent number: 9701303
    Abstract: A method and a system for shifting a gear of a hybrid electric vehicle are provided. The method includes following steps. A state of a battery is determined according to a remaining capacity of the battery, a required torque and a state of the hybrid electric vehicle, in which the state of the battery comprises a discharging state or a charging state. A plurality of optional target gears, a torque and a rotating speed of an engine corresponding to each optional target gear are determined according to the state of the battery and a speed of the hybrid electric vehicle. An optional target gear with a minimum fuel consumption of the engine is selected as a target gear from the plurality of optional target gears. It is determined whether to perform a gear shift by comparing with a current gear.
    Type: Grant
    Filed: June 18, 2015
    Date of Patent: July 11, 2017
    Assignee: BEIQI FOTON MOTOR CO., LTD.
    Inventor: Weibin Yang
  • Patent number: 9706132
    Abstract: Systems and methods in accordance with embodiments of the invention pattern array camera modules with ? filter groups. In one embodiment, an array camera module includes: an M×N imager array including a plurality of focal planes, where each focal plane includes an array of pixels; an M×N optic array of lens stacks, where each lens stack corresponds to a focal plane, and where each lens stack forms an image of a scene on its corresponding focal plane; where each pairing of a lens stack and focal plane thereby defines a camera; where at least one row in the M×N array of cameras includes at least one red camera, one green camera, and one blue camera; and where at least one column in the M×N array of cameras includes at least one red camera, one green camera, and one blue camera.
    Type: Grant
    Filed: November 25, 2015
    Date of Patent: July 11, 2017
    Assignee: FotoNation Cayman Limited
    Inventors: Semyon Nisenzon, Kartik Venkataraman
  • Publication number: 20170187933
    Abstract: Systems and methods for implementing array cameras configured to perform super-resolution processing to generate higher resolution super-resolved images using a plurality of captured images and lens stack arrays that can be utilized in array cameras are disclosed. Lens stack arrays in accordance with many embodiments of the invention include lens elements formed on substrates separated by spacers, where the lens elements, substrates and spacers are configured to form a plurality of optical channels, at least one aperture located within each optical channel, at least one spectral filter located within each optical channel, where each spectral filter is configured to pass a specific spectral band of light, and light blocking materials located within the lens stack array to optically isolate the optical channels.
    Type: Application
    Filed: March 13, 2017
    Publication date: June 29, 2017
    Applicant: FotoNation Cayman Limited
    Inventor: Jacques Duparre
  • Patent number: 9692964
    Abstract: A method of generating one or more new digital images using an original digitally-acquired image including a selected image feature includes identifying within a digital image acquisition device one or more groups of pixels that correspond to the selected image feature based on information from one or more preview images. A portion of the original image is selected that includes the one or more groups of pixels. The technique includes automatically generating values of pixels of one or more new images based on the selected portion in a manner which includes the selected image feature within the one or more new images.
    Type: Grant
    Filed: September 4, 2015
    Date of Patent: June 27, 2017
    Assignee: FotoNation Limited
    Inventors: Eran Steinberg, Petronel Bigioi, Yury Prilutsky, Peter Corcoran
  • Publication number: 20170178363
    Abstract: Systems and methods in accordance with embodiments of the invention are configured to render images using light field image files containing an image synthesized from light field image data and metadata describing the image that includes a depth map. One embodiment of the invention includes a processor and memory containing a rendering application and a light field image file including an encoded image, a set of low resolution images, and metadata describing the encoded image, where the metadata comprises a depth map that specifies depths from the reference viewpoint for pixels in the encoded image. In addition, the rendering application configures the processor to: locate the encoded image within the light field image file; decode the encoded image; locate the metadata within the light field image file; and post process the decoded image by modifying the pixels based on the depths indicated within the depth map and the set of low resolution images to create a rendered image.
    Type: Application
    Filed: December 30, 2016
    Publication date: June 22, 2017
    Applicant: FotoNation Cayman Limited
    Inventors: Kartik Venkataraman, Semyon Nisenzon, Dan Lelescu