Patents Assigned to FotoNation
  • Patent number: 10390005
    Abstract: Systems and methods for the synthesis of light field images from virtual viewpoints in accordance with embodiments of the invention are disclosed. In one embodiment of the invention, a system includes a processor and a memory configured to store captured light field image data and an image manipulation application, wherein the captured light field image data includes image data, pixel position data, and a depth map, and wherein the image manipulation application configures the processor to obtain captured light field image data, determine a virtual viewpoint for the captured light field image data, where the virtual viewpoint includes a virtual location and virtual depth information, compute a virtual depth map based on the captured light field image data and the virtual viewpoint, and generate an image from the perspective of the virtual viewpoint based on the captured light field image data and the virtual depth map.
    Type: Grant
    Filed: October 6, 2015
    Date of Patent: August 20, 2019
    Assignee: FotoNation Limited
    Inventors: Semyon Nisenzon, Ankit K. Jain
  • Patent number: 10380752
    Abstract: Systems in accordance with embodiments of the invention can perform parallax detection and correction in images captured using array cameras. Due to the different viewpoints of the cameras, parallax results in variations in the position of objects within the captured images of the scene. Methods in accordance with embodiments of the invention provide an accurate account of the pixel disparity due to parallax between the different cameras in the array, so that appropriate scene-dependent geometric shifts can be applied to the pixels of the captured images when performing super-resolution processing. In a number of embodiments, generating depth estimates considers the similarity of pixels in multiple spectral channels. In certain embodiments, generating depth estimates involves generating a confidence map indicating the reliability of depth estimates.
    Type: Grant
    Filed: December 29, 2017
    Date of Patent: August 13, 2019
    Assignee: FotoNation Limited
    Inventors: Florian Ciurea, Kartik Venkataraman, Gabriel Molina, Dan Lelescu
  • Publication number: 20190244379
    Abstract: Systems and methods for depth estimation in accordance with embodiments of the invention are illustrated. One embodiment includes a method for estimating depth from images. The method includes steps for receiving a plurality of source images captured from a plurality of different viewpoints using a processing system configured by an image processing application, generating a target image from a target viewpoint that is different to the viewpoints of the plurality of source images based upon a set of generative model parameters using the processing system configured by the image processing application, and identifying depth information of at least one output image based on the predicted target image using the processing system configured by the image processing application.
    Type: Application
    Filed: February 6, 2019
    Publication date: August 8, 2019
    Applicant: FotoNation Limited
    Inventor: Kartik Venkataraman
  • Publication number: 20190243086
    Abstract: Systems and methods in accordance with embodiments of the invention implement optical systems incorporating lens elements formed separately and subsequently bonded to low coefficient of thermal expansion substrates. Optical systems in accordance with various embodiments of the invention can be utilized in single aperture cameras, and multiple-aperture array cameras. In one embodiment, a robust optical system includes at least one carrier characterized by a low coefficient of thermal expansion to which at least a primary lens element formed from precision molded glass is bonded.
    Type: Application
    Filed: September 14, 2017
    Publication date: August 8, 2019
    Applicant: FotoNation Limited
    Inventors: Errol Mark Rodda, Jacques Duparre
  • Patent number: 10373052
    Abstract: A method of tracking an object across a stream of images comprises determining a region of interest (ROI) bounding the object in an initial frame of an image stream. A HOG map is provided for the ROI by: dividing the ROI into an array of M×N cells, each cell comprising a plurality of image pixels; and determining a HOG for each of the cells. The HOG map is stored as indicative of the features of the object. Subsequent frames are acquired from the stream of images. The frames are scanned ROI by ROI to identify a candidate ROI having a HOG map best matching the stored HOG map features. If the match meets a threshold, the stored HOG map indicative of the features of the object is updated according to the HOG map for the best matching candidate ROI.
    Type: Grant
    Filed: February 7, 2017
    Date of Patent: August 6, 2019
    Assignee: FotoNation Limited
    Inventors: Dragos Dinu, Mihai Constantin Munteanu, Alexandru Caliman
  • Patent number: 10375319
    Abstract: Systems and methods for implementing array cameras configured to perform super-resolution processing to generate higher resolution super-resolved images using a plurality of captured images and lens stack arrays that can be utilized in array cameras are disclosed. An imaging device in accordance with one embodiment of the invention includes at least one imager array, and each imager in the array comprises a plurality of light sensing elements and a lens stack including at least one lens surface, where the lens stack is configured to form an image on the light sensing elements, control circuitry configured to capture images formed on the light sensing elements of each of the imagers, and a super-resolution processing module configured to generate at least one higher resolution super-resolved image using a plurality of the captured images.
    Type: Grant
    Filed: November 26, 2018
    Date of Patent: August 6, 2019
    Assignee: FotoNation Limited
    Inventors: Kartik Venkataraman, Amandeep S. Jabbi, Robert H. Mullis, Jacques Duparre, Shane Ching-Feng Hu
  • Patent number: 10375302
    Abstract: Imager arrays, array camera modules, and array cameras in accordance with embodiments of the invention utilize pixel apertures to control the amount of aliasing present in captured images of a scene. One embodiment includes a plurality of focal planes, control circuitry configured to control the capture of image information by the pixels within the focal planes, and sampling circuitry configured to convert pixel outputs into digital pixel data. In addition, the pixels in the plurality of focal planes include a pixel stack including a microlens and an active area, where light incident on the surface of the microlens is focused onto the active area by the microlens and the active area samples the incident light to capture image information, and the pixel stack defines a pixel area and includes a pixel aperture, where the size of the pixel apertures is smaller than the pixel area.
    Type: Grant
    Filed: October 16, 2017
    Date of Patent: August 6, 2019
    Assignee: FotoNation Limited
    Inventors: Shree Nayar, Kartik Venkataraman, Bedabrata Pain, Dan Lelescu
  • Publication number: 20190235138
    Abstract: Systems and methods in accordance with embodiments of the invention actively align a lens stack array with an array of focal planes to construct an array camera module. In one embodiment, a method for actively aligning a lens stack array with a sensor that has a focal plane array includes: aligning the lens stack array relative to the sensor in an initial position; varying the spatial relationship between the lens stack array and the sensor; capturing images of a known target that has a region of interest using a plurality of active focal planes at different spatial relationships; scoring the images based on the extent to which the region of interest is focused in the images; selecting a spatial relationship between the lens stack array and the sensor based on a comparison of the scores; and forming an array camera subassembly based on the selected spatial relationship.
    Type: Application
    Filed: April 11, 2019
    Publication date: August 1, 2019
    Applicant: FotoNation Limited
    Inventors: Jacques Duparre, Andrew Kenneth John McMahon, Dan Lelescu
  • Publication number: 20190236357
    Abstract: A method of iris recognition comprises detecting a body region larger than and comprising at least one iris in an image and performing a first eye modelling on the detected body region. If successful, the result of first iris segmentation based on the first eye model is chosen. Otherwise, a first iris identification is performed on the detected body region. If successful, the result of second iris segmentation based on a second eye modelling is chosen. Otherwise, second iris identification is performed on the image, third eye modelling is performed on the result of the second iris identification, and third iris segmentation is performed on the result of the third eye modelling. If successful, the result of third iris segmentation based on a third eye modelling is chosen. An iris code is extracted from any selected iris segment of the image.
    Type: Application
    Filed: April 10, 2019
    Publication date: August 1, 2019
    Applicant: FotoNation Limited
    Inventors: Gabriel COSTACHE, Barry MCCULLAGH, Serghei CARATEEV
  • Patent number: 10366472
    Abstract: Systems and methods in accordance with embodiments of the invention are disclosed that use super-resolution (SR) processes to use information from a plurality of low resolution (LR) images captured by an array camera to produce a synthesized higher resolution image. One embodiment includes obtaining input images using the plurality of imagers, using a microprocessor to determine an initial estimate of at least a portion of a high resolution image using a plurality of pixels from the input images, and using a microprocessor to determine a high resolution image that when mapped through the forward imaging transformation matches the input images to within at least one predetermined criterion using the initial estimate of at least a portion of the high resolution image.
    Type: Grant
    Filed: June 1, 2016
    Date of Patent: July 30, 2019
    Assignee: FotoNation Limited
    Inventors: Dan Lelescu, Gabriel Molina, Kartik Venkataraman
  • Publication number: 20190227250
    Abstract: A communication system may include a first chassis having first and second side walls and adapted to slidably receive therein a plurality of cassettes. A first cable hanger assembly may have a first side edge hingedly coupled to the first side wall of the first chassis, the first cable hanger assembly including a plurality of first hangers adapted to support cables thereon. An axis of rotation of the first cable hanger assembly may be substantially orthogonal to a direction in which the plurality of cassettes are slideable. The cable hanger assembly may be rotatable from a first position to a second position so that during rotation from the first position to the second position, the plurality of first hangers move toward front faces of the plurality of cassettes.
    Type: Application
    Filed: April 2, 2019
    Publication date: July 25, 2019
    Applicant: Go!Foton Holdings, Inc.
    Inventors: Kenichiro Takeuchi, Haiguang Lu, Alla Shtabnaya, Frank Rumore, Patrick Anderson
  • Publication number: 20190228502
    Abstract: A method for correcting an image divides an output image into a grid with vertical sections of width smaller than the image width but wide enough to allow efficient bursts when writing distortion corrected line sections into memory. A distortion correction engine includes a relatively small amount of memory for an input image buffer but without requiring unduly complex control. The input image buffer accommodates enough lines of an input image to cover the distortion of a single most vertically distorted line section of the input image. The memory required for the input image buffer can be significantly less than would be required to store all the lines of a distorted input image spanning a maximal distortion of a complete line within the input image.
    Type: Application
    Filed: January 24, 2018
    Publication date: July 25, 2019
    Applicant: FotoNation Limited
    Inventors: Piotr STEC, Vlad GEORGESCU
  • Publication number: 20190230348
    Abstract: Systems and methods for dynamically calibrating an array camera to accommodate variations in geometry that can occur throughout its operational life are disclosed. The dynamic calibration processes can include acquiring a set of images of a scene and identifying corresponding features within the images. Geometric calibration data can be used to rectify the images and determine residual vectors for the geometric calibration data at locations where corresponding features are observed. The residual vectors can then be used to determine updated geometric calibration data for the camera array. In several embodiments, the residual vectors are used to generate a residual vector calibration data field that updates the geometric calibration data. In many embodiments, the residual vectors are used to select a set of geometric calibration from amongst a number of different sets of geometric calibration data that is the best fit for the current geometry of the camera array.
    Type: Application
    Filed: April 1, 2019
    Publication date: July 25, 2019
    Applicant: FotoNation Limited
    Inventors: Florian Ciurea, Dan Lelescu, Priyam Chatterjee
  • Patent number: 10359594
    Abstract: A communication system includes an outer housing, an inner housing, and a hanger plate assembly. The outer housing has first and second side walls. The inner housing is at least partially positioned within the outer housing. The inner housing has first and second side walls and is configured to receive a plurality of patch panel devices therein in a stacked arrangement. The hanger plate assembly includes a first hanger plate hingedly coupled to the first side wall of the inner housing and a plurality of hangers connected to the first hanger plate in a stacked arrangement. Each hanger is adapted to support a cable thereon. The hanger plate assembly has a stored condition in which the hanger plate assembly is fully positioned within the outer housing, and a pulled out condition in which the hanger plate assembly is at least partially positioned outside the outer housing.
    Type: Grant
    Filed: September 18, 2017
    Date of Patent: July 23, 2019
    Assignee: Go!Foton Holdings, Inc.
    Inventors: Kenichiro Takeuchi, Haiguang Lu, Alla Shtabnaya
  • Patent number: 10359578
    Abstract: A connector assembly includes an adapter, a housing device, a ferrule assembly, and a sensor. The housing device is received by the adapter and has a bore, a front end, and a rear end opposite the front end. A ferrule of the ferrule assembly is within the bore of the housing device and has a mating end extending beyond the front end of the housing device. The sensor is mounted on the rear end of the housing, the rear end of the ferrule assembly, or on the adapter confronting and spaced apart from the housing device or the ferrule assembly. The sensor is configured for detecting a force applied by the housing device or the ferrule assembly, respectively. An electrical characteristic of the sensor changes to indicate a predetermined force has been applied by the housing device or the ferrule assembly, respectively.
    Type: Grant
    Filed: January 5, 2018
    Date of Patent: July 23, 2019
    Assignee: Go!Foton Holdings, Inc.
    Inventors: Kenichiro Takeuchi, Haiguang Lu, Chi Kong Paul Ng
  • Patent number: 10356346
    Abstract: A method for compensating for off-axis tilting of a lens relative to an image sensor in an image acquisition device comprises acquiring a set of calibrated parameters n ? ? ( n x n y n z ) corresponding to the tilting of said lens. Px? and Py? indicate a coordinate of a pixel in an acquired image. Image information is mapped from the acquired image to a lens tilt compensated image according to the formulae: P x ? = s n z ? ( n z - 1 ) ? ( ( n x 2 + n z ? ( n z - 1 ) ) ? u x + n x ? n y ? u y ) P y ? = s n z ? ( n z - 1 ) ? ( ( n y 2 + n z ? ( n z - 1 ) ) ? u y + n x ? n y ? u x ) where s comprises a scale factor given by s = n z u x ? n x + u y ? n y + n z and where ux and uy indicate the location of a pixel in the lens tilt compensated image.
    Type: Grant
    Filed: February 26, 2018
    Date of Patent: July 16, 2019
    Assignee: FotoNation Limited
    Inventors: Piotr Stec, Brian O'Sullivan
  • Publication number: 20190213434
    Abstract: A hand-held or otherwise portable or spatial or temporal performance-based image capture device includes one or more lenses, an aperture and a main sensor for capturing an original main image. A secondary sensor and optical system are for capturing a reference image that has temporal and spatial overlap with the original image. The device performs an image processing method including capturing the main image with the main sensor and the reference image with the secondary sensor, and utilizing information from the reference image to enhance the main image. The main and secondary sensors are contained together within a housing.
    Type: Application
    Filed: December 17, 2018
    Publication date: July 11, 2019
    Applicant: FotoNation Limited
    Inventors: Adrian ZAMFIR, Petronel BIGIOI, Peter CORCORAN, Alexandru DRIMBAREAN, Eran STEINBERG
  • Publication number: 20190215496
    Abstract: Systems and methods for extended color processing on Pelican array cameras in accordance with embodiments of the invention are disclosed. In one embodiment, a method of generating a high resolution image includes obtaining input images, where a first set of images includes information in a first band of visible wavelengths and a second set of images includes information in a second band of visible wavelengths and non-visible wavelengths, determining an initial estimate by combining the first set of images into a first fused image, combining the second set of images into a second fused image, spatially registering the fused images, denoising the fused images using bilateral filters, normalizing the second fused image in the photometric reference space of the first fused image, combining the fused images, determining a high resolution image that when mapped through a forward imaging transformation matches the input images within at least one predetermined criterion.
    Type: Application
    Filed: January 11, 2019
    Publication date: July 11, 2019
    Applicant: FotoNation Limited
    Inventors: Robert H. Mullis, Dan Lelescu, Kartik Venkataraman
  • Patent number: 10348979
    Abstract: A method is disclosed for processing at least a portion of an input digital image comprising rows of pixels extending in two mutually perpendicular directions over a 2D field. The method comprises defining a kernel for processing an image, the kernel comprising at least one row of contiguous elements of the same non-zero value (such rows being referred to herein as equal-valued kernel regions), the equal-valued kernel regions, if more than one, extending parallel to one another. For each pixel in at least selected parallel rows of pixels within the image portion, the cumulative sum of the pixel is calculated by adding a value of the pixel to the sum of all preceding pixel values in the same row of the image portion. The kernel is convolved with the image portion at successive kernel positions relative to the image portion such that each pixel in each selected row is a target pixel for a respective kernel position.
    Type: Grant
    Filed: April 21, 2016
    Date of Patent: July 9, 2019
    Assignee: FotoNation Limited
    Inventors: Cosmin Pit Rada, Cosmin Stan
  • Patent number: 10346677
    Abstract: Techniques for identifying a person in a target image are described. According to one of the techniques, identifying a person in a target image involves displaying, within a graphical user interface, an image that depicts one or more faces. One or more faces are automatically detected within the image. A user provides input that selects a face of the one or more faces to be a currently-selected face. A set of images are selected from a collection of images, where the set of images includes images that closely match the currently-selected face. Concurrently with display of the currently-selected face, each image in the set of images is displayed. Within the graphical user interface, a control is provided. The control enables a user to select a target image from the set of images. In response to detecting that the user has selected a target image using the control, the currently-selected face is associated with a person to which the target image corresponds.
    Type: Grant
    Filed: September 29, 2017
    Date of Patent: July 9, 2019
    Assignee: FotoNation Limited
    Inventors: Eran Steinberg, Peter Corcoran, Yury Prilutsky, Petronel Bigioi, Mihai Ciuc, Stefanita Ciurel, Constantin Vertan