Patents Assigned to FotoNation
  • Patent number: 9858673
    Abstract: Systems in accordance with embodiments of the invention can perform parallax detection and correction in images captured using array cameras. Due to the different viewpoints of the cameras, parallax results in variations in the position of objects within the captured images of the scene. Methods in accordance with embodiments of the invention provide an accurate account of the pixel disparity due to parallax between the different cameras in the array, so that appropriate scene-dependent geometric shifts can be applied to the pixels of the captured images when performing super-resolution processing. In a number of embodiments, generating depth estimates considers the similarity of pixels in multiple spectral channels. In certain embodiments, generating depth estimates involves generating a confidence map indicating the reliability of depth estimates.
    Type: Grant
    Filed: January 5, 2016
    Date of Patent: January 2, 2018
    Assignee: FotoNation Cayman Limited
    Inventors: Florian Ciurea, Kartik Venkataraman, Gabriel Molina, Dan Lelescu
  • Patent number: 9851523
    Abstract: A communication system includes an outer housing, an inner housing, and a hanger plate assembly. The outer housing has first and second side walls. The inner housing is at least partially positioned within the outer housing. The inner housing has first and second side walls and is configured to receive a plurality of patch panel devices therein in a stacked arrangement. The hanger plate assembly includes a first hanger plate hingedly coupled to the first side wall of the inner housing and a plurality of hangers connected to the first hanger plate in a stacked arrangement. Each hanger is adapted to support a cable thereon. The hanger plate assembly has a stored condition in which the hanger plate assembly is fully positioned within the outer housing, and a pulled out condition in which the hanger plate assembly is at least partially positioned outside the outer housing.
    Type: Grant
    Filed: September 20, 2016
    Date of Patent: December 26, 2017
    Assignee: Go!Foton Holdings, Inc.
    Inventors: Kenichiro Takeuchi, Haiguang Lu, Alla Shtabnaya
  • Publication number: 20170365104
    Abstract: Systems and methods for the manipulation of captured light fields and captured light field image data in accordance with embodiments of the invention are disclosed. In one embodiment of the invention, a system for manipulating captured light field image data includes a processor, a display, a user input device, and a memory, wherein a depth map includes depth information for one or more pixels in the image data, and wherein an image manipulation application configures the processor to display a first synthesized image, receive user input data identifying a region within the first synthesized image, determine boundary data for the identified region using the depth map, receive user input data identifying at least one action, and perform the received action using the boundary data and the captured light field image data.
    Type: Application
    Filed: September 1, 2017
    Publication date: December 21, 2017
    Applicant: FotoNation Cayman Limited
    Inventors: Andrew Kenneth John McMahon, Kartik Venkataraman, Robert Mullis
  • Patent number: 9846739
    Abstract: A method of improving the speed with which a sample data record can be matched against records in a database comprises defining a list of possible key values (430), testing those key values against the sample and, for each record in the database, counting the number of key values that match both the record and the sample at reference positions selected by a mask. A list of possible matches is then selected on the basis of that count, for more detailed matching or analysis. Such a method provides very fast matching at the expense of some additional effort when registering a new record within the database.
    Type: Grant
    Filed: November 14, 2011
    Date of Patent: December 19, 2017
    Assignee: FotoNation Limited
    Inventor: Donald Martin Monro
  • Patent number: 9846279
    Abstract: An optical signal routing device may include a first lens, second lens and a wavelength division multiplexer (“WDM”) filter positioned between the first and second lenses. The WDM filter may reflect a signal of a first wavelength with a first attenuation and pass the first wavelength signal attenuated by at most a second attenuation to the second lens, the first attenuation exceeding the second attenuation by a first predetermined amount. The WDM filter may reflect a signal of a second wavelength different than the first wavelength with at most a third attenuation, the first attenuation exceeding the third attenuation by at least a second predetermined amount. The device may further include a reflector positioned to reflect the first wavelength signal reflected by the WDM filter toward the WDM filter with at least a fourth attenuation, the fourth attenuation exceeding the second attenuation by at least a third predetermined amount.
    Type: Grant
    Filed: October 2, 2015
    Date of Patent: December 19, 2017
    Assignee: Go!Foton Holdings, Inc.
    Inventors: Haiguang Lu, Kenichiro Takeuchi, Rhaniel Peralta, Glenn Lachica, Marlene Gizelle M. Balinos, Anita L. Lumantes, Erika Mae A. Entico
  • Patent number: 9818024
    Abstract: A face is detected and identified within an acquired digital image. One or more features of the face is/are extracted from the digital image, including two independent eyes or subsets of features of each of the two eyes, or lips or partial lips or one or more other mouth features and one or both eyes, or both. A model including multiple shape parameters is applied to the two independent eyes or subsets of features of each of the two eyes, and/or to the lips or partial lips or one or more other mouth features and one or both eyes. One or more similarities between the one or more features of the face and a library of reference feature sets is/are determined. A probable facial expression is identified based on the determining of the one or more similarities.
    Type: Grant
    Filed: April 7, 2015
    Date of Patent: November 14, 2017
    Assignee: FotoNation Limited
    Inventors: Ioana Bacivarov, Peter Corcoran
  • Patent number: 9813617
    Abstract: Systems and methods for implementing array camera configurations that include a plurality of constituent array cameras, where each constituent array camera provides a distinct field of view and/or a distinct viewing direction, are described. In several embodiments, image data captured by the constituent array cameras is used to synthesize multiple images that are subsequently blended. In a number of embodiments, the blended images include a foveated region. In certain embodiments, the blended images possess a wider field of view than the fields of view of the multiple images.
    Type: Grant
    Filed: September 23, 2016
    Date of Patent: November 7, 2017
    Assignee: FotoNation Cayman Limited
    Inventors: Kartik Venkataraman, Jacques Duparré
  • Patent number: 9811753
    Abstract: Systems and methods configured to store images synthesized from light field image data and metadata describing the images in electronic files and render images using the stored image and the metadata in accordance with embodiments of the invention are disclosed. One embodiment includes a processor and memory containing an encoding application and light field image data, where the light field image data comprises a plurality of low resolution images of a scene captured from different viewpoints. In addition, the encoding application configures the processor to synthesize a higher resolution image of the scene from a reference viewpoint using the low resolution images, where synthesizing the higher resolution image involves creating a depth map that specifies depths from the reference viewpoint for pixels in the higher resolution image; encode the higher resolution image; and create a light field image file including the encoded image and metadata including the depth map.
    Type: Grant
    Filed: March 24, 2015
    Date of Patent: November 7, 2017
    Assignee: FotoNation Cayman Limited
    Inventors: Kartik Venkataraman, Semyon Nisenzon, Dan Lelescu
  • Patent number: 9813616
    Abstract: Systems and methods in accordance with embodiments of the invention enable feature based high resolution motion estimation from low resolution images captured using an array camera. One embodiment includes performing feature detection with respect to a sequence of low resolution images to identify initial locations for a plurality of detected features in the sequence of low resolution images, where the at least one sequence of low resolution images is part of a set of sequences of low resolution images captured from different perspectives. The method also includes synthesizing high resolution image portions, where the synthesized high resolution image portions contain the identified plurality of detected features from the sequence of low resolution images.
    Type: Grant
    Filed: November 5, 2015
    Date of Patent: November 7, 2017
    Assignee: FotoNation Cayman Limited
    Inventors: Dan Lelescu, Ankit K. Jain
  • Patent number: 9807382
    Abstract: Systems and methods for detecting defective camera arrays, optic arrays and/or sensors are described. One embodiment includes capturing image data using a camera array; dividing the captured images into a plurality of corresponding image regions; identifying the presence of localized defects in any of the cameras by evaluating the image regions in the captured images; and detecting a defective camera array using the image processing system when the number of localized defects in a specific set of image regions exceeds a predetermined threshold, where the specific set of image regions is formed by: a common corresponding image region from at least a subset of the captured images; and any additional image region in a given image that contains at least one pixel located within a predetermined maximum parallax shift distance along an epipolar line from a pixel within said common corresponding image region within the given image.
    Type: Grant
    Filed: July 21, 2015
    Date of Patent: October 31, 2017
    Assignee: FotoNation Cayman Limited
    Inventors: Jacques Duparre, Andrew Kenneth John McMahon, Dan Lelescu, Kartik Venkataraman, Gabriel Molina
  • Patent number: 9800856
    Abstract: Systems and methods are described for generating restricted depth of field depth maps. In one embodiment, an image processing pipeline application configures a processor to: determine a desired focal plane distance and a range of distances corresponding to a restricted depth of field for an image rendered from a reference viewpoint; generate a restricted depth of field depth map from the reference viewpoint using the set of images captured from different viewpoints, where depth estimation precision is higher for pixels with depth estimates within the range of distances corresponding to the restricted depth of field and lower for pixels with depth estimates outside of the range of distances corresponding to the restricted depth of field; and render a restricted depth of field image from the reference viewpoint using the set of images captured from different viewpoints and the restricted depth of field depth map.
    Type: Grant
    Filed: December 12, 2016
    Date of Patent: October 24, 2017
    Assignee: FotoNation Cayman Limited
    Inventors: Kartik Venkataraman, Semyon Nisenzon, Priyam Chatterjee, Gabriel Molina
  • Patent number: 9800859
    Abstract: Systems and methods for stereo imaging with camera arrays in accordance with embodiments of the invention are disclosed. In one embodiment, a method of generating depth information for an object using two or more array cameras that each include a plurality of imagers includes obtaining a first set of image data captured from a first set of viewpoints, identifying an object in the first set of image data, determining a first depth measurement, determining whether the first depth measurement is above a threshold, and when the depth is above the threshold: obtaining a second set of image data of the same scene from a second set of viewpoints located known distances from one viewpoint in the first set of viewpoints, identifying the object in the second set of image data, and determining a second depth measurement using the first set of image data and the second set of image data.
    Type: Grant
    Filed: May 6, 2015
    Date of Patent: October 24, 2017
    Assignee: FotoNation Cayman Limited
    Inventors: Kartik Venkataraman, Paul Gallagher, Ankit Jain, Semyon Nisenzon
  • Patent number: 9794476
    Abstract: Imager arrays, array camera modules, and array cameras in accordance with embodiments of the invention utilize pixel apertures to control the amount of aliasing present in captured images of a scene. One embodiment includes a plurality of focal planes, control circuitry configured to control the capture of image information by the pixels within the focal planes, and sampling circuitry configured to convert pixel outputs into digital pixel data. In addition, the pixels in the plurality of focal planes include a pixel stack including a microlens and an active area, where light incident on the surface of the microlens is focused onto the active area by the microlens and the active area samples the incident light to capture image information, and the pixel stack defines a pixel area and includes a pixel aperture, where the size of the pixel apertures is smaller than the pixel area.
    Type: Grant
    Filed: February 19, 2016
    Date of Patent: October 17, 2017
    Assignee: FotoNation Cayman Limited
    Inventors: Shree Nayar, Kartik Venkataraman, Bedabrata Pain, Dan Lelescu
  • Patent number: 9787911
    Abstract: Systems and methods for performing photometric normalization in an array camera in accordance with embodiments of this invention are disclosed. The image data of scene from a reference imaging component and alternate imaging components is received. The image data from each of the alternate imaging components is then translated to so that pixel information in the image data of each alternate imaging component corresponds to pixel information in the image data of the reference component. The shifted image data of each alternate imaging component is compared to the image data of the reference imaging component to determine gain and offset parameters for each alternate imaging component. The gain and offset parameters of each alternate imaging component is then applied to the image data of the associate imaging to generate corrected image data for each of the alternate imaging components.
    Type: Grant
    Filed: July 30, 2015
    Date of Patent: October 10, 2017
    Assignee: FotoNation Cayman Limited
    Inventors: Andrew Kenneth John McMahon, Dan Lelescu, Florian Ciurea
  • Patent number: 9779319
    Abstract: Systems and methods for storing images synthesized from light field image data and metadata describing the images in electronic files in accordance with embodiments of the invention are disclosed. One embodiment includes a processor and memory containing an encoding application and light field image data, where the light field image data comprises a plurality of low resolution images of a scene captured from different viewpoints. In addition, the encoding application configures the processor to synthesize a higher resolution image of the scene from a reference viewpoint using the low resolution images, where synthesizing the higher resolution image involves creating a depth map that specifies depths from the reference viewpoint for pixels in the higher resolution image; encode the higher resolution image; and create a light field image file including the encoded image, the low resolution images, and metadata including the depth map.
    Type: Grant
    Filed: March 24, 2015
    Date of Patent: October 3, 2017
    Assignee: FotoNation Cayman Limited
    Inventors: Kartik Venkataraman, Semyon Nisenzon, Dan Lelescu
  • Patent number: 9779287
    Abstract: Techniques for identifying a person in a target image are described. According to one of the techniques, identifying a person in a target image involves displaying, within a graphical user interface, an image that depicts one or more faces. One or more faces are automatically detected within the image. A user provides input that selects a face of the one or more faces to be a currently-selected face. A set of images are selected from a collection of images, where the set of images includes images that closely match the currently-selected face. Concurrently with display of the currently-selected face, each image in the set of images is displayed. Within the graphical user interface, a control is provided. The control enables a user to select a target image from the set of images. In response to detecting that the user has selected a target image using the control, the currently-selected face is associated with a person to which the target image corresponds.
    Type: Grant
    Filed: November 14, 2014
    Date of Patent: October 3, 2017
    Assignee: FotoNation Limited
    Inventors: Eran Steinberg, Peter Corcoran, Yury Prilutsky, Petronel Bigioi, Mihai Ciuc, Stefanita Ciurel, Constantin Verlan
  • Patent number: 9781493
    Abstract: A device and a system may facilitate access to communication connectors, adapters, and/or ports that are supported within a housing, e.g., a rack or cabinet. The system may include one or more of the devices. Each device may include a tray having a proximal portion pivotably coupled to a distal portion, the proximal portion including a lip extending at an oblique angle away from the tray. A plurality of arms may be pivotably attached to the distal portion of the tray. A plurality of cable attachment members may be coupled to the plurality of arms. A plate may be attached to a bottom surface of the tray, a proximal portion of the plate including a lip extending along a bottom portion of the proximal lip of the tray, and a distal portion including a lip extending at an oblique angle away from the distal portion of the tray.
    Type: Grant
    Filed: April 21, 2016
    Date of Patent: October 3, 2017
    Assignee: Go!Foton Holding, Inc.
    Inventors: Kenichiro Takeuchi, Haiguang Lu
  • Patent number: 9774789
    Abstract: Systems and methods for high dynamic range imaging using array cameras in accordance with embodiments of the invention are disclosed. In one embodiment of the invention, a method of generating a high dynamic range image using an array camera includes defining at least two subsets of active cameras, determining image capture settings for each subset of active cameras, where the image capture settings include at least two exposure settings, configuring the active cameras using the determined image capture settings for each subset, capturing image data using the active cameras, synthesizing an image for each of the at least two subset of active cameras using the captured image data, and generating a high dynamic range image using the synthesized images.
    Type: Grant
    Filed: March 7, 2014
    Date of Patent: September 26, 2017
    Assignee: FotoNation Cayman Limited
    Inventors: Florian Ciurea, Kartik Venkataraman
  • Patent number: 9774831
    Abstract: Systems and methods in accordance with embodiments of the invention implement one-dimensional array cameras, as well as modular array cameras using sub-array modules. In one embodiment, a 1×N array camera module includes: a 1×N arrangement of focal planes, where N is greater than or equal to 2, each focal plane includes a plurality of rows of pixels that also form a plurality of columns of pixels, and each focal plane not including pixels from another focal plane; and a 1×N arrangement of lens stacks, the arrangement of lens stacks being disposed relative to the arrangement of focal planes so as to form a 1×N arrangement of cameras, each configured to independently capture an image of a scene, where each lens stack has a field of view that is shifted with respect to that of each other lens stack so that each shift includes a sub-pixel shifted view of the scene.
    Type: Grant
    Filed: April 22, 2016
    Date of Patent: September 26, 2017
    Assignee: FotoNation Cayman Limited
    Inventors: Kartik Venkataraman, Paul Gallagher, Dan Lelescu, Andrew Kenneth John McMahon, Jacques Duparre
  • Patent number: 9766380
    Abstract: Systems and methods in accordance with embodiments of the invention actively align a lens stack array with an array of focal planes to construct an array camera module. In one embodiment, a method for actively aligning a lens stack array with a sensor that has a focal plane array includes: aligning the lens stack array relative to the sensor in an initial position; varying the spatial relationship between the lens stack array and the sensor; capturing images of a known target that has a region of interest using a plurality of active focal planes at different spatial relationships; scoring the images based on the extent to which the region of interest is focused in the images; selecting a spatial relationship between the lens stack array and the sensor based on a comparison of the scores; and forming an array camera subassembly based on the selected spatial relationship.
    Type: Grant
    Filed: January 22, 2016
    Date of Patent: September 19, 2017
    Assignee: FotoNation Cayman Limited
    Inventors: Jacques Duparre, Andrew Kenneth John McMahon, Dan Lelescu