Patents Assigned to FotoNation
  • Patent number: 10275709
    Abstract: A method of tracking an object across a stream of images comprises determining a region of interest (ROI) bounding the object in an initial frame of an image stream. A HOG map is provided for the ROI by: dividing the ROI into an array of M×N cells, each cell comprising a plurality of image pixels; and determining a HOG for each of the cells. The HOG map is stored as indicative of the features of the object. Subsequent frames are acquired from the stream of images. The frames are scanned ROI by ROI to identify a candidate ROI having a HOG map best matching the stored HOG map features. If the match meets a threshold, the stored HOG map indicative of the features of the object is updated according to the HOG map for the best matching candidate ROI.
    Type: Grant
    Filed: September 29, 2016
    Date of Patent: April 30, 2019
    Assignee: FotoNation Limited
    Inventors: Mihai Constantin Munteanu, Alexandru Caliman, Dragos Dinu
  • Patent number: 10270232
    Abstract: A tool for installing cables in a split sleeve includes first and second guide portions, a third arcuate guide portion extending from and positioned radially outward of the first guide portion, the first and third guide portions forming a first guide slot therebetween, and a fourth arcuate guide portion extending from and positioned radially outward of the second guide portion, the second and fourth guide portions forming a second guide slot therebetween. The tool may be assembled to a split sleeve that is biased toward a rolled up configuration in which one side of the split sleeve at least partially overlies another side of the split sleeve. By positioning one or more cables within the tool while the tool is assembled to the split sleeve, a user may slide the tool along the split sleeve to position the cables within the split sleeve.
    Type: Grant
    Filed: June 25, 2015
    Date of Patent: April 23, 2019
    Assignee: Go!Foton Holdings, Inc.
    Inventors: Kenichiro Takeuchi, Haiguang Lu
  • Patent number: 10261219
    Abstract: Systems and methods in accordance with embodiments of the invention actively align a lens stack array with an array of focal planes to construct an array camera module. In one embodiment, a method for actively aligning a lens stack array with a sensor that has a focal plane array includes: aligning the lens stack array relative to the sensor in an initial position; varying the spatial relationship between the lens stack array and the sensor; capturing images of a known target that has a region of interest using a plurality of active focal planes at different spatial relationships; scoring the images based on the extent to which the region of interest is focused in the images; selecting a spatial relationship between the lens stack array and the sensor based on a comparison of the scores; and forming an array camera subassembly based on the selected spatial relationship.
    Type: Grant
    Filed: September 18, 2017
    Date of Patent: April 16, 2019
    Assignee: FotoNation Limited
    Inventors: Jacques Duparre, Andrew Kenneth John McMahon, Dan Lelescu
  • Publication number: 20190109998
    Abstract: Systems and methods for implementing array cameras configured to perform super-resolution processing to generate higher resolution super-resolved images using a plurality of captured images and lens stack arrays that can be utilized in array cameras are disclosed. An imaging device in accordance with one embodiment of the invention includes at least one imager array, and each imager in the array comprises a plurality of light sensing elements and a lens stack including at least one lens surface, where the lens stack is configured to form an image on the light sensing elements, control circuitry configured to capture images formed on the light sensing elements of each of the imagers, and a super-resolution processing module configured to generate at least one higher resolution super-resolved image using a plurality of the captured images.
    Type: Application
    Filed: November 26, 2018
    Publication date: April 11, 2019
    Applicant: FotoNation Limited
    Inventors: Kartik Venkataraman, Amandeep S. Jabbi, Robert H. Mullis, Jacques Duparre, Shane Ching-Feng Hu
  • Publication number: 20190102532
    Abstract: Systems and methods for authenticating a biometric device using a trusted coordinating smart device in accordance with embodiments of the invention are disclosed.
    Type: Application
    Filed: December 3, 2018
    Publication date: April 4, 2019
    Applicant: FotoNation Limited
    Inventor: Peter Corcoran
  • Patent number: 10250871
    Abstract: Systems and methods for dynamically calibrating an array camera to accommodate variations in geometry that can occur throughout its operational life are disclosed. The dynamic calibration processes can include acquiring a set of images of a scene and identifying corresponding features within the images. Geometric calibration data can be used to rectify the images and determine residual vectors for the geometric calibration data at locations where corresponding features are observed. The residual vectors can then be used to determine updated geometric calibration data for the camera array. In several embodiments, the residual vectors are used to generate a residual vector calibration data field that updates the geometric calibration data. In many embodiments, the residual vectors are used to select a set of geometric calibration from amongst a number of different sets of geometric calibration data that is the best fit for the current geometry of the camera array.
    Type: Grant
    Filed: September 29, 2015
    Date of Patent: April 2, 2019
    Assignee: FotoNation Limited
    Inventors: Florian Ciurea, Dan Lelescu, Priyam Chatterjee
  • Publication number: 20190098209
    Abstract: Systems and methods for implementing array camera configurations that include a plurality of constituent array cameras, where each constituent array camera provides a distinct field of view and/or a distinct viewing direction, are described. In several embodiments, image data captured by the constituent array cameras is used to synthesize multiple images that are subsequently blended. In a number of embodiments, the blended images include a foveated region. In certain embodiments, the blended images possess a wider field of view than the fields of view of the multiple images.
    Type: Application
    Filed: November 8, 2018
    Publication date: March 28, 2019
    Applicant: FotoNation Limited
    Inventors: Kartik Venkataraman, Jacques Duparré
  • Publication number: 20190089941
    Abstract: A technique of generating a stereoscopic panorama image includes panning a portable camera device, and acquiring multiple image frames. Multiple at least partially overlapping image frames are acquired of portions of the scene. The method involves registering the image frames, including determining displacements of the imaging device between acquisitions of image frames. Multiple panorama images are generated including joining image frames of the scene according to spatial relationships and determining stereoscopic counterpart relationships between the multiple panorama images. The multiple panorama images arc processed based on the stereoscopic counterpart relationships to form a stereoscopic panorama image.
    Type: Application
    Filed: September 14, 2018
    Publication date: March 21, 2019
    Applicant: FotoNation Limited
    Inventors: Petronel BIGIOI, George SUSANU, Igor BARCOVSCHI, Piotr STEC, Larry MURRAY, Alexandru DRIMBAREAN, Peter CORCORAN
  • Publication number: 20190089947
    Abstract: Systems with an array camera augmented with a conventional camera in accordance with embodiments of the invention are disclosed. In some embodiments, the array camera is used to capture a first set of image data of a scene and a conventional camera is used to capture a second set of image data for the scene. An object of interest is identified in the first set of image data. A first depth measurement for the object of interest is determined and compared to a predetermined threshold. If the first depth measurement is above the threshold, a second set of image data captured using the conventional camera is obtained. The object of interest is identified in the second set of image data and a second depth measurement for the object of interest is determined using at least a portion of the first set of image data and at least a portion of the second set of image data.
    Type: Application
    Filed: November 2, 2018
    Publication date: March 21, 2019
    Applicant: FotoNation Limited
    Inventors: Kartik Venkataraman, Paul Gallagher, Ankit K. Jain, Semyon Nisenzon, Dan Lelescu, Florian Ciurea, Gabriel Molina
  • Patent number: 10235590
    Abstract: Systems and methods for storing images synthesized from light field image data and metadata describing the images in electronic files in accordance with embodiments of the invention are disclosed. One embodiment includes a processor and memory containing an encoding application and light field image data, where the light field image data comprises a plurality of low resolution images of a scene captured from different viewpoints. In addition, the encoding application configures the processor to synthesize a higher resolution image of the scene from a reference viewpoint using the low resolution images, where synthesizing the higher resolution image involves creating a depth map that specifies depths from the reference viewpoint for pixels in the higher resolution image; encode the higher resolution image; and create a light field image file including the encoded image, the low resolution images, and metadata including the depth map.
    Type: Grant
    Filed: January 8, 2018
    Date of Patent: March 19, 2019
    Assignee: FotoNation Limited
    Inventors: Kartik Venkataraman, Semyon Nisenzon, Dan Lelescu
  • Patent number: 10229504
    Abstract: A method of estimating motion between a pair of image frames of a given scene comprises calculating respective integral images for each of the image frames and selecting at least one corresponding region of interest within each frame. For each region of interest, an integral image profile from each integral image is calculated, each profile comprising an array of elements, each element comprising a sum of pixel intensities from successive swaths of the region of interest for the frame. Integral image profiles are correlated to determine a relative displacement of the region of interest between the pair of frames. Each region of interest is divided into a plurality of further regions of interest before repeating until a required hierarchy of estimated motion for successively divided regions of interest is provided.
    Type: Grant
    Filed: March 14, 2014
    Date of Patent: March 12, 2019
    Assignee: FotoNation Limited
    Inventors: Petronel Bigioi, Peter Corcoran, Piotr Stec
  • Patent number: 10225543
    Abstract: Systems and methods for calibrating an array camera are disclosed. Systems and methods for calibrating an array camera in accordance with embodiments of this invention include the capturing of an image of a test pattern with the array camera such that each imaging component in the array camera captures an image of the test pattern. The image of the test pattern captured by a reference imaging component is then used to derive calibration information for the reference component. A corrected image of the test pattern for the reference component is then generated from the calibration information and the image of the test pattern captured by the reference imaging component. The corrected image is then used with the images captured by each of the associate imaging components associated with the reference component to generate calibration information for the associate imaging components.
    Type: Grant
    Filed: May 23, 2018
    Date of Patent: March 5, 2019
    Assignee: FotoNation Limited
    Inventor: Robert Mullis
  • Publication number: 20190063905
    Abstract: Systems and methods in accordance with embodiments of the invention estimate depth from projected texture using camera arrays. One embodiment of the invention includes: at least one two-dimensional array of cameras comprising a plurality of cameras; an illumination system configured to illuminate a scene with a projected texture; a processor; and memory containing an image processing pipeline application and an illumination system controller application. In addition, the illumination system controller application directs the processor to control the illumination system to illuminate a scene with a projected texture.
    Type: Application
    Filed: October 31, 2018
    Publication date: February 28, 2019
    Applicant: FotoNation Limited
    Inventors: Kartik Venkataraman, Jacques Duparré
  • Publication number: 20190065410
    Abstract: A peripheral processing device comprises a physical interface for connecting the processing device to a host computing device through a communications protocol. A local controller connected to local memory across an internal bus provides input/output access to data stored on the processing device to the host through a file system API. A neural processor comprises at least one network processing engine for processing a layer of a neural network according to a network configuration. A memory at least temporarily stores network configuration information, input image information, intermediate image information and output information produced by each network processing engine. The local controller is arranged to receive network configuration information through a file system API write command, to receive input image information through a file system API write command; and to write output information to the local memory for retrieval by the host through a file system API read command.
    Type: Application
    Filed: August 30, 2018
    Publication date: February 28, 2019
    Applicant: FotoNation Limited
    Inventors: Petronel BIGIOI, Corneliu ZAHARIA
  • Patent number: 10218889
    Abstract: Systems and methods for transmitting and receiving image data captured by an imager array including a plurality of focal planes are described. One embodiment of the invention includes capturing image data using a plurality of active focal planes in a camera module, where an image is formed on each active focal plane by a separate lens stack, generating lines of image data by interleaving the image data captured by the plurality of active focal planes, and transmitting the lines of image data and the additional data.
    Type: Grant
    Filed: January 8, 2018
    Date of Patent: February 26, 2019
    Assignee: FotoNation Limited
    Inventor: Andrew Kenneth John McMahon
  • Publication number: 20190057513
    Abstract: Systems and methods for hybrid depth regularization in accordance with various embodiments of the invention are disclosed. In one embodiment of the invention, a depth sensing system comprises a plurality of cameras; a processor; and a memory containing an image processing application. The image processing application may direct the processor to obtain image data for a plurality of images from multiple viewpoints, the image data comprising a reference image and at least one alternate view image; generate a raw depth map using a first depth estimation process, and a confidence map; and generate a regularized depth map. The regularized depth map may be generated by computing a secondary depth map using a second different depth estimation process; and computing a composite depth map by selecting depth estimates from the raw depth map and the secondary depth map based on the confidence map.
    Type: Application
    Filed: August 21, 2017
    Publication date: February 21, 2019
    Applicant: FotoNation Cayman Limited
    Inventors: Ankit Jain, Priyam Chatterjee, Kartik Venkataraman
  • Patent number: 10212366
    Abstract: An iris image acquisition system comprises an image sensor comprising an array of pixels including pixels sensitive to NIR wavelengths; at least one NIR light source capable of selectively emitting light with different discrete NIR wavelengths; and a processor, operably connected to the image sensor and the at least one NIR light source, to acquire image information from the sensor under illumination at one of the different discrete NIR wavelengths. A lens assembly comprises a plurality of lens elements with a total track length no more than 4.7 mm, each lens element comprising a material with a refractive index inversely proportional to wavelength. The different discrete NIR wavelengths are matched with the refractive index of the material for the lens elements to balance axial image shift induced by a change in object distance with axial image shift due to change in illumination wavelength.
    Type: Grant
    Filed: June 17, 2016
    Date of Patent: February 19, 2019
    Assignee: FotoNation Limited
    Inventors: Christopher Dainty, Alexander Goncharov, Niamh Fitzgerald
  • Publication number: 20190049673
    Abstract: A connector assembly includes an adapter, a housing, a ferrule, and a sensor. The housing is received by the adapter and has a bore. The ferrule is translatable within the bore of the housing. The sensor is mounted on the housing or on the adapter. The sensor is configured for detecting translation of the ferrule. An electrical characteristic of the sensor changes to indicate translation of the ferrule to a predetermined position.
    Type: Application
    Filed: October 12, 2018
    Publication date: February 14, 2019
    Applicant: Go!Foton Holdings, Inc.
    Inventors: Kenichiro Takeuchi, Haiguang Lu, Chi Kong Paul Ng
  • Patent number: 10182216
    Abstract: Systems and methods for extended color processing on Pelican array cameras in accordance with embodiments of the invention are disclosed. In one embodiment, a method of generating a high resolution image includes obtaining input images, where a first set of images includes information in a first band of visible wavelengths and a second set of images includes information in a second band of visible wavelengths and non-visible wavelengths, determining an initial estimate by combining the first set of images into a first fused image, combining the second set of images into a second fused image, spatially registering the fused images, denoising the fused images using bilateral filters, normalizing the second fused image in the photometric reference space of the first fused image, combining the fused images, determining a high resolution image that when mapped through a forward imaging transformation matches the input images within at least one predetermined criterion.
    Type: Grant
    Filed: October 6, 2016
    Date of Patent: January 15, 2019
    Assignee: FotoNation Limited
    Inventors: Robert H. Mullis, Dan Lelescu, Kartik Venkataraman
  • Patent number: 10176377
    Abstract: An approach for an iris liveness detection is provided. A plurality of image pairs is acquired using one or more image sensors of a mobile device. A particular image pair is selected from the plurality of image pairs, and a hyperspectral image is generated for the particular image pair. Based on, at least in part, the hyperspectral image, a particular feature vector for the eye-iris region depicted in the particular image pair is generated, and one or more trained model feature vectors generated for facial features of a particular user of the device are retrieved. Based on, at least in part, the particular feature vector and the one or more trained model feature vectors, a distance metric is determined and compared with a threshold. If the distance metric exceeds the threshold, then a first message indicating that the plurality of image pairs fails to depict the particular user is generated.
    Type: Grant
    Filed: November 1, 2016
    Date of Patent: January 8, 2019
    Assignee: FotoNation Limited
    Inventor: Shejin Thavalengal