Patents Assigned to FotoNation
-
Patent number: 10275709Abstract: A method of tracking an object across a stream of images comprises determining a region of interest (ROI) bounding the object in an initial frame of an image stream. A HOG map is provided for the ROI by: dividing the ROI into an array of M×N cells, each cell comprising a plurality of image pixels; and determining a HOG for each of the cells. The HOG map is stored as indicative of the features of the object. Subsequent frames are acquired from the stream of images. The frames are scanned ROI by ROI to identify a candidate ROI having a HOG map best matching the stored HOG map features. If the match meets a threshold, the stored HOG map indicative of the features of the object is updated according to the HOG map for the best matching candidate ROI.Type: GrantFiled: September 29, 2016Date of Patent: April 30, 2019Assignee: FotoNation LimitedInventors: Mihai Constantin Munteanu, Alexandru Caliman, Dragos Dinu
-
Patent number: 10270232Abstract: A tool for installing cables in a split sleeve includes first and second guide portions, a third arcuate guide portion extending from and positioned radially outward of the first guide portion, the first and third guide portions forming a first guide slot therebetween, and a fourth arcuate guide portion extending from and positioned radially outward of the second guide portion, the second and fourth guide portions forming a second guide slot therebetween. The tool may be assembled to a split sleeve that is biased toward a rolled up configuration in which one side of the split sleeve at least partially overlies another side of the split sleeve. By positioning one or more cables within the tool while the tool is assembled to the split sleeve, a user may slide the tool along the split sleeve to position the cables within the split sleeve.Type: GrantFiled: June 25, 2015Date of Patent: April 23, 2019Assignee: Go!Foton Holdings, Inc.Inventors: Kenichiro Takeuchi, Haiguang Lu
-
Patent number: 10261219Abstract: Systems and methods in accordance with embodiments of the invention actively align a lens stack array with an array of focal planes to construct an array camera module. In one embodiment, a method for actively aligning a lens stack array with a sensor that has a focal plane array includes: aligning the lens stack array relative to the sensor in an initial position; varying the spatial relationship between the lens stack array and the sensor; capturing images of a known target that has a region of interest using a plurality of active focal planes at different spatial relationships; scoring the images based on the extent to which the region of interest is focused in the images; selecting a spatial relationship between the lens stack array and the sensor based on a comparison of the scores; and forming an array camera subassembly based on the selected spatial relationship.Type: GrantFiled: September 18, 2017Date of Patent: April 16, 2019Assignee: FotoNation LimitedInventors: Jacques Duparre, Andrew Kenneth John McMahon, Dan Lelescu
-
Publication number: 20190109998Abstract: Systems and methods for implementing array cameras configured to perform super-resolution processing to generate higher resolution super-resolved images using a plurality of captured images and lens stack arrays that can be utilized in array cameras are disclosed. An imaging device in accordance with one embodiment of the invention includes at least one imager array, and each imager in the array comprises a plurality of light sensing elements and a lens stack including at least one lens surface, where the lens stack is configured to form an image on the light sensing elements, control circuitry configured to capture images formed on the light sensing elements of each of the imagers, and a super-resolution processing module configured to generate at least one higher resolution super-resolved image using a plurality of the captured images.Type: ApplicationFiled: November 26, 2018Publication date: April 11, 2019Applicant: FotoNation LimitedInventors: Kartik Venkataraman, Amandeep S. Jabbi, Robert H. Mullis, Jacques Duparre, Shane Ching-Feng Hu
-
Publication number: 20190102532Abstract: Systems and methods for authenticating a biometric device using a trusted coordinating smart device in accordance with embodiments of the invention are disclosed.Type: ApplicationFiled: December 3, 2018Publication date: April 4, 2019Applicant: FotoNation LimitedInventor: Peter Corcoran
-
Patent number: 10250871Abstract: Systems and methods for dynamically calibrating an array camera to accommodate variations in geometry that can occur throughout its operational life are disclosed. The dynamic calibration processes can include acquiring a set of images of a scene and identifying corresponding features within the images. Geometric calibration data can be used to rectify the images and determine residual vectors for the geometric calibration data at locations where corresponding features are observed. The residual vectors can then be used to determine updated geometric calibration data for the camera array. In several embodiments, the residual vectors are used to generate a residual vector calibration data field that updates the geometric calibration data. In many embodiments, the residual vectors are used to select a set of geometric calibration from amongst a number of different sets of geometric calibration data that is the best fit for the current geometry of the camera array.Type: GrantFiled: September 29, 2015Date of Patent: April 2, 2019Assignee: FotoNation LimitedInventors: Florian Ciurea, Dan Lelescu, Priyam Chatterjee
-
Publication number: 20190098209Abstract: Systems and methods for implementing array camera configurations that include a plurality of constituent array cameras, where each constituent array camera provides a distinct field of view and/or a distinct viewing direction, are described. In several embodiments, image data captured by the constituent array cameras is used to synthesize multiple images that are subsequently blended. In a number of embodiments, the blended images include a foveated region. In certain embodiments, the blended images possess a wider field of view than the fields of view of the multiple images.Type: ApplicationFiled: November 8, 2018Publication date: March 28, 2019Applicant: FotoNation LimitedInventors: Kartik Venkataraman, Jacques Duparré
-
Publication number: 20190089941Abstract: A technique of generating a stereoscopic panorama image includes panning a portable camera device, and acquiring multiple image frames. Multiple at least partially overlapping image frames are acquired of portions of the scene. The method involves registering the image frames, including determining displacements of the imaging device between acquisitions of image frames. Multiple panorama images are generated including joining image frames of the scene according to spatial relationships and determining stereoscopic counterpart relationships between the multiple panorama images. The multiple panorama images arc processed based on the stereoscopic counterpart relationships to form a stereoscopic panorama image.Type: ApplicationFiled: September 14, 2018Publication date: March 21, 2019Applicant: FotoNation LimitedInventors: Petronel BIGIOI, George SUSANU, Igor BARCOVSCHI, Piotr STEC, Larry MURRAY, Alexandru DRIMBAREAN, Peter CORCORAN
-
Publication number: 20190089947Abstract: Systems with an array camera augmented with a conventional camera in accordance with embodiments of the invention are disclosed. In some embodiments, the array camera is used to capture a first set of image data of a scene and a conventional camera is used to capture a second set of image data for the scene. An object of interest is identified in the first set of image data. A first depth measurement for the object of interest is determined and compared to a predetermined threshold. If the first depth measurement is above the threshold, a second set of image data captured using the conventional camera is obtained. The object of interest is identified in the second set of image data and a second depth measurement for the object of interest is determined using at least a portion of the first set of image data and at least a portion of the second set of image data.Type: ApplicationFiled: November 2, 2018Publication date: March 21, 2019Applicant: FotoNation LimitedInventors: Kartik Venkataraman, Paul Gallagher, Ankit K. Jain, Semyon Nisenzon, Dan Lelescu, Florian Ciurea, Gabriel Molina
-
Patent number: 10235590Abstract: Systems and methods for storing images synthesized from light field image data and metadata describing the images in electronic files in accordance with embodiments of the invention are disclosed. One embodiment includes a processor and memory containing an encoding application and light field image data, where the light field image data comprises a plurality of low resolution images of a scene captured from different viewpoints. In addition, the encoding application configures the processor to synthesize a higher resolution image of the scene from a reference viewpoint using the low resolution images, where synthesizing the higher resolution image involves creating a depth map that specifies depths from the reference viewpoint for pixels in the higher resolution image; encode the higher resolution image; and create a light field image file including the encoded image, the low resolution images, and metadata including the depth map.Type: GrantFiled: January 8, 2018Date of Patent: March 19, 2019Assignee: FotoNation LimitedInventors: Kartik Venkataraman, Semyon Nisenzon, Dan Lelescu
-
Patent number: 10229504Abstract: A method of estimating motion between a pair of image frames of a given scene comprises calculating respective integral images for each of the image frames and selecting at least one corresponding region of interest within each frame. For each region of interest, an integral image profile from each integral image is calculated, each profile comprising an array of elements, each element comprising a sum of pixel intensities from successive swaths of the region of interest for the frame. Integral image profiles are correlated to determine a relative displacement of the region of interest between the pair of frames. Each region of interest is divided into a plurality of further regions of interest before repeating until a required hierarchy of estimated motion for successively divided regions of interest is provided.Type: GrantFiled: March 14, 2014Date of Patent: March 12, 2019Assignee: FotoNation LimitedInventors: Petronel Bigioi, Peter Corcoran, Piotr Stec
-
Patent number: 10225543Abstract: Systems and methods for calibrating an array camera are disclosed. Systems and methods for calibrating an array camera in accordance with embodiments of this invention include the capturing of an image of a test pattern with the array camera such that each imaging component in the array camera captures an image of the test pattern. The image of the test pattern captured by a reference imaging component is then used to derive calibration information for the reference component. A corrected image of the test pattern for the reference component is then generated from the calibration information and the image of the test pattern captured by the reference imaging component. The corrected image is then used with the images captured by each of the associate imaging components associated with the reference component to generate calibration information for the associate imaging components.Type: GrantFiled: May 23, 2018Date of Patent: March 5, 2019Assignee: FotoNation LimitedInventor: Robert Mullis
-
Publication number: 20190063905Abstract: Systems and methods in accordance with embodiments of the invention estimate depth from projected texture using camera arrays. One embodiment of the invention includes: at least one two-dimensional array of cameras comprising a plurality of cameras; an illumination system configured to illuminate a scene with a projected texture; a processor; and memory containing an image processing pipeline application and an illumination system controller application. In addition, the illumination system controller application directs the processor to control the illumination system to illuminate a scene with a projected texture.Type: ApplicationFiled: October 31, 2018Publication date: February 28, 2019Applicant: FotoNation LimitedInventors: Kartik Venkataraman, Jacques Duparré
-
Publication number: 20190065410Abstract: A peripheral processing device comprises a physical interface for connecting the processing device to a host computing device through a communications protocol. A local controller connected to local memory across an internal bus provides input/output access to data stored on the processing device to the host through a file system API. A neural processor comprises at least one network processing engine for processing a layer of a neural network according to a network configuration. A memory at least temporarily stores network configuration information, input image information, intermediate image information and output information produced by each network processing engine. The local controller is arranged to receive network configuration information through a file system API write command, to receive input image information through a file system API write command; and to write output information to the local memory for retrieval by the host through a file system API read command.Type: ApplicationFiled: August 30, 2018Publication date: February 28, 2019Applicant: FotoNation LimitedInventors: Petronel BIGIOI, Corneliu ZAHARIA
-
Patent number: 10218889Abstract: Systems and methods for transmitting and receiving image data captured by an imager array including a plurality of focal planes are described. One embodiment of the invention includes capturing image data using a plurality of active focal planes in a camera module, where an image is formed on each active focal plane by a separate lens stack, generating lines of image data by interleaving the image data captured by the plurality of active focal planes, and transmitting the lines of image data and the additional data.Type: GrantFiled: January 8, 2018Date of Patent: February 26, 2019Assignee: FotoNation LimitedInventor: Andrew Kenneth John McMahon
-
Publication number: 20190057513Abstract: Systems and methods for hybrid depth regularization in accordance with various embodiments of the invention are disclosed. In one embodiment of the invention, a depth sensing system comprises a plurality of cameras; a processor; and a memory containing an image processing application. The image processing application may direct the processor to obtain image data for a plurality of images from multiple viewpoints, the image data comprising a reference image and at least one alternate view image; generate a raw depth map using a first depth estimation process, and a confidence map; and generate a regularized depth map. The regularized depth map may be generated by computing a secondary depth map using a second different depth estimation process; and computing a composite depth map by selecting depth estimates from the raw depth map and the secondary depth map based on the confidence map.Type: ApplicationFiled: August 21, 2017Publication date: February 21, 2019Applicant: FotoNation Cayman LimitedInventors: Ankit Jain, Priyam Chatterjee, Kartik Venkataraman
-
Patent number: 10212366Abstract: An iris image acquisition system comprises an image sensor comprising an array of pixels including pixels sensitive to NIR wavelengths; at least one NIR light source capable of selectively emitting light with different discrete NIR wavelengths; and a processor, operably connected to the image sensor and the at least one NIR light source, to acquire image information from the sensor under illumination at one of the different discrete NIR wavelengths. A lens assembly comprises a plurality of lens elements with a total track length no more than 4.7 mm, each lens element comprising a material with a refractive index inversely proportional to wavelength. The different discrete NIR wavelengths are matched with the refractive index of the material for the lens elements to balance axial image shift induced by a change in object distance with axial image shift due to change in illumination wavelength.Type: GrantFiled: June 17, 2016Date of Patent: February 19, 2019Assignee: FotoNation LimitedInventors: Christopher Dainty, Alexander Goncharov, Niamh Fitzgerald
-
Publication number: 20190049673Abstract: A connector assembly includes an adapter, a housing, a ferrule, and a sensor. The housing is received by the adapter and has a bore. The ferrule is translatable within the bore of the housing. The sensor is mounted on the housing or on the adapter. The sensor is configured for detecting translation of the ferrule. An electrical characteristic of the sensor changes to indicate translation of the ferrule to a predetermined position.Type: ApplicationFiled: October 12, 2018Publication date: February 14, 2019Applicant: Go!Foton Holdings, Inc.Inventors: Kenichiro Takeuchi, Haiguang Lu, Chi Kong Paul Ng
-
Patent number: 10182216Abstract: Systems and methods for extended color processing on Pelican array cameras in accordance with embodiments of the invention are disclosed. In one embodiment, a method of generating a high resolution image includes obtaining input images, where a first set of images includes information in a first band of visible wavelengths and a second set of images includes information in a second band of visible wavelengths and non-visible wavelengths, determining an initial estimate by combining the first set of images into a first fused image, combining the second set of images into a second fused image, spatially registering the fused images, denoising the fused images using bilateral filters, normalizing the second fused image in the photometric reference space of the first fused image, combining the fused images, determining a high resolution image that when mapped through a forward imaging transformation matches the input images within at least one predetermined criterion.Type: GrantFiled: October 6, 2016Date of Patent: January 15, 2019Assignee: FotoNation LimitedInventors: Robert H. Mullis, Dan Lelescu, Kartik Venkataraman
-
Patent number: 10176377Abstract: An approach for an iris liveness detection is provided. A plurality of image pairs is acquired using one or more image sensors of a mobile device. A particular image pair is selected from the plurality of image pairs, and a hyperspectral image is generated for the particular image pair. Based on, at least in part, the hyperspectral image, a particular feature vector for the eye-iris region depicted in the particular image pair is generated, and one or more trained model feature vectors generated for facial features of a particular user of the device are retrieved. Based on, at least in part, the particular feature vector and the one or more trained model feature vectors, a distance metric is determined and compared with a threshold. If the distance metric exceeds the threshold, then a first message indicating that the plurality of image pairs fails to depict the particular user is generated.Type: GrantFiled: November 1, 2016Date of Patent: January 8, 2019Assignee: FotoNation LimitedInventor: Shejin Thavalengal