Patents by Inventor Florian Ciurea
Florian Ciurea has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11941833Abstract: Systems in accordance with embodiments of the invention can perform parallax detection and correction in images captured using array cameras. Due to the different viewpoints of the cameras, parallax results in variations in the position of objects within the captured images of the scene. Methods in accordance with embodiments of the invention provide an accurate account of the pixel disparity due to parallax between the different cameras in the array, so that appropriate scene-dependent geometric shifts can be applied to the pixels of the captured images when performing super-resolution processing. In a number of embodiments, generating depth estimates considers the similarity of pixels in multiple spectral channels. In certain embodiments, generating depth estimates involves generating a confidence map indicating the reliability of depth estimates.Type: GrantFiled: January 29, 2021Date of Patent: March 26, 2024Assignee: Adeia Imaging LLCInventors: Florian Ciurea, Kartik Venkataraman, Gabriel Molina, Dan Lelescu
-
Publication number: 20240080564Abstract: Electronic devices, methods, and program storage devices for achieving smooth zooming operations during video capture are disclosed. In particular, smooth zooming may be desirable during video capture operations that involve a single image capture device and/or transitioning between two or more distinct image capture devices, e.g., having different optical and/or zooming properties, during the video capture. When video zooming is done abruptly, it can lead to an unpleasant user experience. The techniques described herein to improve the smoothness of zooming operations include: the use of longer zoom “ramps” for image capture devices; the “early” transitioning between image capture devices during video capture; and the performance of additional “digital zoom smoothing-aware” video image stabilization operations. The embodiments described herein also provide for a more consistent user experience between video streaming (i.e., “preview”) modes and the recorded (i.e.Type: ApplicationFiled: February 23, 2023Publication date: March 7, 2024Inventors: Buyue Zhang, Walker J. Eagleston, Avijit S. Wasu, Jeffrey A. Brasket, Florian Ciurea, Zejing Wang, Sean Z. Amadio, Julio C. Hernandez Zaragoza, Tao Zhang
-
Publication number: 20230396883Abstract: Devices, methods, and non-transitory computer readable media are disclosed herein to repair or mitigate the appearance of unwanted reflection artifacts in captured video image streams. These unwanted reflection artifacts often present themselves as brightly-colored spots, circles, rings, or halos that reflect the shape of a bright light source in the captured image. These artifacts, also referred to herein as “ghosts” or “green ghosts” (due to often having a greenish tint), are typically located in regions of the captured images where there is not actually a bright light source located in the image. In fact, such unwanted reflection artifacts often present themselves on the image sensor across the principal point of the lens from where the actual bright light source in the captured image is located. Such devices, methods and computer readable media may be configured to detect, track, and repair such unwanted reflection artifacts in an intelligent and efficient fashion.Type: ApplicationFiled: June 3, 2022Publication date: December 7, 2023Inventors: Ahmed T. Kamal, Feng Li, Florian Ciurea, Jianping Zhou, Saeed Izadi, Sebastien X. Beysserie, Stephane S. Ben Soussan
-
Publication number: 20230336707Abstract: Systems and methods for dynamically calibrating an array camera to accommodate variations in geometry that can occur throughout its operational life are disclosed. The dynamic calibration processes can include acquiring a set of images of a scene and identifying corresponding features within the images. Geometric calibration data can be used to rectify the images and determine residual vectors for the geometric calibration data at locations where corresponding features are observed. The residual vectors can then be used to determine updated geometric calibration data for the camera array. In several embodiments, the residual vectors are used to generate a residual vector calibration data field that updates the geometric calibration data. In many embodiments, the residual vectors are used to select a set of geometric calibration from amongst a number of different sets of geometric calibration data that is the best fit for the current geometry of the camera array.Type: ApplicationFiled: December 28, 2022Publication date: October 19, 2023Applicant: Adeia Imaging LLCInventors: Florian Ciurea, Dan Lelescu, Priyam Chatterjee
-
Patent number: 11546576Abstract: Systems and methods for dynamically calibrating an array camera to accommodate variations in geometry that can occur throughout its operational life are disclosed. The dynamic calibration processes can include acquiring a set of images of a scene and identifying corresponding features within the images. Geometric calibration data can be used to rectify the images and determine residual vectors for the geometric calibration data at locations where corresponding features are observed. The residual vectors can then be used to determine updated geometric calibration data for the camera array. In several embodiments, the residual vectors are used to generate a residual vector calibration data field that updates the geometric calibration data. In many embodiments, the residual vectors are used to select a set of geometric calibration from amongst a number of different sets of geometric calibration data that is the best fit for the current geometry of the camera array.Type: GrantFiled: March 8, 2021Date of Patent: January 3, 2023Assignee: Adeia Imaging LLCInventors: Florian Ciurea, Dan Lelescu, Priyam Chatterjee
-
Publication number: 20220394180Abstract: Devices, methods, and non-transitory program storage devices are disclosed to provide techniques for distortion compensation in images that are subject to video image stabilization (VIS), e.g., electronic image stabilization (EIS). In some embodiments, the techniques comprise: obtaining a first image captured by a first image capture device; determining a first set of image parameters configured to apply a first distortion operation (e.g., an un-distortion operation) to the first image; determining a second set of image parameters configured to apply a first stabilization operation to a first version of the first image that has already had the first distortion operation applied; determining a third set of image parameters configured to apply a second distortion operation (e.g.Type: ApplicationFiled: June 2, 2022Publication date: December 8, 2022Inventors: Zejing Wang, Florian Ciurea, Benjamin A. Darling
-
Patent number: 11158026Abstract: Electronic devices, computer readable storage media, and related methods are disclosed herein that are configured to stitch together images captured by multiple image capture devices of an image capture system. In particular, various techniques are employed to intelligently extend (and, optionally, smooth) the correspondence mapping between first and second images captured by image capture devices having different fields of view, e.g., fields of view that are at least partially overlapping and at least partially non-overlapping. The techniques may also include determining a “transitional” correspondence in a transitional region between the overlapping and non-overlapping regions of the fields of view, as well as performing one or more appearance correction operations to account for the different properties of the different image capture devices used to capture the first and second images.Type: GrantFiled: March 20, 2020Date of Patent: October 26, 2021Assignee: Apple Inc.Inventors: Ahmed Tashrif Kamal, Florian Ciurea, Jianping Zhou, Paul Hubel
-
Publication number: 20210281828Abstract: Systems and methods for dynamically calibrating an array camera to accommodate variations in geometry that can occur throughout its operational life are disclosed. The dynamic calibration processes can include acquiring a set of images of a scene and identifying corresponding features within the images. Geometric calibration data can be used to rectify the images and determine residual vectors for the geometric calibration data at locations where corresponding features are observed. The residual vectors can then be used to determine updated geometric calibration data for the camera array. In several embodiments, the residual vectors are used to generate a residual vector calibration data field that updates the geometric calibration data. In many embodiments, the residual vectors are used to select a set of geometric calibration from amongst a number of different sets of geometric calibration data that is the best fit for the current geometry of the camera array.Type: ApplicationFiled: March 8, 2021Publication date: September 9, 2021Applicant: FotoNation LimitedInventors: Florian Ciurea, Dan Lelescu, Priyam Chatterjee
-
Publication number: 20210150748Abstract: Systems in accordance with embodiments of the invention can perform parallax detection and correction in images captured using array cameras. Due to the different viewpoints of the cameras, parallax results in variations in the position of objects within the captured images of the scene. Methods in accordance with embodiments of the invention provide an accurate account of the pixel disparity due to parallax between the different cameras in the array, so that appropriate scene-dependent geometric shifts can be applied to the pixels of the captured images when performing super-resolution processing. In a number of embodiments, generating depth estimates considers the similarity of pixels in multiple spectral channels. In certain embodiments, generating depth estimates involves generating a confidence map indicating the reliability of depth estimates.Type: ApplicationFiled: January 29, 2021Publication date: May 20, 2021Applicant: FotoNation LimitedInventors: Florian Ciurea, Kartik Venkataraman, Gabriel Molina, Dan Lelescu
-
Patent number: 10944961Abstract: Systems and methods for dynamically calibrating an array camera to accommodate variations in geometry that can occur throughout its operational life are disclosed. The dynamic calibration processes can include acquiring a set of images of a scene and identifying corresponding features within the images. Geometric calibration data can be used to rectify the images and determine residual vectors for the geometric calibration data at locations where corresponding features are observed. The residual vectors can then be used to determine updated geometric calibration data for the camera array. In several embodiments, the residual vectors are used to generate a residual vector calibration data field that updates the geometric calibration data. In many embodiments, the residual vectors are used to select a set of geometric calibration from amongst a number of different sets of geometric calibration data that is the best fit for the current geometry of the camera array.Type: GrantFiled: April 1, 2019Date of Patent: March 9, 2021Assignee: FotoNation LimitedInventors: Florian Ciurea, Dan Lelescu, Priyam Chatterjee
-
Patent number: 10909707Abstract: Systems in accordance with embodiments of the invention can perform parallax detection and correction in images captured using array cameras. Due to the different viewpoints of the cameras, parallax results in variations in the position of objects within the captured images of the scene. Methods in accordance with embodiments of the invention provide an accurate account of the pixel disparity due to parallax between the different cameras in the array, so that appropriate scene-dependent geometric shifts can be applied to the pixels of the captured images when performing super-resolution processing. In a number of embodiments, generating depth estimates considers the similarity of pixels in multiple spectral channels. In certain embodiments, generating depth estimates involves generating a confidence map indicating the reliability of depth estimates.Type: GrantFiled: August 9, 2019Date of Patent: February 2, 2021Assignee: FotoNation LimitedInventors: Florian Ciurea, Kartik Venkataraman, Gabriel Molina, Dan Lelescu
-
Patent number: 10755426Abstract: An electronic device comprises circuitry implementing a depth map enhancer. The depth map enhancer obtains an initial depth map corresponding to a scene and an image of the scene. The depth map enhancer generates a refined depth map corresponding to the scene using an optimizer, the initial depth map and the image. The refined depth map includes estimated depth indicators corresponding to at least a first depth-information region, identified based at least in part on a first criterion, of the initial depth map. Input based on the refined depth map is provided to an image processing application.Type: GrantFiled: May 23, 2018Date of Patent: August 25, 2020Assignee: Apple Inc.Inventors: Mark Norman Lester Jouppi, Michael Wish Tao, Eric Bujold, Stephane Simon Rene Ben Soussan, Volker Roelke, Geoffrey T. Anneheim, Julio Cesar Hernandez Zaragoza, Florian Ciurea
-
Patent number: 10674138Abstract: Systems with an array camera augmented with a conventional camera in accordance with embodiments of the invention are disclosed. In some embodiments, the array camera is used to capture a first set of image data of a scene and a conventional camera is used to capture a second set of image data for the scene. An object of interest is identified in the first set of image data. A first depth measurement for the object of interest is determined and compared to a predetermined threshold. If the first depth measurement is above the threshold, a second set of image data captured using the conventional camera is obtained. The object of interest is identified in the second set of image data and a second depth measurement for the object of interest is determined using at least a portion of the first set of image data and at least a portion of the second set of image data.Type: GrantFiled: November 2, 2018Date of Patent: June 2, 2020Assignee: FotoNation LimitedInventors: Kartik Venkataraman, Paul Gallagher, Ankit K. Jain, Semyon Nisenzon, Dan Lelescu, Florian Ciurea, Gabriel Molina
-
Publication number: 20190362515Abstract: Systems in accordance with embodiments of the invention can perform parallax detection and correction in images captured using array cameras. Due to the different viewpoints of the cameras, parallax results in variations in the position of objects within the captured images of the scene. Methods in accordance with embodiments of the invention provide an accurate account of the pixel disparity due to parallax between the different cameras in the array, so that appropriate scene-dependent geometric shifts can be applied to the pixels of the captured images when performing super-resolution processing. In a number of embodiments, generating depth estimates considers the similarity of pixels in multiple spectral channels. In certain embodiments, generating depth estimates involves generating a confidence map indicating the reliability of depth estimates.Type: ApplicationFiled: August 9, 2019Publication date: November 28, 2019Applicant: FotoNation LimitedInventors: Florian Ciurea, Kartik Venkataraman, Gabriel Molina, Dan Lelescu
-
Publication number: 20190362511Abstract: An electronic device comprises circuitry implementing a depth map enhancer. The depth map enhancer obtains an initial depth map corresponding to a scene and an image of the scene. The depth map enhancer generates a refined depth map corresponding to the scene using an optimizer, the initial depth map and the image. The refined depth map includes estimated depth indicators corresponding to at least a first depth-information region, identified based at least in part on a first criterion, of the initial depth map. Input based on the refined depth map is provided to an image processing application.Type: ApplicationFiled: May 23, 2018Publication date: November 28, 2019Applicant: Apple Inc.Inventors: Mark Norman Lester Jouppi, Michael Wish Tao, Eric Bujold, Stephane Simon Rene Ben Soussan, Volker Roelke, Geoffrey T. Anneheim, Julio Cesar Hernandez Zaragoza, Florian Ciurea
-
Patent number: 10412314Abstract: Systems and methods for performing photometric normalization in an array camera in accordance with embodiments of this invention are disclosed. The image data of scene from a reference imaging component and alternate imaging components is received. The image data from each of the alternate imaging components is then translated to so that pixel information in the image data of each alternate imaging component corresponds to pixel information in the image data of the reference component. The shifted image data of each alternate imaging component is compared to the image data of the reference imaging component to determine gain and offset parameters for each alternate imaging component. The gain and offset parameters of each alternate imaging component is then applied to the image data of the associate imaging to generate corrected image data for each of the alternate imaging components.Type: GrantFiled: October 9, 2017Date of Patent: September 10, 2019Assignee: FotoNation LimitedInventors: Andrew Kenneth John McMahon, Dan Lelescu, Florian Ciurea
-
Patent number: 10380752Abstract: Systems in accordance with embodiments of the invention can perform parallax detection and correction in images captured using array cameras. Due to the different viewpoints of the cameras, parallax results in variations in the position of objects within the captured images of the scene. Methods in accordance with embodiments of the invention provide an accurate account of the pixel disparity due to parallax between the different cameras in the array, so that appropriate scene-dependent geometric shifts can be applied to the pixels of the captured images when performing super-resolution processing. In a number of embodiments, generating depth estimates considers the similarity of pixels in multiple spectral channels. In certain embodiments, generating depth estimates involves generating a confidence map indicating the reliability of depth estimates.Type: GrantFiled: December 29, 2017Date of Patent: August 13, 2019Assignee: FotoNation LimitedInventors: Florian Ciurea, Kartik Venkataraman, Gabriel Molina, Dan Lelescu
-
Publication number: 20190230348Abstract: Systems and methods for dynamically calibrating an array camera to accommodate variations in geometry that can occur throughout its operational life are disclosed. The dynamic calibration processes can include acquiring a set of images of a scene and identifying corresponding features within the images. Geometric calibration data can be used to rectify the images and determine residual vectors for the geometric calibration data at locations where corresponding features are observed. The residual vectors can then be used to determine updated geometric calibration data for the camera array. In several embodiments, the residual vectors are used to generate a residual vector calibration data field that updates the geometric calibration data. In many embodiments, the residual vectors are used to select a set of geometric calibration from amongst a number of different sets of geometric calibration data that is the best fit for the current geometry of the camera array.Type: ApplicationFiled: April 1, 2019Publication date: July 25, 2019Applicant: FotoNation LimitedInventors: Florian Ciurea, Dan Lelescu, Priyam Chatterjee
-
Patent number: 10250871Abstract: Systems and methods for dynamically calibrating an array camera to accommodate variations in geometry that can occur throughout its operational life are disclosed. The dynamic calibration processes can include acquiring a set of images of a scene and identifying corresponding features within the images. Geometric calibration data can be used to rectify the images and determine residual vectors for the geometric calibration data at locations where corresponding features are observed. The residual vectors can then be used to determine updated geometric calibration data for the camera array. In several embodiments, the residual vectors are used to generate a residual vector calibration data field that updates the geometric calibration data. In many embodiments, the residual vectors are used to select a set of geometric calibration from amongst a number of different sets of geometric calibration data that is the best fit for the current geometry of the camera array.Type: GrantFiled: September 29, 2015Date of Patent: April 2, 2019Assignee: FotoNation LimitedInventors: Florian Ciurea, Dan Lelescu, Priyam Chatterjee
-
Publication number: 20190089947Abstract: Systems with an array camera augmented with a conventional camera in accordance with embodiments of the invention are disclosed. In some embodiments, the array camera is used to capture a first set of image data of a scene and a conventional camera is used to capture a second set of image data for the scene. An object of interest is identified in the first set of image data. A first depth measurement for the object of interest is determined and compared to a predetermined threshold. If the first depth measurement is above the threshold, a second set of image data captured using the conventional camera is obtained. The object of interest is identified in the second set of image data and a second depth measurement for the object of interest is determined using at least a portion of the first set of image data and at least a portion of the second set of image data.Type: ApplicationFiled: November 2, 2018Publication date: March 21, 2019Applicant: FotoNation LimitedInventors: Kartik Venkataraman, Paul Gallagher, Ankit K. Jain, Semyon Nisenzon, Dan Lelescu, Florian Ciurea, Gabriel Molina