Patents by Inventor Bruno César Douady

Bruno César Douady has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11178341
    Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving an image from an image sensor; applying a filter to the image to obtain a low-frequency component image and a high-frequency component image; determining a first enhanced image based on a weighted sum of the low-frequency component image and the high-frequency component image, where the high-frequency component image is weighted more than the low-frequency component image; determining a second enhanced image based on the first enhanced image and a tone mapping; and storing, displaying, or transmitting an output image based on the second enhanced image.
    Type: Grant
    Filed: February 3, 2020
    Date of Patent: November 16, 2021
    Assignee: GoPro, Inc.
    Inventors: Guillaume Matthieu Guerin, Antoine Regimbeau, Thomas Nicolas Emmanuel Veit, Bruno Cesar Douady-Pleven, Violaine Marie Mong-lan Sudret
  • Publication number: 20210342987
    Abstract: An image is processed using a combination of techniques, particularly, in which low frequency information is processed using multiple tone control and high frequency information is processed using local tone mapping. An image is divided into a plurality of blocks including a given block. Low frequency information and high frequency information of the given block are separated. The low frequency information is processed using multiple tone control. The low high frequency information is processed using local tone mapping. A processed image is then produced based on the processed low frequency information and based on the processed high frequency information, the processed image corresponding to the image captured using the image sensor. The processed image is then output for storage or display. Processing the low frequency information can include using a gain curve and bilinear interpolation. Processing the high frequency information can include using an edge preservation filter.
    Type: Application
    Filed: June 13, 2019
    Publication date: November 4, 2021
    Inventors: Guillaume Matthieu Guérin, Bruno César Douady
  • Patent number: 11132773
    Abstract: Systems and methods are disclosed for image capture. For example, methods may include accessing a sequence of images from an image sensor; determining a sequence of parameters for respective images in the sequence of images based on the respective images; storing the sequence of images in a buffer; determining a temporally smoothed parameter for a current image in the sequence of images based on the sequence of parameters, wherein the sequence of parameters includes parameters for images in the sequence of images that were captured after the current image; applying image processing to the current image based on the temporally smoothed parameter to obtain a processed image; and storing, displaying, or transmitting an output image based on the processed image.
    Type: Grant
    Filed: May 18, 2020
    Date of Patent: September 28, 2021
    Assignee: GoPro, Inc.
    Inventors: Bruno César Douady-Pleven, Vincent Vacquerie
  • Publication number: 20210281710
    Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving a first image from a first image sensor; receiving a second image from a second image sensor; determining an electronic rolling shutter correction mapping for the first image and the second image; determining a parallax correction mapping based on the first image and the second image for stitching the first image and the second image; determining a warp mapping based on the parallax correction mapping and the electronic rolling shutter correction mapping, wherein the warp mapping applies the electronic rolling shutter correction mapping after the parallax correction mapping; applying the warp mapping to image data based on the first image and the second image to obtain a composite image; and storing, displaying, or transmitting an output image that is based on the composite image.
    Type: Application
    Filed: February 19, 2021
    Publication date: September 9, 2021
    Inventors: Bruno César Douady-Pleven, Antoine Meler, Christophe Clienti
  • Patent number: 11064110
    Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving, by an image signal processor, one or more input image signals from one or more image sensors; determining a mapping based on the input image signal(s), wherein the mapping includes records that associate image portions of an output image with corresponding image portions of the input image signal(s); sorting the records of the mapping according to an order of the corresponding image portions of the input image signal(s); applying, by the image signal processor, image processing to image portions of the input image signal(s) to determine image portions of one or more processed images in the order; and determining, by the image signal processor, the image portions of the output image based at least in part on the mapping and the corresponding image portions of the processed image(s) in the order.
    Type: Grant
    Filed: August 30, 2019
    Date of Patent: July 13, 2021
    Assignee: GoPro, Inc.
    Inventors: Bruno Cesar Douady-Pleven, Sandeep Doshi, Sophana Kok
  • Patent number: 11050946
    Abstract: Systems and methods are disclosed for high dynamic rate processing based on angular rate measurements. For example, methods may include receiving a short exposure image that was captured using an image sensor; receiving a long exposure image that was captured using the image sensor; receiving an angular rate measurement captured using an angular rate sensor attached to the image sensor during exposure of the long exposure image; determining, based on the angular rate measurement, whether to apply high dynamic range processing to an image portion of the short exposure image and the long exposure image; and responsive to a determination not to apply high dynamic range processing to the image portion, selecting the image portion of the short exposure image for use as the image portion of an output image and discard the image portion of the long exposure image.
    Type: Grant
    Filed: March 9, 2020
    Date of Patent: June 29, 2021
    Assignee: GoPro, Inc.
    Inventors: Bruno César Douady, Hervé Hornung
  • Publication number: 20210176388
    Abstract: An image capture apparatus may include an image sensor, a motion sensor, and an auto-exposure unit. The auto-exposure unit may obtain an input image captured during an exposure interval and corresponding motion data indicating motion of the image capture apparatus during the exposure interval. The auto-exposure unit may obtain image information-amount data for the input image. The auto-exposure unit may obtain derivative information-amount data based on the information-amount data and a candidate exposure adjustment. The auto-exposure unit may obtain an information-amount maximizing exposure interval based on the information-amount data and the derivative information-amount data. The image capture apparats may control the image sensor to obtain a subsequent input image signal representing a subsequent input image captured during the information-amount maximizing exposure interval, and output or store information representing the subsequent input image.
    Type: Application
    Filed: December 23, 2020
    Publication date: June 10, 2021
    Inventors: Bruno César Douady-Pleven, Thomas Nicolas Emmanuel Veit, Guillaume Matthieu Guérin
  • Publication number: 20210125319
    Abstract: Multiple lookup tables (LUTs) storing different numbers of control point values are used to process pixels within different blocks of an image, such as after image processing using tone mapping and/or tone control, and/or to collect histogram information or implement 3D LUTs. First control point values stored within a first LUT are applied against pixels of a given block of an image to produce a distorted image block. Second control point values stored within a second lookup table are applied against a pixel of the distorted image block to produce a processed pixel. The second LUT is one of a plurality of second LUTs and stores fewer values than the first LUT. A processed image is produced using the processed pixel. The processed image is then output for further processing or display.
    Type: Application
    Filed: January 4, 2021
    Publication date: April 29, 2021
    Inventors: Bruno César Douady, Guillaume Matthieu Guérin
  • Publication number: 20210084200
    Abstract: An image capture device may include an image sensor, a processor, and a memory. The image sensor may be configured to obtain an image. The processor may be configured to generate a grid on the image. The grid may include one or more vertices. The one or more vertices may be used to form tiles. The processor may be configured to determine a flare level of each vertex. The processor may be configured to assign a maximum flare level for each tile of the image. The processor may be configured to sort the tiles. The tiles may be sorted based on the maximum flare level of each tile. The processor may be configured to apply a flare compensation to a subset of the tiles to obtain a processed image. The processed image may have reduced flare artifacts or no flare artifacts. The processed image may be stored in the memory.
    Type: Application
    Filed: August 24, 2020
    Publication date: March 18, 2021
    Applicant: GoPro, Inc.
    Inventors: Bruno César Douady, Guillaume Matthieu Guérin, Eric Chasseur
  • Publication number: 20210084281
    Abstract: Systems and methods are disclosed for circular stitching of images. For example, methods may include accessing a first image captured using a first image sensor; accessing a second image captured using a second image sensor; determining a cost table for a circular stitching boundary that includes overlapping regions of the first image and the second image; determining an extended disparity profile based on a periodic extension of the cost table and a smoothness criterion, wherein the extended disparity profile has a length greater than the width of the cost table; determining a binocular disparity profile of a length equal to the width of the cost table based on a contiguous subsequence of the extended disparity profile; and stitching the first image and the second image using the binocular disparity profile to obtain a combined image.
    Type: Application
    Filed: September 11, 2020
    Publication date: March 18, 2021
    Inventors: Bruno César Douady, Alexis Lefebvre
  • Publication number: 20210073956
    Abstract: Image analysis and processing may include a first sensor readout unit configured to receive first Bayer format image data, a second sensor readout unit configured to receive second Bayer format image data, a first Bayer-to-RGB unit configured to obtain first RGB format image data based on the first Bayer format image data, a second Bayer-to-RGB unit configured to obtain second RGB format image data based on the second Bayer format image data, a high dynamic range unit configured to obtain high dynamic range image data based on a combination of the first RGB format image data and the second RGB format image data, an RGB-to-YUV unit configured to obtain YUV format image data based on the high dynamic range image data, and a three-dimensional noise reduction unit configured to obtain noise reduced image data based on the YUV format image data.
    Type: Application
    Filed: February 11, 2019
    Publication date: March 11, 2021
    Inventors: Guillaume Matthieu Guerin, Bruno Faure, Vincent Vacquerie, Bruno César Douady
  • Patent number: 10931851
    Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving a first image from a first image sensor; receiving a second image from a second image sensor; determining an electronic rolling shutter correction mapping for the first image and the second image; determining a parallax correction mapping based on the first image and the second image for stitching the first image and the second image; determining a warp mapping based on the parallax correction mapping and the electronic rolling shutter correction mapping, wherein the warp mapping applies the electronic rolling shutter correction mapping after the parallax correction mapping; applying the warp mapping to image data based on the first image and the second image to obtain a composite image; and storing, displaying, or transmitting an output image that is based on the composite image.
    Type: Grant
    Filed: November 12, 2019
    Date of Patent: February 23, 2021
    Assignee: GoPro, Inc.
    Inventors: Bruno César Douady-Pleven, Antoine Meler, Christophe Clienti
  • Patent number: 10885615
    Abstract: Multiple lookup tables (LUTs) storing different numbers of control point values are used to process pixels within different blocks of an image, such as after image processing using tone mapping and/or tone control, and/or to collect histogram information or implement 3D LUTs. First control point values stored within a first LUT are applied against pixels of a given block of an image to produce a distorted image block. Second control point values stored within a second lookup table are applied against a pixel of the distorted image block to produce a processed pixel. The second LUT is one of a plurality of second LUTs and stores fewer values than the first LUT. A processed image is produced using the processed pixel. The processed image is then output for further processing or display.
    Type: Grant
    Filed: May 15, 2019
    Date of Patent: January 5, 2021
    Assignee: GoPro, Inc.
    Inventors: Bruno César Douady, Guillaume Matthieu Guérin
  • Publication number: 20200388009
    Abstract: Systems and methods are disclosed for image capture. For example, methods may include accessing a sequence of images from an image sensor; determining a sequence of parameters for respective images in the sequence of images based on the respective images; storing the sequence of images in a buffer; determining a temporally smoothed parameter for a current image in the sequence of images based on the sequence of parameters, wherein the sequence of parameters includes parameters for images in the sequence of images that were captured after the current image; applying image processing to the current image based on the temporally smoothed parameter to obtain a processed image; and storing, displaying, or transmitting an output image based on the processed image.
    Type: Application
    Filed: May 18, 2020
    Publication date: December 10, 2020
    Inventors: Bruno César Douady-Pleven, Vincent Vacquerie
  • Publication number: 20200358944
    Abstract: Image signal processing includes obtaining two or more image signals from a first hyper-hemispherical image sensor, where each of the two or more image signals has a different exposure and obtaining two or more image signals from a second hyper-hemispherical image sensor, where each of the two or more image signals has a different exposure. Image signal processing includes generating an exposure compensated image based on a gain value applied to an exposure level of a first image and a gain value applied to an exposure level of a second image. Image signal processing further includes performing high dynamic range (HDR) processing on the exposure compensated image. The HDR processing may be performed on a high a frequency portion of the exposure compensated image.
    Type: Application
    Filed: June 12, 2020
    Publication date: November 12, 2020
    Inventors: Bruno César Douady, Guillaume Matthieu Guérin
  • Patent number: 10757384
    Abstract: Image signal processing may include desaturation control, which may include adaptive desaturation control. Image signal processing with desaturation control may include obtaining, by an image signal processor, from an image sensor, an input image signal representing an input image, obtaining, by the image signal processor, color correction information for the input image, obtaining a color corrected image based on the input image using color correction with desaturation control such that inaccurate colorization of the color corrected image is minimized, and outputting the color corrected image.
    Type: Grant
    Filed: July 24, 2018
    Date of Patent: August 25, 2020
    Assignee: GoPro, Inc.
    Inventors: Bruno César Douady-Pleven, Thomas Nicolas Emmanuel Veit, Marc Lebrun
  • Publication number: 20200267339
    Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving a current image of a sequence of images from an image sensor; combining the current image with a recirculated image to obtain a noise reduced image, where the recirculated image is based on one or more previous images of the sequence of images from the image sensor; determining a noise map for the noise reduced image, where the noise map is determined based on estimates of noise levels for pixels in the current image, a noise map for the recirculated image, and a set of mixing weights; recirculating the noise map with the noise reduced image to combine the noise reduced image with a next image of the sequence of images from the image sensor; and storing, displaying, or transmitting an output image that is based on the noise reduced image.
    Type: Application
    Filed: May 24, 2017
    Publication date: August 20, 2020
    Applicants: GoPro, Inc., GoPro, Inc.
    Inventors: Bruno César Douady-Pleven, Michael Serge Andre Kraak, Guillaume Matthieu Guérin, Thomas Nicolas Emmanuel Veit
  • Publication number: 20200258200
    Abstract: Systems and methods are disclosed for non-local means denoising of images. For example, methods may include receiving an image from an image sensor; determining a set of non-local means weights for the image; applying the set of non-local means weights to the image to obtain a first denoised image; applying the set of non-local means weights to the first denoised image to obtain a second denoised image; and storing, displaying, or transmitting an output image based on the second denoised image.
    Type: Application
    Filed: April 27, 2020
    Publication date: August 13, 2020
    Inventors: Bruno César Douady-Pleven, Thomas Nicolas Emmanuel Veit, Marc Lebrun
  • Publication number: 20200260001
    Abstract: A system accesses an image with each pixel of the image having luminance values each representative of a color component of the pixel. The system generates a first histogram for aggregate luminance values of the image, and accesses a target histogram for the image representative of a desired global image contrast. The system computes a transfer function based on the first histogram and the target histogram such that when the transfer function is applied, a histogram of the modified aggregate luminance values is within a threshold similarity of the target histogram. The system modifies the image by applying the transfer function to the luminance values of the image to produce a tone mapped image, and outputs the modified image.
    Type: Application
    Filed: January 6, 2020
    Publication date: August 13, 2020
    Inventors: Bruno César Douady-Pleven, Michael Serge Andre Kraak, Guillaume Matthieu Guérin, Thomas Nicolas Emmanuel Veit
  • Patent number: 10743002
    Abstract: Image signal processing may include obtaining a first portion of a first input image, the first portion having a defined width, a defined height, and a defined portion size, which is a product of multiplying the defined width by the defined height, the first portion of the first input image including a first set of image elements in raster order and having a cardinality of the defined portion size. Image signal processing may include sequential in-place blocking transposition of the first input image, which may include using a buffer, omit using another buffer, and has linear complexity, and may include buffering the first set of image elements using the buffer, the buffer having a defined buffer size within twice the defined portion size, and outputting the first set of image elements from the buffer in block order.
    Type: Grant
    Filed: August 28, 2017
    Date of Patent: August 11, 2020
    Assignee: GoPro, Inc.
    Inventors: Bruno César Douady-Pleven, Vincent Vacquerie