Patents by Inventor Thomas Nicolas Emmanuel Veit

Thomas Nicolas Emmanuel Veit has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240137658
    Abstract: A non-transitory computer-readable storage medium stores executable instructions that, when executed by a processor, cause performance of operations comprising operations to access an image captured by an image sensor, obtain a transfer function for mapping pixel values, determine a faces indication that reflects a proportion of a scene depicted in the image that includes one or more human faces, and modify the transfer function based on the faces indication. Modifying the transfer function based on the faces indication comprises adjusting a gain of the transfer function to move the gain closer to unity. The operations include to apply the transfer function to pixel values of the image to produce a tone mapped image and output the tone mapped image.
    Type: Application
    Filed: December 14, 2023
    Publication date: April 25, 2024
    Inventors: Bruno César Douady, Michael Serge Andre Kraak, Thomas Nicolas Emmanuel Veit, Guillaume Matthieu Guérin
  • Publication number: 20240048854
    Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving an image from an image sensor; applying a filter to the image to obtain a low-frequency component image and a high-frequency component image; determining a first enhanced image based on a weighted sum of the low-frequency component image and the high-frequency component image, where the high-frequency component image is weighted more than the low-frequency component image; determining a second enhanced image based on the first enhanced image and a tone mapping; and storing, displaying, or transmitting an output image based on the second enhanced image.
    Type: Application
    Filed: October 18, 2023
    Publication date: February 8, 2024
    Inventors: Guillaume Matthieu Guerin, Antoine Regimbeau, Thomas Nicolas Emmanuel Veit, Bruno Cesar Douady-Pleven, Violaine Marie Mong-lan Sudret
  • Publication number: 20240015397
    Abstract: A camera mode to use for capturing an image or video is selected by estimating high dynamic range (HDR), motion, and light intensity with respect to a scene of the image or video to capture. An image capture device includes a HDR estimation unit to detect whether HDR is present in a scene of an image to capture, a motion estimation unit to determine whether motion is detected within the scene, and a light intensity estimation unit to determine whether a scene luminance for the scene meets a threshold. A mode selection unit selects a camera mode to use for capturing the image based on output of the HDR estimation unit, the motion estimation unit, and the light intensity estimation unit. An image sensor captures the image according to the selected camera mode.
    Type: Application
    Filed: September 19, 2023
    Publication date: January 11, 2024
    Inventors: Thomas Nicolas Emmanuel Veit, Sylvain Leroy, Heng Zhang, Ingrid Cotoros
  • Patent number: 11849224
    Abstract: A system accesses an image with each pixel of the image having luminance values each representative of a color component of the pixel. The system generates a first histogram for aggregate luminance values of the image, and accesses a target histogram for the image representative of a desired global image contrast. The system computes a transfer function based on the first histogram and the target histogram such that when the transfer function is applied, a histogram of the modified aggregate luminance values is within a threshold similarity of the target histogram. The system modifies the image by applying the transfer function to the luminance values of the image to produce a tone mapped image, and outputs the modified image.
    Type: Grant
    Filed: January 3, 2022
    Date of Patent: December 19, 2023
    Assignee: GoPro, Inc.
    Inventors: Bruno César Douady, Michael Serge Andre Kraak, Thomas Nicolas Emmanuel Veit, Guillaume Matthieu Guérin
  • Patent number: 11810269
    Abstract: Systems and methods are disclosed for denoising chrominance channels of images. For example, methods may include receiving an image from one or more image sensors; determining a set of weights for the image based on a luminance channel of the image, wherein a weight in the set of weights corresponds to a subject pixel and a candidate pixel and is determined based on luminance values of one or more pixels of the image centered at the subject pixel and one or more pixels of the image centered at the candidate pixel; applying the set of weights to chrominance channels of the image to obtain a denoised image, wherein the subject pixel of the denoised image is determined based on the weight multiplied by the candidate pixel of the image; and storing, displaying, or transmitting an output image based on the denoised image.
    Type: Grant
    Filed: January 3, 2022
    Date of Patent: November 7, 2023
    Assignee: GoPro, Inc.
    Inventors: Thomas Nicolas Emmanuel Veit, Marc Lebrun
  • Patent number: 11800238
    Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving an image from an image sensor; applying a filter to the image to obtain a low-frequency component image and a high-frequency component image; determining a first enhanced image based on a weighted sum of the low-frequency component image and the high-frequency component image, where the high-frequency component image is weighted more than the low-frequency component image; determining a second enhanced image based on the first enhanced image and a tone mapping; and storing, displaying, or transmitting an output image based on the second enhanced image.
    Type: Grant
    Filed: November 15, 2021
    Date of Patent: October 24, 2023
    Assignee: GoPro, Inc.
    Inventors: Guillaume Matthieu Guerin, Antoine Regimbeau, Thomas Nicolas Emmanuel Veit, Bruno Cesar Douady-Pleven, Violaine Marie Mong-Ian Sudret
  • Patent number: 11785339
    Abstract: A camera mode to use for capturing an image or video is selected by estimating high dynamic range (HDR), motion, and light intensity with respect to a scene of the image or video to capture. An image capture device includes a HDR estimation unit to detect whether HDR is present in a scene of an image to capture, a motion estimation unit to determine whether motion is detected within the scene, and a light intensity estimation unit to determine whether a scene luminance for the scene meets a threshold. A mode selection unit selects a camera mode to use for capturing the image based on output of the HDR estimation unit, the motion estimation unit, and the light intensity estimation unit. An image sensor captures the image according to the selected camera mode.
    Type: Grant
    Filed: July 25, 2022
    Date of Patent: October 10, 2023
    Assignee: GoPro, Inc.
    Inventors: Thomas Nicolas Emmanuel Veit, Sylvain Leroy, Heng Zhang, Ingrid Cotoros
  • Publication number: 20230247281
    Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving a current image of a sequence of images from an image sensor; combining the current image with a recirculated image to obtain a noise reduced image, where the recirculated image is based on one or more previous images of the sequence of images from the image sensor; determining a noise map for the noise reduced image, where the noise map is determined based on estimates of noise levels for pixels in the current image, a noise map for the recirculated image, and a set of mixing weights; recirculating the noise map with the noise reduced image to combine the noise reduced image with a next image of the sequence of images from the image sensor; and storing, displaying, or transmitting an output image that is based on the noise reduced image.
    Type: Application
    Filed: April 13, 2023
    Publication date: August 3, 2023
    Inventors: Bruno César Douady, Michael Serge Andre Kraak, Guillaume Matthieu Guérin, Thomas Nicolas Emmanuel Veit
  • Patent number: 11669939
    Abstract: A method for deblurring a target image includes receiving a burst of images that includes the target image; partitioning respective images of the burst of images into respective patches; converting, to a frequency domain, the respective patches into respective transform patches; selecting a first set of corresponding transform patches from the respective transform patches, where the first set of the corresponding transform patches includes a respective transform patch for a respective image of the burst of images; obtaining, using a neural network, respective weight maps for the corresponding transform patches; obtaining a deblurred transform patch by combining the first set of corresponding transform patches using the respective weight maps; obtaining a first deblurred patch by converting the deblurred transform patch to a pixel domain; and obtaining a deblurred image of the target image using the first deblurred patch.
    Type: Grant
    Filed: August 24, 2020
    Date of Patent: June 6, 2023
    Assignee: GoPro, Inc.
    Inventors: Matias Tassano Ferrés, Thomas Nicolas Emmanuel Veit, Julie Delon, Pablo Muse Freire
  • Patent number: 11653088
    Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving a current image of a sequence of images from an image sensor; combining the current image with a recirculated image to obtain a noise reduced image, where the recirculated image is based on one or more previous images of the sequence of images from the image sensor; determining a noise map for the noise reduced image, where the noise map is determined based on estimates of noise levels for pixels in the current image, a noise map for the recirculated image, and a set of mixing weights; recirculating the noise map with the noise reduced image to combine the noise reduced image with a next image of the sequence of images from the image sensor; and storing, displaying, or transmitting an output image that is based on the noise reduced image.
    Type: Grant
    Filed: December 6, 2021
    Date of Patent: May 16, 2023
    Assignee: GoPro, Inc.
    Inventors: Bruno César Douady, Michael Serge Andre Kraak, Guillaume Matthieu Guérin, Thomas Nicolas Emmanuel Veit
  • Publication number: 20220377224
    Abstract: An image capture apparatus may include an image sensor, a motion sensor, and an auto-exposure unit. The auto-exposure unit may obtain an input image captured during an exposure interval and corresponding motion data indicating motion of the image capture apparatus during the exposure interval. The auto-exposure unit may obtain image information-amount data for the input image. The auto-exposure unit may obtain derivative information-amount data based on the information-amount data and a candidate exposure adjustment. The auto-exposure unit may obtain an information-amount maximizing exposure interval based on the information-amount data and the derivative information-amount data. The image capture apparats may control the image sensor to obtain a subsequent input image signal representing a subsequent input image captured during the information-amount maximizing exposure interval, and output or store information representing the subsequent input image.
    Type: Application
    Filed: August 4, 2022
    Publication date: November 24, 2022
    Inventors: Bruno César Douady-Pleven, Thomas Nicolas Emmanuel Veit, Guillaume Matthieu Guérin
  • Patent number: 11508046
    Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include accessing an image from an image sensor; detecting an object area on the image; classifying the object area on the image; applying a filter to an object area of the image to obtain a low-frequency component image and a high-frequency component image; determining a first enhanced image based on a weighted sum of the low-frequency component image and the high-frequency component image, where the high-frequency component image is weighted more than the low-frequency component image; determining a second enhanced image based on the first enhanced image and a tone mapping; and storing, displaying, or transmitting an output image based on the second enhanced image.
    Type: Grant
    Filed: December 23, 2020
    Date of Patent: November 22, 2022
    Assignee: GoPro, Inc.
    Inventors: Heng Zhang, Thomas Nicolas Emmanuel Veit, Guillaume Matthieu Guérin
  • Publication number: 20220360711
    Abstract: A camera mode to use for capturing an image or video is selected by estimating high dynamic range (HDR), motion, and light intensity with respect to a scene of the image or video to capture. An image capture device includes a HDR estimation unit to detect whether HDR is present in a scene of an image to capture, a motion estimation unit to determine whether motion is detected within the scene, and a light intensity estimation unit to determine whether a scene luminance for the scene meets a threshold. A mode selection unit selects a camera mode to use for capturing the image based on output of the HDR estimation unit, the motion estimation unit, and the light intensity estimation unit. An image sensor captures the image according to the selected camera mode.
    Type: Application
    Filed: July 25, 2022
    Publication date: November 10, 2022
    Inventors: Thomas Nicolas Emmanuel Veit, Sylvain Leroy, Heng Zhang, Ingrid Cotoros
  • Publication number: 20220256076
    Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving a current image of a sequence of images from an image sensor; combining the current image with a recirculated image to obtain a noise reduced image, where the recirculated image is based on one or more previous images of the sequence of images from the image sensor; determining a noise map for the noise reduced image, where the noise map is determined based on estimates of noise levels for pixels in the current image, a noise map for the recirculated image, and a set of mixing weights; recirculating the noise map with the noise reduced image to combine the noise reduced image with a next image of the sequence of images from the image sensor; and storing, displaying, or transmitting an output image that is based on the noise reduced image.
    Type: Application
    Filed: December 6, 2021
    Publication date: August 11, 2022
    Inventors: Bruno César Douady, Michael Serge Andre Kraak, Guillaume Matthieu Guérin, Thomas Nicolas Emmanuel Veit
  • Patent number: 11412150
    Abstract: An image capture apparatus may include an image sensor, a motion sensor, and an auto-exposure unit. The auto-exposure unit may obtain an input image captured during an exposure interval and corresponding motion data indicating motion of the image capture apparatus during the exposure interval. The auto-exposure unit may obtain image information-amount data for the input image. The auto-exposure unit may obtain derivative information-amount data based on the information-amount data and a candidate exposure adjustment. The auto-exposure unit may obtain an information-amount maximizing exposure interval based on the information-amount data and the derivative information-amount data. The image capture apparats may control the image sensor to obtain a subsequent input image signal representing a subsequent input image captured during the information-amount maximizing exposure interval, and output or store information representing the subsequent input image.
    Type: Grant
    Filed: December 23, 2020
    Date of Patent: August 9, 2022
    Assignee: GoPro, Inc.
    Inventors: Bruno César Douady-Pleven, Thomas Nicolas Emmanuel Veit, Guillaume Matthieu Guérin
  • Patent number: 11399136
    Abstract: A camera mode to use for capturing an image or video is selected by estimating high dynamic range (HDR), motion, and light intensity with respect to a scene of the image or video to capture. An image capture device includes a HDR estimation unit to detect whether HDR is present in a scene of an image to capture, a motion estimation unit to determine whether motion is detected within the scene, and a light intensity estimation unit to determine whether a scene luminance for the scene meets a threshold. A mode selection unit selects a camera mode to use for capturing the image based on output of the HDR estimation unit, the motion estimation unit, and the light intensity estimation unit. An image sensor captures the image according to the selected camera mode.
    Type: Grant
    Filed: June 6, 2019
    Date of Patent: July 26, 2022
    Assignee: GoPro, Inc.
    Inventors: Thomas Nicolas Emmanuel Veit, Sylvain Leroy, Heng Zhang, Ingrid Cotoros
  • Publication number: 20220217271
    Abstract: A system accesses an image with each pixel of the image having luminance values each representative of a color component of the pixel. The system generates a first histogram for aggregate luminance values of the image, and accesses a target histogram for the image representative of a desired global image contrast. The system computes a transfer function based on the first histogram and the target histogram such that when the transfer function is applied, a histogram of the modified aggregate luminance values is within a threshold similarity of the target histogram. The system modifies the image by applying the transfer function to the luminance values of the image to produce a tone mapped image, and outputs the modified image.
    Type: Application
    Filed: January 3, 2022
    Publication date: July 7, 2022
    Inventors: Bruno César Douady, Michael Serge Andre Kraak, Thomas Nicolas Emmanuel Veit, Guillaume Matthieu Guérin
  • Patent number: 11330208
    Abstract: Flare compensation includes obtaining a first input frame, which includes lens flare, and a second input frame; obtaining a stitch line between the first input frame and the second input frame; obtaining, for the first input frame, a first intensity profile; obtaining, for the second input frame, a second intensity profile; obtaining an intensity differences profile; obtaining a first dark corner profile based on a first illumination of a first area outside a first image circle of the first input frame; obtaining a second dark corner profile based on a second illumination of a second area outside a second image circle of the second input frame; obtaining a dark corner difference profile; calculating a flare model; obtaining a flare mask; and correcting the first input frame by subtracting the flare mask from the first input frame.
    Type: Grant
    Filed: April 15, 2020
    Date of Patent: May 10, 2022
    Assignee: GoPro, Inc.
    Inventors: Bruno César Douady-Pleven, Nicolas Boehrer, Thomas Nicolas Emmanuel Veit
  • Publication number: 20220122228
    Abstract: Systems and methods are disclosed for denoising chrominance channels of images. For example, methods may include receiving an image from one or more image sensors; determining a set of weights for the image based on a luminance channel of the image, wherein a weight in the set of weights corresponds to a subject pixel and a candidate pixel and is determined based on luminance values of one or more pixels of the image centered at the subject pixel and one or more pixels of the image centered at the candidate pixel; applying the set of weights to chrominance channels of the image to obtain a denoised image, wherein the subject pixel of the denoised image is determined based on the weight multiplied by the candidate pixel of the image; and storing, displaying, or transmitting an output image based on the denoised image.
    Type: Application
    Filed: January 3, 2022
    Publication date: April 21, 2022
    Inventors: Thomas Nicolas Emmanuel Veit, Marc Lebrun
  • Patent number: 11276149
    Abstract: Systems and methods are disclosed for non-local means denoising of images. For example, methods may include receiving an image from an image sensor; determining a set of non-local means weights for the image; applying the set of non-local means weights to the image to obtain a first denoised image; applying the set of non-local means weights to the first denoised image to obtain a second denoised image; and storing, displaying, or transmitting an output image based on the second denoised image.
    Type: Grant
    Filed: April 27, 2020
    Date of Patent: March 15, 2022
    Assignee: GoPro, Inc.
    Inventors: Bruno César Douady-Pleven, Thomas Nicolas Emmanuel Veit, Marc Lebrun