Patents by Inventor Cesar Douady
Cesar Douady has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11983839Abstract: Apparatus and methods for the stitch zone calculation of a generated projection of a spherical image. In one embodiment, a non-transitory computer-readable apparatus comprising a storage apparatus, the storage apparatus comprising instructions configured to, when executed by a processor apparatus, cause a computerized apparatus to identify a stitch line associated with an equatorial area of a plurality of spherical images; re-orient the plurality of spherical images in accordance with the stitch line; and project the re-oriented plurality of spherical images to a selected image projection type.Type: GrantFiled: July 25, 2023Date of Patent: May 14, 2024Assignee: GoPro, Inc.Inventors: Adeel Abbas, Timothy Macmillan, Cesar Douady-Pleven
-
Patent number: 11979662Abstract: Visual content is captured by an image capture device during a capture duration. The image capture devices experiences motion during the capture duration. The intentionality of the motion of the image capture device is determined based on angular acceleration of the image capture device during the capture duration. A punchout of the visual content is determined based on the intentionality of the motion of the image capture device. The punchout of the visual content is used to generate stabilized visual content.Type: GrantFiled: January 27, 2023Date of Patent: May 7, 2024Assignee: GoPro, Inc.Inventors: Cesar Douady, Thomas Derbanne, Maxim Karpushin
-
Publication number: 20240137658Abstract: A non-transitory computer-readable storage medium stores executable instructions that, when executed by a processor, cause performance of operations comprising operations to access an image captured by an image sensor, obtain a transfer function for mapping pixel values, determine a faces indication that reflects a proportion of a scene depicted in the image that includes one or more human faces, and modify the transfer function based on the faces indication. Modifying the transfer function based on the faces indication comprises adjusting a gain of the transfer function to move the gain closer to unity. The operations include to apply the transfer function to pixel values of the image to produce a tone mapped image and output the tone mapped image.Type: ApplicationFiled: December 14, 2023Publication date: April 25, 2024Inventors: Bruno César Douady, Michael Serge Andre Kraak, Thomas Nicolas Emmanuel Veit, Guillaume Matthieu Guérin
-
Patent number: 11962736Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving a first image from a first image sensor; receiving a second image from a second image sensor; determining an electronic rolling shutter correction mapping for the first image and the second image; determining a parallax correction mapping based on the first image and the second image for stitching the first image and the second image; determining a warp mapping based on the parallax correction mapping and the electronic rolling shutter correction mapping, wherein the warp mapping applies the electronic rolling shutter correction mapping after the parallax correction mapping; applying the warp mapping to image data based on the first image and the second image to obtain a composite image; and storing, displaying, or transmitting an output image that is based on the composite image.Type: GrantFiled: February 19, 2021Date of Patent: April 16, 2024Assignee: GoPro, Inc.Inventors: Bruno César Douady-Pleven, Antoine Meler, Christophe Clienti
-
Patent number: 11941789Abstract: An image is processed using a combination of techniques, particularly, in which low frequency information is processed using multiple tone control and high frequency information is processed using local tone mapping. An image is divided into a plurality of blocks including a given block. Low frequency information and high frequency information of the given block are separated. The low frequency information is processed using multiple tone control. The high frequency information is processed using local tone mapping. A processed image is then produced based on the processed low frequency information and based on the processed high frequency information, the processed image corresponding to the image captured using the image sensor. The processed image is then output for storage or display. Processing the low frequency information can include using a gain curve and bilinear interpolation. Processing the high frequency information can include using an edge preservation filter.Type: GrantFiled: June 13, 2019Date of Patent: March 26, 2024Assignee: GoPro, Inc.Inventors: Guillaume Matthieu Guérin, Bruno César Douady
-
Publication number: 20240073542Abstract: Systems and methods are disclosed for high dynamic rate processing based on angular rate measurements. For example, methods may include receiving a short exposure image that was captured using an image sensor; receiving a long exposure image that was captured using the image sensor; receiving an angular rate measurement captured using an angular rate sensor attached to the image sensor during exposure of the long exposure image; determining, based on the angular rate measurement, whether to apply high dynamic range processing to an image portion of the short exposure image and the long exposure image; and responsive to a determination not to apply high dynamic range processing to the image portion, selecting the image portion of the short exposure image for use as the image portion of an output image and discard the image portion of the long exposure image.Type: ApplicationFiled: November 7, 2023Publication date: February 29, 2024Inventors: Bruno César Douady, Hervé Hornung
-
Patent number: 11908111Abstract: Image analysis and processing may include a first sensor readout unit receiving first Bayer format image data corresponding to a first input image, a second sensor readout unit receiving second Bayer format image data corresponding to a second input image, a first Bayer-to-RGB unit obtaining first RGB format image data based on the first Bayer format image data, a second Bayer-to-RGB unit obtaining second RGB format image data based on the second Bayer format image data, a high dynamic range unit configured obtaining high dynamic range image data based on a combination of the first RGB format image data and the second RGB format image data, an RGB-to-YUV unit obtaining YUV format image data based on the high dynamic range image data, and a three-dimensional noise reduction unit obtaining processed image data based on the YUV format image data.Type: GrantFiled: May 24, 2022Date of Patent: February 20, 2024Assignee: GoPro, Inc.Inventors: Guillaume Matthieu Guerin, Bruno Faure, Vincent Vacquerie, Bruno César Douady
-
Publication number: 20240048854Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving an image from an image sensor; applying a filter to the image to obtain a low-frequency component image and a high-frequency component image; determining a first enhanced image based on a weighted sum of the low-frequency component image and the high-frequency component image, where the high-frequency component image is weighted more than the low-frequency component image; determining a second enhanced image based on the first enhanced image and a tone mapping; and storing, displaying, or transmitting an output image based on the second enhanced image.Type: ApplicationFiled: October 18, 2023Publication date: February 8, 2024Inventors: Guillaume Matthieu Guerin, Antoine Regimbeau, Thomas Nicolas Emmanuel Veit, Bruno Cesar Douady-Pleven, Violaine Marie Mong-lan Sudret
-
Publication number: 20240013345Abstract: Methods and apparatus for shared image processing among multiple devices. In one embodiment, an exemplary action camera performs a partial multiband blend. Even though the action camera may not have resources to handle the multiband blend of the entire action camera's footage, it can do a significant portion. The partially blended content can be used in ready-to-share applications, or completely blended by another device.Type: ApplicationFiled: June 28, 2023Publication date: January 11, 2024Applicant: GoPro, Inc.Inventors: Gladys Jocelyne Marc, Alexis Lefebvre, Cesar Douady, Guillaume Guerin
-
Patent number: 11863888Abstract: Flare compensation includes obtaining a dark corner intensity differences profile between a first and a second image based on a relative illumination of an area outside a first image circle of the first image and a second image circle of the second image. The dark corner intensity differences profile is obtained for a luminance (Y) component. A flare profile is obtained using an intensity differences profile and the dark corner intensity differences profile. The intensity differences profile is obtained for the Y component along a stitch line between the first image and the second image. The flare profile of the Y component is converted to an RGB flare profile. The first image is modified based on the RGB flare profile to obtain a processed first image.Type: GrantFiled: October 14, 2022Date of Patent: January 2, 2024Assignee: GoPro, Inc.Inventors: Guillaume Matthieu Guérin, Karl Krissian, Bruno César Douady
-
Patent number: 11849224Abstract: A system accesses an image with each pixel of the image having luminance values each representative of a color component of the pixel. The system generates a first histogram for aggregate luminance values of the image, and accesses a target histogram for the image representative of a desired global image contrast. The system computes a transfer function based on the first histogram and the target histogram such that when the transfer function is applied, a histogram of the modified aggregate luminance values is within a threshold similarity of the target histogram. The system modifies the image by applying the transfer function to the luminance values of the image to produce a tone mapped image, and outputs the modified image.Type: GrantFiled: January 3, 2022Date of Patent: December 19, 2023Assignee: GoPro, Inc.Inventors: Bruno César Douady, Michael Serge Andre Kraak, Thomas Nicolas Emmanuel Veit, Guillaume Matthieu Guérin
-
Publication number: 20230388473Abstract: Systems and methods are disclosed for circular stitching of images. For example, methods may include accessing a first image captured using a first image sensor; accessing a second image captured using a second image sensor; determining a cost table for a circular stitching boundary that includes overlapping regions of the first image and the second image; determining an extended disparity profile based on a periodic extension of the cost table and a smoothness criterion, wherein the extended disparity profile has a length greater than the width of the cost table; determining a binocular disparity profile of a length equal to the width of the cost table based on a contiguous subsequence of the extended disparity profile; and stitching the first image and the second image using the binocular disparity profile to obtain a combined image.Type: ApplicationFiled: August 9, 2023Publication date: November 30, 2023Inventors: Bruno César Douady, Alexis Lefebvre
-
Publication number: 20230377605Abstract: Video content may be captured by an image capture device during a capture duration. The video content may include video frames that define visual content viewable as a function of progress through a progress length of the video content. Rotational position information may characterize rotational positions of the image capture device during the capture duration. Time-lapse video frames may be determined from the video frames of the video content based on a spatiotemporal metric. The spatiotemporal metric may characterize spatial smoothness and temporal regularity of the time-lapse video frames. The spatial smoothness may be determined based on the rotational positions of the image capture device corresponding to the time-lapse video frames, and the temporal regularity may be determined based on moments corresponding to the time-lapse video frames. Time-lapse video content may be generated based on the time-lapse video frames.Type: ApplicationFiled: August 3, 2023Publication date: November 23, 2023Inventors: Thomas Derbanne, Cesar Douady, Maxim Karpushin
-
Publication number: 20230368329Abstract: Apparatus and methods for the stitch zone calculation of a generated projection of a spherical image. In one embodiment, a non-transitory computer-readable apparatus comprising a storage apparatus, the storage apparatus comprising instructions configured to, when executed by a processor apparatus, cause a computerized apparatus to identify a stitch line associated with an equatorial area of a plurality of spherical images; re-orient the plurality of spherical images in accordance with the stitch line; and project the re-oriented plurality of spherical images to a selected image projection type.Type: ApplicationFiled: July 25, 2023Publication date: November 16, 2023Inventors: Adeel Abbas, Timothy MacMillan, Cesar Douady-Pleven
-
Publication number: 20230362319Abstract: Apparatus and methods for stitching images, or re-stitching previously stitched images. Specifically, the disclosed systems in one implementation save stitching information and/or original overlap source data during an original stitching process. During subsequent retrieval, rendering, and/or display of the stitched images, the originally stitched image can be flexibly augmented, and/or re-stitched to improve the original stitch quality. Practical applications of the disclosed solutions enable, among other things, a user to create and stitch a wide field of view (FOV) panorama from multiple source images on a device with limited processing capability (such as a mobile phone or other capture device). Moreover, post-processing stitching allows for the user to convert from one image projection to another without fidelity loss (or with an acceptable level of loss).Type: ApplicationFiled: July 10, 2023Publication date: November 9, 2023Applicant: GoPro, Inc.Inventors: Adeel Abbas, Cesar Douady, Timothy MacMillan
-
Patent number: 11812159Abstract: Systems and methods are disclosed for high dynamic rate processing based on angular rate measurements. For example, methods may include receiving a short exposure image that was captured using an image sensor; receiving a long exposure image that was captured using the image sensor; receiving an angular rate measurement captured using an angular rate sensor attached to the image sensor during exposure of the long exposure image; determining, based on the angular rate measurement, whether to apply high dynamic range processing to an image portion of the short exposure image and the long exposure image; and responsive to a determination not to apply high dynamic range processing to the image portion, selecting the image portion of the short exposure image for use as the image portion of an output image and discard the image portion of the long exposure image.Type: GrantFiled: September 23, 2022Date of Patent: November 7, 2023Assignee: GoPro, Inc.Inventors: Bruno César Douady, Hervé Hornung
-
Publication number: 20230345124Abstract: Images with an optical field of view are captured by an image capture device. An observed trajectory of the image capture device reflects the positions of the image capture device at different moments may be determined. A capture trajectory of the image capture device reflects virtual positions of the image capture device from which video content may be generated. The capture trajectory is determined based on a subsequent portion of the observed trajectory such that a portion of the capture trajectory corresponding to a portion of the observed trajectory is determined based on a subsequent portion of the observed trajectory. Orientations of punch-outs for the images are determined based on the capture trajectory. Video content is generated based on visual content of the images within the punch-outs.Type: ApplicationFiled: June 30, 2023Publication date: October 26, 2023Inventors: Thomas Derbanne, Cesar Douady, Maxim Karpushin
-
Patent number: 11800141Abstract: Methods and apparatus for processing of video content to optimize codec bandwidth. In one embodiment, the method includes capturing panoramic imaging content (e.g., a 360° panorama), mapping the panoramic imaging content into an equi-angular cubemap (EAC) format, and splitting the EAC format into segments for transmission to maximize codec bandwidth. In one exemplary embodiment, the EAC segments are transmitted at a different frame rate than the subsequent display rate of the panoramic imaging content. For example, the mapping and frame rate may be chosen to enable the rendering of 8K, 360° content at 24 fps, using commodity encoder hardware and software that nominally supports 4K content at 60 fps.Type: GrantFiled: November 2, 2021Date of Patent: October 24, 2023Assignee: GoPro, Inc.Inventors: David A. Newman, Cesar Douady, Alexis Lefebvre, Daryl Stimm, Michael Kraak
-
Patent number: 11800239Abstract: Image signal processing includes obtaining two or more image signals from a first image sensor, where each of the two or more image signals has a different exposure and obtaining two or more image signals from a second image sensor, where each of the two or more image signals has a different exposure. Image signal processing includes generating an exposure compensated image based on a gain value applied to an exposure level of a first image and a gain value applied to an exposure level of a second image. Image signal processing further includes processing a transformed base layer of the exposure compensated image to obtain a high dynamic range (HDR) image.Type: GrantFiled: January 9, 2023Date of Patent: October 24, 2023Assignee: GoPro, Inc.Inventors: Bruno César Douady, Guillaume Matthieu Guérin
-
Patent number: 11800238Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving an image from an image sensor; applying a filter to the image to obtain a low-frequency component image and a high-frequency component image; determining a first enhanced image based on a weighted sum of the low-frequency component image and the high-frequency component image, where the high-frequency component image is weighted more than the low-frequency component image; determining a second enhanced image based on the first enhanced image and a tone mapping; and storing, displaying, or transmitting an output image based on the second enhanced image.Type: GrantFiled: November 15, 2021Date of Patent: October 24, 2023Assignee: GoPro, Inc.Inventors: Guillaume Matthieu Guerin, Antoine Regimbeau, Thomas Nicolas Emmanuel Veit, Bruno Cesar Douady-Pleven, Violaine Marie Mong-Ian Sudret