Patents by Inventor Antoine Méler

Antoine Méler has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11962736
    Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving a first image from a first image sensor; receiving a second image from a second image sensor; determining an electronic rolling shutter correction mapping for the first image and the second image; determining a parallax correction mapping based on the first image and the second image for stitching the first image and the second image; determining a warp mapping based on the parallax correction mapping and the electronic rolling shutter correction mapping, wherein the warp mapping applies the electronic rolling shutter correction mapping after the parallax correction mapping; applying the warp mapping to image data based on the first image and the second image to obtain a composite image; and storing, displaying, or transmitting an output image that is based on the composite image.
    Type: Grant
    Filed: February 19, 2021
    Date of Patent: April 16, 2024
    Assignee: GoPro, Inc.
    Inventors: Bruno César Douady-Pleven, Antoine Meler, Christophe Clienti
  • Publication number: 20210281710
    Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving a first image from a first image sensor; receiving a second image from a second image sensor; determining an electronic rolling shutter correction mapping for the first image and the second image; determining a parallax correction mapping based on the first image and the second image for stitching the first image and the second image; determining a warp mapping based on the parallax correction mapping and the electronic rolling shutter correction mapping, wherein the warp mapping applies the electronic rolling shutter correction mapping after the parallax correction mapping; applying the warp mapping to image data based on the first image and the second image to obtain a composite image; and storing, displaying, or transmitting an output image that is based on the composite image.
    Type: Application
    Filed: February 19, 2021
    Publication date: September 9, 2021
    Inventors: Bruno César Douady-Pleven, Antoine Meler, Christophe Clienti
  • Patent number: 11102465
    Abstract: First visual information defining first spherical visual content, second visual information defining second spherical visual content, and/or other information may be obtained. Presentation of the first spherical visual content on a display may be effectuated. A spherical transition between the first spherical visual content and the second spherical visual content may be identified. The spherical transition may define a change in presentation of visual content on the display from the first spherical visual content to the second spherical visual content based on a transitional motion within a spherical space and/or other information. A change in presentation of the first spherical visual content on the display to presentation of the second visual content on the display may be effectuated based on the spherical transition and/or other information. The change may be determined based on the transition motion within the spherical space and/or other information.
    Type: Grant
    Filed: February 10, 2020
    Date of Patent: August 24, 2021
    Assignee: GoPro, Inc.
    Inventors: Adrien Fontvielle, Loïc Martin, Antoine Meler
  • Patent number: 10999512
    Abstract: Images may be obtained using a moving camera comprised of two or more rigidly mounted image sensors. Camera motion may change camera orientation when different portions of an image are captured. Pixel acquisition time may be determined based on image exposure duration and position of the pixel in the image array (pixel row index). Orientation of the sensor may at the pixel acquisition time instance may be determined. Image transformation may be performed wherein a given portion of the image may be associated with a respective transformation characterized by the corrected sensor orientation. In some implementations of panoramic image acquisition, multiple source images may be transformed to, e.g., equirectangular plane, using sensor orientation that is corrected for the time of pixel acquisition. Use of orientation correction may improve quality of stitching by, e.g., reducing contrast of border areas between portions of the transformed image obtained by different image sensors.
    Type: Grant
    Filed: February 7, 2020
    Date of Patent: May 4, 2021
    Assignee: GoPro, Inc.
    Inventor: Antoine Meler
  • Patent number: 10972661
    Abstract: Multiple images may be combined to obtain a composite image. Individual images may be obtained with different camera sensors and/or at different time instances. In order to obtain the composite image source images may be aligned in order to produce a seamless stitch. Source images may be characterized by a region of overlap. A disparity measure may be determined for pixels along a border region between the source images. A warp transformation may be determined using a refinement process configured to determine displacement of pixels of the border region based on the disparity. Pixel displacement at a given location may be constrained to direction configured tangential to an epipolar line corresponding to the location. The warp transformation may be propagated to pixels of the image. Spatial and/or temporal smoothing may be applied. In order to obtain refined solution, the warp transformation may be determined at multiple spatial scales.
    Type: Grant
    Filed: November 25, 2019
    Date of Patent: April 6, 2021
    Assignee: GoPro, Inc.
    Inventors: Antoine Meler, Thomas Derbanne
  • Patent number: 10931851
    Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving a first image from a first image sensor; receiving a second image from a second image sensor; determining an electronic rolling shutter correction mapping for the first image and the second image; determining a parallax correction mapping based on the first image and the second image for stitching the first image and the second image; determining a warp mapping based on the parallax correction mapping and the electronic rolling shutter correction mapping, wherein the warp mapping applies the electronic rolling shutter correction mapping after the parallax correction mapping; applying the warp mapping to image data based on the first image and the second image to obtain a composite image; and storing, displaying, or transmitting an output image that is based on the composite image.
    Type: Grant
    Filed: November 12, 2019
    Date of Patent: February 23, 2021
    Assignee: GoPro, Inc.
    Inventors: Bruno César Douady-Pleven, Antoine Meler, Christophe Clienti
  • Publication number: 20200236280
    Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving a first image from a first image sensor; receiving a second image from a second image sensor; stitching the first image and the second image to obtain a stitched image; identifying an image portion of the stitched image that is positioned on a stitching boundary of the stitched image; and inputting the image portion to a machine learning module to obtain a score, wherein the machine learning module has been trained using training data that included image portions labeled to reflect an absence of stitching and image portions labeled to reflect a presence of stitching, wherein the image portions labeled to reflect a presence of stitching included stitching.
    Type: Application
    Filed: April 6, 2020
    Publication date: July 23, 2020
    Inventors: Antoine Meler, Bruno Cesar Douady-Pleven
  • Publication number: 20200177780
    Abstract: Images may be obtained using a moving camera comprised of two or more rigidly mounted image sensors. Camera motion may change camera orientation when different portions of an image are captured. Pixel acquisition time may be determined based on image exposure duration and position of the pixel in the image array (pixel row index). Orientation of the sensor may at the pixel acquisition time instance may be determined. Image transformation may be performed wherein a given portion of the image may be associated with a respective transformation characterized by the corrected sensor orientation. In some implementations of panoramic image acquisition, multiple source images may be transformed to, e.g., equirectangular plane, using sensor orientation that is corrected for the time of pixel acquisition. Use of orientation correction may improve quality of stitching by, e.g., reducing contrast of border areas between portions of the transformed image obtained by different image sensors.
    Type: Application
    Filed: February 7, 2020
    Publication date: June 4, 2020
    Inventor: Antoine Meler
  • Publication number: 20200177860
    Abstract: First visual information defining first spherical visual content, second visual information defining second spherical visual content, and/or other information may be obtained. Presentation of the first spherical visual content on a display may be effectuated. A spherical transition between the first spherical visual content and the second spherical visual content may be identified. The spherical transition may define a change in presentation of visual content on the display from the first spherical visual content to the second spherical visual content based on a transitional motion within a spherical space and/or other information. A change in presentation of the first spherical visual content on the display to presentation of the second visual content on the display may be effectuated based on the spherical transition and/or other information. The change may be determined based on the transition motion within the spherical space and/or other information.
    Type: Application
    Filed: February 10, 2020
    Publication date: June 4, 2020
    Inventors: Adrien Fontvielle, Loïc Martin, Antoine Meler
  • Patent number: 10616482
    Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving a first image from a first image sensor; receiving a second image from a second image sensor; stitching the first image and the second image to obtain a stitched image; identifying an image portion of the stitched image that is positioned on a stitching boundary of the stitched image; and inputting the image portion to a machine learning module to obtain a score, wherein the machine learning module has been trained using training data that included image portions labeled to reflect an absence of stitching and image portions labeled to reflect a presence of stitching, wherein the image portions labeled to reflect a presence of stitching included stitching.
    Type: Grant
    Filed: March 10, 2017
    Date of Patent: April 7, 2020
    Assignee: GoPro, Inc.
    Inventors: Antoine Meler, Bruno Cesar Douady-Pleven
  • Patent number: 10600152
    Abstract: Images of a scene may be captured by a set of image capture devices. Overlapping areas of the images may be identified based on the topology of the set of image capture devices. Frontiers within the overlapping areas of the images may be identified based on borders of the images. Sample points for the images may be distributed along the frontiers. Warp parameters including an anti-symmetric warping portion and a symmetric warping portion may be determined at the sample points. Displacement values may be determined at the sample points based on the warp parameters. Warp maps for the images may be determined based on diffusion of the displacement values. Displacement maps for the images may be determined based on interpolation of the warp maps. The images may be modified based on the displacement maps.
    Type: Grant
    Filed: May 9, 2018
    Date of Patent: March 24, 2020
    Assignee: GoPro, Inc.
    Inventors: Adrien Fontvielle, Antoine Meler, Benoit Fouet, Claire Mathis, Denys Bulant, Emeric Grange, Hervé Bonaillie, Jerome Lehaire, Julien Morat, Martin Arnoux, Mickaël Heudre, Renan Coudray, Stéphane Gamet, Thomas Vuillermet
  • Publication number: 20200092475
    Abstract: Multiple images may be combined to obtain a composite image. Individual images may be obtained with different camera sensors and/or at different time instances. In order to obtain the composite image source images may be aligned in order to produce a seamless stitch. Source images may be characterized by a region of overlap. A disparity measure may be determined for pixels along a border region between the source images. A warp transformation may be determined using a refinement process configured to determine displacement of pixels of the border region based on the disparity. Pixel displacement at a given location may be constrained to direction configured tangential to an epipolar line corresponding to the location. The warp transformation may be propagated to pixels of the image. Spatial and/or temporal smoothing may be applied. In order to obtain refined solution, the warp transformation may be determined at multiple spatial scales.
    Type: Application
    Filed: November 25, 2019
    Publication date: March 19, 2020
    Inventors: Antoine Meler, Thomas Derbanne
  • Publication number: 20200084338
    Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving a first image from a first image sensor; receiving a second image from a second image sensor; determining an electronic rolling shutter correction mapping for the first image and the second image; determining a parallax correction mapping based on the first image and the second image for stitching the first image and the second image; determining a warp mapping based on the parallax correction mapping and the electronic rolling shutter correction mapping, wherein the warp mapping applies the electronic rolling shutter correction mapping after the parallax correction mapping; applying the warp mapping to image data based on the first image and the second image to obtain a composite image; and storing, displaying, or transmitting an output image that is based on the composite image.
    Type: Application
    Filed: November 12, 2019
    Publication date: March 12, 2020
    Inventors: Bruno César Douady-Pleven, Antoine Meler, Christophe Clienti
  • Patent number: 10587856
    Abstract: First visual information defining first spherical visual content, second visual information defining second spherical visual content, and/or other information may be obtained. Presentation of the first spherical visual content on a display may be effectuated. A spherical transition between the first spherical visual content and the second spherical visual content may be identified. The spherical transition may define a change in presentation of visual content on the display from the first spherical visual content to the second spherical visual content based on a transitional motion within a spherical space and/or other information. A change in presentation of the first spherical visual content on the display to presentation of the second visual content on the display may be effectuated based on the spherical transition and/or other information. The change may be determined based on the transition motion within the spherical space and/or other information.
    Type: Grant
    Filed: August 24, 2017
    Date of Patent: March 10, 2020
    Assignee: GoPro, Inc.
    Inventors: Adrien Fontvielle, Loïc Martin, Antoine Meler
  • Patent number: 10560633
    Abstract: Images may be obtained using a moving camera comprised of two or more rigidly mounted image sensors. Camera motion may change camera orientation when different portions of an image are captured. Pixel acquisition time may be determined based on image exposure duration and position of the pixel in the image array (pixel row index). Orientation of the sensor may at the pixel acquisition time instance may be determined. Image transformation may be performed wherein a given portion of the image may be associated with a respective transformation characterized by the corrected sensor orientation. In some implementations of panoramic image acquisition, multiple source images may be transformed to, e.g., equirectangular plane, using sensor orientation that is corrected for the time of pixel acquisition. Use of orientation correction may improve quality of stitching by, e.g., reducing contrast of border areas between portions of the transformed image obtained by different image sensors.
    Type: Grant
    Filed: July 20, 2018
    Date of Patent: February 11, 2020
    Assignee: GoPro, Inc.
    Inventor: Antoine Meler
  • Patent number: 10498958
    Abstract: Multiple images may be combined to obtain a composite image. Individual images may be obtained with different camera sensors and/or at different time instances. In order to obtain the composite image source images may be aligned in order to produce a seamless stitch. Source images may be characterized by a region of overlap. A disparity measure may be determined for pixels along a border region between the source images. A warp transformation may be determined using a refinement process configured to determine displacement of pixels of the border region based on the disparity. Pixel displacement at a given location may be constrained to direction configured tangential to an epipolar line corresponding to the location. The warp transformation may be propagated to pixels of the image. Spatial and/or temporal smoothing may be applied. In order to obtain refined solution, the warp transformation may be determined at multiple spatial scales.
    Type: Grant
    Filed: May 14, 2018
    Date of Patent: December 3, 2019
    Assignee: GoPro, Inc.
    Inventors: Antoine Meler, Thomas Derbanne
  • Patent number: 10477064
    Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving a first image from a first image sensor; receiving a second image from a second image sensor; determining an electronic rolling shutter correction mapping for the first image and the second image; determining a parallax correction mapping based on the first image and the second image for stitching the first image and the second image; determining a warp mapping based on the parallax correction mapping and the electronic rolling shutter correction mapping, wherein the warp mapping applies the electronic rolling shutter correction mapping after the parallax correction mapping; applying the warp mapping to image data based on the first image and the second image to obtain a composite image; and storing, displaying, or transmitting an output image that is based on the composite image.
    Type: Grant
    Filed: August 21, 2017
    Date of Patent: November 12, 2019
    Assignee: GoPro, Inc.
    Inventors: Bruno César Douady-Pleven, Antoine Meler, Christophe Clienti
  • Patent number: 10432855
    Abstract: Multiple video segments, including multiple frames, may be obtained. The video segments may be time synchronized for at least portions of the video segments captured during a synchronized time period. A first key frame moment may be set with the synchronized time period. A first set of construction parameter values may be determined for the frames captured during the first key frame moment. A first set of spherical images may be constructed using the first set of construction parameter values. A change may be detected in the construction parameter values at a moment in time subsequent to the first key frame moment, which may be identified as a second key frame moment. A second set of construction parameter values may be determined for the frames captured during the second key frame moment. The second set of spherical images may be constructed using the second set of construction parameter values.
    Type: Grant
    Filed: May 20, 2016
    Date of Patent: October 1, 2019
    Assignee: GoPro, Inc.
    Inventors: Alexandre Jenny, Renan Coudray, Antoine Méler, Thomas Vuillermet
  • Publication number: 20190058811
    Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving a first image from a first image sensor; receiving a second image from a second image sensor; determining an electronic rolling shutter correction mapping for the first image and the second image; determining a parallax correction mapping based on the first image and the second image for stitching the first image and the second image; determining a warp mapping based on the parallax correction mapping and the electronic rolling shutter correction mapping, wherein the warp mapping applies the electronic rolling shutter correction mapping after the parallax correction mapping; applying the warp mapping to image data based on the first image and the second image to obtain a composite image; and storing, displaying, or transmitting an output image that is based on the composite image.
    Type: Application
    Filed: August 21, 2017
    Publication date: February 21, 2019
    Inventors: Bruno César Douady-Pleven, Antoine Meler, Christophe Clienti
  • Publication number: 20180332206
    Abstract: Images may be obtained using a moving camera comprised of two or more rigidly mounted image sensors. Camera motion may change camera orientation when different portions of an image are captured. Pixel acquisition time may be determined based on image exposure duration and position of the pixel in the image array (pixel row index). Orientation of the sensor may at the pixel acquisition time instance may be determined. Image transformation may be performed wherein a given portion of the image may be associated with a respective transformation characterized by the corrected sensor orientation. In some implementations of panoramic image acquisition, multiple source images may be transformed to, e.g., equirectangular plane, using sensor orientation that is corrected for the time of pixel acquisition. Use of orientation correction may improve quality of stitching by, e.g., reducing contrast of border areas between portions of the transformed image obtained by different image sensors.
    Type: Application
    Filed: July 20, 2018
    Publication date: November 15, 2018
    Inventor: Antoine Meler