Patents Assigned to GoPro, Inc.
  • Patent number: 11818468
    Abstract: Methods and apparatus for shear correction in spherical projections. Embedded devices generally lack the compute and/or memory resources to implement two-dimensional (2D) stitches for spherical projections. Objects (such as a mounting fixture) within a certain distance of the camera may experience a 2D “tear” or “shear” artifact when stitched. Various embodiments of the present disclosure perform two orthogonal 1D stitches: (i) latitudinally across the meridian and (ii) longitudinally along the meridian to approximate the effect of a 2D stitch. Notably, the 1D stitch may be less precise than a true 2D stitch, however the image portion being stitched (e.g., the camera mount) is not the user's subject of interest and can be rendered much more loosely without adverse consequence. Temporal smoothing optimizations are additionally disclosed.
    Type: Grant
    Filed: August 10, 2022
    Date of Patent: November 14, 2023
    Assignee: GoPro, Inc.
    Inventors: David Newman, Daryl Stimm
  • Patent number: 11818465
    Abstract: Systems, apparatus, and methods for stabilization and blending of exposures. So-called Electronic Image Stabilization (EIS) techniques use image manipulation software to compensate for camera motion. Unfortunately, existing EIS techniques cannot compensate for artifacts introduced by low shutter speed (e.g., blurs). Various embodiments of the present disclosure generate stabilized images from multiple exposures. In one exemplary embodiment, the stabilized exposures are blended using a linear sum of the color data for each pixel of the image. By stabilizing each exposure and linearly summing the light information, the camera shake can be removed, and the subject motion blur can be controlled. The stabilization and blending techniques enable a mathematical emulation of a selected shutter angle from many high-speed exposures.
    Type: Grant
    Filed: January 10, 2022
    Date of Patent: November 14, 2023
    Assignee: GoPro, Inc.
    Inventor: David Newman
  • Patent number: 11818448
    Abstract: An image capture device includes a housing and a lens cavity comprising an external lens that separates the lens cavity from an exterior environment. The lens cavity is connected with an inside of the housing. The image capture device includes a door positioned on the housing that opens the inside of the housing to the exterior environment. The image capture device includes a vent positioned on housing so that moisture can be vented from housing and the lens cavity to the exterior environment.
    Type: Grant
    Filed: November 29, 2022
    Date of Patent: November 14, 2023
    Assignee: GoPro, Inc.
    Inventors: Joseph Tucker, Matthew Feddersen
  • Patent number: 11816896
    Abstract: A media summary is generated to include portions of media items. The portions of media items identified for inclusion in the media summary is determined based on the length of the media summary and classification of content depicted within the media items. Classification of content depicted within the media items includes number of smiles depicted within the media items.
    Type: Grant
    Filed: December 16, 2022
    Date of Patent: November 14, 2023
    Assignee: GoPro, Inc.
    Inventors: Anais Oules, Guillaume Oules
  • Publication number: 20230362319
    Abstract: Apparatus and methods for stitching images, or re-stitching previously stitched images. Specifically, the disclosed systems in one implementation save stitching information and/or original overlap source data during an original stitching process. During subsequent retrieval, rendering, and/or display of the stitched images, the originally stitched image can be flexibly augmented, and/or re-stitched to improve the original stitch quality. Practical applications of the disclosed solutions enable, among other things, a user to create and stitch a wide field of view (FOV) panorama from multiple source images on a device with limited processing capability (such as a mobile phone or other capture device). Moreover, post-processing stitching allows for the user to convert from one image projection to another without fidelity loss (or with an acceptable level of loss).
    Type: Application
    Filed: July 10, 2023
    Publication date: November 9, 2023
    Applicant: GoPro, Inc.
    Inventors: Adeel Abbas, Cesar Douady, Timothy MacMillan
  • Patent number: 11809067
    Abstract: An image capture device includes an image sensor and a heat controller. The image capture device includes a heat spreader that extends between the image sensor and the heat controller. The heat spreader dissipates heat from the image sensor to the heat controller. The image capture device includes an electronics unit spaced from the image sensor. The image capture device includes a compressive insulator that contacts the heat spreader and the electronics unit, and the compressible insulator thermally separates the electronics unit and the heat spreader.
    Type: Grant
    Filed: January 30, 2023
    Date of Patent: November 7, 2023
    Assignee: GoPro, Inc.
    Inventor: Ihab A. Ali
  • Patent number: 11810269
    Abstract: Systems and methods are disclosed for denoising chrominance channels of images. For example, methods may include receiving an image from one or more image sensors; determining a set of weights for the image based on a luminance channel of the image, wherein a weight in the set of weights corresponds to a subject pixel and a candidate pixel and is determined based on luminance values of one or more pixels of the image centered at the subject pixel and one or more pixels of the image centered at the candidate pixel; applying the set of weights to chrominance channels of the image to obtain a denoised image, wherein the subject pixel of the denoised image is determined based on the weight multiplied by the candidate pixel of the image; and storing, displaying, or transmitting an output image based on the denoised image.
    Type: Grant
    Filed: January 3, 2022
    Date of Patent: November 7, 2023
    Assignee: GoPro, Inc.
    Inventors: Thomas Nicolas Emmanuel Veit, Marc Lebrun
  • Patent number: 11812159
    Abstract: Systems and methods are disclosed for high dynamic rate processing based on angular rate measurements. For example, methods may include receiving a short exposure image that was captured using an image sensor; receiving a long exposure image that was captured using the image sensor; receiving an angular rate measurement captured using an angular rate sensor attached to the image sensor during exposure of the long exposure image; determining, based on the angular rate measurement, whether to apply high dynamic range processing to an image portion of the short exposure image and the long exposure image; and responsive to a determination not to apply high dynamic range processing to the image portion, selecting the image portion of the short exposure image for use as the image portion of an output image and discard the image portion of the long exposure image.
    Type: Grant
    Filed: September 23, 2022
    Date of Patent: November 7, 2023
    Assignee: GoPro, Inc.
    Inventors: Bruno César Douady, Hervé Hornung
  • Publication number: 20230351656
    Abstract: A method includes determining an altitude of a camera of an aerial vehicle, determining a field of view (FOV) of a camera, generating a localized map, determining a relative position of the aerial vehicle on the localized map, and determining a relative heading of the aerial vehicle.
    Type: Application
    Filed: July 6, 2023
    Publication date: November 2, 2023
    Applicant: GoPro, Inc.
    Inventor: Joseph Anthony Enke
  • Patent number: 11800141
    Abstract: Methods and apparatus for processing of video content to optimize codec bandwidth. In one embodiment, the method includes capturing panoramic imaging content (e.g., a 360° panorama), mapping the panoramic imaging content into an equi-angular cubemap (EAC) format, and splitting the EAC format into segments for transmission to maximize codec bandwidth. In one exemplary embodiment, the EAC segments are transmitted at a different frame rate than the subsequent display rate of the panoramic imaging content. For example, the mapping and frame rate may be chosen to enable the rendering of 8K, 360° content at 24 fps, using commodity encoder hardware and software that nominally supports 4K content at 60 fps.
    Type: Grant
    Filed: November 2, 2021
    Date of Patent: October 24, 2023
    Assignee: GoPro, Inc.
    Inventors: David A. Newman, Cesar Douady, Alexis Lefebvre, Daryl Stimm, Michael Kraak
  • Patent number: 11798594
    Abstract: Video information may define spherical video content having a duration. Spherical video content may define visual content viewable from a point of view as a function of progress through the spherical video content. Path information may define a path selection for the spherical video content. Path selection may include movement of a viewing window within the spherical video content. The viewing window may define extents of the visual content viewable from the point of view as the function of progress through the spherical video content. Time lapse parameter information may define at least two of a time portion of the duration, an image sampling rate, and a time lapse speed effect. A time lapse video may be generated based on the video information, the path information, and the time lapse parameter information.
    Type: Grant
    Filed: September 26, 2022
    Date of Patent: October 24, 2023
    Assignee: GoPro, Inc.
    Inventors: Nicholas Ryan Gilmour, Jessica Bonner
  • Patent number: 11800239
    Abstract: Image signal processing includes obtaining two or more image signals from a first image sensor, where each of the two or more image signals has a different exposure and obtaining two or more image signals from a second image sensor, where each of the two or more image signals has a different exposure. Image signal processing includes generating an exposure compensated image based on a gain value applied to an exposure level of a first image and a gain value applied to an exposure level of a second image. Image signal processing further includes processing a transformed base layer of the exposure compensated image to obtain a high dynamic range (HDR) image.
    Type: Grant
    Filed: January 9, 2023
    Date of Patent: October 24, 2023
    Assignee: GoPro, Inc.
    Inventors: Bruno César Douady, Guillaume Matthieu Guérin
  • Patent number: 11800238
    Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving an image from an image sensor; applying a filter to the image to obtain a low-frequency component image and a high-frequency component image; determining a first enhanced image based on a weighted sum of the low-frequency component image and the high-frequency component image, where the high-frequency component image is weighted more than the low-frequency component image; determining a second enhanced image based on the first enhanced image and a tone mapping; and storing, displaying, or transmitting an output image based on the second enhanced image.
    Type: Grant
    Filed: November 15, 2021
    Date of Patent: October 24, 2023
    Assignee: GoPro, Inc.
    Inventors: Guillaume Matthieu Guerin, Antoine Regimbeau, Thomas Nicolas Emmanuel Veit, Bruno Cesar Douady-Pleven, Violaine Marie Mong-Ian Sudret
  • Patent number: 11796895
    Abstract: An image capture device is described that includes a body; a mounting structure that is connected to the body; an integrated sensor-lens assembly (ISLA) that defines an optical axis and extends through the body and the mounting structure; and an accessory that is releasably connectable to the mounting structure via rotation through a range of motion less than approximately 90 degrees. The mounting structure and the accessory include corresponding angled bearing surfaces that are configured for engagement such that rotation of the accessory relative to the mounting structure creates a bearing effect that displaces the accessory along the optical axis to thereby reduce any axial force required during connection and disconnection of the accessory.
    Type: Grant
    Filed: March 2, 2023
    Date of Patent: October 24, 2023
    Assignee: GoPro, Inc.
    Inventors: Matthew David Thomas, Jordan Zook Todd, Jesse Patterson, Nicholas Vitale, Joseph Tucker, Ian Griggs
  • Patent number: 11790572
    Abstract: Depiction of a physical whiteboard may be captured by an image capture device. The depiction of the physical whiteboard may be detected and used to generate a virtual whiteboard. A change in the depiction of the physical whiteboard may be detected and used to change the virtual whiteboard. A virtual change to the virtual whiteboard may be received and used to change the virtual whiteboard. The change to the virtual whiteboard based on the virtual change may be projected on top of the physical whiteboard.
    Type: Grant
    Filed: December 21, 2021
    Date of Patent: October 17, 2023
    Assignee: GoPro, Inc.
    Inventors: Guillaume Oulès, Daryl Stimm
  • Patent number: 11790488
    Abstract: Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.
    Type: Grant
    Filed: May 27, 2021
    Date of Patent: October 17, 2023
    Assignee: GoPro, Inc.
    Inventors: David Newman, Daryl Stimm, Adeel Abbas
  • Patent number: 11792502
    Abstract: A user interface of an image capture device may provide options for a user to schedule future capture of visual content by the image capture device. The user may interact with the options to specify the start time and the capture duration for the future capture of visual content. Information on scheduled future capture of visual content may be presented on one or more displays.
    Type: Grant
    Filed: December 9, 2022
    Date of Patent: October 17, 2023
    Assignee: GoPro, Inc.
    Inventor: Michael Adkins Knott
  • Patent number: D1003972
    Type: Grant
    Filed: June 15, 2023
    Date of Patent: November 7, 2023
    Assignee: GoPro, Inc.
    Inventors: Bessy Liang, Daniel J. Coster, Huy Phuong Nguyen
  • Patent number: D1003979
    Type: Grant
    Filed: August 18, 2021
    Date of Patent: November 7, 2023
    Assignee: GoPro, Inc.
    Inventors: Scott Alberstein, Daniel J. Coster, Joshua T. Druker
  • Patent number: D1004675
    Type: Grant
    Filed: May 17, 2023
    Date of Patent: November 14, 2023
    Assignee: GoPro, Inc.
    Inventors: Huy Phuong Nguyen, Bessy Liang, Jordan Zook Todd