GoPro Patents

GoPro, Inc. manufactures and sells their HERO line of cameras that enable athletes to self-capture their activities, as well as manage and share their photos and videos.

GoPro Patents by Type
  • GoPro Patents Granted: GoPro patents that have been granted by the United States Patent and Trademark Office (USPTO).
  • GoPro Patent Applications: GoPro patent applications that are pending before the United States Patent and Trademark Office (USPTO).
  • Patent number: 10666868
    Abstract: An aerial vehicle platform includes an aerial vehicle, a gimbal coupled to the aerial vehicle, and a camera mounted to the gimbal. An attitude sensing system includes an inertial measurement unit to sense attitude and an attitude adjustment module to generate an attitude adjustment for adjusting the sensed attitude to compensate for drift error.
    Type: Grant
    Filed: June 12, 2019
    Date of Patent: May 26, 2020
    Assignee: GoPro, Inc.
    Inventors: Thomas Gubler, Garance Bruneau, Axel Murguet, Pascal Gohl
  • Patent number: 10666845
    Abstract: In one aspect of the present disclosure, a module is disclosed for use with a digital image capturing device (DICD) including an integrated sensor-lens assembly (ISLA). The module includes a cradle configured for connection to a housing of the DICD, and at least one dampener that is configured for positioning between the module and the housing of the DICD to reduce vibrations transmitted to the ISLA.
    Type: Grant
    Filed: February 28, 2019
    Date of Patent: May 26, 2020
    Assignee: GoPro, Inc.
    Inventors: Himay Shukla, Kielan Crow, Pascal Gohl
  • Patent number: 10659683
    Abstract: A camera system configuration generates 2D or 3D images capable of being stitched together to create panoramic images. The configuration detects a communication coupling of at least two cameras for capturing a sequence of images. The cameras themselves are configured such that their rolling shutters mitigate field of view artifacts from adjacent cameras (2D panoramas) and adjacent 3D camera pairs (3D panoramas) by allowing for the substantially temporally-aligned capture of light in overlap regions between adjacent cameras.
    Type: Grant
    Filed: October 29, 2015
    Date of Patent: May 19, 2020
    Assignee: GoPro, Inc.
    Inventor: Scott Patrick Campbell
  • Patent number: 10657627
    Abstract: Systems and methods are disclosed for image capture. For example, methods may include accessing a sequence of images from an image sensor; determining a sequence of parameters for respective images in the sequence of images based on the respective images; storing the sequence of images in a buffer; determining a temporally smoothed parameter for a current image in the sequence of images based on the sequence of parameters, wherein the sequence of parameters includes parameters for images in the sequence of images that were captured after the current image; applying image processing to the current image based on the temporally smoothed parameter to obtain a processed image; and storing, displaying, or transmitting an output image based on the processed image.
    Type: Grant
    Filed: January 23, 2018
    Date of Patent: May 19, 2020
    Assignee: GoPro, Inc.
    Inventors: Bruno César Douady-Pleven, Vincent Vacquerie
  • Patent number: 10648809
    Abstract: Disclosed is a system and method for calibrating a magnetometer. The method comprises responsive to a determination that a magnetic inclination is less than a threshold, measuring first magnetic field data by detecting a magnetic field with the magnetometer through a first rotation path, measuring second magnetic field data by detecting the magnetic field with the magnetometer through a second rotation path, and determining calibration values for the magnetometer based on the measured first magnetic field data and the measured second magnetic field data.
    Type: Grant
    Filed: November 29, 2018
    Date of Patent: May 12, 2020
    Assignee: GoPro, Inc.
    Inventors: Fabio Diem, Tim Oberhauser, Sammy Omari
  • Patent number: 10652558
    Abstract: Apparatus and methods for digital video data compression via a scalable, multi-resolution approach. In one embodiment, the video content may be encoded using a multi-resolution and/or multi-quality scalable coding approach that reduces computational and/or energy load on a client device. In one implementation, a low fidelity image is obtained based on a first full resolution image. The low fidelity image may be encoded to obtain a low fidelity bitstream. A second full resolution image may be obtained based on the low fidelity bitstream. A portion of a difference image obtained based on the second full resolution image and the first full resolution may be encoded to obtain a high fidelity bitstream. The low fidelity bitstream and the high fidelity bitstream may be provided to e.g., a receiving device.
    Type: Grant
    Filed: December 27, 2018
    Date of Patent: May 12, 2020
    Assignee: GoPro, Inc.
    Inventors: Adeel Abbas, Balineedu Chowdary Adsumilli, David Newman
  • Patent number: 10650592
    Abstract: Apparatus and methods for providing a rotated spherical viewpoint (RSV). In one or more embodiments, the RSV is implemented using equirectangular projections (ERPs). The RSV methodologies described herein are particularly suitable for panning within virtual reality (VR) or 360° panoramic content as there is minimal, if any, geometric distortions at the edge of a given viewport. Moreover, the RSV methodologies described herein may reduce the bandwidth requirements of, for example, devices operating in a client-server architecture. Additionally, the computation requirements for providing RSV are minimal and can be provided using relatively simple rotation transforms.
    Type: Grant
    Filed: December 27, 2018
    Date of Patent: May 12, 2020
    Assignee: GoPro, Inc.
    Inventor: Adeel Abbas
  • Patent number: 10650487
    Abstract: Hyper-hemispherical images may be combined to generate a rectangular projection of a spherical image having an equatorial stitch line along of a line of lowest distortion in the two images. First and second circular images are received representing respective hyper-hemispherical fields of view. A video processing device may project each circular image to a respective rectangular image by mapping an outer edge of the circular image to a first edge of the rectangular image and mapping a center point of the circular image to a second edge of the first rectangular image. The rectangular images may be stitched together along the edges corresponding to the outer edge of the original circular image.
    Type: Grant
    Filed: June 24, 2019
    Date of Patent: May 12, 2020
    Assignee: GoPro, Inc.
    Inventors: Joseph Steel, Timothy Macmillan
  • Patent number: 10643663
    Abstract: Video and corresponding metadata is accessed. Events of interest within the video are identified based on the corresponding metadata, and best scenes are identified based on the identified events of interest. In one example, best scenes are identified based on the motion values associated with frames or portions of a frame of a video. Motion values are determined for each frame and portions of the video including frames with the most motion are identified as best scenes. Best scenes may also be identified based on the motion profile of a video. The motion profile of a video is a measure of global or local motion within frames throughout the video. For example, best scenes are identified from portion of the video including steady global motion. A video summary can be generated including one or more of the identified best scenes.
    Type: Grant
    Filed: January 24, 2019
    Date of Patent: May 5, 2020
    Assignee: GoPro, Inc.
    Inventors: Balineedu Chowdary Adsumilli, Ryan Lustig, David A. Newman
  • Patent number: 10643661
    Abstract: A system and/or method configured to determine highlight segments. Content files that define content in a content segment set may be obtained. A highlight segment set may be determined from the content segment set. Determining the highlight segment set may include iterating (a)-(c) for multiple iterations. At (a), individual content segments included in the content segment set may be selected as a selected content segment for inclusion in the highlight segment set. At, (b) diversity scores for content segments that are (i) included in the content segment set and (ii) not yet selected for inclusion in the highlight segment set may be determined. At (c), one or more of the content segments may be disqualified for inclusion in the highlight segment set for future iterations based on the diversity scores.
    Type: Grant
    Filed: June 18, 2018
    Date of Patent: May 5, 2020
    Assignee: GoPro, Inc.
    Inventors: Desmond Chik, Daniel Tse, Jonathan Wills
  • Patent number: 10645358
    Abstract: Image analysis and processing may include using an image processor to receive image data corresponding to an input image, determine an initial gain value for the image data based on at least one of a two-dimensional gain map or a parameterized radial gain model, determine whether the initial gain value is below a threshold, determine a maximum RGB triplet value for the image data where the initial gain value is below the threshold, determine a pixel intensity as output of a function for saturation management, determine a final gain value for the image data based on the maximum RGB triplet value and the pixel intensity, apply the final gain value against the image data to produce processed image data, and output the processed image data for further processing using the image processor.
    Type: Grant
    Filed: September 26, 2018
    Date of Patent: May 5, 2020
    Assignee: GoPro, Inc.
    Inventors: Guillaume Matthieu Guérin, Karl Krissian, Marc Lebrun, Giuseppe Moschetti
  • Patent number: 10643303
    Abstract: A video edit of first video content and second video content may be generated based on the fields of view of the first video content and the second video content. Based on the fields of view of the first video content and the second video content, a first viewing window for the first video content and a second viewing window for the second video content may be determined. The viewing windows may define one or more extents of the corresponding visual content. The video edit may include a punchout of the first video content based on the first viewing window and a punchout of the second video content based on the second viewing window.
    Type: Grant
    Filed: February 28, 2019
    Date of Patent: May 5, 2020
    Assignee: GoPro, Inc.
    Inventor: Ingrid A. Cotoros
  • Patent number: 10642479
    Abstract: Video content may be presented on a touchscreen display. A viewing window for the video content may define an extent of the video content presented on the touchscreen display. Reception of an automatic movement input by the touchscreen display during the presentation of the video content may be determined. The automatic movement input may include user engagement with the touchscreen display that moves along the touchscreen display to an edge of the touchscreen display during an input period. The movement along the touchscreen display may cause a movement of the viewing window during the input period. Based on the automatic movement input, the movement of the viewing window may be continued after the input period. The movement of the viewing window after the input period may be continuous with the movement of the viewing window during the input period.
    Type: Grant
    Filed: October 21, 2019
    Date of Patent: May 5, 2020
    Assignee: GoPro, Inc.
    Inventor: Jakub Uradnik
  • Patent number: 10643308
    Abstract: Systems and methods are disclosed for non-local means denoising of images. For example, methods may include receiving an image from an image sensor; determining a set of non-local means weights for the image; applying the set of non-local means weights to the image to obtain a first denoised image; applying the set of non-local means weights to the first denoised image to obtain a second denoised image; and storing, displaying, or transmitting an output image based on the second denoised image.
    Type: Grant
    Filed: October 11, 2017
    Date of Patent: May 5, 2020
    Assignee: GoPro, Inc.
    Inventors: Bruno César Douady-Pleven, Thomas Nicolas Emmanuel Veit, Marc Lebrun
  • Patent number: 10642133
    Abstract: A camera mounting system has an upper mount component, a lower mount component, and a base mount component. The upper mount component secures the camera and has a ball protrusion that reciprocally couples with a socket of the lower mount component. The upper mount component can rotate 360 degrees relative to the lower mount, and can pivot 90 degrees or more relative to the lower mount component. The lower mount component couples with the base mount component in a plurality of orientations. This camera mounting system allows for a large range of motion for the camera relative to the mounting system.
    Type: Grant
    Filed: August 15, 2019
    Date of Patent: May 5, 2020
    Assignee: GoPro, Inc.
    Inventor: Christopher Aaron Clearman
  • Patent number: 10645362
    Abstract: Apparatus and methods for characterizing panoramic content, such as by a wide field of view and large image size. In one implementation, a panoramic image may be mapped to a cube or any other projection e.g icosahedron or octahedron. The disclosure exploits content continuity between facets, such as in the case of encoding/decoding cube-projected images. One facet may be encoded/decoded independently from other facets to obtain a seed facet. One or more transformed versions of the seed facet may be obtained; e.g., one corresponding to a 90° counterclockwise rotation, another to a 90° clockwise rotation, and one to an 180° rotation. Transformed versions may be used to form an augmented image. The remaining facets of the cube may be encoded using transformed versions within the augmented image.
    Type: Grant
    Filed: September 8, 2016
    Date of Patent: May 5, 2020
    Assignee: GoPro, Inc.
    Inventors: Adeel Abbas, Balineedu Chowdary Adsumilli, David Newman
  • Patent number: 10645468
    Abstract: A video set of one or more videos may include video content having a progress length. The video content may be segmented into a sequence of video content segments. The sequence of video content segments may be provided for presentation on a display as individual video clips. Individual video content segments may be provided as individual video clips.
    Type: Grant
    Filed: December 3, 2018
    Date of Patent: May 5, 2020
    Assignee: GoPro, Inc.
    Inventors: Abraham Kislevitz, Vadim Polonichko
  • Patent number: 10643406
    Abstract: An unmanned aerial vehicle manages storage of data and transfer between other connected devices. The unmanned aerial vehicle captures sensor data from sensors on the unmanned aerial vehicle. The unmanned aerial vehicle transfers the captured sensor data from the unmanned aerial vehicle to a remote controller via a wireless interface. The captured data may be transferred via a TCP link, a UDP link, or a combination thereof. If a loss of link is detected, the captured sensor data is stored to a buffer and a battery level of the unmanned aerial vehicle and a flight status of the unmanned aerial vehicle is monitored. The stored sensor data is transferred from the buffer to a non-volatile storage responsive to the battery level dropping below a predefined threshold or detecting that the unmanned aerial vehicle is stationary and a shutdown may be imminent.
    Type: Grant
    Filed: April 18, 2017
    Date of Patent: May 5, 2020
    Assignee: GoPro, Inc.
    Inventors: Ashwani Arya, Gary Fong
  • Patent number: 10645407
    Abstract: Multiple videos having individual time durations may be obtained, including a first video with a first time duration. The videos may include visual information defined by one or more electronic media files. An initial portion of the first time duration where the one or more electronic media are to be transcoded may be determined, including determining whether the first time duration is greater than a predefined threshold and if the first time duration is greater than the predefined threshold, determining the initial portion to be an initial time duration that is less than the first time duration. One or more transcoded media files may be generated during the initial portion. A request for the first video may be received from a client computing platform. In response to receipt of the request, the one or more transcoded media files may be transmitted to the client computing platform for display.
    Type: Grant
    Filed: March 29, 2019
    Date of Patent: May 5, 2020
    Assignee: GoPro, Inc.
    Inventor: Cedric Fernandes
  • Patent number: 10638047
    Abstract: A frame rate is synchronized to a detected cadence in order to generate an output image sequence that is substantially stabilized. In an in-camera process, a camera receives motion data of the camera while the camera captures the sequence of image frames. A dominant frequency of motion is determined and the capture frame rate is dynamically adjusted to match the frequency of detected motion so that each image frame is captured when the camera is at approximately the same position along the axis of motion. Alternatively, in a post-processing process, frames of a captured image sequence are selectively sampled at a sampling rate corresponding to the dominant frequency of motion so that each sampled frame corresponds to an image capture that occurred when the camera is at approximately the same position along the axis of motion.
    Type: Grant
    Filed: December 12, 2016
    Date of Patent: April 28, 2020
    Assignee: GoPro, Inc.
    Inventors: Charles Edward Weckel, Vishwanatha Bhat
  • Patent number: 10636150
    Abstract: A method for tracking a subject in successive image frames includes obtaining previous image frames with an imaging device, processing the previous image frames, obtaining motion information of the imaging device and a subject, determining a region of interest, obtaining a subsequent image frame, and processing the region of interest. The processing includes determining previous frame positions of the subject therein. The motion information is obtained with sensors physically associated with one or more of the imaging device and the subject. The region of interest is located in a predetermined spatial relationship relative to a predicted frame position of the subject.
    Type: Grant
    Filed: July 21, 2017
    Date of Patent: April 28, 2020
    Assignee: GoPro, Inc.
    Inventors: Sammy Omari, Joseph A. Enke
  • Patent number: 10630921
    Abstract: Image signal processing may include flare reduction, which may include obtaining a first input frame captured by a first image capture device of an image capture apparatus, the first image capture device having a first field-of-view, and the first input frame including lens flare corresponding to a primary light source; obtaining a second input frame captured by a second image capture device of the image capture apparatus, the second image capture device having a second field-of-view partially overlapping the first field-of-view; obtaining primary light source information corresponding to the primary light source based on the first input frame and the second input frame; obtaining a processed frame by modifying the first input frame based on the primary light source information to minimize the lens flare; and outputting the processed frame.
    Type: Grant
    Filed: May 21, 2018
    Date of Patent: April 21, 2020
    Assignee: GoPro, Inc.
    Inventors: Bruno César Douady-Pleven, Nicolas Boehrer, Thomas Nicolas Emmanuel Veit
  • Patent number: 10625857
    Abstract: Vehicles such as unmanned air vehicles that are capable of movement from an open, flight configuration to an enclosed configuration in which all major flight components can be protected by an outer shell are disclosed. In the enclosed configuration, the vehicles can take on standard geometric shapes such as a rectangular prism, sphere, cylinder, or another shape, so as to not be recognizable as an unmanned air vehicle. Embodiments of vehicles can also include interchangeable and/or wireless motor arms, motor arms which are electrically connected to the remainder of the vehicle only when in an open configuration, remote controllers removably attached to the remainder of the vehicle, and clip or other attachment mechanisms for attachment to objects such as backpacks.
    Type: Grant
    Filed: February 7, 2019
    Date of Patent: April 21, 2020
    Assignee: GoPro, Inc.
    Inventor: Ryan Michael Goldstein
  • Patent number: 10618629
    Abstract: A variable pitch propeller is designed to adjust the pitch of the propeller blade during flight to maximize the propeller efficiency. The propeller blade may comprise airfoil cross-sections. Each cross-section may be composed of different materials at the leading edge and trailing edge. In various embodiments, these materials are selected and oriented to achieve the necessary elastic moduli of the leading and trailing edge for the airfoil cross-section. During liftoff, the airfoil at the blade tip possesses a high blade pitch (e.g. 20 degrees), thereby increasing the generated lift on the propeller blades. During flight or hover conditions when maximal lift is no longer required, the trailing edge of the airfoil displaces upward and reduces the blade pitch to minimize the drag forces on the blade tip.
    Type: Grant
    Filed: August 9, 2016
    Date of Patent: April 14, 2020
    Assignee: GoPro, Inc.
    Inventors: Scott Patrick Campbell, Leo Baldwin, Gary Fong
  • Patent number: 10614315
    Abstract: Physical storage media accessible to a remote device may store video information defining video content. The video content may be characterized by capture information. The remote device may transmit at least a portion of the capture information to a computing device. The computing device may identify one or more portions of the video content based on the transmitted capture information. The remote device may receive the identification of the identified portion(s) of the video content from the computing device. Responsive to the reception of the identification, the remote device may transmit the video information defining at least some of the identified portion(s) of the video content to the computing device.
    Type: Grant
    Filed: August 9, 2019
    Date of Patent: April 7, 2020
    Assignee: GoPro, Inc.
    Inventors: Otto Sievert, Naveen Krishnamurthy
  • Patent number: 10616482
    Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving a first image from a first image sensor; receiving a second image from a second image sensor; stitching the first image and the second image to obtain a stitched image; identifying an image portion of the stitched image that is positioned on a stitching boundary of the stitched image; and inputting the image portion to a machine learning module to obtain a score, wherein the machine learning module has been trained using training data that included image portions labeled to reflect an absence of stitching and image portions labeled to reflect a presence of stitching, wherein the image portions labeled to reflect a presence of stitching included stitching.
    Type: Grant
    Filed: March 10, 2017
    Date of Patent: April 7, 2020
    Assignee: GoPro, Inc.
    Inventors: Antoine Meler, Bruno Cesar Douady-Pleven
  • Patent number: 10613420
    Abstract: A camera system includes a camera with a lens assembly and image processing electronics internal to the camera housing. The lens assembly and image processing electronics are sensitive to thermal gradients within the camera body. The image processing electronics are coupled to a thermal management system that transfers thermal energy away from the electronics towards a heat diffuser. The thermal management system comprises a heat controller with a heat source, an offset arm, and a heat exchange. The thermal energy moves from the heat source to the heat exchange via the offset arm. The thermal management system also manages heat transfer between auxiliary electronic components and the image processing electronics. The thermal management system is constructed of materials that react to the compressive forces created on the system during camera assembly.
    Type: Grant
    Filed: December 19, 2016
    Date of Patent: April 7, 2020
    Assignee: GoPro, Inc.
    Inventor: Ihab A. Ali
  • Patent number: 10614114
    Abstract: Media items may be obtained. The media items may be characterized by capture information indicating a capture time and a capture location of individual media items. The media items may be clustered into scenes based on proximity of the capture times of the media items. The scenes may be clustered into collections based on proximity of the capture times and/or the capture locations of the media items within the scenes. The collections may be iteratively clustered into higher collections based on proximity of the capture times and/or the capture locations of the media items within the collections. One or more collections may be identified for inclusion in a media compilation based on a size of the identified collection(s). A media compilation, including one or more of the media items included in the identified collection(s), may be generated.
    Type: Grant
    Filed: July 10, 2017
    Date of Patent: April 7, 2020
    Assignee: GoPro, Inc.
    Inventors: Vincent Garcia, Jean Caillé
  • Patent number: 10607087
    Abstract: First video information defining first video content may be accessed. The first video content may have been captured by a first image sensor from a first conveyance position. Second video information defining second video content may be accessed. The second video content may have been captured by a second image sensor from a second conveyance position. A first highlight criterion may be selected for the first video content based on the first conveyance position. A second highlight criterion may be selected for the second video content based on the second conveyance position. A first set of highlight moments within the first video content may be identified based on the first criterion. A second set of highlight moments within the second video content may be identified based on the second criterion. The identification of the first set of highlight moments and the second set of highlight moments may be stored.
    Type: Grant
    Filed: April 18, 2019
    Date of Patent: March 31, 2020
    Assignee: GoPro, Inc.
    Inventor: Christophe Delachanal
  • Patent number: 10607651
    Abstract: Implementations are directed to providing a digital media editing environment for editing at least a portion of a digital video using a mobile device, establishing communication between the mobile device and a data source, receiving, from the data source, a first portion of the digital video, the first portion including a first set of frames including less than all frames of the digital video, applying an edit to the first portion of the digital video, while less than all frames of the first digital video are stored on the mobile device, subsequent to applying the at least one edit, receiving, from the data source, a second portion of the digital video, the second portion including a second set of frames, and storing an edited digital video including at least one frame of the first set of frames, at least one frame of the second set of frames, and the edit.
    Type: Grant
    Filed: October 16, 2018
    Date of Patent: March 31, 2020
    Assignee: GoPro, Inc.
    Inventors: Stephen Trey Moore, Ross Chinni, Devin McKaskle
  • Patent number: 10607313
    Abstract: Spherical visual content represented in an image space may be obtained. The spherical visual content may have been captured by image sensor(s) during a time duration. The spherical visual content may include phenomena caused by motion of the image sensor(s) and/or optical components that guide light onto the image sensor(s). A capture path taken by the image sensor(s) during the time duration may be determined. The capture path may reflect positions and orientations of the image sensor(s) during the time duration. A smoothed path may be determined based on the capture path. The smoothed path may have smoother changes in positions and/or orientations than the capture path. The image space may be warped based on a difference between the capture path and the smoothed path. The stabilized visual content may be determined by projecting the spherical visual content represented in the warped image space to a spherical projection space.
    Type: Grant
    Filed: March 19, 2018
    Date of Patent: March 31, 2020
    Assignee: GoPro, Inc.
    Inventor: Alexandre Jenny
  • Patent number: 10607649
    Abstract: Video information may define spherical video content having a duration. Spherical video content may define visual content viewable from a point of view as a function of progress through the spherical video content. Path information may define a path selection for the spherical video content. Path selection may include movement of a viewing window within the spherical video content. The viewing window may define extents of the visual content viewable from the point of view as the function of progress through the spherical video content. Time lapse parameter information may define at least two of a time portion of the duration, an image sampling rate, and a time lapse speed effect. A time lapse video may be generated based on the video information, the path information, and the time lapse parameter information.
    Type: Grant
    Filed: April 12, 2019
    Date of Patent: March 31, 2020
    Assignee: GoPro, Inc.
    Inventors: Nicholas Ryan Gilmour, Jessica Bonner
  • Patent number: 10609307
    Abstract: A processing device generates composite images from a sequence of images. The composite images may be used as frames of video. A foreground/background segmentation is performed at selected frames to extract a plurality of foreground object images depicting a foreground object at different locations as it moves across a scene. The foreground object images are stored to a foreground object list. The foreground object images in the foreground object list are overlaid onto subsequent video frames that follow the respective frames from which they were extracted, thereby generating a composite video.
    Type: Grant
    Filed: March 24, 2016
    Date of Patent: March 31, 2020
    Assignee: GoPro, Inc.
    Inventors: Balineedu Chowdary Adsumilli, Ryan Lustig
  • Patent number: 10600152
    Abstract: Images of a scene may be captured by a set of image capture devices. Overlapping areas of the images may be identified based on the topology of the set of image capture devices. Frontiers within the overlapping areas of the images may be identified based on borders of the images. Sample points for the images may be distributed along the frontiers. Warp parameters including an anti-symmetric warping portion and a symmetric warping portion may be determined at the sample points. Displacement values may be determined at the sample points based on the warp parameters. Warp maps for the images may be determined based on diffusion of the displacement values. Displacement maps for the images may be determined based on interpolation of the warp maps. The images may be modified based on the displacement maps.
    Type: Grant
    Filed: May 9, 2018
    Date of Patent: March 24, 2020
    Assignee: GoPro, Inc.
    Inventors: Adrien Fontvielle, Antoine Meler, Benoit Fouet, Claire Mathis, Denys Bulant, Emeric Grange, Hervé Bonaillie, Jerome Lehaire, Julien Morat, Martin Arnoux, Mickaël Heudre, Renan Coudray, Stéphane Gamet, Thomas Vuillermet
  • Patent number: 10599139
    Abstract: A first pattern associated with a performer may be recognized based upon visual information. A sensor carried by an unmanned aerial vehicle may be configured to generate output signals conveying the visual information. A first distance may be determined between the first pattern and the unmanned aerial vehicle. A second pattern associated with a performee may be recognized based upon the visual information. A second distance may be determined between the second pattern and the unmanned aerial vehicle. Flight control may be adjusted based upon the first distance and the second distance. A flight control subsystem may be configured to provide the flight control for the unmanned aerial vehicle.
    Type: Grant
    Filed: November 8, 2017
    Date of Patent: March 24, 2020
    Assignee: GoPro, Inc.
    Inventors: Pablo Lema, Shu Ching Ip
  • Patent number: 10602124
    Abstract: Apparatus and methods for providing a frame packing arrangement for the encoding/decoding of, for example, panoramic content. In one embodiment, the frame packing arrangement utilizes overlapping imaging data so as to enable, for example, a post-decode stitching operation to be performed. The frame packing arrangement may utilize a number of projection formats, such as a cubemap projection, and may utilize any number of differing aspect ratios such as, without limitation, 4×3, 3×2, 4×2, 2×4 aspect ratios. Additionally, the overlapping imaging data may be positioned within the frame packing arrangement chosen so as to improve upon coding efficiency. For example, the overlapping imaging data may be positioned within the frame packing arrangement so as to emphasize image continuity. An encoder apparatus and decoder apparatus for use with the aforementioned frame packing arrangements are also disclosed.
    Type: Grant
    Filed: July 19, 2017
    Date of Patent: March 24, 2020
    Assignee: GoPro, Inc.
    Inventors: Adeel Abbas, Timothy Macmillan
  • Patent number: 10599020
    Abstract: A swivel mount locking apparatus is configured to mount a camera system onto a target user, an object, or a surface. The camera system is mounted on a swivel component which can be rotated to a variety of different positions relative to a base component. To fix the camera position, a locking protrusion of a release lever in the base component is compressibly inserted into a detent located on the swivel component. When a new orientation of the camera system is desired, a user may forcibly pivot the release lever away from the swivel component to decouple the locking protrusion from the detent. The user can then rotate the mounted camera system and the swivel component to the new orientation relative to the base component. At the new orientation, the user may recouple the locking protrusion of the release lever into a different detent of the swivel component, thereby fixing the camera system into the desired, new orientation.
    Type: Grant
    Filed: January 16, 2018
    Date of Patent: March 24, 2020
    Assignee: GoPro, Inc.
    Inventors: Joshua Todd Druker, Christopher Aaron Clearman
  • Patent number: 10599145
    Abstract: Consumption information associated with a user consuming video segments may be obtained. The consumption information may define user engagement during a video segment and/or user response to the video segment. Sets of flight control settings associated with capture of the video segments may be obtained. The flight control settings may define aspects of a flight control subsystem for the unmanned aerial vehicle and/or a sensor control subsystem for the unmanned aerial vehicle. The preferences for the flight control settings of the unmanned aerial vehicle may be determined based upon the first set and the second set of flight control settings. Instructions may be transmitted to the unmanned aerial vehicle. The instructions may include the determined preferences for the flight control settings and being configured to cause the unmanned aerial vehicle to adjust the flight control settings to the determined preferences.
    Type: Grant
    Filed: December 4, 2017
    Date of Patent: March 24, 2020
    Assignee: GoPro, Inc.
    Inventors: Pablo Lema, Shu Ching Ip
  • Patent number: 10602191
    Abstract: Panoramic content may be characterized by a wide field of view and large image size. Panoramic image may be mapped to cube projection. When encoding/decoding cube-projected images, the disclosure exploits content continuity between cube facets. One facet may be encoded/decoded independently from other facets to obtain a seed facet. One or more transformed versions of the seed facet may be obtained, for example, one corresponding to a 90° counterclockwise rotation, another to a 90° clockwise rotation, and one to an 180° rotation. Transformed versions may be used to form an augmented image. The remained facets of the cube may be encoded using transformed versions within the augmented image. Boundary filtering may be applied to one or more edges of one or more facets.
    Type: Grant
    Filed: January 25, 2017
    Date of Patent: March 24, 2020
    Assignee: GoPro, Inc.
    Inventors: Adeel Abbas, David Newman
  • Patent number: 10593363
    Abstract: Video content may be captured by an image capture device during a capture duration. The video content may include video frames that define visual content viewable as a function of progress through a progress length of the video content. Rotational position information may characterize rotational positions of the image capture device during the capture duration. Time-lapse video frames may be determined from the video frames of the video content based on a spatiotemporal metric. The spatiotemporal metric may characterize spatial smoothness and temporal regularity of the time-lapse video frames. The spatial smoothness may be determined based on the rotational positions of the image capture device corresponding to the time-lapse video frames, and the temporal regularity may be determined based on moments corresponding to the time-lapse video frames. Time-lapse video content may be generated based on the time-lapse video frames.
    Type: Grant
    Filed: May 14, 2018
    Date of Patent: March 17, 2020
    Assignee: GoPro, Inc.
    Inventors: Thomas Derbanne, César Douady, Maxim Karpushin
  • Patent number: 10589860
    Abstract: An infrared (IR) emitter projects a spherical IR pattern. The IR emitter may include one or more IR lasers to produce two IR laser beams, two beam expanders, two diffraction screens to each produce diffracted radiation, a top wide angle lens, and a bottom wide angle lens. The wide angle lenses may each receive diffracted radiation from a respective one of the diffractions screens and may emit a spherical IR pattern including a plurality of longitudinal lines, each longitudinal line including a first portion of the spherical IR pattern emitted from the top wide angle lens and a second portion of the spherical IR pattern from the bottom wide angle lens. The IR emitter may be part of an object detection system in an aerial vehicle.
    Type: Grant
    Filed: May 23, 2017
    Date of Patent: March 17, 2020
    Assignee: GoPro, Inc.
    Inventors: Scott Patrick Campbell, Gary Fong
  • Patent number: 10587808
    Abstract: Images with an optical field of view are captured by an image capture device. An observed trajectory of the image capture device reflects the positions of the image capture device at different moments may be determined. A capture trajectory of the image capture device reflects virtual positions of the image capture device from which video content may be generated. The capture trajectory is determined based on a subsequent portion of the observed trajectory such that a portion of the capture trajectory corresponding to a portion of the observed trajectory is determined based on a subsequent portion of the observed trajectory. Orientations of punch-outs for the images are determined based on the capture trajectory. Video content is generated based on visual content of the images within the punch-outs.
    Type: Grant
    Filed: May 21, 2019
    Date of Patent: March 10, 2020
    Assignee: GoPro, Inc.
    Inventors: Thomas Derbanne, Cesar Douady, Maxim Karpushin
  • Patent number: 10587807
    Abstract: Images with an optical field of view may be captured by an image capture device. An observed trajectory of the image capture device reflecting the positions of the image capture device at different moments may be determined. A capture trajectory of the image capture device may be determined based on a subsequent portion of the observed trajectory such that a portion of the capture trajectory corresponding to the one portion of the observed trajectory may be determined based on a subsequent portion of the observed trajectory. Orientations of a capture field of view for the images with respect to the optical field of view of the images may be determined based on the capture trajectory. Video content may be generated based on visual content of the images within the capture field of view.
    Type: Grant
    Filed: May 23, 2018
    Date of Patent: March 10, 2020
    Assignee: GoPro, Inc.
    Inventors: Thomas Derbanne, César Douady, Maxim Karpushin
  • Patent number: 10587856
    Abstract: First visual information defining first spherical visual content, second visual information defining second spherical visual content, and/or other information may be obtained. Presentation of the first spherical visual content on a display may be effectuated. A spherical transition between the first spherical visual content and the second spherical visual content may be identified. The spherical transition may define a change in presentation of visual content on the display from the first spherical visual content to the second spherical visual content based on a transitional motion within a spherical space and/or other information. A change in presentation of the first spherical visual content on the display to presentation of the second visual content on the display may be effectuated based on the spherical transition and/or other information. The change may be determined based on the transition motion within the spherical space and/or other information.
    Type: Grant
    Filed: August 24, 2017
    Date of Patent: March 10, 2020
    Assignee: GoPro, Inc.
    Inventors: Adrien Fontvielle, Loïc Martin, Antoine Meler
  • Patent number: 10587855
    Abstract: Multiple punchouts of a video may be presented based on multiple viewing windows. The video may include visual content having a field of view. Multiple viewing windows may be determined for the video, with individual viewing window defining a set of extents of the visual content. Different punchouts of the visual content may be presented based on the different viewing windows. Individual punchout of the visual content may include the set of extents of the visual content defined by corresponding viewing window.
    Type: Grant
    Filed: December 20, 2018
    Date of Patent: March 10, 2020
    Assignee: GoPro, Inc.
    Inventors: Anandhakumar Chinnaiyan, Ravi Kumar Belagutti Shivanandappa, Jonathan Leland Thorn, Nicholas Ryan Gilmour, Clark Weber
  • Patent number: D880561
    Type: Grant
    Filed: October 30, 2019
    Date of Patent: April 7, 2020
    Assignee: GoPro, Inc.
    Inventors: John George Muhlenkamp, IV, Huy Phuong Nguyen
  • Patent number: D880570
    Type: Grant
    Filed: December 19, 2018
    Date of Patent: April 7, 2020
    Assignee: GoPro, Inc.
    Inventors: Senka Agic Bergman, Arthur Charles Kwun, Huy Phuong Nguyen, Eric McCallister Bennett, Nicholas D. Woodman, Joshua T. Druker, Travis Pynn
  • Patent number: D880571
    Type: Grant
    Filed: July 30, 2019
    Date of Patent: April 7, 2020
    Assignee: GoPro, Inc.
    Inventors: Ryan Harrison, Ross Thayer, Arthur Kwun, Mark Costa
  • Patent number: D881974
    Type: Grant
    Filed: November 20, 2017
    Date of Patent: April 21, 2020
    Assignee: GoPro, Inc.
    Inventors: Huy Phuong Nguyen, Richard Gioscia, Quinn Jerome Odette Fitzgerald, William Duncan Webb, II
  • Patent number: D884718
    Type: Grant
    Filed: September 18, 2017
    Date of Patent: May 19, 2020
    Assignee: GoPro, Inc.
    Inventors: Lou Fillingham, Grant McCauley, Stephen Yui