GoPro Patents

GoPro, Inc. manufactures and sells their HERO line of cameras that enable athletes to self-capture their activities, as well as manage and share their photos and videos.

GoPro Patents by Type

  • GoPro Patents Granted: GoPro patents that have been granted by the United States Patent and Trademark Office (USPTO).
  • GoPro Patent Applications: GoPro patent applications that are pending before the United States Patent and Trademark Office (USPTO).
  • Patent number: 10051206
    Abstract: A processing device generates composite images from a sequence of images. The composite images may be used as frames of video. A foreground/background segmentation is performed at selected frames to extract a plurality of foreground object images depicting a foreground object at different locations as it moves across a scene. The foreground object images are stored to a foreground object list. The foreground object images in the foreground object list are overlaid onto subsequent video frames that follow the respective frames from which they were extracted, thereby generating a composite video.
    Type: Grant
    Filed: March 24, 2016
    Date of Patent: August 14, 2018
    Assignee: GOPRO, INC.
    Inventors: Balineedu Chowdary Adsumilli, Ryan Lustig
  • Patent number: 10051363
    Abstract: A camera system with image and audio capture capabilities is configured to protect the internal audio components from the external environment. The camera system includes an internal audio assembly with a microphone and an audio circuit board. The audio circuit board is structured such that a gap exists within the board that allows transmission of sound waves from external the environment to the microphone. The audio assembly also includes a compressible annulus, a support annulus, and a waterproof membrane coupled buy a support structure. The waterproof membrane protects the internal components from moisture while still allowing transmission of sound waves. The support structure, compressible annulus, support annulus, and audio circuit board are structured such that a gap exists above the microphone and underneath the waterproof membrane.
    Type: Grant
    Filed: August 24, 2017
    Date of Patent: August 14, 2018
    Assignee: GoPro, Inc.
    Inventor: Joshua Randall Clyne
  • Patent number: 10043237
    Abstract: Hyper-hemispherical images may be combined to generate a rectangular projection of a spherical image having an equatorial stitch line along of a line of lowest distortion in the two images. First and second circular images are received representing respective hyper-hemispherical fields of view. A video processing device may project each circular image to a respective rectangular image by mapping an outer edge of the circular image to a first edge of the rectangular image and mapping a center point of the circular image to a second edge of the first rectangular image. The rectangular images may be stitched together along the edges corresponding to the outer edge of the original circular image.
    Type: Grant
    Filed: August 11, 2016
    Date of Patent: August 7, 2018
    Assignee: GOPRO, INC.
    Inventors: Joseph Steel, Timothy Macmillan
  • Patent number: 10043552
    Abstract: Visual information defining the video content may be accessed. The video content may have a progress length. Presentation information for the video content may be accessed. The presentation information may define one or more viewing options for the video content. The one or more viewing options may include one or more viewing directions as a function of progress through the video content. One or more thumbnails for the video content may be generated based on the one or more viewing options for the video content.
    Type: Grant
    Filed: October 8, 2016
    Date of Patent: August 7, 2018
    Assignee: GoPro, Inc.
    Inventor: Loïc Martin
  • Patent number: 10044899
    Abstract: Systems and methods are disclosed that capture and compress frames of pixel data. In an implementation, an image sensor chip converts light into pixel data and generates transform data by applying a transform to a portion of the pixel data associated with a pixel category from a plurality of pixel categories and generates compressed pixel data at a variable compression rate by compressing the transform data. The variable compression rate is within an available bandwidth of an output bus that outputs the compressed pixel data.
    Type: Grant
    Filed: February 28, 2017
    Date of Patent: August 7, 2018
    Assignee: GoPro, Inc.
    Inventors: Scott Patrick Campbell, David A. Newman, Brian G. Schunck
  • Patent number: 10043536
    Abstract: Multiple audio files may be synchronized using energy vectors produced from energy portions of individual frequency energy representations. Individual energy samples and time values of individual energy vectors may be compared using a multi-resolution framework to correlate energy samples and time values of multiple audio tracks to one another.
    Type: Grant
    Filed: July 3, 2017
    Date of Patent: August 7, 2018
    Assignee: GoPro, Inc.
    Inventor: David Tcheng
  • Patent number: 10044972
    Abstract: Systems and methods to automatically transfer audiovisual content include camera devices, client computing devices, and centralized servers. A camera device captures audiovisual content and notifies an external entity, e.g., a (client) computing device or a centralized server. The external entity may effectuate transfer of the content to other computing devices and/or destinations. Operations on the audiovisual content, including but not limited to tagging, transcoding, clipping, speed changes, and/or image cropping, are synchronized and propagated across different computing devices and the centralized server such that any user from any computing device can be presented with the latest version of any particular audiovisual content.
    Type: Grant
    Filed: September 30, 2016
    Date of Patent: August 7, 2018
    Assignee: GoPro, Inc.
    Inventors: Gregory Herd, Jeffrey Youel, Otto Sievert
  • Patent number: 10044944
    Abstract: A processing device generates composite images from a sequence of images. The composite images may be used as frames of video. A foreground/background segmentation is performed at selected frames to extract a plurality of foreground object images depicting a foreground object at different locations as it moves across a scene. The foreground object images are stored to a foreground object list. The foreground object images in the foreground object list are overlaid onto subsequent video frames that follow the respective frames from which they were extracted, thereby generating a composite video.
    Type: Grant
    Filed: March 24, 2016
    Date of Patent: August 7, 2018
    Assignee: GOPRO, INC.
    Inventors: Balineedu Chowdary Adsumilli, Ryan Lustig
  • Patent number: 10045120
    Abstract: Disclosed is a system and method for generating a model of the geometric relationships between various audio sources recorded by a multi-camera system. The spatial audio scene module associates source signals, extracted from recorded audio, of audio sources to visual objects identified in videos recorded by one or more cameras. This association may be based on estimated positions of the audio sources based on relative signal gains and delays of the source signal received at each microphone. The estimated positions of audio sources are tracked indirectly by tracking the associated visual objects with computer vision. A virtual microphone module may receive a position for a virtual microphone and synthesize a signal corresponding to the virtual microphone position based on the estimated positions of the audio sources.
    Type: Grant
    Filed: June 20, 2016
    Date of Patent: August 7, 2018
    Assignee: GoPro, Inc.
    Inventors: Balineedu Chowdary Adsumilli, Timothy Macmillan
  • Patent number: 10031396
    Abstract: A camera system includes an image sensor assembly and a tunable optical element. The tunable optical element is a polymer dispersed liquid crystal lens doublet using a PDLC layer. The doublet is tunable by applying an electric field to the optical element via a control element. The control element applies a voltage differential to the optical element inducing an electric field which changes the polarization of the PDLC within the optical element. The refractive index of the lens doublet is dependent on the polarization of the liquid crystals within the optical element. Applying the electric field to the tunable element changes the optical properties of the lens doublet.
    Type: Grant
    Filed: May 23, 2017
    Date of Patent: July 24, 2018
    Assignee: GoPro, Inc.
    Inventor: Scott Patrick Campbell
  • Patent number: 10033928
    Abstract: Images may be obtained using a moving camera comprised of two or more rigidly mounted image sensors. Camera motion may change camera orientation when different portions of an image are captured. Pixel acquisition time may be determined based on image exposure duration and position of the pixel in the image array (pixel row index). Orientation of the sensor may at the pixel acquisition time instance may be determined. Image transformation may be performed wherein a given portion of the image may be associated with a respective transformation characterized by the corrected sensor orientation. In some implementations of panoramic image acquisition, multiple source images may be transformed to, e.g., equirectangular plane, using sensor orientation that is corrected for the time of pixel acquisition. Use of orientation correction may improve quality of stitching by, e.g., reducing contrast of border areas between portions of the transformed image obtained by different image sensors.
    Type: Grant
    Filed: October 29, 2015
    Date of Patent: July 24, 2018
    Assignee: GoPro, Inc.
    Inventor: Antoine Meler
  • Patent number: 10031314
    Abstract: To compensate for a focal plane shifting away from an image plane due to a temperature change, an integrated image sensor and lens assembly includes an optical component and an optics compensator including passively actuating elements. The passively actuating elements couple the optical component to the inner surface of the lens mount. The passively actuating elements and the optics component are configured such that the focal plane is maintained to coincide with or substantially coincide with the image plane. The passively actuating elements and the optics component adjust the distance an incident ray travels in the optics compensator when the temperature changes to thereby maintaining the focal plane to coincide with or substantially coincide with the image plane.
    Type: Grant
    Filed: April 24, 2017
    Date of Patent: July 24, 2018
    Assignee: GoPro, Inc.
    Inventor: Scott Patrick Campbell
  • Patent number: 10033915
    Abstract: A peripheral device (e.g., a small wearable device) may operate in conjunction with a camera to enable in-the-moment capture and control. The peripheral device may receive voice commands and uses voice recognition to generate a control signal to control the camera, thereby enabling users to freely participate in their activities while seamlessly controlling the camera in a hands-free manner. Additionally, the peripheral device may operate as a wireless microphone source to capture high quality audio for instead of or in addition to audio captured by the camera. This may provide improved audio quality in certain operating conditions such as during narrating and interviewing.
    Type: Grant
    Filed: August 18, 2017
    Date of Patent: July 24, 2018
    Assignee: GoPro, Inc.
    Inventors: Lisa Boghosian, Jesse Baker
  • Patent number: 10025166
    Abstract: A camera mount for coupling a camera to a user's wrist is described. The camera mount includes a swivel component that rotates relative to a wrist component when an above-threshold amount of force is applied on the swivel component. A rippled spring component is coupled between the swivel component and the wrist component, and exerts an outward force upon the swivel component in response to a compressive force exerted on the rippled spring component by the swivel component. A strap couples to each of two sides of the wrist mount component, and is configured to secure the camera mount to the user's wrist. The camera mount can additionally include a base component and a padding component, and a screw to couple each camera mount component together.
    Type: Grant
    Filed: December 13, 2016
    Date of Patent: July 17, 2018
    Assignee: GoPro, Inc.
    Inventor: Christopher Aaron Clearman
  • Patent number: 10021286
    Abstract: A method and device are provided for positioning a mounted camera. The device includes a holding element that secures the mounted camera to the device, a wireless linkage at which remote attitude commands representing attitude changes of a remote driver are received, a local controller that interprets the remote attitude commands and generates local attitude commands that move the camera to mimic an orientation of the remote driver, and an attitude sensing element that senses a local attitude of the device. The attitude sensing element includes a gyro, an accelerometer, or a magnetometer, and jitter present in the remote attitude commands is removed and not passed on to the local attitude commands.
    Type: Grant
    Filed: July 22, 2016
    Date of Patent: July 10, 2018
    Assignee: GoPro, Inc.
    Inventors: JoeBen Bevirt, Josh Guyot
  • Patent number: 10015469
    Abstract: Blurring is simulated in post-processing for captured images. A 3D image is received from a 3D camera, and depth information in the 3D image is used to determine the relative distances of objects in the image. One object is chosen as the subject of the image, and an additional object in the image is identified. Image blur is applied to the identified additional object based on the distance between the 3D camera and the subject object, the distance between the subject object and the additional object, and a virtual focal length and virtual f-number.
    Type: Grant
    Filed: October 5, 2015
    Date of Patent: July 3, 2018
    Assignee: GoPro, Inc.
    Inventors: Scott Patrick Campbell, Balineedu Chowdary Adsumilli
  • Patent number: 10015369
    Abstract: Timing metadata is generated and added to captured video to compensate for synchronization error between video captured concurrently from multiple cameras. A wireless beacon including timer data is transmitted from an access point to each station camera. A radio circuit of the station camera synchronizes to the timer of the access point based on timing information in the wireless beacon. An image processor in each station camera includes an image processor timer separate from the radio circuit timer. During video capture, timing metrics are generated indicating deviation between the image processor timer and the radio circuit timer. The timing metrics are stored as metadata and can be used to compensate for synchronization error in post-processing.
    Type: Grant
    Filed: May 4, 2016
    Date of Patent: July 3, 2018
    Assignee: GOPRO, INC.
    Inventors: David A. Boone, Bich Nguyen, Pavan Kumar
  • Patent number: 10011354
    Abstract: Vehicles such as unmanned air vehicles that are capable of movement from an open, flight configuration to an enclosed configuration in which all major flight components can be protected by an outer shell are disclosed. In the enclosed configuration, the vehicles can take on standard geometric shapes such as a rectangular prism, sphere, cylinder, or another shape, so as to not be recognizable as an unmanned air vehicle. Embodiments of vehicles can also include interchangeable and/or wireless motor arms, motor arms which are electrically connected to the remainder of the vehicle only when in an open configuration, remote controllers removably attached to the remainder of the vehicle, and clip or other attachment mechanisms for attachment to objects such as backpacks.
    Type: Grant
    Filed: December 17, 2015
    Date of Patent: July 3, 2018
    Assignee: GoPro, Inc.
    Inventor: Ryan Michael Goldstein
  • Patent number: 10015413
    Abstract: A camera system captures an image in a source aspect ratio and applies a transformation to the input image to scale and warp the image to generate an output image having a target aspect ratio different than the source aspect ratio. The output image has the same field of view as the input image, maintains image resolution, and limits distortion to levels that do not substantially affect the viewing experience. In one embodiment, the output image is non-linearly warped relative to the input image such that a distortion in the output image relative to the input image is greater in a corner region of the output image than a center region of the output image.
    Type: Grant
    Filed: April 20, 2017
    Date of Patent: July 3, 2018
    Assignee: GoPro, Inc.
    Inventors: Nicholas D. Woodman, Sumit Chawla, Loic Segapelli, Scott Patrick Campbell
  • Patent number: 10007967
    Abstract: A system access a reference frame and temporally adjacent frames. For each portion of the reference image frame, the system calculates a pixel distance value between the portion of the reference image frame and a corresponding portion of each temporally adjacent image frame. If the pixel distance value indicates a potential ghosting artifact, the system computes a set of spatial noise reduction values for the image portion. Otherwise, the system computes a set of temporal noise reduction values for the image portion. The system blends the sets of computed spatial noise reduction values and the sets of computed temporal noise reduction values, and generates a modified reference image frame based on the blended set of noise reduction values.
    Type: Grant
    Filed: March 25, 2016
    Date of Patent: June 26, 2018
    Assignee: GoPro, Inc.
    Inventors: Bruno Cesar Douady-Pleven, Michael Serge André Kraak, Guillaume Matthieu Guerin, Thomas Nicolas Emmanuel Veit
  • Patent number: 10003768
    Abstract: Apparatus and methods for the generation of interpolated frames of video data. In one embodiment, a computerized apparatus is disclosed that includes a video data interface configured to receive frames of video data; a processing apparatus in data communication with the video data interface; and a storage apparatus in data communication with the processing apparatus. The computerized apparatus is further configured to: receive frames of captured video data; retrieve capture parameters associated with the frames of captured video data; generate optical flow parameters from the frames of captured video data; ascribe differing weights based on the capture parameters and/or the optical flow parameters; generate frames of interpolated video data for the frames of captured video data based at least in part on the ascribed weights; and compile a resultant video stream using the frames of interpolated video data and the frames of captured video data.
    Type: Grant
    Filed: September 28, 2016
    Date of Patent: June 19, 2018
    Assignee: GOPRO, INC.
    Inventors: Balineedu Chowdary Adsumilli, Ryan Lustig
  • Patent number: 10002641
    Abstract: A system and/or method configured to determine highlight segment sets. Content files that define content in content segment sets may be obtained. Individual highlight segment sets of content segments may be determined from the content segment sets. Determining a first highlight segment set of content segments included in the first content segment may include iterating (a)-(c) for multiple iterations. At (a), individual content segments included in the first content segment set may be selected as a selected content segment for inclusion in the first highlight segment set. At, (b) diversity scores for content segments that are (i) included in the first content segment set and (ii) not yet selected for inclusion in the first highlight segment set may be determined. At (c), one or more of the content segments may be disqualified for inclusion in the first highlight segment set for future iterations based on the diversity scores.
    Type: Grant
    Filed: October 17, 2016
    Date of Patent: June 19, 2018
    Assignee: GoPro, Inc.
    Inventors: Desmond Chik, Daniel Tse, Jonathan Wills
  • Patent number: 9998681
    Abstract: Disclosed is an electronically controlled camera iris device. The camera iris device may include a transparent conductor layer supplying an input voltage controlling the diameter of the aperture, a transparent resistance layer providing different voltages in different regions varying based on the distance from a center point, and a diaphragm layer that can be independently controlled in different regions to block or transmit light incident on the diaphragm layer when corresponding control voltages are applied on the diaphragm layer. The camera iris device can be configured to have a desired diameter by controlling a first region of the diaphragm layer to transmit the light and a second region of the diaphragm layer outside of the first region to block the light. The diaphragm layer may include a Bragg grating layer or an Electrochromic layer.
    Type: Grant
    Filed: June 28, 2016
    Date of Patent: June 12, 2018
    Assignee: GoPro, Inc.
    Inventors: Scott Patrick Campbell, Leo Baldwin
  • Patent number: 9995990
    Abstract: A camera is configured for use with a removable camera lens cover, which can be secured to or removed from the camera by a user without the use of a tool set. The mechanism which allows the lens cover to be secured to and removed from the camera includes a set of wires embedded into the lens cover and a set of wedges protruding from the lens wall of the camera. To secure the lens cover to the camera, the lens cover is placed onto the front of the camera and rotated until the wires align with corresponding wedges, securing the wires underneath the tapered surface of the wedges. To remove the lens cover from the camera, a force is applied outward and normal to the lens cover, causing the wires to flex outward and enabling the rotation and removal of the lens cover from the camera.
    Type: Grant
    Filed: December 15, 2015
    Date of Patent: June 12, 2018
    Assignee: GoPro, Inc.
    Inventors: Way Chet Lim, Andrew Liu, Margaret Birmingham Mittan, Daniel Lee Sobel
  • Patent number: 9998769
    Abstract: Multiple videos having individual time durations may be obtained, including a first video with a first time duration. The videos may include visual information defined by one or more electronic media files. An initial portion of the first time duration where the one or more electronic media are to be transcoded may be determined, including identifying a first moment of interest within the first video, associating the first moment of interest with a first portion of the first video having a first portion time duration, and determining the initial portion to be the first portion time duration. One or more transcoded media files may be generated during the initial portion. A request for the first video may be received from a client computing platform. In response to receipt of the request, the one or more transcoded media files may be transmitted to the client computing platform for display.
    Type: Grant
    Filed: June 15, 2016
    Date of Patent: June 12, 2018
    Assignee: GoPro, Inc.
    Inventor: Cedric Fernandes
  • Patent number: 9996750
    Abstract: Video and corresponding metadata is accessed. Events of interest within the video are identified based on the corresponding metadata, and best scenes are identified based on the identified events of interest. Events of interest can be tagged within the video based on, for instance, user input, audio signals, motion vectors, and metadata corresponding to the video. A camera system can process video data based on the events of interest tagged within the video before outputting the video data. For instance, video scenes associated with tagged events of interest can be combined to form a video highlight clip. Likewise, portions of video tagged with events of interest can be encoded or stored at a higher resolution or frame rate than other portions of the video.
    Type: Grant
    Filed: June 1, 2016
    Date of Patent: June 12, 2018
    Assignee: GoPro, Inc.
    Inventor: Scott Patrick Campbell
  • Patent number: 9992394
    Abstract: Dual-lens assemblies and cameras including dual lens-assemblies that include a first lens barrel securing a first lens having a first optical axis and a second lens barrel securing a second lens having a second optical axis are disclosed. In one dual-lens assembly, the first optical axis is approximately parallel to and spaced from the second optical axis by a lateral offset, axial lengths of the first lens barrel and the second lens barrel are approximately equal, and the first lens and the second lens are oriented in opposite directions at opposing ends of the first lens barrel and the second lens barrel.
    Type: Grant
    Filed: December 30, 2016
    Date of Patent: June 5, 2018
    Assignee: GoPro, Inc.
    Inventors: Adeel Abbas, Joshua P. Davies, William H. Tolbert
  • Patent number: 9992502
    Abstract: Apparatus and methods for digital video data compression via a scalable, multi-resolution approach. In one embodiment, the video content may be encoded using a multi-resolution and/or multi-quality scalable coding approach that reduces computational and/or energy load on a client device. In one implementation, a low fidelity image is obtained based on a first full resolution image. The low fidelity image may be encoded to obtain a low fidelity bitstream. A second full resolution image may be obtained based on the low fidelity bitstream. A portion of a difference image obtained based on the second full resolution image and the first full resolution may be encoded to obtain a high fidelity bitstream. The low fidelity bitstream and the high fidelity bitstream may be provided to e.g., a receiving device.
    Type: Grant
    Filed: August 29, 2016
    Date of Patent: June 5, 2018
    Assignee: GOPRO, INC.
    Inventors: Adeel Abbas, Balineedu Chowdary Adsumilli, David Newman
  • Patent number: 9984293
    Abstract: Video and corresponding metadata is accessed. Events of interest within the video are identified based on the corresponding metadata, and best scenes are identified based on the identified events of interest. A video summary can be generated including one or more of the identified best scenes. The video summary can be generated using a video summary template with slots corresponding to video clips selected from among sets of candidate video clips. Best scenes can also be identified by receiving an indication of an event of interest within video from a user during the capture of the video. Metadata patterns representing activities identified within video clips can be identified within other videos, which can subsequently be associated with the identified activities.
    Type: Grant
    Filed: October 13, 2014
    Date of Patent: May 29, 2018
    Assignee: GoPro, Inc.
    Inventors: Nick Hodulik, Jonathan Taylor
  • Patent number: 9984672
    Abstract: A noise cancellation system for an unmanned aerial vehicle may have an audio capture module, a metadata module and a filter. The audio capture module may be configured to receive an audio signal captured from a microphone, e.g., on a camera. The metadata module may be configured to retrieve noise information associated with noise generating components operating on the unmanned aerial vehicle (UAV). The filter may be configured to receive the audio signal and noise information from the audio capture module. The filter also may be configured to retrieve a baseline profile from a database based on the noise information. The baseline profile includes noise parameter to filter out audio frequencies from the audio signal corresponding to the noise generating component. The filter may generate a filtered audio signal for output.
    Type: Grant
    Filed: September 15, 2016
    Date of Patent: May 29, 2018
    Assignee: GoPro, Inc.
    Inventor: Gary Fong
  • Patent number: 9977226
    Abstract: A spherical camera includes two oppositely-oriented lenses rigidly secured by a unibody dual-lens mount. The unibody dual-lens mount includes two lens barrel that are laterally offset from each other. Each lens barrel secures a lens and has a top, a midsection and a bottom along its axial length, where the midsection is located between the top and the bottom. A first base portion extends radially outward from the bottom of a first lens barrel to join the midsection of a second lens barrel. A second base portion extends radially outward from a bottom of the second lens barrel to join a midsection of the first lens barrel. The base portions may be approximately perpendicular to central axes of the lens barrels. Additionally, the first lens barrel can be approximately parallel to the second lens barrel, and the first base portion can be approximately parallel to the second base portion.
    Type: Grant
    Filed: March 1, 2016
    Date of Patent: May 22, 2018
    Assignee: GoPro, Inc.
    Inventors: Joshua P. Davies, William H. Tolbert
  • Patent number: 9973696
    Abstract: Multiple images may be combined to obtain a composite image. Individual images may be obtained with different camera sensors and/or at different time instances. In order to obtain the composite image source images may be aligned in order to produce a seamless stitch. Source images may be characterized by a region of overlap. A disparity measure may be determined for pixels along a border region between the source images. A warp transformation may be determined using a refinement process configured to determine displacement of pixels of the border region based on the disparity. Pixel displacement at a given location may be constrained to direction configured tangential to an epipolar line corresponding to the location. The warp transformation may be propagated to pixels of the image. Spatial and/or temporal smoothing may be applied. In order to obtain refined solution, the warp transformation may be determined at multiple spatial scales.
    Type: Grant
    Filed: September 12, 2016
    Date of Patent: May 15, 2018
    Assignee: GoPro, Inc.
    Inventors: Antoine Meler, Thomas Derbanne
  • Patent number: 9973746
    Abstract: Systems and methods for presenting and viewing a spherical video segment is provided. The spherical video segment including tag information associated with an event of interest may be obtained. The tag information may identify a point in time and a viewing angle at which the event of interest is viewable in the spherical video segment. An orientation of a two dimensional display may be determined based upon output signals of a sensor. A display field of view within the spherical video segment may be determined and presented on the display based upon the orientation of the display. The display field of view may be captured as a two dimensional video segment. If the viewing angle of the event of interest is outside the display field of view proximate the point in time, a notification may be presented within the display field of view.
    Type: Grant
    Filed: February 17, 2016
    Date of Patent: May 15, 2018
    Assignee: GoPro, Inc.
    Inventors: Joven Matias, David Newman, Ha Phan, Timothy Bucklin, Daryl Stimm
  • Patent number: 9973695
    Abstract: A first image sensor may generate images capturing a first portion of a capture field. The capture of images by the first image sensor may be characterized by a first rolling shutter direction. A second image sensor may generate images capturing a second portion of the capture field. The capture of images by the second image sensor may be characterized by a second rolling shutter direction. The first portion may be adjacent to the second portion. The first rolling shutter direction may be parallel to and the same as the second rolling shutter direction. A first image may be obtained from the first image sensor. A second image may be obtained from the second image sensor. A stitched image may be generated based on the first image and the second image.
    Type: Grant
    Filed: July 29, 2016
    Date of Patent: May 15, 2018
    Assignee: GoPro, Inc.
    Inventors: Antoine Méler, Martin Arnoux
  • Patent number: 9973792
    Abstract: A first and second video segment may be obtained. A second video segment may be obtained. A first and second set of contextual information associated with the first and second video segments may be obtained. The first set of contextual information defining a first set of performance information characterizing performance of a first activity associated with the first video segment and the second set of contextual information defining a second set of performance information characterizing performance of a second activity associated with the second video segment. The first set of performance information and the second set of performance information may be compared. Relative performance of the first activity relative to the second activity may be determined based upon the comparison. Visual information associated with the first video segment may be generated. The visual information may be presented during presentation of the first video segment.
    Type: Grant
    Filed: October 27, 2016
    Date of Patent: May 15, 2018
    Assignee: GoPro, Inc.
    Inventor: Christophe Delachanal
  • Patent number: 9972294
    Abstract: Multiple audio files may be synchronized using harmonic sound included in audio content obtained from audio tracks. Individual audio tracks are partitioned into multiple temporal windows of a first and second temporal window length. Individual audio waveforms for individual temporal windows of the first and second window length are transformed into frequency space in which energy is represented as a function of frequency. Individual pitches and magnitudes of harmonic sound determined for individual temporal windows may be compared using a multi-resolution framework to correlate pitches and harmonic energy of multiple audio tracks to one another.
    Type: Grant
    Filed: March 14, 2017
    Date of Patent: May 15, 2018
    Assignee: GoPro, Inc.
    Inventor: David Tcheng
  • Patent number: 9972066
    Abstract: Variable image projection for spherical visual content may be provided by obtaining visual information defining an image of the spherical visual content and a field of view for the spherical visual content. A location of a projection point may be determined based on the field of view. A two-dimensional projection of the spherical visual content may be determined by projecting pixels of the image within the field of view to the two-dimensional projection plane. Individuals pixels of the image may be projected along individual projection lines including the projection point and the individual pixel. Presentation of the two-dimensional projection of the spherical visual content may be effectuated.
    Type: Grant
    Filed: March 16, 2016
    Date of Patent: May 15, 2018
    Assignee: GoPro, Inc.
    Inventor: Yann Gilquin
  • Patent number: 9965703
    Abstract: An algorithm for performing an image or video processing task is generated that may be used to combine a plurality of different independent solutions to the image or video processing task in an optimized manner. A plurality of base algorithms may be applied to a training set of images or video and a first generation of different combining algorithms may be applied to combine the respective solutions from each of the respective base algorithms into respective combined solutions. The respective combined solutions may be evaluated to generate respective fitness scores representing measures of how well the plurality of different combining algorithms each perform the image or video processing task. The algorithms may be iteratively updated to generate an optimized combining algorithm that may be applied to an input image or video.
    Type: Grant
    Filed: June 8, 2016
    Date of Patent: May 8, 2018
    Assignee: GoPro, Inc.
    Inventors: Balineedu Chowdary Adsumilli, Ryan Lustig
  • Patent number: 9967580
    Abstract: A system and method disposed to enable encoding, decoding and manipulation of digital video with substantially less processing load than would otherwise required. In particular, one disclosed method is directed to generating a compressed video data structure that is selectively decodable to a plurality of resolutions including the full resolution of the uncompressed stream. The desired number of data components and the content of the data components that make up the compressed video data, which determine the available video resolutions, are variable based upon the processing carried out and the resources available to decode and process the data components. During decoding, efficiency is substantially improved because only the data components necessary to generate a desired resolution are decoded. In variations, both temporal and spatial decoding are utilized to reduce frame rates, and hence, further reduce processor load. The system and method are particularly useful for real-time video editing applications.
    Type: Grant
    Filed: November 17, 2016
    Date of Patent: May 8, 2018
    Assignee: GOPRO, INC.
    Inventors: David A. Newman, Brian G. Schunck
  • Patent number: 9966108
    Abstract: A playback speed effect is applied to a video using a playback speed template. The playback speed template specifies playback speed ratios (i.e., ratios between playback duration and capture duration) at the highlight moment, at a template start time, and at a template end time. A video associated with a highlight tag indicating a highlight capture time of a highlight moment within the video is accessed. An input portion of the video including the highlight moment is identified. The duration of the input portion has a duration depending on the template start time and the template end time. A playback speed template is applied to the input portion. A modified video including a modified video portion is generated from the input portion of the video according to the applied playback speed template and is provided for subsequent playback.
    Type: Grant
    Filed: March 14, 2017
    Date of Patent: May 8, 2018
    Assignee: GoPro, Inc.
    Inventors: Joven Michael Matias, Otto Kenneth Sievert, Joshua Edward Bodinet
  • Patent number: D818966
    Type: Grant
    Filed: September 16, 2016
    Date of Patent: May 29, 2018
    Assignee: GoPro, Inc.
    Inventors: Michael Paterson, Huy Phuong Nguyen, Ryan Harrison
  • Patent number: D819116
    Type: Grant
    Filed: February 15, 2017
    Date of Patent: May 29, 2018
    Assignee: GoPro, Inc.
    Inventor: Michael Paterson
  • Patent number: D819117
    Type: Grant
    Filed: February 16, 2017
    Date of Patent: May 29, 2018
    Assignee: GoPro, Inc.
    Inventors: Seung Heon Lee, Ryan Harrison
  • Patent number: D819118
    Type: Grant
    Filed: December 20, 2016
    Date of Patent: May 29, 2018
    Assignee: GoPro, Inc.
    Inventors: John George Muhlenkamp, IV, Mark E. Costa, Ryan Harrison, Theresa Loney Casarez
  • Patent number: D819328
    Type: Grant
    Filed: February 28, 2017
    Date of Patent: June 5, 2018
    Assignee: GoPro, Inc.
    Inventor: John George Muhlenkamp, IV
  • Patent number: D821480
    Type: Grant
    Filed: September 10, 2015
    Date of Patent: June 26, 2018
    Assignee: GoPro, Inc.
    Inventors: Richard Gioscia, Seungheon Lee, Derek Yap, Evan L. Coons, Joshua P. Davies
  • Patent number: D821481
    Type: Grant
    Filed: December 20, 2016
    Date of Patent: June 26, 2018
    Assignee: GoPro, Inc.
    Inventors: Richard Gioscia, Seung Heon Lee, Derek Yap, Evan L. Coons, Joshua P. Davies
  • Patent number: D821482
    Type: Grant
    Filed: April 13, 2016
    Date of Patent: June 26, 2018
    Assignee: GoPro, Inc.
    Inventors: Charles Bacon, Adam Thomas Blumer
  • Patent number: D821483
    Type: Grant
    Filed: July 26, 2016
    Date of Patent: June 26, 2018
    Assignee: GoPro, Inc.
    Inventors: Nicholas Vitale, Michael Paterson
  • Patent number: D822092
    Type: Grant
    Filed: March 7, 2017
    Date of Patent: July 3, 2018
    Assignee: GoPro, Inc.
    Inventors: Senka Agic Bergman, Nicholas Vitale, Erik Jorgensen