GoPro Patents

GoPro, Inc. manufactures and sells their HERO line of cameras that enable athletes to self-capture their activities, as well as manage and share their photos and videos.

GoPro Patents by Type

  • GoPro Patents Granted: GoPro patents that have been granted by the United States Patent and Trademark Office (USPTO).
  • GoPro Patent Applications: GoPro patent applications that are pending before the United States Patent and Trademark Office (USPTO).
  • Patent number: 10212438
    Abstract: Apparatus and methods for digital video data compression via a scalable, multi-resolution approach. In one embodiment, the video content may be encoded using a multi-resolution and/or multi-quality scalable coding approach that reduces computational and/or energy load on a client device. In one implementation, a low fidelity image is obtained based on a first full resolution image. The low fidelity image may be encoded to obtain a low fidelity bitstream. A second full resolution image may be obtained based on the low fidelity bitstream. A portion of a difference image obtained based on the second full resolution image and the first full resolution may be encoded to obtain a high fidelity bitstream. The low fidelity bitstream and the high fidelity bitstream may be provided to e.g., a receiving device.
    Type: Grant
    Filed: October 31, 2017
    Date of Patent: February 19, 2019
    Assignee: GoPro, Inc.
    Inventors: Adeel Abbas, Balineedu Chowdary Adsumilli, David Newman
  • Patent number: 10212352
    Abstract: A method is described to greatly improve the efficiency of and reduce the complexity of image compression when using single-sensor color imagers for video acquisition. The method in addition allows for this new image compression type to be compatible with existing video processing tools, improving the workflow for film and television production.
    Type: Grant
    Filed: July 19, 2017
    Date of Patent: February 19, 2019
    Assignee: GoPro, Inc.
    Inventor: David A. Newman
  • Patent number: 10203588
    Abstract: A camera system with six faces and a front housing is configured to capture images and audio content from external the camera body. The camera system includes an interior audio assembly protected from external environments by a waterproof membrane. The camera system includes drainage ports on the bottom face and the left face of the camera system to encourage moisture to drain from the system. A first drainage channel couples the internal audio assembly to the first drainage port on left face of the camera system and a second drainage channel couples the drainage port on the left face of the camera system to the drainage port on the bottom face of the camera system. A third drainage channel exists between the front face of the camera system and the front housing, the third drainage channel coupling the first and second drainage channels.
    Type: Grant
    Filed: September 14, 2017
    Date of Patent: February 12, 2019
    Assignee: GoPro, Inc.
    Inventor: Joshua Randall Clyne
  • Patent number: 10204273
    Abstract: Users desiring to generate videos from video clips may want to locate moments of interest within the video clips. A system and method described herein may be configured to provide recommendations of moments of interest within video clips post capture of the video clips. User accounts associated with users of the system may include preference information that defines user preferences with respect to values of attributes of video clips. Moments of interest may be identified within individual video clips when the individual video clips have at least one value of at least one attribute specified by the user preferences. Recommendations of identified moments of interest may be provide to users.
    Type: Grant
    Filed: October 20, 2015
    Date of Patent: February 12, 2019
    Assignee: GoPro, Inc.
    Inventors: Joven Matias, Ha Phan
  • Patent number: 10205879
    Abstract: Disclosed are a system and a method for determining enabling or disabling electronic image stabilization (EIS) for a video frame. An image sensor of a camera system captures a video stream that comprises a plurality of video frames. An image processor determines availability of a computational resource that may process application of EIS on each video frame. Simultaneously, the image processor receives motion data of the camera system from a gyroscope. Based on the computational resource availability, a motion frequency threshold is determined. Based on the gyroscope motion data, a motion frequency of each video frame is estimated. The estimated motion frequency is compared to the determined motion frequency threshold. If the estimated motion frequency is greater than the determined motion frequency threshold, application of EIS is disabled. If the estimated motion frequency is less than or equal to the determined motion frequency threshold, application of EIS is enabled.
    Type: Grant
    Filed: August 1, 2017
    Date of Patent: February 12, 2019
    Assignee: GoPro, Inc.
    Inventor: Loic Segapelli
  • Patent number: 10205880
    Abstract: A camera is configured with multiple microphones to reduce wind noise in audio data collected by the camera. The camera receives motion data, which may comprise data indicating acceleration of the camera, a plurality of video frames received by the camera, or a background level of noise associated with one or more microphones configured on the camera. The camera determines a motion vector from the motion data. The motion vector is parallel to the direction of motion of the camera. The camera selects a subset of one or more microphones in the direction of the motion vector. By recording audio data using the one or more selected microphones, the camera reduces wind noise in the audio data.
    Type: Grant
    Filed: October 14, 2017
    Date of Patent: February 12, 2019
    Assignee: GoPro, Inc.
    Inventors: Erich Tisch, Fabrice Barbier, Scott Patrick Campbell
  • Patent number: 10204437
    Abstract: A video may be presented on a touchscreen display. Reception of annotation input may be determined based on user's engagement with the touchscreen display. Annotation input may define an in-frame visual annotation for the video. In-frame visual annotation may be associated with a visual portion of the video and one or more points within a duration of the video such that a subsequent presentation of the video includes the in-frame visual annotation positioned at the visual portion of the video at the one or more points. A graphical user interface may be presented on the touchscreen display. The graphical user interface may include one or more animation fields that provide options for selection by the user. The options may define different properties of a moving visual element added to the video. The options may define visual characteristics, presentation periods, and motions of the moving visual element.
    Type: Grant
    Filed: November 3, 2017
    Date of Patent: February 12, 2019
    Assignee: GoPro, Inc.
    Inventors: Trey Moore, Ross Chinni, Nicholas D. Woodman, Meghan Laffey
  • Patent number: 10200575
    Abstract: A capture settings for one or more image capture devices may be determined. The capture setting may define one or more aspects of operation for the image capture device(s). The aspect(s) of operation for the image capture device(s) may include one or more aspects of operation for a processor of the image capture device(s), an image sensor of the image capture device(s), and/or an optical element of the image capture device(s). A machine-readable optical code may be generated based on the capture setting and/or other information. The machine-readable optical code may convey the capture setting for the image capture device(s) such that a first image capture device capturing a first image including the machine-readable optical code may: (1) identify the machine-readable optical code within the first image; (2) determine the capture setting conveyed by the machine-readable optical code; and (3) operate in accordance with the capture setting.
    Type: Grant
    Filed: May 2, 2017
    Date of Patent: February 5, 2019
    Assignee: GoPro, Inc.
    Inventors: David Newman, Jeffrey Youel, Joseph VanDalsem
  • Patent number: 10198841
    Abstract: A mapping system receives sensor data from an unmanned aerial vehicle. The mapping system further receives images from a camera of the unmanned aerial vehicle. The mapping system determines an altitude of the camera based on the sensor data. The mapping system calculates a footprint of the camera based on the altitude of the camera and a field of view of the camera. The mapping system constructs a localized map based on the images and the footprint of the camera.
    Type: Grant
    Filed: November 30, 2016
    Date of Patent: February 5, 2019
    Assignee: GoPro, Inc.
    Inventor: Joseph Anthony Enke
  • Patent number: 10200636
    Abstract: Multiple cameras are arranged in an array at a pitch, roll, and yaw that allow the cameras to have adjacent fields of view such that each camera is pointed inward relative to the array. The read window of an image sensor of each camera in a multi-camera array can be adjusted to minimize the overlap between adjacent fields of view, to maximize the correlation within the overlapping portions of the fields of view, and to correct for manufacturing and assembly tolerances. Images from cameras in a multi-camera array with adjacent fields of view can be manipulated using low-power warping and cropping techniques, and can be taped together to form a final image.
    Type: Grant
    Filed: October 23, 2015
    Date of Patent: February 5, 2019
    Assignee: GoPro, Inc.
    Inventors: Timothy MacMillan, Scott Patrick Campbell
  • Patent number: 10198862
    Abstract: Apparatus and methods for providing a rotated spherical viewpoint (RSV). In one or more embodiments, the RSV is implemented using equirectangular projections (ERPs). The RSV methodologies described herein are particularly suitable for panning within virtual reality (VR) or 360° panoramic content as there is minimal, if any, geometric distortions at the edge of a given viewport. Moreover, the RSV methodologies described herein may reduce the bandwidth requirements of, for example, devices operating in a client-server architecture. Additionally, the computation requirements for providing RSV are minimal and can be provided using relatively simple rotation transforms.
    Type: Grant
    Filed: June 1, 2017
    Date of Patent: February 5, 2019
    Assignee: GOPRO, INC.
    Inventor: Adeel Abbas
  • Patent number: 10200610
    Abstract: A camera system includes a lens assembly and image processing electronics internal to the camera housing and thermally coupled to the battery assembly. The battery assembly is sensitive to low ambient temperatures and may become damaged if the temperature of the assembly becomes sufficiently low. The camera system comprises a thermal management system that dissipates heat from electronic components of the camera to increase or maintain the temperature of the battery assembly. The thermal management configures the electronic components in different modes to create a step-wise increase of the resistive heat generated in the camera system and thereby increase the temperature of the components in the camera system.
    Type: Grant
    Filed: March 13, 2017
    Date of Patent: February 5, 2019
    Assignee: GoPro, Inc.
    Inventors: Nicholas D. Woodman, Ihab A. Ali, Todd Gotham
  • Patent number: 10192362
    Abstract: A content visualization system generates visual content for a visualization device based on visual content of a live event. The content visualization system collects visual content and source perspective data from visual content sources. The visualization device requests visual content from the content visualization system by providing device perspective data to the content visualization system. The content visualization system generates visual content for the visualization device based on the visual content from the visual content sources, the source perspective data, and the device perspective data. The content visualization system can determine visual content that is relevant to the device perspective by identifying source perspectives that overlap with the device perspective. The content visualization system generates visual content for the visualization device based on the identified visual content.
    Type: Grant
    Filed: October 27, 2016
    Date of Patent: January 29, 2019
    Assignee: GoPro, Inc.
    Inventors: Scott Patrick Campbell, Gary Fong
  • Patent number: 10192585
    Abstract: Video and corresponding metadata is accessed. Events of interest within the video are identified based on the corresponding metadata, and best scenes are identified based on the identified events of interest. In one example, best scenes are identified based on the motion values associated with frames or portions of a frame of a video. Motion values are determined for each frame and portions of the video including frames with the most motion are identified as best scenes. Best scenes may also be identified based on the motion profile of a video. The motion profile of a video is a measure of global or local motion within frames throughout the video. For example, best scenes are identified from portion of the video including steady global motion. A video summary can be generated including one or more of the identified best scenes.
    Type: Grant
    Filed: March 23, 2017
    Date of Patent: January 29, 2019
    Assignee: GoPro, Inc.
    Inventors: Balineedu Chowdary Adsumilli, Ryan Lustig, David A. Newman
  • Patent number: 10194069
    Abstract: A camera detects devices, such as other cameras, smart devices, and access points, with which the camera may communicate. The camera may alternate between operating as a wireless station and a wireless access point. The camera may connect to and receive credentials from a device for another device to which it is not connected. In one embodiment, the camera is configured to operate as a wireless access point, and is configured to receive credentials from a smart device operating as a wireless station. The camera may then transfer the credentials to additional cameras, each configured to operate as wireless stations. The camera and additional cameras may connect to a smart device directly or indirectly (for instance, through an access point), and the smart device may change the camera mode of the cameras. The initial modes of the cameras may be preserved and restored by the smart device upon disconnection.
    Type: Grant
    Filed: August 21, 2017
    Date of Patent: January 29, 2019
    Assignee: GoPro, Inc.
    Inventors: Richard T. Brockway, III, Jeffrey S. Youel, John S. Chen, Fabrice Barbier
  • Patent number: 10194073
    Abstract: A first portion of a first video segment may be obtained from a user. A second portion of a second video segment may be obtained from the user. The first portion and the second portion may be aggregated to form an aggregated video segment. A first set of capture settings associated with capture of the first portion may be obtained. A second set of capture settings associated with capture of the second portion may be obtained. Preferences for capture settings of an image capturing device may be determined based upon the first and second set of capture settings. Instructions may be transmitted to the image capturing device. The instructions may include the determined preferences for the capture settings and may be configured to cause the image capturing device to adjust the capture settings to the determined preferences.
    Type: Grant
    Filed: May 26, 2017
    Date of Patent: January 29, 2019
    Assignee: GoPro, Inc.
    Inventors: Joven Matias, Suejin Kim
  • Patent number: 10194097
    Abstract: Apparatus and methods for stitching images, or re-stitching previously stitched images. Specifically, the disclosed systems in one implementation save stitching information and/or original overlap source data during an original stitching process. During subsequent retrieval, rendering, and/or display of the stitched images, the originally stitched image can be flexibly augmented, and/or re-stitched to improve the original stitch quality. Practical applications of the disclosed solutions enable, among other things, a user to create and stitch a wide field of view (FOV) panorama from multiple source images on a device with limited processing capability (such as a mobile phone or other capture device). Moreover, post-processing stitching allows for the user to convert from one image projection to another without fidelity loss (or with an acceptable level of loss).
    Type: Grant
    Filed: January 13, 2017
    Date of Patent: January 29, 2019
    Assignee: GOPRO, INC.
    Inventors: Adeel Abbas, Cesar Douady-Pleven, Timothy Macmillan
  • Patent number: 10192143
    Abstract: Systems and methods of distinguishing between feature depicted in an image are presented herein. Information defining an image may be obtained. The image may include visual content comprising an array of pixels. The array may include pixel rows. An identification of a pixel row in an image may be obtained. Distances of individual pixels and/or groups of pixels from the identified row of pixels may be determined. Parameter values for a set of pixel parameters of individual pixels of the image may be determined. Based on one or more of the distances from the identified row of pixels, parameter values of one or more pixel parameters, and/or other information, individual pixels and/or groups of pixels may be classified as one of a plurality of image features.
    Type: Grant
    Filed: September 20, 2016
    Date of Patent: January 29, 2019
    Assignee: GoPro, Inc.
    Inventors: Vincent Garcia, Maxime Schwab, Francois Lagunas
  • Patent number: 10194101
    Abstract: Image captured with an image capture device with a rolling shutter may be deformed due to changes in imaging sensor orientation during image capture. Image deformities may occur due to rolling shutter that exposes rows of pixels to light at slightly different times during image capture. Deformities such as wobble, for example, and/or other deformities may be corrected by constructing an output image. The output image may be constructed by determining corresponding pixels within the input image. The location of the input pixel may be determined by performing one or more fixed point iterations to identify one or more input pixels within the input image. A value of the output pixel within the output image may be determined based on a value of a corresponding pixel within the input image.
    Type: Grant
    Filed: February 22, 2017
    Date of Patent: January 29, 2019
    Assignee: GoPro, Inc.
    Inventor: Adrien Fontvielle
  • Patent number: 10193886
    Abstract: Conventional wireless interface (WiFi) controllers cannot resolve authentication for trusted client devices without calculation from a host processor. Leaving the host processor on or awaking it from a sleep state each time a non-authenticated trusted client device attempts to connect wastes power. A hostless authenticated wake service allows a host controller to enter a sleep state while the WiFi controller responds to multicast domain name service-service discovery (mDNS-SD) queries from trusted client devices. Once a client device is authenticated, the WiFi controller may respond to a trusted client request to awake the host processor for further command processing and service provision. Not only does this approach reduce power consumption by allowing the host processor to remain in the sleep state, it allows trusted client devices to discover its presence while ensuring security.
    Type: Grant
    Filed: December 11, 2017
    Date of Patent: January 29, 2019
    Assignee: GOPRO, INC.
    Inventors: Joseph Anthony Enke, David Boone, Jeffrey S. Youel, Bich Nguyen, Mark Petersen, Kevin Fry
  • Patent number: 10185895
    Abstract: An image including a visual capture of a scene may be accessed. The image may be processed through a convolutional neural network. The convolutional neural network may generate a set of two-dimensional feature maps based on the image. The set of two-dimensional feature maps may be processed through a contextual long short-term memory unit. The contextual long short-term memory unit may generate a set of two-dimensional outputs based on the set of two-dimensional feature maps. A set of attention-masks for the image may be generated based on the set of two-dimensional outputs and the set of two-dimensional feature maps. The set of attention-masks may define dimensional portions of the image. The scene may be classified based on the two-dimensional outputs.
    Type: Grant
    Filed: March 23, 2017
    Date of Patent: January 22, 2019
    Assignee: GoPro, Inc.
    Inventors: Daniel Tse, Desmond Chik, Guanhang Wu
  • Patent number: 10185891
    Abstract: A compact convolutional neural network may include a preliminary layer group, one or more intermediate layer groups, a final layer group, and/or other layers/layer groups. The preliminary layer group may include an input layer, a first preliminary normalization layer, a preliminary padding layer, a preliminary convolution layer, a preliminary activation layer, a second preliminary normalization layer, and a preliminary downsampling layer. One or more intermediate layer groups may include an intermediate squeeze layer, a first intermediate normalization layer, an intermediate padding layer, a first intermediate expand layer, a second intermediate expand layer, an intermediate concatenation layer, a second intermediate normalization layer, an intermediate activation layer, and an intermediate combination layer.
    Type: Grant
    Filed: July 8, 2016
    Date of Patent: January 22, 2019
    Assignee: GoPro, Inc.
    Inventor: Louis Martin
  • Patent number: 10185318
    Abstract: Disclosed is a configuration to control automatic return of an aerial vehicle. The configuration stores a return location in a storage device of the aerial vehicle. The return location may correspond to a location where the aerial vehicle is to return. One or more sensors of the aerial vehicle are monitored during flight for detection of a predefined condition. When a predetermined condition is met a return path program may be loaded for execution to provide a return flight path for the aerial vehicle to automatically navigate to the return location.
    Type: Grant
    Filed: December 27, 2016
    Date of Patent: January 22, 2019
    Assignee: GoPro, Inc.
    Inventor: Joseph Anthony Enke
  • Patent number: 10186036
    Abstract: Systems and method of identifying a horizon depicted in an image are presented herein. Information defining an image may be obtained. The image may include visual content comprising an array of pixels. The array may include pixel rows. Parameter values for a set of pixel parameters of individual pixels of the image may be determined. Individual average parameter values of the individual pixel parameters of the pixels in the individual pixel rows may be determined. Based on the average parameter values a pixel row may be identified as depicting a horizon in the image.
    Type: Grant
    Filed: November 4, 2016
    Date of Patent: January 22, 2019
    Assignee: GoPro, Inc.
    Inventor: Vincent Garcia
  • Patent number: 10186012
    Abstract: In a video capture system, a virtual lens is simulated when applying a crop or zoom effect to an input video. An input video frame is received from the input video that has a first field of view and an input lens distortion caused by a lens used to capture the input video frame. A selection of a sub-frame representing a portion of the input video frame is obtained that has a second field of view smaller than the first field of view. The sub-frame is processed to remap the input lens distortion to a desired lens distortion in the sub-frame. The processed sub-frame is the outputted.
    Type: Grant
    Filed: May 17, 2016
    Date of Patent: January 22, 2019
    Assignee: GoPro, Inc.
    Inventors: David A. Newman, Joshua Edward Bodinet, Otto Kenneth Sievert, Timothy Macmillan
  • Patent number: 10187690
    Abstract: Systems and method of automatically detecting user responses from users to media content and correlating the user responses to the media content include a determination of an emotional response by a user—for example a smile—to a presentation of media content. The determined emotional response is correlated to the media content. Subsequent presentation of the same media content includes presentation of an indicator—for example a smiley —that indicates the determined emotional response.
    Type: Grant
    Filed: April 24, 2017
    Date of Patent: January 22, 2019
    Assignee: GoPro, Inc.
    Inventors: Vincent Garcia, Tom Medioni, Matthieu Rouif, Gabriel Lema, Francescu Santoni
  • Patent number: 10186298
    Abstract: Videos may be automatically generated using a set of video clip. Individual moments of interest may be identified within individual video clips of a set of video clips. A moment of interest may correspond to a point in time within a video clip. The point in time may be associated with one or more values of one or more attributes of the video clip. Individual moments of interest may be associated with individual portions of a video. The video may be generated using the set of video clips based on the associations.
    Type: Grant
    Filed: June 19, 2017
    Date of Patent: January 22, 2019
    Assignee: GoPro, Inc.
    Inventors: Joven Matias, Ha Phan
  • Patent number: 10187607
    Abstract: An image sensor may generate visual output signals conveying visual information within a field of view of the image sensor. First and second video information defining first and video content may be generated based on the visual output signals. The first video content may be captured using a first capture frame rate and the second video content may be captured using a second capture frame rate. Motion of the image sensor and/or motion of an object within the field of view may be determined. The first capture frame rate may be changed based on the determined motion. Third video information defining third video content may be generated based on the first video information and the second video information. The third video content may include one or more frames of the first video content and one or more frames of the second video content.
    Type: Grant
    Filed: April 4, 2017
    Date of Patent: January 22, 2019
    Assignee: GoPro, Inc.
    Inventor: Christophe Delachanal
  • Patent number: 10175042
    Abstract: Disclosed is a system and method for calibrating a magnetometer of a compass. With a global navigation satellite system receiver, a current position is determined. The determined position is used to determine a magnetic inclination (e.g., by a global magnetic field model such as the World Magnetic Model). The calibration system may perform different calibration sequences based on the magnetic inclination. In a first calibration sequence, performed responsive to a determination that a magnetic inclination (or the absolute value of the magnetic inclination) is less than a threshold, magnetic field data is measured by the magnetometer as it is rotated through horizontal rotation paths. If the magnetic inclination is greater than the threshold, magnetic field data is measured by the magnetometer as it is rotated through vertical rotation paths. The measured magnetic field data may be used to determine calibration values for the magnetometer compass.
    Type: Grant
    Filed: November 10, 2016
    Date of Patent: January 8, 2019
    Assignee: GoPro, Inc.
    Inventors: Fabio Diem, Tim Oberhauser, Sammy Omari
  • Patent number: 10175687
    Abstract: Systems and methods for controlling an unmanned aerial vehicle recognize and interpret gestures by a user. The gestures are interpreted to adjust the operation of the unmanned aerial vehicle, a sensor carried by the unmanned aerial vehicle, or both.
    Type: Grant
    Filed: May 26, 2017
    Date of Patent: January 8, 2019
    Assignee: GoPro, Inc.
    Inventors: Pablo Lema, Shu Ching Ip
  • Patent number: 10169265
    Abstract: A camera includes an input/out system and one or more input/output ports. The camera configures the pins of the input/output port according to a default pin configuration. The camera detects a peripheral device is connected the input/output ports and receives an identifier from the peripheral device indicating whether the peripheral device is a USB3 device or a non-USB3 device. If the peripheral device is a non-USB3 device, the camera remaps the pins to a first configuration. The camera authenticates with the peripheral device to determine if the peripheral device meets a criteria for an approved device. If the authentication is successful, the camera enables communication with the peripheral device and remaps the pins to a second configuration. If the authentication is unsuccessful, the camera disables communication with the peripheral device and remaps the pins of the input/output port to the default configuration.
    Type: Grant
    Filed: October 16, 2015
    Date of Patent: January 1, 2019
    Assignee: GoPro, Inc.
    Inventor: Yu Wang
  • Patent number: 10163029
    Abstract: A camera system processes images based on image luminance data. The camera system includes an image sensor, an image pipeline, an encoder and a memory. The image sensor converts light incident upon the image sensor into raw image data. The image pipeline converts raw image data into color-space image data and calculates luminance levels of the color-space image data. The encoder can determine one or more of quantization levels, determining GOP structure or reference frame spacing for the color-space image data based on the luminance levels. The memory stores the color-space image data and the luminance levels.
    Type: Grant
    Filed: May 12, 2017
    Date of Patent: December 25, 2018
    Assignee: GoPro, Inc.
    Inventor: Sandeep Doshi
  • Patent number: 10163030
    Abstract: A camera system processes images based on image activity data. The camera system includes an image sensor, an image pipeline, an encoder and a memory. The image sensor converts light incident upon the image sensor into raw image data. The image pipeline converts raw image data into color-space image data and calculates activity variances of the color-space image data. The encoder can determine one or more of quantization levels, block type (Intra vs Inter), determining transform size and type, and determining GOP structure or reference frame spacing for the color-space image data based on the activity variances. The memory stores the color-space image data and the activity variances.
    Type: Grant
    Filed: May 12, 2017
    Date of Patent: December 25, 2018
    Assignee: GoPro, Inc.
    Inventor: Sandeep Doshi
  • Patent number: 10150576
    Abstract: A gimbal sleeve for connecting to a camera gimbal may float between a floor surface and a ceiling surface of an aerial vehicle chassis such that the gimbal sleeve has freedom of motion in yaw, pitch, and roll directions relative to the vehicle chassis. The gimbal sleeve may comprise a pair of connection points to the lower dampers on a floor surface of the vehicle chassis and a pair of connection points to upper dampers on a ceiling surface of the vehicle chassis. The connection points include spring forces that enable the gimbal sleeve to return to an equilibrium position in response to external vibrations and reduce the magnitude of vibrations transferred from the aerial vehicle to the gimbal and camera systems.
    Type: Grant
    Filed: September 16, 2016
    Date of Patent: December 11, 2018
    Assignee: GoPro, Inc.
    Inventors: Noriaki Saika, Christopher Bramley Fruhauf, Daniel Francis Kennedy
  • Patent number: 10148939
    Abstract: A system captures a first hemispherical image and a second hemispherical image, each hemispherical image including an overlap portion, the overlap portions capturing a same field of view, the two hemispherical images collectively comprising a spherical FOV and separated along a longitudinal plane. The system maps a modified first hemispherical image to a first portion of the 2D projection of a cubic image, the modified first hemispherical image including a non-overlap portion of the first hemispherical image, and maps a modified second hemispherical image to a second portion of the 2D projection of the cubic image, the modified second hemispherical image also including a non-overlap portion. The system maps the overlap portions of the first hemispherical image and the second hemispherical image to the 2D projection of the cubic image, and encodes the 2D projection of the cubic image to generate an encoded image representative of the spherical FOV.
    Type: Grant
    Filed: November 21, 2016
    Date of Patent: December 4, 2018
    Assignee: GOPRO, INC.
    Inventors: Timothy Macmillan, Adeel Abbas
  • Patent number: 10148882
    Abstract: Systems and methods are provided that capture and process frames of frame data. An image sensor captures frames of frame data representative of light incident upon the image sensor using a rolling shutter and outputs the frames of frame data. The image sensor captures at least one of the frames over a frame capture interval and then waits over a blanking interval before capturing another frame. A buffer receives and stores the frames output by the image sensor. An image signal processor retrieves the frames from the buffer and processes the frames over successive frame processing intervals to generate a video having a time interval per frame greater than the frame capture interval. At least one of the successive frame processing intervals is greater than the frame capture interval and is less than or equal to a sum of the frame capture interval and the blanking interval.
    Type: Grant
    Filed: February 28, 2017
    Date of Patent: December 4, 2018
    Assignee: GoPro, Inc.
    Inventors: Paul Mobbs, Scott Patrick Campbell, David A. Newman, Kasturi Rangam, Sumit Chawla
  • Patent number: 10134114
    Abstract: Apparatus and methods for video image post-processing for segmentation based interpolation. In one embodiment, a computerized apparatus is utilized in order to obtain a first frame of video data; segment one or more objects within the first frame of video data; obtain a second frame of video data; segment one or more objects within the second frame of video data; match at least a portion of the one or more objects within the first frame of video data with the one or more objects within the second frame of video data; compute the motion of the pixels for the matched portion of the one or more objects; compute the motion of pixels associated with a background image; and generate an interpolated frame of video data, the interpolated frame of video data residing temporally between the first frame of video data and the second frame of video data.
    Type: Grant
    Filed: September 20, 2016
    Date of Patent: November 20, 2018
    Assignee: GOPRO, INC.
    Inventors: Balineedu Chowdary Adsumilli, Ryan Lustig, Aaron Staranowicz
  • Patent number: 10129499
    Abstract: Disclosed is a system and method for securely storing a Wi-Fi password or similar WLAN security credentials on a device, such as a camera. The password is secured by encryption using an encryption key generated from the Service Set Identifier (SSID) of the network. A one-way-hash of the SSID is stored in a non-volatile memory of the device, but the plaintext SSID is not stored on the device. At a later time, the device may detect the SSID of the network and hash the detected SSID. If the hash matches a previously stored hash, an encryption key is generated from the SSID and the encryption key is used to decrypt the password associated with the matching hash. Without knowledge of the SSID, an attacker who gains access to the device will not be able to recover the password from the hashed SSID and the encrypted password.
    Type: Grant
    Filed: December 6, 2016
    Date of Patent: November 13, 2018
    Assignee: GOPRO, INC.
    Inventor: David A. Boone
  • Patent number: 10129464
    Abstract: Systems and methods for image compositing. Image capture devices may be used for documenting various activities. An image capture device may be configured to operate in image acquisition mode configured for image compositing. The image acquisition mode may be characterized by one or more of a given image acquisition interval, number of acquired images, camera shutter setting, and/or other settings. The image capture device may provide a user interface configured to facilitate acquiring an image sequence suitable for compositing. A live compositing preview may enable users to select one or more composite images for viewing and/or sharing.
    Type: Grant
    Filed: February 17, 2017
    Date of Patent: November 13, 2018
    Assignee: GoPro, Inc.
    Inventors: Joven Matias, Daryl Stimm, Ryan Lustig, Kyler Schwartz, Joseph VanDalsem
  • Patent number: 10129516
    Abstract: Systems and methods for marking an event of interest within a spherical video segment are provided. The spherical video segment may define visual content viewable from a point of view. User input designating an event of interest within the visual content may be received. The user input may indicate a point in time in the spherical video segment and a viewing angle of the event of interest. Tag information associated with the event of interest may be generated. The tag information may identify the point in time and the viewing angle such that notification of alert information is effectuated based on a determination that the viewing angle, proximate to the point in time during a subsequent presentation of the spherical video segment, is outside a display field of view. The alert information may indicate that the event of interest is located outside the display field of view.
    Type: Grant
    Filed: March 14, 2017
    Date of Patent: November 13, 2018
    Assignee: GoPro, Inc.
    Inventors: Joven Matias, David Newman, Ha Phan, Timothy Bucklin, Daryl Stimm
  • Patent number: 10127943
    Abstract: Video information defining video content may be accessed. Music information defining a music track providing an accompaniment for video content may be accessed. The music track may have pulses and one or more music events. Individual music events may correspond to different moments within the music track. One or more music events may be individually classified into one or more categories based on intensities of one or pulses occurring within the music event. One or more visual effects may be selected for different moments within the music track based on the categories of the music events. One or more visual effects may be applied to the video content. One or more visual effects may be applied to one or more moments within the video content aligned to one or more different moments within the music track.
    Type: Grant
    Filed: March 2, 2017
    Date of Patent: November 13, 2018
    Assignee: GoPro, Inc.
    Inventor: Jean Patry
  • Patent number: 10129470
    Abstract: System and methods are disclosed for generating an output video stream from a wide field video stream. The wide field video stream may be created from compiling a plurality of video stream capturing different viewpoints of the same environment simultaneously. Upon selecting a wide field video stream, a first geometric function may be utilized to generate individual intermediate points that correspond to locations in a wide field video stream to be displayed on a particular display space. A second geometric function may be further utilized to generate reference points so that a the pixel on the output video stream are determined from the intermediate points of the wide field video stream of the first geometric function. Upon the execution of the first and second geometric function, an output video stream is generated for display on the determined display space.
    Type: Grant
    Filed: October 19, 2015
    Date of Patent: November 13, 2018
    Assignee: GoPro, Inc.
    Inventors: Alexandre Jenny, Yann Renaud Gilquin
  • Patent number: 10122956
    Abstract: A camera system capable of capturing images of an event in a dynamic environment includes two microphones configured to capture stereo audio of the event. The microphones are on orthogonal surfaces of the camera system. Because the microphones are on orthogonal surfaces of the camera system, the camera body can impact the spatial response of the two recorded audio channels differently, leading to degraded stereo recreation if standard beam forming techniques are used. The camera system includes tuned beam forming techniques to generate multi-channel audio that more accurately recreates the stereo audio by compensating for the shape of the camera system and the orientation of microphones on the camera system. The tuned beam forming techniques include optimizing a set of beam forming parameters, as a function of frequency, based on the true spatial response of the recorded audio signals.
    Type: Grant
    Filed: September 11, 2017
    Date of Patent: November 6, 2018
    Assignee: GoPro, Inc.
    Inventors: Zhinian Jing, Joyce Rosenbaum
  • Patent number: 10122902
    Abstract: An integrated image sensor and lens assembly comprises a lens barrel adhered to a lens holder or a lens barrel adhered to an image sensor assembly using an adhesive. The lens barrel and lens holder or the lens barrel and the image sensor assembly are bonded based on the sheer strength of the adhesive. Thus, adhesive expansion does not substantially affect the distance between the lens and the image sensor and therefore does not affect the focal plane of the assembly.
    Type: Grant
    Filed: May 6, 2015
    Date of Patent: November 6, 2018
    Assignee: GoPro, Inc.
    Inventors: Scott Patrick Campbell, Thomas Czepowicz
  • Patent number: 10122904
    Abstract: A camera controller is configured to control a camera through voice commands. The camera controller includes drain mechanisms that allow the camera controller to be used in environments in which the camera controller is exposed to fluids. The camera controller device comprises a housing body with an outer surface including a first opening and a second opening. A first channel extends from the first opening into the housing body and to a cavity in which a microphone is located, enabling audio signals entering the first opening to be captured by the microphone. A membrane is located between the first channel and the microphone to create a waterproof seal over the microphone. A second channel extends from the first channel to the second opening to create a drain such that fluid entering from the first opening can flow from the first channel through the second channel and out the second opening.
    Type: Grant
    Filed: July 11, 2016
    Date of Patent: November 6, 2018
    Assignee: GoPro, Inc.
    Inventors: Senka Agic Bergman, Joyce Rosenbaum
  • Publication number: 20180316843
    Abstract: A method and device are provided for positioning a mounted camera. The device includes a holding element that secures the mounted camera to the device, a wireless linkage at which remote attitude commands representing attitude changes of a remote driver are received, a local controller that interprets the remote attitude commands and generates local attitude commands that move the camera to mimic an orientation of the remote driver, and an attitude sensing element that senses a local attitude of the device. The attitude sensing element includes a gyro, an accelerometer, or a magnetometer, and jitter present in the remote attitude commands is removed and not passed on to the local attitude commands.
    Type: Application
    Filed: July 9, 2018
    Publication date: November 1, 2018
    Applicant: GoPro, Inc.
    Inventors: Josh Guyot, JoeBen Bevirt
  • Patent number: D833511
    Type: Grant
    Filed: June 15, 2017
    Date of Patent: November 13, 2018
    Assignee: GoPro, Inc.
    Inventors: Michael Paterson, Kelan Dammers
  • Patent number: D837865
    Type: Grant
    Filed: November 17, 2017
    Date of Patent: January 8, 2019
    Assignee: GoPro, Inc.
    Inventors: Ben Parfitt, Fred Bould, Richard Gioscia
  • Patent number: D836558
    Type: Grant
    Filed: June 15, 2016
    Date of Patent: December 25, 2018
    Assignee: GoPro, Inc.
    Inventors: Michael Paterson, Huy Phuong Nguyen, Ryan Harrison, Mitalee Desai
  • Patent number: D840463
    Type: Grant
    Filed: November 20, 2017
    Date of Patent: February 12, 2019
    Assignee: GoPro, Inc.
    Inventors: Huy Phuong Nguyen, Richard Gioscia, Quinn Jerome Odette Fitzgerald, William Duncan Webb, II