GoPro Patents

GoPro, Inc. manufactures and sells their HERO line of cameras that enable athletes to self-capture their activities, as well as manage and share their photos and videos.

GoPro Patents by Type

  • GoPro Patents Granted: GoPro patents that have been granted by the United States Patent and Trademark Office (USPTO).
  • GoPro Patent Applications: GoPro patent applications that are pending before the United States Patent and Trademark Office (USPTO).
  • Patent number: 10150576
    Abstract: A gimbal sleeve for connecting to a camera gimbal may float between a floor surface and a ceiling surface of an aerial vehicle chassis such that the gimbal sleeve has freedom of motion in yaw, pitch, and roll directions relative to the vehicle chassis. The gimbal sleeve may comprise a pair of connection points to the lower dampers on a floor surface of the vehicle chassis and a pair of connection points to upper dampers on a ceiling surface of the vehicle chassis. The connection points include spring forces that enable the gimbal sleeve to return to an equilibrium position in response to external vibrations and reduce the magnitude of vibrations transferred from the aerial vehicle to the gimbal and camera systems.
    Type: Grant
    Filed: September 16, 2016
    Date of Patent: December 11, 2018
    Assignee: GoPro, Inc.
    Inventors: Noriaki Saika, Christopher Bramley Fruhauf, Daniel Francis Kennedy
  • Patent number: 10148939
    Abstract: A system captures a first hemispherical image and a second hemispherical image, each hemispherical image including an overlap portion, the overlap portions capturing a same field of view, the two hemispherical images collectively comprising a spherical FOV and separated along a longitudinal plane. The system maps a modified first hemispherical image to a first portion of the 2D projection of a cubic image, the modified first hemispherical image including a non-overlap portion of the first hemispherical image, and maps a modified second hemispherical image to a second portion of the 2D projection of the cubic image, the modified second hemispherical image also including a non-overlap portion. The system maps the overlap portions of the first hemispherical image and the second hemispherical image to the 2D projection of the cubic image, and encodes the 2D projection of the cubic image to generate an encoded image representative of the spherical FOV.
    Type: Grant
    Filed: November 21, 2016
    Date of Patent: December 4, 2018
    Assignee: GOPRO, INC.
    Inventors: Timothy Macmillan, Adeel Abbas
  • Patent number: 10148882
    Abstract: Systems and methods are provided that capture and process frames of frame data. An image sensor captures frames of frame data representative of light incident upon the image sensor using a rolling shutter and outputs the frames of frame data. The image sensor captures at least one of the frames over a frame capture interval and then waits over a blanking interval before capturing another frame. A buffer receives and stores the frames output by the image sensor. An image signal processor retrieves the frames from the buffer and processes the frames over successive frame processing intervals to generate a video having a time interval per frame greater than the frame capture interval. At least one of the successive frame processing intervals is greater than the frame capture interval and is less than or equal to a sum of the frame capture interval and the blanking interval.
    Type: Grant
    Filed: February 28, 2017
    Date of Patent: December 4, 2018
    Assignee: GoPro, Inc.
    Inventors: Paul Mobbs, Scott Patrick Campbell, David A. Newman, Kasturi Rangam, Sumit Chawla
  • Patent number: 10134114
    Abstract: Apparatus and methods for video image post-processing for segmentation based interpolation. In one embodiment, a computerized apparatus is utilized in order to obtain a first frame of video data; segment one or more objects within the first frame of video data; obtain a second frame of video data; segment one or more objects within the second frame of video data; match at least a portion of the one or more objects within the first frame of video data with the one or more objects within the second frame of video data; compute the motion of the pixels for the matched portion of the one or more objects; compute the motion of pixels associated with a background image; and generate an interpolated frame of video data, the interpolated frame of video data residing temporally between the first frame of video data and the second frame of video data.
    Type: Grant
    Filed: September 20, 2016
    Date of Patent: November 20, 2018
    Assignee: GOPRO, INC.
    Inventors: Balineedu Chowdary Adsumilli, Ryan Lustig, Aaron Staranowicz
  • Patent number: 10129464
    Abstract: Systems and methods for image compositing. Image capture devices may be used for documenting various activities. An image capture device may be configured to operate in image acquisition mode configured for image compositing. The image acquisition mode may be characterized by one or more of a given image acquisition interval, number of acquired images, camera shutter setting, and/or other settings. The image capture device may provide a user interface configured to facilitate acquiring an image sequence suitable for compositing. A live compositing preview may enable users to select one or more composite images for viewing and/or sharing.
    Type: Grant
    Filed: February 17, 2017
    Date of Patent: November 13, 2018
    Assignee: GoPro, Inc.
    Inventors: Joven Matias, Daryl Stimm, Ryan Lustig, Kyler Schwartz, Joseph VanDalsem
  • Patent number: 10127943
    Abstract: Video information defining video content may be accessed. Music information defining a music track providing an accompaniment for video content may be accessed. The music track may have pulses and one or more music events. Individual music events may correspond to different moments within the music track. One or more music events may be individually classified into one or more categories based on intensities of one or pulses occurring within the music event. One or more visual effects may be selected for different moments within the music track based on the categories of the music events. One or more visual effects may be applied to the video content. One or more visual effects may be applied to one or more moments within the video content aligned to one or more different moments within the music track.
    Type: Grant
    Filed: March 2, 2017
    Date of Patent: November 13, 2018
    Assignee: GoPro, Inc.
    Inventor: Jean Patry
  • Patent number: 10129499
    Abstract: Disclosed is a system and method for securely storing a Wi-Fi password or similar WLAN security credentials on a device, such as a camera. The password is secured by encryption using an encryption key generated from the Service Set Identifier (SSID) of the network. A one-way-hash of the SSID is stored in a non-volatile memory of the device, but the plaintext SSID is not stored on the device. At a later time, the device may detect the SSID of the network and hash the detected SSID. If the hash matches a previously stored hash, an encryption key is generated from the SSID and the encryption key is used to decrypt the password associated with the matching hash. Without knowledge of the SSID, an attacker who gains access to the device will not be able to recover the password from the hashed SSID and the encrypted password.
    Type: Grant
    Filed: December 6, 2016
    Date of Patent: November 13, 2018
    Assignee: GOPRO, INC.
    Inventor: David A. Boone
  • Patent number: 10129470
    Abstract: System and methods are disclosed for generating an output video stream from a wide field video stream. The wide field video stream may be created from compiling a plurality of video stream capturing different viewpoints of the same environment simultaneously. Upon selecting a wide field video stream, a first geometric function may be utilized to generate individual intermediate points that correspond to locations in a wide field video stream to be displayed on a particular display space. A second geometric function may be further utilized to generate reference points so that a the pixel on the output video stream are determined from the intermediate points of the wide field video stream of the first geometric function. Upon the execution of the first and second geometric function, an output video stream is generated for display on the determined display space.
    Type: Grant
    Filed: October 19, 2015
    Date of Patent: November 13, 2018
    Assignee: GoPro, Inc.
    Inventors: Alexandre Jenny, Yann Renaud Gilquin
  • Patent number: 10129516
    Abstract: Systems and methods for marking an event of interest within a spherical video segment are provided. The spherical video segment may define visual content viewable from a point of view. User input designating an event of interest within the visual content may be received. The user input may indicate a point in time in the spherical video segment and a viewing angle of the event of interest. Tag information associated with the event of interest may be generated. The tag information may identify the point in time and the viewing angle such that notification of alert information is effectuated based on a determination that the viewing angle, proximate to the point in time during a subsequent presentation of the spherical video segment, is outside a display field of view. The alert information may indicate that the event of interest is located outside the display field of view.
    Type: Grant
    Filed: March 14, 2017
    Date of Patent: November 13, 2018
    Assignee: GoPro, Inc.
    Inventors: Joven Matias, David Newman, Ha Phan, Timothy Bucklin, Daryl Stimm
  • Patent number: 10122902
    Abstract: An integrated image sensor and lens assembly comprises a lens barrel adhered to a lens holder or a lens barrel adhered to an image sensor assembly using an adhesive. The lens barrel and lens holder or the lens barrel and the image sensor assembly are bonded based on the sheer strength of the adhesive. Thus, adhesive expansion does not substantially affect the distance between the lens and the image sensor and therefore does not affect the focal plane of the assembly.
    Type: Grant
    Filed: May 6, 2015
    Date of Patent: November 6, 2018
    Assignee: GoPro, Inc.
    Inventors: Scott Patrick Campbell, Thomas Czepowicz
  • Patent number: 10122904
    Abstract: A camera controller is configured to control a camera through voice commands. The camera controller includes drain mechanisms that allow the camera controller to be used in environments in which the camera controller is exposed to fluids. The camera controller device comprises a housing body with an outer surface including a first opening and a second opening. A first channel extends from the first opening into the housing body and to a cavity in which a microphone is located, enabling audio signals entering the first opening to be captured by the microphone. A membrane is located between the first channel and the microphone to create a waterproof seal over the microphone. A second channel extends from the first channel to the second opening to create a drain such that fluid entering from the first opening can flow from the first channel through the second channel and out the second opening.
    Type: Grant
    Filed: July 11, 2016
    Date of Patent: November 6, 2018
    Assignee: GoPro, Inc.
    Inventors: Senka Agic Bergman, Joyce Rosenbaum
  • Patent number: 10122956
    Abstract: A camera system capable of capturing images of an event in a dynamic environment includes two microphones configured to capture stereo audio of the event. The microphones are on orthogonal surfaces of the camera system. Because the microphones are on orthogonal surfaces of the camera system, the camera body can impact the spatial response of the two recorded audio channels differently, leading to degraded stereo recreation if standard beam forming techniques are used. The camera system includes tuned beam forming techniques to generate multi-channel audio that more accurately recreates the stereo audio by compensating for the shape of the camera system and the orientation of microphones on the camera system. The tuned beam forming techniques include optimizing a set of beam forming parameters, as a function of frequency, based on the true spatial response of the recorded audio signals.
    Type: Grant
    Filed: September 11, 2017
    Date of Patent: November 6, 2018
    Assignee: GoPro, Inc.
    Inventors: Zhinian Jing, Joyce Rosenbaum
  • Publication number: 20180316843
    Abstract: A method and device are provided for positioning a mounted camera. The device includes a holding element that secures the mounted camera to the device, a wireless linkage at which remote attitude commands representing attitude changes of a remote driver are received, a local controller that interprets the remote attitude commands and generates local attitude commands that move the camera to mimic an orientation of the remote driver, and an attitude sensing element that senses a local attitude of the device. The attitude sensing element includes a gyro, an accelerometer, or a magnetometer, and jitter present in the remote attitude commands is removed and not passed on to the local attitude commands.
    Type: Application
    Filed: July 9, 2018
    Publication date: November 1, 2018
    Applicant: GoPro, Inc.
    Inventors: Josh Guyot, JoeBen Bevirt
  • Patent number: 10116853
    Abstract: An integrated image sensor and lens assembly comprises a lens barrel, an adapter tube, and a lens mount. The lens mount includes a first thread having a first pitch and the tube adapter comprises a second thread reciprocal to the first thread. The first and second threads secure the tube adapter within the lens mount. The tube adapter further comprises a third thread having a second pitch different than the first pitch, and the lens barrel comprises a fourth thread reciprocal to the third thread. The third and fourth threads secure the lens barrel within the tube adapter. A rotation of the tube adapter with respect to the lens barrel and the lens mount causes linear movement of the lens barrel and the lens mount with respect to the tube adapter in a same direction along the optical axis.
    Type: Grant
    Filed: November 11, 2015
    Date of Patent: October 30, 2018
    Assignee: GoPro, Inc.
    Inventors: Steven Xiwen Wang, Karen Ann Baumgartner, Emilio Graff
  • Patent number: 10109319
    Abstract: Implementations are directed to providing a digital media editing environment for editing at least a portion of a digital video using a mobile device, establishing communication between the mobile device and a data source, receiving, from the data source, a first portion of the digital video, the first portion including a first set of frames including less than all frames of the digital video, applying an edit to the first portion of the digital video, while less than all frames of the first digital video are stored on the mobile device, subsequent to applying the at least one edit, receiving, from the data source, a second portion of the digital video, the second portion including a second set of frames, and storing an edited digital video including at least one frame of the first set of frames, at least one frame of the second set of frames, and the edit.
    Type: Grant
    Filed: January 6, 2017
    Date of Patent: October 23, 2018
    Assignee: GoPro, Inc.
    Inventors: Stephen Trey Moore, Ross Chinni, Devin McKaskle
  • Patent number: 10096082
    Abstract: An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode.
    Type: Grant
    Filed: October 7, 2017
    Date of Patent: October 9, 2018
    Assignee: GoPro, Inc.
    Inventors: Scott Patrick Campbell, Paul Mobbs, Balineedu Chowdary Adsumilli, Sumit Chawla
  • Patent number: 10094513
    Abstract: The quick release bite mount comprises a quick release coupler portion and a malleable overmold that allows a user to bite down on the mount when a user holds the mount with a mouth. The overmold part of the mount can be a material such as rubber, plastic, or gel based structure. The overmold has an outer ridge that can hang from teeth of a user, allowing the user to relax their jaw during use. The plastic part of the mount has a thin, flexible area that the rubber part is overmolded over. This adds stiffness to the malleable area, while still allowing it to flex. The mount is configured to mechanically couple with a camera (or camera housing). The camera can be coupled to the mount such the camera can capture images in an unobstructed field of view when the mount is gripped in the mouth of a user.
    Type: Grant
    Filed: April 22, 2015
    Date of Patent: October 9, 2018
    Assignee: GoPro, Inc.
    Inventors: Eric McCallister Bennett, Travis Eastman Pynn, Nicholas D. Woodman, Joshua Todd Druker
  • Patent number: 10095696
    Abstract: Contextual parameters of digital media content may be obtained. The digital media content may be associated with a content capture user and/or an end user. Editing parameters defining one or more editing attributes of an edited version of the digital media content selected by the content capture user and/or the end user may be received. Post-capture user profiles may be obtained. Individual post-capture user profiles may include expertise attributes associated with individual post-capture users. A set of post-capture users may be identified as potential matches for creating the edited version of the digital media content based upon the contextual parameters, the editing parameters, and the one or more expertise attributes of the post-capture user profiles. The set of post-capture users may be presented to the content capture user and/or the end user for selection of one of the post-capture users to create the edited version of the digital media content.
    Type: Grant
    Filed: March 25, 2016
    Date of Patent: October 9, 2018
    Assignee: GoPro, Inc.
    Inventors: Logan Turley, Steven Grove
  • Patent number: 10096341
    Abstract: A video identifier uniquely identifying a video captured by a camera is generated. The video includes video frames and optionally concurrently captured audio as well as video metadata describing the video. Video data is extracted from at least two of the video's frames. By combining the extracted video data in an order specified by an identifier generation protocol, an extracted data object is generated. The extracted data object is hashed to generate the unique media identifier, which is stored in association with the video. The identifier generation protocol may indicate the portions of the video data to extract, such as video data corresponding to particular video frames and audio data corresponding to particular audio samples. The extracted data object may include a size of particular video frames, a number of audio samples in the video, or the duration of the video, for example.
    Type: Grant
    Filed: May 19, 2017
    Date of Patent: October 9, 2018
    Assignee: GoPro, Inc.
    Inventors: Otto K. Sievert, Gurprit Cheema, David A. Newman
  • Patent number: 10089710
    Abstract: An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode.
    Type: Grant
    Filed: May 26, 2017
    Date of Patent: October 2, 2018
    Assignee: GoPro, Inc.
    Inventor: Scott Patrick Campbell
  • Patent number: 10083537
    Abstract: A video may be presented on a touchscreen display. Reception of annotation input may be determined based on user's engagement with the touchscreen display. Annotation input may define an in-frame visual annotation for the video. In-frame visual annotation may be associated with a visual portion of the video and one or more points within a duration of the video such that a subsequent presentation of the video includes the in-frame visual annotation positioned at the visual portion of the video at the one or more points. A graphical user interface may be presented on the touchscreen display. The graphical user interface may include one or more animation fields that provide options for selection by the user. The options may define different properties of a moving visual element added to the video. The options may define visual characteristics, presentation periods, and motions of the moving visual element.
    Type: Grant
    Filed: September 16, 2016
    Date of Patent: September 25, 2018
    Assignee: GoPro, Inc.
    Inventors: Stephen Trey Moore, Ross Chinni, Nicholas D. Woodman
  • Patent number: 10084961
    Abstract: A spherical content capture system captures spherical video content. A spherical video sharing platform enables users to share the captured spherical content and enables users to access spherical content shared by other users. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest.
    Type: Grant
    Filed: May 15, 2017
    Date of Patent: September 25, 2018
    Assignee: GoPro, Inc.
    Inventors: Timothy MacMillan, David A. Newman, Balineedu Chowdary Adsumilli
  • Patent number: 10083718
    Abstract: Motion within first video content and second video content may be assessed. A match between the motions assessed within the first video content and the second video content may be determined. The match may including a first set of video frames within the first video content and a second set of video frames within the second video content within which the matching motion is present. A first video portion (including frame(s) of the first set of video frames) of the first video content and a second video portion (include frame(s) of the second set of video frames) of the second video content may be identified based on the match. The first video portion and the second video portion may be concatenated to provide a transition between the first video portion and the second video portion in which continuity of motion may be achieved.
    Type: Grant
    Filed: March 24, 2017
    Date of Patent: September 25, 2018
    Assignee: GoPro, Inc.
    Inventor: Jean Patry
  • Patent number: 10078644
    Abstract: Content proxy may be obtained. Content may include video captured by an action camera. Content proxy may include metadata information obtained contemporaneous with the content and stored in a session container. Content proxy may include lower data rate version of the content (thumbnails). Content proxy information may be viewed and/or analyzed in order to obtain one or more highlights. Content portion corresponding to the highlight may be obtained. Multiple versions of content proxy obtained by multiple cameras may be used to identify, display, and/or share content portions in a multi-camera/multiuser applications.
    Type: Grant
    Filed: January 19, 2016
    Date of Patent: September 18, 2018
    Assignee: GoPro, Inc.
    Inventors: David Newman, Mark Vaden, Rolf Fischer, Vadim Polonichko
  • Patent number: 10074013
    Abstract: Video and corresponding metadata is accessed. Events of interest within the video are identified based on the corresponding metadata, and best scenes are identified based on the identified events of interest. A video summary can be generated including one or more of the identified best scenes. The video summary can be generated using a video summary template with slots corresponding to video clips selected from among sets of candidate video clips. Best scenes can also be identified by receiving an indication of an event of interest within video from a user during the capture of the video. Metadata patterns representing activities identified within video clips can be identified within other videos, which can subsequently be associated with the identified activities.
    Type: Grant
    Filed: October 13, 2014
    Date of Patent: September 11, 2018
    Assignee: GoPro, Inc.
    Inventors: David A. Newman, Adam Silver
  • Publication number: 20180255241
    Abstract: System and methods are disclosed for generating an output video stream from a wide field video stream. The wide field video stream may be created from compiling a plurality of video stream capturing different viewpoints of the same environment simultaneously. Upon selecting a wide field video stream, a first geometric function may be utilized to generate individual intermediate points that correspond to locations in a wide field video stream to be displayed on a particular display space. A second geometric function may be further utilized to generate reference points so that a the pixel on the output video stream are determined from the intermediate points of the wide field video stream of the first geometric function. Upon the execution of the first and second geometric function, an output video stream is generated for display on the determined display space.
    Type: Application
    Filed: October 19, 2015
    Publication date: September 6, 2018
    Applicant: GOPRO, INC.
    Inventors: Alexandre JENNY, Yann Renaud GILQUIN
  • Patent number: 10066427
    Abstract: A camera housing includes a simplified draw latch for securing a first portion and a second portion of the camera housing together. The draw latch can include a draw hook and a wireform mid-linkage. The draw latch enables a user to easily open and close a camera housing, and to establish an air-tight or water-tight seal between the housing portions for use in various activities, including scuba diving.
    Type: Grant
    Filed: June 24, 2014
    Date of Patent: September 4, 2018
    Assignee: GoPro, Inc.
    Inventors: Evan L. Coons, Joshua P. Davies, Todd Lewis
  • Patent number: 10068011
    Abstract: A dataset representing repeated sounds within a musical composition recorded on an audio track may be constructed. An audio track duration of an audio track may be partitioned into partitions of a partition size. A current partition may be compared to remaining partitions of the audio track. Audio information for the current partition may be correlated to audio information for remaining partitions to determine a correlated partition for the current partition from among the remaining partitions of the track duration. The correlated partition determined may be identified as most likely to represent the same sound as the current partition. This comparison process may be performed iteratively, for individual ones of the remaining partitions. Correlation results of the comparison process may be recorded to represent the partition time period of the correlated partition as a function of partition time period of the current partition.
    Type: Grant
    Filed: March 14, 2017
    Date of Patent: September 4, 2018
    Assignee: GoPro, Inc.
    Inventor: David Tcheng
  • Patent number: 10063776
    Abstract: Cameras may monitor its operation and automatically switch between operation modes thereby to best capture users' experiences. Auxiliary sensor data collected by the one or more sensors and/or captured image data may be analyzed to determine when a camera should switch to a different operation mode. The auxiliary sensor data and/or the content of the captured images may include motion information indicating whether the camera or the captured scene has relatively high-motion, relatively low-motion, or no motion. Event(s) may be detected by analyzing the auxiliary sensor data and/or analyzing captured image data, and preferred operation mode(s) suitable for capturing the events can be determined. Each preferred operation mode may be associated with a confidence value. A camera may switch to a preferred operation mode for capturing an event if the event is determined with high confidence to take place at a time point.
    Type: Grant
    Filed: April 29, 2016
    Date of Patent: August 28, 2018
    Assignee: GoPro, Inc.
    Inventors: Shishir Rao Ayalasomayajula, Ravi Kumar Belagutti Shivanandappa, Anandhakumar Chinnaiyan
  • Patent number: 10063777
    Abstract: Cameras may monitor its operation and automatically switch between operation modes thereby to best capture users' experiences. Auxiliary sensor data collected by the one or more sensors and/or captured image data may be analyzed to determine when a camera should switch to a high-motion operation mode. The auxiliary sensor data include motion information of the camera and the content of the captured images include motion information of the captured objects. When a camera or objects captured by the camera are moving rapidly, the camera is switched to operate at the high-motion operation mode to ensure image quality and minimize artifacts to best capture users' experiences. Motion of the camera may be detected or predicted by analyzing the auxiliary sensor data and motion of the captured objects may be detected by analyzing the captured image data thereby to determine whether or not the camera should switch to the high-motion operation mode.
    Type: Grant
    Filed: November 30, 2016
    Date of Patent: August 28, 2018
    Assignee: GoPro, Inc.
    Inventors: Kasturi Rangam, Shishir Rao Ayalasomayajula, Ravi Kumar Belagutti Shivanandappa, Anandhakumar Chinnaiyan
  • Patent number: 10055816
    Abstract: A pair of cameras having an overlapping field of view is aligned based on images captured by image sensors of the pair of cameras. A pixel shift is identified between the images. Based on the identified pixel shift, a calibration is applied to one or both of the pair of cameras. To determine the pixel shift, the camera applies correlation methods including edge matching. Calibrating the pair of cameras may include adjusting a read window on an image sensor. The pixel shift can also be used to determine a time lag, which can be used to synchronize subsequent image captures.
    Type: Grant
    Filed: September 21, 2017
    Date of Patent: August 21, 2018
    Assignee: GoPro, Inc.
    Inventors: Yajie Sun, Timothy Macmillan, Elizabeth Torres Edwards, Sumit Chawla
  • Patent number: 10057538
    Abstract: Methods and apparatus for the generation of interpolated frames of video data. In one embodiment, the interpolated frames of video data are generated by obtaining two or more frames of video data; performing Lagrangian interpolation on one or more portions of the obtained two or more frames of video data to generate a Lagrangian interpolated image; performing Eulerian interpolation on one or more portions of the obtained two or more frames to generate a Eulerian interpolated image; and when the Lagrangian interpolated image and the Eulerian interpolated image should be combined, computing an average interpolated image using the Lagrangian interpolated image and the Eulerian interpolated image; otherwise, selecting either the Lagrangian interpolated image or the Eulerian interpolated image; and generating an interpolated frame of video data using one or more of the average interpolated image, the Lagrangian interpolated image, or the Eulerian interpolated image.
    Type: Grant
    Filed: January 16, 2017
    Date of Patent: August 21, 2018
    Assignee: GOPRO, INC.
    Inventors: Aaron Staranowicz, Ryan Lustig
  • Patent number: 10056115
    Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.
    Type: Grant
    Filed: December 30, 2016
    Date of Patent: August 21, 2018
    Assignee: GoPro, Inc.
    Inventors: Scott Patrick Campbell, Zhinian Jing, Timothy Macmillan, David A. Newman, Balineedu Chowdary Adsumilli
  • Patent number: 10051363
    Abstract: A camera system with image and audio capture capabilities is configured to protect the internal audio components from the external environment. The camera system includes an internal audio assembly with a microphone and an audio circuit board. The audio circuit board is structured such that a gap exists within the board that allows transmission of sound waves from external the environment to the microphone. The audio assembly also includes a compressible annulus, a support annulus, and a waterproof membrane coupled buy a support structure. The waterproof membrane protects the internal components from moisture while still allowing transmission of sound waves. The support structure, compressible annulus, support annulus, and audio circuit board are structured such that a gap exists above the microphone and underneath the waterproof membrane.
    Type: Grant
    Filed: August 24, 2017
    Date of Patent: August 14, 2018
    Assignee: GoPro, Inc.
    Inventor: Joshua Randall Clyne
  • Patent number: 10051206
    Abstract: A processing device generates composite images from a sequence of images. The composite images may be used as frames of video. A foreground/background segmentation is performed at selected frames to extract a plurality of foreground object images depicting a foreground object at different locations as it moves across a scene. The foreground object images are stored to a foreground object list. The foreground object images in the foreground object list are overlaid onto subsequent video frames that follow the respective frames from which they were extracted, thereby generating a composite video.
    Type: Grant
    Filed: March 24, 2016
    Date of Patent: August 14, 2018
    Assignee: GOPRO, INC.
    Inventors: Balineedu Chowdary Adsumilli, Ryan Lustig
  • Patent number: 10044899
    Abstract: Systems and methods are disclosed that capture and compress frames of pixel data. In an implementation, an image sensor chip converts light into pixel data and generates transform data by applying a transform to a portion of the pixel data associated with a pixel category from a plurality of pixel categories and generates compressed pixel data at a variable compression rate by compressing the transform data. The variable compression rate is within an available bandwidth of an output bus that outputs the compressed pixel data.
    Type: Grant
    Filed: February 28, 2017
    Date of Patent: August 7, 2018
    Assignee: GoPro, Inc.
    Inventors: Scott Patrick Campbell, David A. Newman, Brian G. Schunck
  • Patent number: 10043536
    Abstract: Multiple audio files may be synchronized using energy vectors produced from energy portions of individual frequency energy representations. Individual energy samples and time values of individual energy vectors may be compared using a multi-resolution framework to correlate energy samples and time values of multiple audio tracks to one another.
    Type: Grant
    Filed: July 3, 2017
    Date of Patent: August 7, 2018
    Assignee: GoPro, Inc.
    Inventor: David Tcheng
  • Patent number: 10043237
    Abstract: Hyper-hemispherical images may be combined to generate a rectangular projection of a spherical image having an equatorial stitch line along of a line of lowest distortion in the two images. First and second circular images are received representing respective hyper-hemispherical fields of view. A video processing device may project each circular image to a respective rectangular image by mapping an outer edge of the circular image to a first edge of the rectangular image and mapping a center point of the circular image to a second edge of the first rectangular image. The rectangular images may be stitched together along the edges corresponding to the outer edge of the original circular image.
    Type: Grant
    Filed: August 11, 2016
    Date of Patent: August 7, 2018
    Assignee: GOPRO, INC.
    Inventors: Joseph Steel, Timothy Macmillan
  • Patent number: 10043552
    Abstract: Visual information defining the video content may be accessed. The video content may have a progress length. Presentation information for the video content may be accessed. The presentation information may define one or more viewing options for the video content. The one or more viewing options may include one or more viewing directions as a function of progress through the video content. One or more thumbnails for the video content may be generated based on the one or more viewing options for the video content.
    Type: Grant
    Filed: October 8, 2016
    Date of Patent: August 7, 2018
    Assignee: GoPro, Inc.
    Inventor: Loïc Martin
  • Patent number: 10044944
    Abstract: A processing device generates composite images from a sequence of images. The composite images may be used as frames of video. A foreground/background segmentation is performed at selected frames to extract a plurality of foreground object images depicting a foreground object at different locations as it moves across a scene. The foreground object images are stored to a foreground object list. The foreground object images in the foreground object list are overlaid onto subsequent video frames that follow the respective frames from which they were extracted, thereby generating a composite video.
    Type: Grant
    Filed: March 24, 2016
    Date of Patent: August 7, 2018
    Assignee: GOPRO, INC.
    Inventors: Balineedu Chowdary Adsumilli, Ryan Lustig
  • Patent number: 10045120
    Abstract: Disclosed is a system and method for generating a model of the geometric relationships between various audio sources recorded by a multi-camera system. The spatial audio scene module associates source signals, extracted from recorded audio, of audio sources to visual objects identified in videos recorded by one or more cameras. This association may be based on estimated positions of the audio sources based on relative signal gains and delays of the source signal received at each microphone. The estimated positions of audio sources are tracked indirectly by tracking the associated visual objects with computer vision. A virtual microphone module may receive a position for a virtual microphone and synthesize a signal corresponding to the virtual microphone position based on the estimated positions of the audio sources.
    Type: Grant
    Filed: June 20, 2016
    Date of Patent: August 7, 2018
    Assignee: GoPro, Inc.
    Inventors: Balineedu Chowdary Adsumilli, Timothy Macmillan
  • Patent number: 10044972
    Abstract: Systems and methods to automatically transfer audiovisual content include camera devices, client computing devices, and centralized servers. A camera device captures audiovisual content and notifies an external entity, e.g., a (client) computing device or a centralized server. The external entity may effectuate transfer of the content to other computing devices and/or destinations. Operations on the audiovisual content, including but not limited to tagging, transcoding, clipping, speed changes, and/or image cropping, are synchronized and propagated across different computing devices and the centralized server such that any user from any computing device can be presented with the latest version of any particular audiovisual content.
    Type: Grant
    Filed: September 30, 2016
    Date of Patent: August 7, 2018
    Assignee: GoPro, Inc.
    Inventors: Gregory Herd, Jeffrey Youel, Otto Sievert
  • Patent number: 10033915
    Abstract: A peripheral device (e.g., a small wearable device) may operate in conjunction with a camera to enable in-the-moment capture and control. The peripheral device may receive voice commands and uses voice recognition to generate a control signal to control the camera, thereby enabling users to freely participate in their activities while seamlessly controlling the camera in a hands-free manner. Additionally, the peripheral device may operate as a wireless microphone source to capture high quality audio for instead of or in addition to audio captured by the camera. This may provide improved audio quality in certain operating conditions such as during narrating and interviewing.
    Type: Grant
    Filed: August 18, 2017
    Date of Patent: July 24, 2018
    Assignee: GoPro, Inc.
    Inventors: Lisa Boghosian, Jesse Baker
  • Patent number: 10031314
    Abstract: To compensate for a focal plane shifting away from an image plane due to a temperature change, an integrated image sensor and lens assembly includes an optical component and an optics compensator including passively actuating elements. The passively actuating elements couple the optical component to the inner surface of the lens mount. The passively actuating elements and the optics component are configured such that the focal plane is maintained to coincide with or substantially coincide with the image plane. The passively actuating elements and the optics component adjust the distance an incident ray travels in the optics compensator when the temperature changes to thereby maintaining the focal plane to coincide with or substantially coincide with the image plane.
    Type: Grant
    Filed: April 24, 2017
    Date of Patent: July 24, 2018
    Assignee: GoPro, Inc.
    Inventor: Scott Patrick Campbell
  • Patent number: D827696
    Type: Grant
    Filed: August 9, 2016
    Date of Patent: September 4, 2018
    Assignee: GoPro, Inc.
    Inventors: Kielan Crow, Alexander Wroblewski, Joseph Chun, Himay Rashmikant Shukla, Seungheon Lee
  • Patent number: D827697
    Type: Grant
    Filed: August 9, 2016
    Date of Patent: September 4, 2018
    Assignee: GoPro, Inc.
    Inventors: Kielan Crow, Alexander Wroblewski, Joseph Chun, Himay Rashmikant Shukla, Seungheon Lee
  • Patent number: D829809
    Type: Grant
    Filed: July 12, 2017
    Date of Patent: October 2, 2018
    Assignee: GoPro, Inc.
    Inventors: Ryan Harrison, Ross Thayer, Arthur Kwun, Mark E. Costa
  • Patent number: D830446
    Type: Grant
    Filed: December 21, 2015
    Date of Patent: October 9, 2018
    Assignee: GoPro, Inc.
    Inventors: John George Muhlenkamp, IV, Huy Phuong Nguyen
  • Patent number: D831099
    Type: Grant
    Filed: April 12, 2017
    Date of Patent: October 16, 2018
    Assignee: GoPro, Inc.
    Inventors: Michael Paterson, Jordan Todd
  • Patent number: D833511
    Type: Grant
    Filed: June 15, 2017
    Date of Patent: November 13, 2018
    Assignee: GoPro, Inc.
    Inventors: Michael Paterson, Kelan Dammers