Patents by Inventor Daryl Stimm

Daryl Stimm has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230412788
    Abstract: A viewing direction may define an angle/visual portion of a spherical video at which a viewing window is directed. A trajectory of viewing direction may include changes in viewing directions for playback of spherical video. Abrupt changes in the viewing directions may result in jerky or shaky views of the spherical video. Changes in the viewing directions may be stabilized to provide stabilized views of the spherical video. Amount of stabilization may be limited by a margin constraint.
    Type: Application
    Filed: September 1, 2023
    Publication date: December 21, 2023
    Inventors: Daryl Stimm, William Edward MacDonald, Kyler William Schwartz
  • Publication number: 20230410251
    Abstract: Apparatus and methods for optimized stitching of overcapture content. In one embodiment, the optimized stitching of the overcapture content includes capturing the overcapture content; producing overlap bands associated with the captured overcapture content; downsampling the produced overlap bands; generating derivative images from the downsampled overlap bands; generating a cost map associated with the generated derivative images; determining shortest path information for the generated cost map; generating a warp file based on the determined shortest path information, the generated warp file being utilized for the optimized stitching of the overcapture content. Camera apparatus and a non-transitory computer-readable apparatus are also disclosed.
    Type: Application
    Filed: August 30, 2023
    Publication date: December 21, 2023
    Applicant: GoPro, Inc.
    Inventors: Daryl Stimm, David Newman, Kyler William Schwartz, William Edward MacDonald
  • Patent number: 11818468
    Abstract: Methods and apparatus for shear correction in spherical projections. Embedded devices generally lack the compute and/or memory resources to implement two-dimensional (2D) stitches for spherical projections. Objects (such as a mounting fixture) within a certain distance of the camera may experience a 2D “tear” or “shear” artifact when stitched. Various embodiments of the present disclosure perform two orthogonal 1D stitches: (i) latitudinally across the meridian and (ii) longitudinally along the meridian to approximate the effect of a 2D stitch. Notably, the 1D stitch may be less precise than a true 2D stitch, however the image portion being stitched (e.g., the camera mount) is not the user's subject of interest and can be rendered much more loosely without adverse consequence. Temporal smoothing optimizations are additionally disclosed.
    Type: Grant
    Filed: August 10, 2022
    Date of Patent: November 14, 2023
    Assignee: GoPro, Inc.
    Inventors: David Newman, Daryl Stimm
  • Publication number: 20230362487
    Abstract: Positions of an image capture device during capture of a video may be transferred to a computing device before the video is transferred to the computing device. The positions of the image capture device may be used to determine a viewing window for the video before the video is obtained. The viewing window may be used to present a stabilized view of the video when the video is obtained. For example, a stabilized view of the video may be presented as the video is streamed to the computing device.
    Type: Application
    Filed: July 14, 2023
    Publication date: November 9, 2023
    Inventors: Daryl Stimm, Kyler William Schwartz, Kevin Marcus Grant
  • Publication number: 20230360172
    Abstract: Apparatus and methods for the non-uniform downsampling of captured panoramic images. In one embodiment, a computing device is disclosed that includes a processing apparatus and a non-transitory computer readable apparatus comprising a storage medium have one or more instructions stored thereon. The one or more instructions, when executed by the processing apparatus, being configured to: receive captured images, the captured images obtained using two or more image sensors; non-uniformly downsample the received captured images; and encode the non-uniformly downsampled images. In some variants, the non-uniformly downsampled images take into account a desired area of interest within the captured images. In some implementations, the computing device includes an image capture device. Methods and non-transitory computer readable apparatus are also disclosed.
    Type: Application
    Filed: July 14, 2023
    Publication date: November 9, 2023
    Inventors: Daryl Stimm, David Newman
  • Patent number: 11800141
    Abstract: Methods and apparatus for processing of video content to optimize codec bandwidth. In one embodiment, the method includes capturing panoramic imaging content (e.g., a 360° panorama), mapping the panoramic imaging content into an equi-angular cubemap (EAC) format, and splitting the EAC format into segments for transmission to maximize codec bandwidth. In one exemplary embodiment, the EAC segments are transmitted at a different frame rate than the subsequent display rate of the panoramic imaging content. For example, the mapping and frame rate may be chosen to enable the rendering of 8K, 360° content at 24 fps, using commodity encoder hardware and software that nominally supports 4K content at 60 fps.
    Type: Grant
    Filed: November 2, 2021
    Date of Patent: October 24, 2023
    Assignee: GoPro, Inc.
    Inventors: David A. Newman, Cesar Douady, Alexis Lefebvre, Daryl Stimm, Michael Kraak
  • Patent number: 11790572
    Abstract: Depiction of a physical whiteboard may be captured by an image capture device. The depiction of the physical whiteboard may be detected and used to generate a virtual whiteboard. A change in the depiction of the physical whiteboard may be detected and used to change the virtual whiteboard. A virtual change to the virtual whiteboard may be received and used to change the virtual whiteboard. The change to the virtual whiteboard based on the virtual change may be projected on top of the physical whiteboard.
    Type: Grant
    Filed: December 21, 2021
    Date of Patent: October 17, 2023
    Assignee: GoPro, Inc.
    Inventors: Guillaume Oulès, Daryl Stimm
  • Patent number: 11790488
    Abstract: Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.
    Type: Grant
    Filed: May 27, 2021
    Date of Patent: October 17, 2023
    Assignee: GoPro, Inc.
    Inventors: David Newman, Daryl Stimm, Adeel Abbas
  • Publication number: 20230328201
    Abstract: An image capture device may be physically connected to a computing device using a data cable. The image capture device may masquerade as an ethernet card to the computing device over the physical connection. The image capture device may communicate with the computing device over the physical connection using a wireless communication protocol.
    Type: Application
    Filed: June 9, 2023
    Publication date: October 12, 2023
    Inventor: Daryl Stimm
  • Patent number: 11783447
    Abstract: Apparatus and methods for optimized stitching of overcapture content. In one embodiment, the optimized stitching of the overcapture content includes capturing the overcapture content; producing overlap bands associated with the captured overcapture content; downsampling the produced overlap bands; generating derivative images from the downsampled overlap bands; generating a cost map associated with the generated derivative images; determining shortest path information for the generated cost map; generating a warp file based on the determined shortest path information, the generated warp file being utilized for the optimized stitching of the overcapture content. Camera apparatus and a non-transitory computer-readable apparatus are also disclosed.
    Type: Grant
    Filed: October 25, 2021
    Date of Patent: October 10, 2023
    Assignee: GoPro, Inc.
    Inventors: Daryl Stimm, David Newman, Kyler William Schwartz, William Edward MacDonald
  • Publication number: 20230317115
    Abstract: A video may include visual content having a progress length. A user may interact with a mobile device to set framings of the visual content at moments within the progress length. The framings of the visual content may be provided to a video editing application. The video editing application may utilize the framings set via the mobile device to provide preliminary framings of the visual content at the moments within the progress length.
    Type: Application
    Filed: June 12, 2023
    Publication date: October 5, 2023
    Inventors: Scott Corbin, Joshua Hamill, Daryl Stimm, Kyler William Schwartz
  • Patent number: 11776089
    Abstract: Apparatus and methods for the non-uniform downsampling of captured panoramic images. In one embodiment, a computing device is disclosed that includes a processing apparatus and a non-transitory computer readable apparatus comprising a storage medium have one or more instructions stored thereon. The one or more instructions, when executed by the processing apparatus, being configured to: receive captured images, the captured images obtained using two or more image sensors; non-uniformly downsample the received captured images; and encode the non-uniformly downsampled images. In some variants, the non-uniformly downsampled images take into account a desired area of interest within the captured images. In some implementations, the computing device includes an image capture device. Methods and non-transitory computer readable apparatus are also disclosed.
    Type: Grant
    Filed: October 4, 2022
    Date of Patent: October 3, 2023
    Assignee: GoPro, Inc.
    Inventors: Daryl Stimm, David Newman
  • Publication number: 20230308601
    Abstract: Multiple framings of a video may define different positionings of a viewing window at different moments within the video. The positionings of the viewing window defined by the multiple framings may be used as fixed positionings of the viewing window in a viewing path. The viewing path may define changes in the positioning of the viewing window between the fixed positionings. A presentation of the video may be generated to include the extents of the video within the viewing window.
    Type: Application
    Filed: May 30, 2023
    Publication date: September 28, 2023
    Inventors: Daryl Stimm, Kyler William Schwartz, William Edward MacDonald
  • Patent number: 11750790
    Abstract: A viewing direction may define an angle/visual portion of a spherical video at which a viewing window is directed. A trajectory of viewing direction may include changes in viewing directions for playback of spherical video. Abrupt changes in the viewing directions may result in jerky or shaky views of the spherical video. Changes in the viewing directions may be stabilized to provide stabilized views of the spherical video. Amount of stabilization may be limited by a margin constraint.
    Type: Grant
    Filed: June 28, 2021
    Date of Patent: September 5, 2023
    Assignee: GoPro, Inc.
    Inventors: Daryl Stimm, William Edward MacDonald, Kyler William Schwartz
  • Patent number: 11721366
    Abstract: A video may include visual content having a progress length. A user may interact with a mobile device to set framings of the visual content at moments within the progress length. The framings of the visual content may be provided to a video editing application. The video editing application may utilize the framings set via the mobile device to provide preliminary framings of the visual content at the moments within the progress length.
    Type: Grant
    Filed: December 9, 2021
    Date of Patent: August 8, 2023
    Assignee: GoPro, Inc.
    Inventors: Scott Corbin, Joshua Hamill, Daryl Stimm, Kyler William Schwartz
  • Publication number: 20230247292
    Abstract: Methods and apparatus for stabilizing image data based on a lens polynomial. Non-rectilinear footage can be captured and rectified in-camera; the rectified images may be stabilized to provide rectified stable video. In one exemplary embodiment, the footage is rectified and stabilized based on a lens polynomial and the camera's own movement. In some variants, the rectified stable video may be stored along with its margin track. In-camera rectified stable video provides several benefits over traditional techniques (e.g., the ability to share rectilinear content from the camera without additional post-processing, as well as reduced file sizes of the shared videos). Lens-aware post-processing can reuse portions of the in-camera rectified stable videos while providing additional benefits (e.g., the ability to re-frame the video in post-production).
    Type: Application
    Filed: May 31, 2022
    Publication date: August 3, 2023
    Applicant: GoPro, Inc.
    Inventors: Daryl Stimm, Kyler William Schwartz, Andrew Russell, Robert McIntosh
  • Patent number: 11706527
    Abstract: Positions of an image capture device during capture of a video may be transferred to a computing device before the video is transferred to the computing device. The positions of the image capture device may be used to determine a viewing window for the video before the video is obtained. The viewing window may be used to present a stabilized view of the video when the video is obtained. For example, a stabilized view of the video may be presented as the video is streamed to the computing device.
    Type: Grant
    Filed: June 2, 2022
    Date of Patent: July 18, 2023
    Assignee: GoPro, Inc.
    Inventors: Daryl Stimm, Kyler William Schwartz, Kevin Marcus Grant
  • Patent number: 11683441
    Abstract: An image capture device may be physically connected to a computing device using a data cable. The image capture device may masquerade as an ethernet card to the computing device over the physical connection. The image capture device may communicate with the computing device over the physical connection using a wireless communication protocol.
    Type: Grant
    Filed: June 21, 2022
    Date of Patent: June 20, 2023
    Assignee: GoPro, Inc.
    Inventor: Daryl Stimm
  • Patent number: 11683440
    Abstract: Multiple framings of a video may define different positionings of a viewing window at different moments within the video. The positionings of the viewing window defined by the multiple framings may be used as fixed positionings of the viewing window in a viewing path. The viewing path may define changes in the positioning of the viewing window between the fixed positionings. A presentation of the video may be generated to include the extents of the video within the viewing window.
    Type: Grant
    Filed: October 13, 2022
    Date of Patent: June 20, 2023
    Assignee: GoPro, Inc.
    Inventors: Daryl Stimm, Kyler William Schwartz, William Edward MacDonald
  • Publication number: 20230179862
    Abstract: A video may be captured by an image capture device in motion. A stabilized view of the video may be generated by providing a punchout of the video. The punchout of the video may compensate for rotation of the image capture device during capture of the video. The size of the punchout of the video may be changed based on different rotational positions of to provide a view that includes different extents of the captured visual content. The changes in the size of the punchout may simulate changes in zoom of the visual content.
    Type: Application
    Filed: January 27, 2023
    Publication date: June 8, 2023
    Inventors: Daryl Stimm, Kyler William Schwartz, Peter Tran