Patents by Inventor Daryl Stimm

Daryl Stimm has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20220101882
    Abstract: A video may include visual content having a progress length. A user may interact with a mobile device to set framings of the visual content at moments within the progress length. The framings of the visual content may be provided to a video editing application. The video editing application may utilize the framings set via the mobile device to provide preliminary framings of the visual content at the moments within the progress length.
    Type: Application
    Filed: December 9, 2021
    Publication date: March 31, 2022
    Inventors: Scott Corbin, Joshua Hamill, Daryl Stimm, Kyler William Schwartz
  • Patent number: 11282547
    Abstract: A graphical user interface for framing a video may include a framing element. Responsive to user interaction with the framing element, a framing of the video at a moment may be determined. The framing of the video may define viewing direction, viewing size, viewing rotation, and/or viewing projection for a viewing window. The framing of the video at the moment may be determined based on how the video is being presented when the user interacted with the framing element.
    Type: Grant
    Filed: August 28, 2020
    Date of Patent: March 22, 2022
    Assignee: GoPro, Inc.
    Inventors: Steven Fortunato, Daryl Stimm
  • Publication number: 20220060738
    Abstract: Methods and apparatus for processing of video content to optimize codec bandwidth. In one embodiment, the method includes capturing panoramic imaging content (e.g., a 360° panorama), mapping the panoramic imaging content into an equi-angular cubemap (EAC) format, and splitting the EAC format into segments for transmission to maximize codec bandwidth. In one exemplary embodiment, the EAC segments are transmitted at a different frame rate than the subsequent display rate of the panoramic imaging content. For example, the mapping and frame rate may be chosen to enable the rendering of 8K, 360° content at 24 fps, using commodity encoder hardware and software that nominally supports 4K content at 60 fps.
    Type: Application
    Filed: November 2, 2021
    Publication date: February 24, 2022
    Applicant: GoPro, Inc.
    Inventors: David A. Newman, Cesar Douady, Alexis Lefebvre, Daryl Stimm, Michael Kraak
  • Publication number: 20220044357
    Abstract: Apparatus and methods for optimized stitching of overcapture content. In one embodiment, the optimized stitching of the overcapture content includes capturing the overcapture content; producing overlap bands associated with the captured overcapture content; downsampling the produced overlap bands; generating derivative images from the downsampled overlap bands; generating a cost map associated with the generated derivative images; determining shortest path information for the generated cost map; generating a warp file based on the determined shortest path information, the generated warp file being utilized for the optimized stitching of the overcapture content. Camera apparatus and a non-transitory computer-readable apparatus are also disclosed.
    Type: Application
    Filed: October 25, 2021
    Publication date: February 10, 2022
    Applicant: GoPro, Inc.
    Inventors: Daryl Stimm, David Newman, Kyler William Schwartz, William Edward MacDonald
  • Patent number: 11237690
    Abstract: A viewing window for a spherical video may define which extents of the spherical video are viewable. Abrupt changes in the extents defined by the viewing window may result in non-smooth views of the spherical video, such as stagger, jitter, and/or other jerky motions being included in the views of the spherical video. Changes in the extents defined by the viewing window may be smoothed to provide smoother views of the spherical video.
    Type: Grant
    Filed: January 19, 2021
    Date of Patent: February 1, 2022
    Assignee: GoPro, Inc.
    Inventors: Daryl Stimm, William Edward MacDonald
  • Patent number: 11228781
    Abstract: Methods and apparatus for processing of video content to optimize codec bandwidth. In one embodiment, the method includes capturing panoramic imaging content (e.g., a 360° panorama), mapping the panoramic imaging content into an equi-angular cubemap (EAC) format, and splitting the EAC format into segments for transmission to maximize codec bandwidth. In one exemplary embodiment, the EAC segments are transmitted at a different frame rate than the subsequent display rate of the panoramic imaging content. For example, the mapping and frame rate may be chosen to enable the rendering of 8K, 360-degree content at 24 fps, using commodity encoder hardware and software that nominally supports 4K content at 60 fps.
    Type: Grant
    Filed: September 16, 2019
    Date of Patent: January 18, 2022
    Assignee: GoPro, Inc.
    Inventors: David A. Newman, Cesar Douady, Alexis Lefebvre, Daryl Stimm, Michael Kraak
  • Publication number: 20210392375
    Abstract: Methods and apparatus for processing of video content to optimize codec bandwidth. In one embodiment, the method includes capturing panoramic imaging content (e.g., a 360° panorama), mapping the panoramic imaging content into an equi-angular cubemap (EAC) format, and splitting the EAC format into segments for transmission to maximize codec bandwidth. In one exemplary embodiment, the EAC segments are transmitted at a different frame rate than the subsequent display rate of the panoramic imaging content. For example, the mapping and frame rate may be chosen to enable the rendering of 8K, 360° content at 24 fps, using commodity encoder hardware and software that nominally supports 4K content at 60 fps.
    Type: Application
    Filed: August 30, 2021
    Publication date: December 16, 2021
    Applicant: GoPro, Inc.
    Inventors: David A. Newman, Cesar Douady, Alexis Lefebvre, Daryl Stimm, Michael Kraak
  • Patent number: 11200918
    Abstract: A video may include visual content having a progress length. A user may interact with a mobile device to set framings of the visual content at moments within the progress length. The framings of the visual content may be provided to a video editing application. The video editing application may utilize the framings set via the mobile device to provide preliminary framings of the visual content at the moments within the progress length.
    Type: Grant
    Filed: July 29, 2020
    Date of Patent: December 14, 2021
    Assignee: GoPro, Inc.
    Inventors: Scott Corbin, Joshua Hamill, Daryl Stimm, Kyler William Schwartz
  • Patent number: 11158025
    Abstract: Apparatus and methods for optimized stitching of overcapture content. In one embodiment, the optimized stitching of the overcapture content includes capturing the overcapture content; producing overlap bands associated with the captured overcapture content; downsampling the produced overlap bands; generating derivative images from the downsampled overlap bands; generating a cost map associated with the generated derivative images; determining shortest path information for the generated cost map; generating a warp file based on the determined shortest path information, the generated warp file being utilized for the optimized stitching of the overcapture content. Camera apparatus and a non-transitory computer-readable apparatus are also disclosed.
    Type: Grant
    Filed: December 31, 2018
    Date of Patent: October 26, 2021
    Assignee: GoPro, Inc.
    Inventors: Daryl Stimm, David Newman, Kyler William Schwartz, William Edward MacDonald
  • Publication number: 20210329215
    Abstract: A viewing direction may define an angle/visual portion of a spherical video at which a viewing window is directed. A trajectory of viewing direction may include changes in viewing directions for playback of spherical video. Abrupt changes in the viewing directions may result in jerky or shaky views of the spherical video. Changes in the viewing directions may be stabilized to provide stabilized views of the spherical video. Amount of stabilization may be limited by a margin constraint.
    Type: Application
    Filed: June 28, 2021
    Publication date: October 21, 2021
    Inventors: Daryl Stimm, William Edward MacDonald, Kyler William Schwartz
  • Publication number: 20210287337
    Abstract: Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.
    Type: Application
    Filed: May 27, 2021
    Publication date: September 16, 2021
    Inventors: David Newman, Daryl Stimm, Adeel Abbas
  • Patent number: 11109067
    Abstract: Methods and apparatus for processing of video content to optimize codec bandwidth. In one embodiment, the method includes capturing panoramic imaging content (e.g., a 360° panorama), mapping the panoramic imaging content into an equi-angular cubemap (EAC) format, and splitting the EAC format into segments for transmission to maximize codec bandwidth. In one exemplary embodiment, the EAC segments are transmitted at a different frame rate than the subsequent display rate of the panoramic imaging content. For example, the mapping and frame rate may be chosen to enable the rendering of 8K, 360-degree content at 24 fps, using commodity encoder hardware and software that nominally supports 4K content at 60 fps.
    Type: Grant
    Filed: December 30, 2019
    Date of Patent: August 31, 2021
    Assignee: GoPro, Inc.
    Inventors: David A. Newman, Cesar Douady, Alexis Lefebvre, Daryl Stimm, Michael Kraak
  • Publication number: 20210250523
    Abstract: Multiple framings of a video may define different positionings of a viewing window at different moments within the video. The positionings of the viewing window defined by the multiple framings may be used as fixed positionings of the viewing window in a viewing path. The viewing path may define changes in the positioning of the viewing window between the fixed positionings. A presentation of the video may be generated to include the extents of the video within the viewing window.
    Type: Application
    Filed: April 25, 2021
    Publication date: August 12, 2021
    Inventors: Daryl Stimm, Kyler William Schwartz, William Edward MacDonald
  • Patent number: 11064181
    Abstract: A viewing direction may define an angle/visual portion of a spherical video at which a viewing window is directed. A trajectory of viewing direction may include changes in viewing directions for playback of spherical video. Abrupt changes in the viewing directions may result in jerky or shaky views of the spherical video. Changes in the viewing directions may be stabilized to provide stabilized views of the spherical video. Amount of stabilization may be limited by a margin constraint.
    Type: Grant
    Filed: May 19, 2020
    Date of Patent: July 13, 2021
    Assignee: GOPRO, INC.
    Inventors: Daryl Stimm, William Edward MacDonald, Kyler William Schwartz
  • Publication number: 20210203844
    Abstract: Methods and apparatus for shear correction in spherical projections. Embedded devices generally lack the compute and/or memory resources to implement two-dimensional (2D) stitches for spherical projections. Objects (such as a mounting fixture) within a certain distance of the camera may experience a 2D “tear” or “shear” artifact when stitched. Various embodiments of the present disclosure perform two orthogonal 1D stitches: (i) latitudinally across the meridian and (ii) longitudinally along the meridian to approximate the effect of a 2D stitch. Notably, the 1D stitch may be less precise than a true 2D stitch, however the image portion being stitched (e.g., the camera mount) is not the user's subject of interest and can be rendered much more loosely without adverse consequence. Temporal smoothing optimizations are additionally disclosed.
    Type: Application
    Filed: December 31, 2020
    Publication date: July 1, 2021
    Applicant: GoPro, Inc.
    Inventors: David Newman, Daryl Stimm
  • Patent number: 11049219
    Abstract: Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.
    Type: Grant
    Filed: December 27, 2018
    Date of Patent: June 29, 2021
    Assignee: GoPro, Inc.
    Inventors: David Newman, Daryl Stimm, Adeel Abbas
  • Publication number: 20210174470
    Abstract: Apparatus and methods for the non-uniform downsampling of captured panoramic images. In one embodiment, a computing device is disclosed that includes a processing apparatus and a non-transitory computer readable apparatus comprising a storage medium have one or more instructions stored thereon. The one or more instructions, when executed by the processing apparatus, being configured to: receive captured images, the captured images obtained using two or more image sensors; non-uniformly downsample the received captured images; and encode the non-uniformly downsampled images. In some variants, the non-uniformly downsampled images take into account a desired area of interest within the captured images. In some implementations, the computing device includes an image capture device. Methods and non-transitory computer readable apparatus are also disclosed.
    Type: Application
    Filed: December 23, 2020
    Publication date: June 10, 2021
    Inventors: Daryl Stimm, David Newman
  • Patent number: 11024008
    Abstract: Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.
    Type: Grant
    Filed: February 4, 2020
    Date of Patent: June 1, 2021
    Assignee: GoPro, Inc.
    Inventors: David Newman, Daryl Stimm, Adeel Abbas
  • Publication number: 20210144304
    Abstract: A video may be captured by an image capture device in motion. A stabilized view of the video may be generated by providing a punchout of the video. The punchout of the video may compensate for rotation of the image capture device during capture of the video. The size of the punchout of the video may be changed based on different rotational positions of to provide a view that includes different extents of the captured visual content. The changes in the size of the punchout may simulate changes in zoom of the visual content.
    Type: Application
    Filed: January 19, 2021
    Publication date: May 13, 2021
    Inventors: Daryl Stimm, Kyler William Schwartz, Peter Tran
  • Publication number: 20210141475
    Abstract: A viewing window for a spherical video may define which extents of the spherical video are viewable. Abrupt changes in the extents defined by the viewing window may result in non-smooth views of the spherical video, such as stagger, jitter, and/or other jerky motions being included in the views of the spherical video. Changes in the extents defined by the viewing window may be smoothed to provide smoother views of the spherical video.
    Type: Application
    Filed: January 19, 2021
    Publication date: May 13, 2021
    Inventors: Daryl Stimm, William Edward MacDonald