Patents by Inventor Daryl Stimm

Daryl Stimm has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11064181
    Abstract: A viewing direction may define an angle/visual portion of a spherical video at which a viewing window is directed. A trajectory of viewing direction may include changes in viewing directions for playback of spherical video. Abrupt changes in the viewing directions may result in jerky or shaky views of the spherical video. Changes in the viewing directions may be stabilized to provide stabilized views of the spherical video. Amount of stabilization may be limited by a margin constraint.
    Type: Grant
    Filed: May 19, 2020
    Date of Patent: July 13, 2021
    Assignee: GOPRO, INC.
    Inventors: Daryl Stimm, William Edward MacDonald, Kyler William Schwartz
  • Publication number: 20210203844
    Abstract: Methods and apparatus for shear correction in spherical projections. Embedded devices generally lack the compute and/or memory resources to implement two-dimensional (2D) stitches for spherical projections. Objects (such as a mounting fixture) within a certain distance of the camera may experience a 2D “tear” or “shear” artifact when stitched. Various embodiments of the present disclosure perform two orthogonal 1D stitches: (i) latitudinally across the meridian and (ii) longitudinally along the meridian to approximate the effect of a 2D stitch. Notably, the 1D stitch may be less precise than a true 2D stitch, however the image portion being stitched (e.g., the camera mount) is not the user's subject of interest and can be rendered much more loosely without adverse consequence. Temporal smoothing optimizations are additionally disclosed.
    Type: Application
    Filed: December 31, 2020
    Publication date: July 1, 2021
    Applicant: GoPro, Inc.
    Inventors: David Newman, Daryl Stimm
  • Patent number: 11049219
    Abstract: Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.
    Type: Grant
    Filed: December 27, 2018
    Date of Patent: June 29, 2021
    Assignee: GoPro, Inc.
    Inventors: David Newman, Daryl Stimm, Adeel Abbas
  • Publication number: 20210174470
    Abstract: Apparatus and methods for the non-uniform downsampling of captured panoramic images. In one embodiment, a computing device is disclosed that includes a processing apparatus and a non-transitory computer readable apparatus comprising a storage medium have one or more instructions stored thereon. The one or more instructions, when executed by the processing apparatus, being configured to: receive captured images, the captured images obtained using two or more image sensors; non-uniformly downsample the received captured images; and encode the non-uniformly downsampled images. In some variants, the non-uniformly downsampled images take into account a desired area of interest within the captured images. In some implementations, the computing device includes an image capture device. Methods and non-transitory computer readable apparatus are also disclosed.
    Type: Application
    Filed: December 23, 2020
    Publication date: June 10, 2021
    Inventors: Daryl Stimm, David Newman
  • Patent number: 11024008
    Abstract: Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.
    Type: Grant
    Filed: February 4, 2020
    Date of Patent: June 1, 2021
    Assignee: GoPro, Inc.
    Inventors: David Newman, Daryl Stimm, Adeel Abbas
  • Publication number: 20210141475
    Abstract: A viewing window for a spherical video may define which extents of the spherical video are viewable. Abrupt changes in the extents defined by the viewing window may result in non-smooth views of the spherical video, such as stagger, jitter, and/or other jerky motions being included in the views of the spherical video. Changes in the extents defined by the viewing window may be smoothed to provide smoother views of the spherical video.
    Type: Application
    Filed: January 19, 2021
    Publication date: May 13, 2021
    Inventors: Daryl Stimm, William Edward MacDonald
  • Publication number: 20210144304
    Abstract: A video may be captured by an image capture device in motion. A stabilized view of the video may be generated by providing a punchout of the video. The punchout of the video may compensate for rotation of the image capture device during capture of the video. The size of the punchout of the video may be changed based on different rotational positions of to provide a view that includes different extents of the captured visual content. The changes in the size of the punchout may simulate changes in zoom of the visual content.
    Type: Application
    Filed: January 19, 2021
    Publication date: May 13, 2021
    Inventors: Daryl Stimm, Kyler William Schwartz, Peter Tran
  • Patent number: 11004176
    Abstract: Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.
    Type: Grant
    Filed: February 4, 2020
    Date of Patent: May 11, 2021
    Assignee: GoPro, Inc.
    Inventors: David Newman, Daryl Stimm, Adeel Abbas
  • Patent number: 10992880
    Abstract: Multiple framings of a video may define different positionings of a viewing window at different moments within the video. The positionings of the viewing window defined by the multiple framings may be used as fixed positionings of the viewing window in a viewing path. The viewing path may define changes in the positioning of the viewing window between the fixed positionings. A presentation of the video may be generated to include the extents of the video within the viewing window.
    Type: Grant
    Filed: August 28, 2020
    Date of Patent: April 27, 2021
    Assignee: GoPro, Inc.
    Inventors: Daryl Stimm, Kyler William Schwartz, William Edward MacDonald
  • Publication number: 20210090214
    Abstract: Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.
    Type: Application
    Filed: December 27, 2018
    Publication date: March 25, 2021
    Inventors: David Newman, Daryl Stimm, Adeel Abbas
  • Publication number: 20210082085
    Abstract: Apparatus and methods for optimized stitching of overcapture content. In one embodiment, the optimized stitching of the overcapture content includes capturing the overcapture content; producing overlap bands associated with the captured overcapture content; downsampling the produced overlap bands; generating derivative images from the downsampled overlap bands; generating a cost map associated with the generated derivative images; determining shortest path information for the generated cost map; generating a warp file based on the determined shortest path information, the generated warp file being utilized for the optimized stitching of the overcapture content. Camera apparatus and a non-transitory computer-readable apparatus are also disclosed.
    Type: Application
    Filed: December 31, 2018
    Publication date: March 18, 2021
    Inventors: Daryl Stimm, David Newman, Kyler William Schwartz, William Edward MacDonald
  • Patent number: 10921946
    Abstract: A viewing window for a spherical video may define which extents of the spherical video are viewable. Abrupt changes in the extents defined by the viewing window may result in non-smooth views of the spherical video, such as stagger, jitter, and/or other jerky motions being included in the views of the spherical video. Changes in the extents defined by the viewing window may be smoothed to provide smoother views of the spherical video.
    Type: Grant
    Filed: July 27, 2018
    Date of Patent: February 16, 2021
    Assignee: GoPro, Inc.
    Inventors: Daryl Stimm, William Edward MacDonald
  • Patent number: 10917573
    Abstract: A video may be captured by an image capture device in motion. A stabilized view of the video may be generated by providing a punchout of the video. The punchout of the video may compensate for rotation of the image capture device during capture of the video. The size of the punchout of the video may be changed based on different rotational positions of to provide a view that includes different extents of the captured visual content. The changes in the size of the punchout may simulate changes in zoom of the visual content.
    Type: Grant
    Filed: May 21, 2019
    Date of Patent: February 9, 2021
    Assignee: GoPro, Inc.
    Inventors: Daryl Stimm, Kyler William Schwartz, Peter Tran
  • Publication number: 20200413086
    Abstract: Methods and apparatus for processing of video content to optimize codec bandwidth. In one embodiment, the method includes capturing panoramic imaging content (e.g., a 360° panorama), mapping the panoramic imaging content into an equi-angular cubemap (EAC) format, and splitting the EAC format into segments for transmission to maximize codec bandwidth. In one exemplary embodiment, the EAC segments are transmitted at a different frame rate than the subsequent display rate of the panoramic imaging content. For example, the mapping and frame rate may be chosen to enable the rendering of 8K, 360-degree content at 24 fps, using commodity encoder hardware and software that nominally supports 4K content at 60 fps.
    Type: Application
    Filed: September 16, 2019
    Publication date: December 31, 2020
    Inventors: David A. Newman, Cesar Douady, Alexis Lefebvre, Daryl Stimm, Michael Kraak
  • Publication number: 20200413093
    Abstract: Methods and apparatus for processing of video content to optimize codec bandwidth. In one embodiment, the method includes capturing panoramic imaging content (e.g., a 360° panorama), mapping the panoramic imaging content into an equi-angular cubemap (EAC) format, and splitting the EAC format into segments for transmission to maximize codec bandwidth. In one exemplary embodiment, the EAC segments are transmitted at a different frame rate than the subsequent display rate of the panoramic imaging content. For example, the mapping and frame rate may be chosen to enable the rendering of 8K, 360-degree content at 24 fps, using commodity encoder hardware and software that nominally supports 4K content at 60 fps.
    Type: Application
    Filed: December 30, 2019
    Publication date: December 31, 2020
    Inventors: David A. Newman, Cesar Douady, Alexis Lefebvre, Daryl Stimm, Michael Kraak
  • Patent number: 10878536
    Abstract: Apparatus and methods for the non-uniform downsampling of captured panoramic images. In one embodiment, a computing device is disclosed that includes a processing apparatus and a non-transitory computer readable apparatus comprising a storage medium have one or more instructions stored thereon. The one or more instructions, when executed by the processing apparatus, being configured to: receive captured images, the captured images obtained using two or more image sensors; non-uniformly downsample the received captured images; and encode the non-uniformly downsampled images. In some variants, the non-uniformly downsampled images take into account a desired area of interest within the captured images. In some implementations, the computing device includes an image capture device. Methods and non-transitory computer readable apparatus are also disclosed.
    Type: Grant
    Filed: December 28, 2018
    Date of Patent: December 29, 2020
    Assignee: GoPro, inc.
    Inventors: Daryl Stimm, David Newman
  • Publication number: 20200351485
    Abstract: A viewing direction may define an angle/visual portion of a spherical video at which a viewing window is directed. A trajectory of viewing direction may include changes in viewing directions for playback of spherical video. Abrupt changes in the viewing directions may result in jerky or shaky views of the spherical video. Changes in the viewing directions may be stabilized to provide stabilized views of the spherical video. Amount of stabilization may be limited by a margin constraint.
    Type: Application
    Filed: May 19, 2020
    Publication date: November 5, 2020
    Inventors: Daryl Stimm, William Edward MacDonald, Kyler William Schwartz
  • Patent number: 10681332
    Abstract: A viewing direction may define an angle/visual portion of a spherical video at which a viewing window is directed. A trajectory of viewing direction may include changes in viewing directions for playback of spherical video. Abrupt changes in the viewing directions may result in jerky or shaky views of the spherical video. Changes in the viewing directions may be stabilized to provide stabilized views of the spherical video. Amount of stabilization may be limited by a margin constraint.
    Type: Grant
    Filed: July 27, 2018
    Date of Patent: June 9, 2020
    Assignee: GoPro, Inc.
    Inventors: Daryl Stimm, William Edward MacDonald, Kyler William Schwartz
  • Publication number: 20200128223
    Abstract: Systems and methods for tagging portions a spherical video segment are provided. The spherical video segment may include visual content. User input indicating a moment in time in the spherical video segment and a viewing angle corresponding to the moment in time may be received. Tag information for the spherical video segment may be generated. The tag information may identify the moment in time and the viewing angle such that a subsequent presentation of the spherical video segment, proximate to the moment in time, includes a notification that the viewing angle is outside a display field of view based on the viewing angle being located outside the display field of view.
    Type: Application
    Filed: December 19, 2019
    Publication date: April 23, 2020
    Inventors: Joven Matias, David Newman, Ha Phan, Timothy Bucklin, Daryl Stimm
  • Patent number: 10536683
    Abstract: Systems and methods for marking an event of interest within a spherical video segment are provided. The spherical video segment may define visual content viewable from a point of view. User input may designate an event of interest within the visual content. The user input may indicate a moment in time in the spherical video segment and a viewing angle of the event of interest. Tag information associated with the event of interest may be generated. The tag information may identify the moment in time and the viewing angle such that a subsequent presentation of the spherical video segment, proximate to the moment in time, includes an alert notification that the event of interest is outside a display field of view based on the viewing angle being outside the display field of view.
    Type: Grant
    Filed: November 9, 2018
    Date of Patent: January 14, 2020
    Assignee: GoPro, Inc.
    Inventors: Joven Matias, David Newman, Ha Phan, Timothy Bucklin, Daryl Stimm