Patents by Inventor Kyler William Schwartz

Kyler William Schwartz has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11887210
    Abstract: Methods and apparatus for image processing of spherical content via hardware acceleration components. In one embodiment, an EAC image is subdivided into facets via existing software addressing and written into the memory buffers (normally used for rectilinear cubemaps) in a graphics processing unit (GPU). The EAC facets may be translated, rotated, and/or mirrored so as to align with the expected three-dimensional (3D) coordinate space. The GPU may use existing hardware accelerator logic, parallelization, and/or addressing logic to greatly improve 3D image processing effects (such as a multi-band blend using Gaussian blurs.
    Type: Grant
    Filed: September 8, 2022
    Date of Patent: January 30, 2024
    Assignee: GoPro, Inc.
    Inventors: William Edward MacDonald, Kyler William Schwartz, David A. Newman
  • Publication number: 20230410251
    Abstract: Apparatus and methods for optimized stitching of overcapture content. In one embodiment, the optimized stitching of the overcapture content includes capturing the overcapture content; producing overlap bands associated with the captured overcapture content; downsampling the produced overlap bands; generating derivative images from the downsampled overlap bands; generating a cost map associated with the generated derivative images; determining shortest path information for the generated cost map; generating a warp file based on the determined shortest path information, the generated warp file being utilized for the optimized stitching of the overcapture content. Camera apparatus and a non-transitory computer-readable apparatus are also disclosed.
    Type: Application
    Filed: August 30, 2023
    Publication date: December 21, 2023
    Applicant: GoPro, Inc.
    Inventors: Daryl Stimm, David Newman, Kyler William Schwartz, William Edward MacDonald
  • Publication number: 20230412788
    Abstract: A viewing direction may define an angle/visual portion of a spherical video at which a viewing window is directed. A trajectory of viewing direction may include changes in viewing directions for playback of spherical video. Abrupt changes in the viewing directions may result in jerky or shaky views of the spherical video. Changes in the viewing directions may be stabilized to provide stabilized views of the spherical video. Amount of stabilization may be limited by a margin constraint.
    Type: Application
    Filed: September 1, 2023
    Publication date: December 21, 2023
    Inventors: Daryl Stimm, William Edward MacDonald, Kyler William Schwartz
  • Publication number: 20230362487
    Abstract: Positions of an image capture device during capture of a video may be transferred to a computing device before the video is transferred to the computing device. The positions of the image capture device may be used to determine a viewing window for the video before the video is obtained. The viewing window may be used to present a stabilized view of the video when the video is obtained. For example, a stabilized view of the video may be presented as the video is streamed to the computing device.
    Type: Application
    Filed: July 14, 2023
    Publication date: November 9, 2023
    Inventors: Daryl Stimm, Kyler William Schwartz, Kevin Marcus Grant
  • Patent number: 11783447
    Abstract: Apparatus and methods for optimized stitching of overcapture content. In one embodiment, the optimized stitching of the overcapture content includes capturing the overcapture content; producing overlap bands associated with the captured overcapture content; downsampling the produced overlap bands; generating derivative images from the downsampled overlap bands; generating a cost map associated with the generated derivative images; determining shortest path information for the generated cost map; generating a warp file based on the determined shortest path information, the generated warp file being utilized for the optimized stitching of the overcapture content. Camera apparatus and a non-transitory computer-readable apparatus are also disclosed.
    Type: Grant
    Filed: October 25, 2021
    Date of Patent: October 10, 2023
    Assignee: GoPro, Inc.
    Inventors: Daryl Stimm, David Newman, Kyler William Schwartz, William Edward MacDonald
  • Publication number: 20230317115
    Abstract: A video may include visual content having a progress length. A user may interact with a mobile device to set framings of the visual content at moments within the progress length. The framings of the visual content may be provided to a video editing application. The video editing application may utilize the framings set via the mobile device to provide preliminary framings of the visual content at the moments within the progress length.
    Type: Application
    Filed: June 12, 2023
    Publication date: October 5, 2023
    Inventors: Scott Corbin, Joshua Hamill, Daryl Stimm, Kyler William Schwartz
  • Publication number: 20230308601
    Abstract: Multiple framings of a video may define different positionings of a viewing window at different moments within the video. The positionings of the viewing window defined by the multiple framings may be used as fixed positionings of the viewing window in a viewing path. The viewing path may define changes in the positioning of the viewing window between the fixed positionings. A presentation of the video may be generated to include the extents of the video within the viewing window.
    Type: Application
    Filed: May 30, 2023
    Publication date: September 28, 2023
    Inventors: Daryl Stimm, Kyler William Schwartz, William Edward MacDonald
  • Patent number: 11750790
    Abstract: A viewing direction may define an angle/visual portion of a spherical video at which a viewing window is directed. A trajectory of viewing direction may include changes in viewing directions for playback of spherical video. Abrupt changes in the viewing directions may result in jerky or shaky views of the spherical video. Changes in the viewing directions may be stabilized to provide stabilized views of the spherical video. Amount of stabilization may be limited by a margin constraint.
    Type: Grant
    Filed: June 28, 2021
    Date of Patent: September 5, 2023
    Assignee: GoPro, Inc.
    Inventors: Daryl Stimm, William Edward MacDonald, Kyler William Schwartz
  • Patent number: 11721366
    Abstract: A video may include visual content having a progress length. A user may interact with a mobile device to set framings of the visual content at moments within the progress length. The framings of the visual content may be provided to a video editing application. The video editing application may utilize the framings set via the mobile device to provide preliminary framings of the visual content at the moments within the progress length.
    Type: Grant
    Filed: December 9, 2021
    Date of Patent: August 8, 2023
    Assignee: GoPro, Inc.
    Inventors: Scott Corbin, Joshua Hamill, Daryl Stimm, Kyler William Schwartz
  • Publication number: 20230247292
    Abstract: Methods and apparatus for stabilizing image data based on a lens polynomial. Non-rectilinear footage can be captured and rectified in-camera; the rectified images may be stabilized to provide rectified stable video. In one exemplary embodiment, the footage is rectified and stabilized based on a lens polynomial and the camera's own movement. In some variants, the rectified stable video may be stored along with its margin track. In-camera rectified stable video provides several benefits over traditional techniques (e.g., the ability to share rectilinear content from the camera without additional post-processing, as well as reduced file sizes of the shared videos). Lens-aware post-processing can reuse portions of the in-camera rectified stable videos while providing additional benefits (e.g., the ability to re-frame the video in post-production).
    Type: Application
    Filed: May 31, 2022
    Publication date: August 3, 2023
    Applicant: GoPro, Inc.
    Inventors: Daryl Stimm, Kyler William Schwartz, Andrew Russell, Robert McIntosh
  • Patent number: 11706527
    Abstract: Positions of an image capture device during capture of a video may be transferred to a computing device before the video is transferred to the computing device. The positions of the image capture device may be used to determine a viewing window for the video before the video is obtained. The viewing window may be used to present a stabilized view of the video when the video is obtained. For example, a stabilized view of the video may be presented as the video is streamed to the computing device.
    Type: Grant
    Filed: June 2, 2022
    Date of Patent: July 18, 2023
    Assignee: GoPro, Inc.
    Inventors: Daryl Stimm, Kyler William Schwartz, Kevin Marcus Grant
  • Patent number: 11683440
    Abstract: Multiple framings of a video may define different positionings of a viewing window at different moments within the video. The positionings of the viewing window defined by the multiple framings may be used as fixed positionings of the viewing window in a viewing path. The viewing path may define changes in the positioning of the viewing window between the fixed positionings. A presentation of the video may be generated to include the extents of the video within the viewing window.
    Type: Grant
    Filed: October 13, 2022
    Date of Patent: June 20, 2023
    Assignee: GoPro, Inc.
    Inventors: Daryl Stimm, Kyler William Schwartz, William Edward MacDonald
  • Publication number: 20230179862
    Abstract: A video may be captured by an image capture device in motion. A stabilized view of the video may be generated by providing a punchout of the video. The punchout of the video may compensate for rotation of the image capture device during capture of the video. The size of the punchout of the video may be changed based on different rotational positions of to provide a view that includes different extents of the captured visual content. The changes in the size of the punchout may simulate changes in zoom of the visual content.
    Type: Application
    Filed: January 27, 2023
    Publication date: June 8, 2023
    Inventors: Daryl Stimm, Kyler William Schwartz, Peter Tran
  • Patent number: 11622076
    Abstract: A video may be captured by an image capture device in motion. A stabilized view of the video may be generated by providing a punchout of the video. The punchout of the video may compensate for rotation of the image capture device during capture of the video. The size of the punchout of the video may be changed based on different rotational positions of to provide a view that includes different extents of the captured visual content. The changes in the size of the punchout may simulate changes in zoom of the visual content.
    Type: Grant
    Filed: April 14, 2022
    Date of Patent: April 4, 2023
    Assignee: GoPro, Inc.
    Inventors: Daryl Stimm, Kyler William Schwartz, Peter Tran
  • Publication number: 20230034490
    Abstract: Multiple framings of a video may define different positionings of a viewing window at different moments within the video. The positionings of the viewing window defined by the multiple framings may be used as fixed positionings of the viewing window in a viewing path. The viewing path may define changes in the positioning of the viewing window between the fixed positionings. A presentation of the video may be generated to include the extents of the video within the viewing window.
    Type: Application
    Filed: October 13, 2022
    Publication date: February 2, 2023
    Inventors: Daryl Stimm, Kyler William Schwartz, William Edward MacDonald
  • Publication number: 20230011843
    Abstract: Methods and apparatus for image processing of spherical content via hardware acceleration components. In one embodiment, an EAC image is subdivided into facets via existing software addressing and written into the memory buffers (normally used for rectilinear cubemaps) in a graphics processing unit (GPU). The EAC facets may be translated, rotated, and/or mirrored so as to align with the expected three-dimensional (3D) coordinate space. The GPU may use existing hardware accelerator logic, parallelization, and/or addressing logic to greatly improve 3D image processing effects (such as a multi-band blend using Gaussian blurs.
    Type: Application
    Filed: September 8, 2022
    Publication date: January 12, 2023
    Applicant: GoPro, Inc.
    Inventors: William Edward MacDonald, Kyler William Schwartz, David A. Newman
  • Patent number: 11481863
    Abstract: Methods and apparatus for image processing of spherical content via hardware acceleration components. In one embodiment, an EAC image is subdivided into facets via existing software addressing and written into the memory buffers (normally used for rectilinear cubemaps) in a graphics processing unit (GPU). The EAC facets may be translated, rotated, and/or mirrored so as to align with the expected three-dimensional (3D) coordinate space. The GPU may use existing hardware accelerator logic, parallelization, and/or addressing logic to greatly improve 3D image processing effects (such as a multi-band blend using Gaussian blurs.
    Type: Grant
    Filed: October 23, 2020
    Date of Patent: October 25, 2022
    Inventors: William Edward MacDonald, Kyler William Schwartz, David A. Newman
  • Patent number: 11477394
    Abstract: Multiple framings of a video may define different positionings of a viewing window at different moments within the video. The positionings of the viewing window defined by the multiple framings may be used as fixed positionings of the viewing window in a viewing path. The viewing path may define changes in the positioning of the viewing window between the fixed positionings. A presentation of the video may be generated to include the extents of the video within the viewing window.
    Type: Grant
    Filed: April 25, 2021
    Date of Patent: October 18, 2022
    Assignee: GoPro, Inc.
    Inventors: Daryl Stimm, Kyler William Schwartz, William Edward MacDonald
  • Publication number: 20220279128
    Abstract: A video may be captured by an image capture device in motion. A horizon-leveled view of the video may be generated by providing a punchout of the video. The punchout of the video may compensate for rotation of the image capture device during capture of the video. The placement of the punchout of the video may be changed based on different rotational positions of to provide a view in which a horizon depicted within the video is leveled.
    Type: Application
    Filed: May 16, 2022
    Publication date: September 1, 2022
    Inventors: Daryl Stimm, Kyler William Schwartz, Jonathan Leland Thorn
  • Publication number: 20220239833
    Abstract: A video may be captured by an image capture device in motion. A stabilized view of the video may be generated by providing a punchout of the video. The punchout of the video may compensate for rotation of the image capture device during capture of the video. The size of the punchout of the video may be changed based on different rotational positions of to provide a view that includes different extents of the captured visual content. The changes in the size of the punchout may simulate changes in zoom of the visual content.
    Type: Application
    Filed: April 14, 2022
    Publication date: July 28, 2022
    Inventors: Daryl Stimm, Kyler William Schwartz, Peter Tran