Patents by Inventor Timothy Macmillan

Timothy Macmillan has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230368329
    Abstract: Apparatus and methods for the stitch zone calculation of a generated projection of a spherical image. In one embodiment, a non-transitory computer-readable apparatus comprising a storage apparatus, the storage apparatus comprising instructions configured to, when executed by a processor apparatus, cause a computerized apparatus to identify a stitch line associated with an equatorial area of a plurality of spherical images; re-orient the plurality of spherical images in accordance with the stitch line; and project the re-oriented plurality of spherical images to a selected image projection type.
    Type: Application
    Filed: July 25, 2023
    Publication date: November 16, 2023
    Inventors: Adeel Abbas, Timothy MacMillan, Cesar Douady-Pleven
  • Publication number: 20230362319
    Abstract: Apparatus and methods for stitching images, or re-stitching previously stitched images. Specifically, the disclosed systems in one implementation save stitching information and/or original overlap source data during an original stitching process. During subsequent retrieval, rendering, and/or display of the stitched images, the originally stitched image can be flexibly augmented, and/or re-stitched to improve the original stitch quality. Practical applications of the disclosed solutions enable, among other things, a user to create and stitch a wide field of view (FOV) panorama from multiple source images on a device with limited processing capability (such as a mobile phone or other capture device). Moreover, post-processing stitching allows for the user to convert from one image projection to another without fidelity loss (or with an acceptable level of loss).
    Type: Application
    Filed: July 10, 2023
    Publication date: November 9, 2023
    Applicant: GoPro, Inc.
    Inventors: Adeel Abbas, Cesar Douady, Timothy MacMillan
  • Publication number: 20230334616
    Abstract: In a video capture system, a virtual lens is simulated when applying a crop or zoom effect to an input video. An input video frame is received from the input video that has a first field of view and an input lens distortion. A selection of a sub-frame representing a portion of the input video frame is obtained that has a second field of view smaller than the first field of view. The sub-frame is processed to remap the input lens distortion to a desired lens distortion in the sub-frame. The processed sub-frame is output.
    Type: Application
    Filed: June 23, 2023
    Publication date: October 19, 2023
    Inventors: David A. Newman, Joshua Edward Bodinet, Otto Kenneth Sievert, Timothy MacMillan
  • Patent number: 11756152
    Abstract: Apparatus and methods for the stitch zone calculation of a generated projection of a spherical image. In one embodiment, a computing device is disclosed which includes logic configured to: obtain a plurality of images; map the plurality of images onto a spherical image; re-orient the spherical image in accordance with a desired stitch line and a desired projection for the desired stitch line; and map the spherical image to the desired projection having the desired stitch line. In a variant, the desired stitch line is mapped onto an optimal stitch zone, the optimal stitch zone characterized as a set of points that defines a single line on the desired projection in which the set of points along the desired projection lie closest to the spherical image in a mean square sense.
    Type: Grant
    Filed: October 4, 2022
    Date of Patent: September 12, 2023
    Assignee: GoPro, Inc.
    Inventors: Adeel Abbas, Timothy Macmillan, Cesar Douady-Pleven
  • Patent number: 11743416
    Abstract: Apparatus and methods for stitching images, or re-stitching previously stitched images. Specifically, the disclosed systems in one implementation save stitching information and/or original overlap source data during an original stitching process. During subsequent retrieval, rendering, and/or display of the stitched images, the originally stitched image can be flexibly augmented, and/or re-stitched to improve the original stitch quality. Practical applications of the disclosed solutions enable, among other things, a user to create and stitch a wide field of view (FOV) panorama from multiple source images on a device with limited processing capability (such as a mobile phone or other capture device). Moreover, post-processing stitching allows for the user to convert from one image projection to another without fidelity loss (or with an acceptable level of loss).
    Type: Grant
    Filed: September 15, 2022
    Date of Patent: August 29, 2023
    Assignee: GoPro, Inc.
    Inventors: Adeel Abbas, Cesar Douady, Timothy MacMillan
  • Patent number: 11688034
    Abstract: In a video capture system, a virtual lens is simulated when applying a crop or zoom effect to an input video. An input video frame is received from the input video that has a first field of view and an input lens distortion caused by a lens used to capture the input video frame. A selection of a sub-frame representing a portion of the input video frame is obtained that has a second field of view smaller than the first field of view. The sub-frame is processed to remap the input lens distortion to a desired lens distortion in the sub-frame. The processed sub-frame is the outputted.
    Type: Grant
    Filed: October 28, 2021
    Date of Patent: June 27, 2023
    Assignee: GoPro, Inc.
    Inventors: David A. Newman, Joshua Edward Bodinet, Otto Kenneth Sievert, Timothy MacMillan
  • Patent number: 11631155
    Abstract: Hyper-hemispherical images may be combined to generate a rectangular projection of a spherical image having an equatorial stitch line along of a line of lowest distortion in the two images. First and second circular images are received representing respective hyper-hemispherical fields of view. A video processing device may project each circular image to a respective rectangular image by mapping an outer edge of the circular image to a first edge of the rectangular image and mapping a center point of the circular image to a second edge of the first rectangular image. The rectangular images may be stitched together along the edges corresponding to the outer edge of the original circular image.
    Type: Grant
    Filed: December 6, 2021
    Date of Patent: April 18, 2023
    Assignee: GoPro, Inc.
    Inventors: Joseph Steel, Timothy Macmillan
  • Publication number: 20230027366
    Abstract: Apparatus and methods for the stitch zone calculation of a generated projection of a spherical image. In one embodiment, a computing device is disclosed which includes logic configured to: obtain a plurality of images; map the plurality of images onto a spherical image; re-orient the spherical image in accordance with a desired stitch line and a desired projection for the desired stitch line; and map the spherical image to the desired projection having the desired stitch line. In a variant, the desired stitch line is mapped onto an optimal stitch zone, the optimal stitch zone characterized as a set of points that defines a single line on the desired projection in which the set of points along the desired projection lie closest to the spherical image in a mean square sense.
    Type: Application
    Filed: October 4, 2022
    Publication date: January 26, 2023
    Inventors: Adeel Abbas, Timothy Macmillan, Cesar Douady-Pleven
  • Publication number: 20230009943
    Abstract: Apparatus and methods for stitching images, or re-stitching previously stitched images. Specifically, the disclosed systems in one implementation save stitching information and/or original overlap source data during an original stitching process. During subsequent retrieval, rendering, and/or display of the stitched images, the originally stitched image can be flexibly augmented, and/or re-stitched to improve the original stitch quality. Practical applications of the disclosed solutions enable, among other things, a user to create and stitch a wide field of view (FOV) panorama from multiple source images on a device with limited processing capability (such as a mobile phone or other capture device). Moreover, post-processing stitching allows for the user to convert from one image projection to another without fidelity loss (or with an acceptable level of loss).
    Type: Application
    Filed: September 15, 2022
    Publication date: January 12, 2023
    Applicant: GoPro, Inc.
    Inventors: Adeel Abbas, Cesar Douady, Timothy MacMillan
  • Patent number: 11477395
    Abstract: Apparatus and methods for stitching images, or re-stitching previously stitched images. Specifically, the disclosed systems in one implementation save stitching information and/or original overlap source data during an original stitching process. During subsequent retrieval, rendering, and/or display of the stitched images, the originally stitched image can be flexibly augmented, and/or re-stitched to improve the original stitch quality. Practical applications of the disclosed solutions enable, among other things, a user to create and stitch a wide field of view (FOV) panorama from multiple source images on a device with limited processing capability (such as a mobile phone or other capture device). Moreover, post-processing stitching allows for the user to convert from one image projection to another without fidelity loss (or with an acceptable level of loss).
    Type: Grant
    Filed: April 26, 2021
    Date of Patent: October 18, 2022
    Assignee: GoPro, Inc.
    Inventors: Adeel Abbas, Cesar Douady, Timothy MacMillan
  • Patent number: 11475534
    Abstract: Apparatus and methods for the stitch zone calculation of a generated projection of a spherical image. In one embodiment, a computing device is disclosed which includes logic configured to: obtain a plurality of images; map the plurality of images onto a spherical image; re-orient the spherical image in accordance with a desired stitch line and a desired projection for the desired stitch line; and map the spherical image to the desired projection having the desired stitch line. In a variant, the desired stitch line is mapped onto an optimal stitch zone, the optimal stitch zone characterized as a set of points that defines a single line on the desired projection in which the set of points along the desired projection lie closest to the spherical image in a mean square sense.
    Type: Grant
    Filed: October 26, 2020
    Date of Patent: October 18, 2022
    Assignee: GoPro, Inc.
    Inventors: Adeel Abbas, Timothy Macmillan, Cesar Douady-Pleven
  • Patent number: 11375173
    Abstract: An image capture device having multiple image sensors having overlapping fields of view that aligns the image sensors based on images captured by image sensors. A pixel shift is identified between the images. Based on the identified pixel shift, a calibration is applied to one or more of the image sensors. To determine the pixel shift, a processor applies correlation methods including edge matching. Calibrating the image sensors may include adjusting a read window on an image sensor. The pixel shift can also be used to determine a time lag, which can be used to synchronize subsequent image captures.
    Type: Grant
    Filed: October 2, 2020
    Date of Patent: June 28, 2022
    Assignee: GoPro, Inc.
    Inventors: Timothy Macmillan, Scott Patrick Campbell, David A. Newman, Yajie Sun
  • Patent number: 11330245
    Abstract: Apparatus and methods for providing a frame packing arrangement for the encoding/decoding of, for example, panoramic content. In one embodiment, the frame packing arrangement utilizes overlapping imaging data so as to enable, for example, a post-decode stitching operation to be performed. The frame packing arrangement may utilize a number of projection formats, such as a cubemap projection, and may utilize any number of differing aspect ratios such as, without limitation, 4×3, 3×2, 4×2, 2×4 aspect ratios. Additionally, the overlapping imaging data may be positioned within the frame packing arrangement chosen so as to improve upon coding efficiency. For example, the overlapping imaging data may be positioned within the frame packing arrangement so as to emphasize image continuity. An encoder apparatus and decoder apparatus for use with the aforementioned frame packing arrangements are also disclosed.
    Type: Grant
    Filed: March 18, 2020
    Date of Patent: May 10, 2022
    Assignee: GoPro, Inc.
    Inventors: Adeel Abbas, Timothy Macmillan
  • Publication number: 20220092729
    Abstract: Hyper-hemispherical images may be combined to generate a rectangular projection of a spherical image having an equatorial stitch line along of a line of lowest distortion in the two images. First and second circular images are received representing respective hyper-hemispherical fields of view. A video processing device may project each circular image to a respective rectangular image by mapping an outer edge of the circular image to a first edge of the rectangular image and mapping a center point of the circular image to a second edge of the first rectangular image. The rectangular images may be stitched together along the edges corresponding to the outer edge of the original circular image.
    Type: Application
    Filed: December 6, 2021
    Publication date: March 24, 2022
    Applicant: GoPro, Inc.
    Inventors: Joseph Steel, Timothy Macmillan
  • Publication number: 20220051365
    Abstract: In a video capture system, a virtual lens is simulated when applying a crop or zoom effect to an input video. An input video frame is received from the input video that has a first field of view and an input lens distortion caused by a lens used to capture the input video frame. A selection of a sub-frame representing a portion of the input video frame is obtained that has a second field of view smaller than the first field of view. The sub-frame is processed to remap the input lens distortion to a desired lens distortion in the sub-frame. The processed sub-frame is the outputted.
    Type: Application
    Filed: October 28, 2021
    Publication date: February 17, 2022
    Inventors: David A. Newman, Joshua Edward Bodinet, Otto Kenneth Sievert, Timothy MacMillan
  • Patent number: 11195253
    Abstract: Hyper-hemispherical images may be combined to generate a rectangular projection of a spherical image having an equatorial stitch line along of a line of lowest distortion in the two images. First and second circular images are received representing respective hyper-hemispherical fields of view. A video processing device may project each circular image to a respective rectangular image by mapping an outer edge of the circular image to a first edge of the rectangular image and mapping a center point of the circular image to a second edge of the first rectangular image. The rectangular images may be stitched together along the edges corresponding to the outer edge of the original circular image.
    Type: Grant
    Filed: May 11, 2020
    Date of Patent: December 7, 2021
    Inventors: Joseph Steel, Timothy Macmillan
  • Patent number: 11164282
    Abstract: In a video capture system, a virtual lens is simulated when applying a crop or zoom effect to an input video. An input video frame is received from the input video that has a first field of view and an input lens distortion caused by a lens used to capture the input video frame. A selection of a sub-frame representing a portion of the input video frame is obtained that has a second field of view smaller than the first field of view. The sub-frame is processed to remap the input lens distortion to a desired lens distortion in the sub-frame. The processed sub-frame is the outputted.
    Type: Grant
    Filed: October 21, 2020
    Date of Patent: November 2, 2021
    Assignee: GOPRO, INC.
    Inventors: David A. Newman, Joshua Edward Bodinet, Otto Kenneth Sievert, Timothy MacMillan
  • Publication number: 20210321047
    Abstract: Apparatus and methods for stitching images, or re-stitching previously stitched images. Specifically, the disclosed systems in one implementation save stitching information and/or original overlap source data during an original stitching process. During subsequent retrieval, rendering, and/or display of the stitched images, the originally stitched image can be flexibly augmented, and/or re-stitched to improve the original stitch quality. Practical applications of the disclosed solutions enable, among other things, a user to create and stitch a wide field of view (FOV) panorama from multiple source images on a device with limited processing capability (such as a mobile phone or other capture device). Moreover, post-processing stitching allows for the user to convert from one image projection to another without fidelity loss (or with an acceptable level of loss).
    Type: Application
    Filed: April 26, 2021
    Publication date: October 14, 2021
    Applicant: GoPro, Inc.
    Inventors: Adeel Abbas, Cesar Douady, Timothy MacMillan
  • Publication number: 20210144356
    Abstract: An image capture device having multiple image sensors having overlapping fields of view that aligns the image sensors based on images captured by image sensors. A pixel shift is identified between the images. Based on the identified pixel shift, a calibration is applied to one or more of the image sensors. To determine the pixel shift, a processor applies correlation methods including edge matching. Calibrating the image sensors may include adjusting a read window on an image sensor. The pixel shift can also be used to determine a time lag, which can be used to synchronize subsequent image captures.
    Type: Application
    Filed: October 2, 2020
    Publication date: May 13, 2021
    Inventors: Timothy Macmillan, Scott Patrick Campbell, David A. Newman, Yajie Sun
  • Patent number: 10992881
    Abstract: Apparatus and methods for stitching images, or re-stitching previously stitched images. Specifically, the disclosed systems in one implementation save stitching information and/or original overlap source data during an original stitching process. During subsequent retrieval, rendering, and/or display of the stitched images, the originally stitched image can be flexibly augmented, and/or re-stitched to improve the original stitch quality. Practical applications of the disclosed solutions enable, among other things, a user to create and stitch a wide field of view (FOV) panorama from multiple source images on a device with limited processing capability (such as a mobile phone or other capture device). Moreover, post-processing stitching allows for the user to convert from one image projection to another without fidelity loss (or with an acceptable level of loss).
    Type: Grant
    Filed: October 28, 2019
    Date of Patent: April 27, 2021
    Assignee: Gopro, Inc.
    Inventors: Adeel Abbas, Cesar Douady, Timothy MacMillan