Patents by Inventor Timothy Macmillan

Timothy Macmillan has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 9478008
    Abstract: Images captured by multi-camera arrays with overlap regions can be stitched together using image stitching operations. An image stitching operation can be selected for use in stitching images based on a number of factors. An image stitching operation can be selected based on a view window location of a user viewing the images to be stitched together. An image stitching operation can also be selected based on a type, priority, or depth of image features located within an overlap region. Finally, an image stitching operation can be selected based on a likelihood that a particular image stitching operation will produce visible artifacts. Once a stitching operation is selected, the images corresponding to the overlap region can be stitched using the stitching operation, and the stitched image can be stored for subsequent access.
    Type: Grant
    Filed: April 28, 2016
    Date of Patent: October 25, 2016
    Assignee: GoPro, Inc.
    Inventors: Balineedu Chowdary Adsumilli, Scott Patrick Campbell, Timothy Macmillan
  • Patent number: 9473713
    Abstract: Multiple cameras are arranged in an array at a pitch, roll, and yaw that allow the cameras to have adjacent fields of view such that each camera is pointed inward relative to the array. The read window of an image sensor of each camera in a multi-camera array can be adjusted to minimize the overlap between adjacent fields of view, to maximize the correlation within the overlapping portions of the fields of view, and to correct for manufacturing and assembly tolerances. Images from cameras in a multi-camera array with adjacent fields of view can be manipulated using low-power warping and cropping techniques, and can be taped together to form a final image.
    Type: Grant
    Filed: January 8, 2016
    Date of Patent: October 18, 2016
    Assignee: GoPro, Inc.
    Inventors: Timothy MacMillan, Scott Patrick Campell
  • Publication number: 20160205381
    Abstract: A pair of cameras having an overlapping field of view is aligned based on images captured by image sensors of the pair of cameras. A pixel shift is identified between the images. Based on the identified pixel shift, a calibration is applied to one or both of the pair of cameras. To determine the pixel shift, the camera applies correlation methods including edge matching. Calibrating the pair of cameras may include adjusting a read window on an image sensor. The pixel shift can also be used to determine a time lag, which can be used to synchronize subsequent image captures.
    Type: Application
    Filed: March 23, 2016
    Publication date: July 14, 2016
    Inventors: Timothy Macmillan, Scott Patrick Campbell, David A. Newman, Yajie Sun
  • Patent number: 9355433
    Abstract: Images captured by multi-camera arrays with overlap regions can be stitched together using image stitching operations. An image stitching operation can be selected for use in stitching images based on a number of factors. An image stitching operation can be selected based on a view window location of a user viewing the images to be stitched together. An image stitching operation can also be selected based on a type, priority, or depth of image features located within an overlap region. Finally, an image stitching operation can be selected based on a likelihood that a particular image stitching operation will produce visible artifacts. Once a stitching operation is selected, the images corresponding to the overlap region can be stitched using the stitching operation, and the stitched image can be stored for subsequent access.
    Type: Grant
    Filed: June 30, 2015
    Date of Patent: May 31, 2016
    Assignee: GoPro, Inc.
    Inventors: Balineedu Chowdary Adsumilli, Scott Patrick Campbell, Timothy MacMillan
  • Publication number: 20160142655
    Abstract: Multiple cameras are arranged in an array at a pitch, roll, and yaw that allow the cameras to have adjacent fields of view such that each camera is pointed inward relative to the array. The read window of an image sensor of each camera in a multi-camera array can be adjusted to minimize the overlap between adjacent fields of view, to maximize the correlation within the overlapping portions of the fields of view, and to correct for manufacturing and assembly tolerances. Images from cameras in a multi-camera array with adjacent fields of view can be manipulated using low-power warping and cropping techniques, and can be taped together to form a final image.
    Type: Application
    Filed: October 23, 2015
    Publication date: May 19, 2016
    Inventors: Timothy MacMillan, Scott Patrick Campbell
  • Publication number: 20160125570
    Abstract: Multiple cameras are arranged in an array at a pitch, roll, and yaw that allow the cameras to have adjacent fields of view such that each camera is pointed inward relative to the array. The read window of an image sensor of each camera in a multi-camera array can be adjusted to minimize the overlap between adjacent fields of view, to maximize the correlation within the overlapping portions of the fields of view, and to correct for manufacturing and assembly tolerances. Images from cameras in a multi-camera array with adjacent fields of view can be manipulated using low-power warping and cropping techniques, and can be taped together to form a final image.
    Type: Application
    Filed: January 8, 2016
    Publication date: May 5, 2016
    Inventors: Timothy Macmillan, Scott Patrick Campell
  • Patent number: 9330436
    Abstract: Multiple cameras are arranged in an array at a pitch, roll, and yaw that allow the cameras to have adjacent fields of view such that each camera is pointed inward relative to the array. The read window of an image sensor of each camera in a multi-camera array can be adjusted to minimize the overlap between adjacent fields of view, to maximize the correlation within the overlapping portions of the fields of view, and to correct for manufacturing and assembly tolerances. Images from cameras in a multi-camera array with adjacent fields of view can be manipulated using low-power warping and cropping techniques, and can be taped together to form a final image.
    Type: Grant
    Filed: June 18, 2014
    Date of Patent: May 3, 2016
    Assignee: GoPro, Inc.
    Inventors: Timothy MacMillan, Scott Patrick Campbell
  • Patent number: 9325917
    Abstract: A pair of cameras having an overlapping field of view is aligned based on images captured by image sensors of the pair of cameras. A pixel shift is identified between the images. Based on the identified pixel shift, a calibration is applied to one or both of the pair of cameras. To determine the pixel shift, the camera applies correlation methods including edge matching. Calibrating the pair of cameras may include adjusting a read window on an image sensor. The pixel shift can also be used to determine a time lag, which can be used to synchronize subsequent image captures.
    Type: Grant
    Filed: January 27, 2015
    Date of Patent: April 26, 2016
    Assignee: GoPro, Inc.
    Inventors: Timothy MacMillan, Scott Patrick Campbell, David A. Newman, Yajie Sun
  • Publication number: 20160112634
    Abstract: Multiple cameras are arranged in an array at a pitch, roll, and yaw that allow the cameras to have adjacent fields of view such that each camera is pointed inward relative to the array. The read window of an image sensor of each camera in a multi-camera array can be adjusted to minimize the overlap between adjacent fields of view, to maximize the correlation within the overlapping portions of the fields of view, and to correct for manufacturing and assembly tolerances. Images from cameras in a multi-camera array with adjacent fields of view can be manipulated using low-power warping and cropping techniques, and can be taped together to form a final image.
    Type: Application
    Filed: October 23, 2015
    Publication date: April 21, 2016
    Inventors: Timothy MacMillan, Scott Patrick Campbell
  • Patent number: 9262801
    Abstract: Multiple cameras are arranged in an array at a pitch, roll, and yaw that allow the cameras to have adjacent fields of view such that each camera is pointed inward relative to the array. The read window of an image sensor of each camera in a multi-camera array can be adjusted to minimize the overlap between adjacent fields of view, to maximize the correlation within the overlapping portions of the fields of view, and to correct for manufacturing and assembly tolerances. Images from cameras in a multi-camera array with adjacent fields of view can be manipulated using low-power warping and cropping techniques, and can be taped together to form a final image.
    Type: Grant
    Filed: June 18, 2014
    Date of Patent: February 16, 2016
    Assignee: GoPro, Inc.
    Inventors: Timothy MacMillan, Scott Patrick Campbell
  • Publication number: 20160042493
    Abstract: Multiple cameras are arranged in an array at a pitch, roll, and yaw that allow the cameras to have adjacent fields of view such that each camera is pointed inward relative to the array. The read window of an image sensor of each camera in a multi-camera array can be adjusted to minimize the overlap between adjacent fields of view, to maximize the correlation within the overlapping portions of the fields of view, and to correct for manufacturing and assembly tolerances. Images from cameras in a multi-camera array with adjacent fields of view can be manipulated using low-power warping and cropping techniques, and can be taped together to form a final image.
    Type: Application
    Filed: October 23, 2015
    Publication date: February 11, 2016
    Inventors: Timothy MacMillan, Scott Patrick Campbell
  • Publication number: 20160037063
    Abstract: A pair of cameras having an overlapping field of view is aligned based on images captured by image sensors of the pair of cameras. A pixel shift is identified between the images. Based on the identified pixel shift, a calibration is applied to one or both of the pair of cameras. To determine the pixel shift, the camera applies correlation methods including edge matching. Calibrating the pair of cameras may include adjusting a read window on an image sensor. The pixel shift can also be used to determine a time lag, which can be used to synchronize subsequent image captures.
    Type: Application
    Filed: October 6, 2015
    Publication date: February 4, 2016
    Inventors: Yajie Sun, Timothy Macmillan, Elizabeth Torres Edwards, Sumit Chawla
  • Publication number: 20160005435
    Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.
    Type: Application
    Filed: July 1, 2015
    Publication date: January 7, 2016
    Inventors: Scott Patrick Campbell, Zhinian Jing, Timothy MacMillan, David A. Newman, Balineedu Chowdary Adsumilli
  • Patent number: 9197885
    Abstract: A pair of cameras having an overlapping field of view is aligned based on images captured by image sensors of the pair of cameras. A pixel shift is identified between the images. Based on the identified pixel shift, a calibration is applied to one or both of the pair of cameras. To determine the pixel shift, the camera applies correlation methods including edge matching. Calibrating the pair of cameras may include adjusting a read window on an image sensor. The pixel shift can also be used to determine a time lag, which can be used to synchronize subsequent image captures.
    Type: Grant
    Filed: March 20, 2014
    Date of Patent: November 24, 2015
    Assignee: GoPro, Inc.
    Inventors: Yajie Sun, Timothy Macmillan, Elizabeth Torres Martin, Sumit Chawla
  • Patent number: 9196039
    Abstract: Multiple cameras are arranged in an array at a pitch, roll, and yaw that allow the cameras to have adjacent fields of view such that each camera is pointed inward relative to the array. The read window of an image sensor of each camera in a multi-camera array can be adjusted to minimize the overlap between adjacent fields of view, to maximize the correlation within the overlapping portions of the fields of view, and to correct for manufacturing and assembly tolerances. Images from cameras in a multi-camera array with adjacent fields of view can be manipulated using low-power warping and cropping techniques, and can be taped together to form a final image.
    Type: Grant
    Filed: June 18, 2014
    Date of Patent: November 24, 2015
    Assignee: GoPro, Inc.
    Inventors: Timothy MacMillan, Scott Patrick Campbell
  • Publication number: 20150278988
    Abstract: Multiple cameras are arranged in an array at a pitch, roll, and yaw that allow the cameras to have adjacent fields of view such that each camera is pointed inward relative to the array. The read window of an image sensor of each camera in a multi-camera array can be adjusted to minimize the overlap between adjacent fields of view, to maximize the correlation within the overlapping portions of the fields of view, and to correct for manufacturing and assembly tolerances. Images from cameras in a multi-camera array with adjacent fields of view can be manipulated using low-power warping and cropping techniques, and can be taped together to form a final image.
    Type: Application
    Filed: June 18, 2014
    Publication date: October 1, 2015
    Inventors: Timothy MacMillan, Scott Patrick Campbell, Gary Fong
  • Publication number: 20150281590
    Abstract: Multiple cameras are arranged in an array at a pitch, roll, and yaw that allow the cameras to have adjacent fields of view such that each camera is pointed inward relative to the array. The read window of an image sensor of each camera in a multi-camera array can be adjusted to minimize the overlap between adjacent fields of view, to maximize the correlation within the overlapping portions of the fields of view, and to correct for manufacturing and assembly tolerances. Images from cameras in a multi-camera array with adjacent fields of view can be manipulated using low-power warping and cropping techniques, and can be taped together to form a final image.
    Type: Application
    Filed: June 18, 2014
    Publication date: October 1, 2015
    Inventors: Timothy MacMillan, Scott Patrick Campbell, Gary Fong
  • Publication number: 20150279038
    Abstract: Multiple cameras are arranged in an array at a pitch, roll, and yaw that allow the cameras to have adjacent fields of view such that each camera is pointed inward relative to the array. The read window of an image sensor of each camera in a multi-camera array can be adjusted to minimize the overlap between adjacent fields of view, to maximize the correlation within the overlapping portions of the fields of view, and to correct for manufacturing and assembly tolerances. Images from cameras in a multi-camera array with adjacent fields of view can be manipulated using low-power warping and cropping techniques, and can be taped together to form a final image.
    Type: Application
    Filed: June 18, 2014
    Publication date: October 1, 2015
    Inventors: Timothy MacMillan, Scott Patrick Campbell, Gary Fong
  • Publication number: 20150271421
    Abstract: A pair of cameras having an overlapping field of view is aligned based on images captured by image sensors of the pair of cameras. A pixel shift is identified between the images. Based on the identified pixel shift, a calibration is applied to one or both of the pair of cameras. To determine the pixel shift, the camera applies correlation methods including edge matching. Calibrating the pair of cameras may include adjusting a read window on an image sensor. The pixel shift can also be used to determine a time lag, which can be used to synchronize subsequent image captures.
    Type: Application
    Filed: January 27, 2015
    Publication date: September 24, 2015
    Inventors: Timothy MacMillan, Scott Patrick Campbell, David A. Newman, Yajie Sun
  • Publication number: 20150271483
    Abstract: A pair of cameras having an overlapping field of view is aligned based on images captured by image sensors of the pair of cameras. A pixel shift is identified between the images. Based on the identified pixel shift, a calibration is applied to one or both of the pair of cameras. To determine the pixel shift, the camera applies correlation methods including edge matching. Calibrating the pair of cameras may include adjusting a read window on an image sensor. The pixel shift can also be used to determine a time lag, which can be used to synchronize subsequent image captures.
    Type: Application
    Filed: March 20, 2014
    Publication date: September 24, 2015
    Applicant: GoPro, Inc.
    Inventors: Yajie Sun, Timothy Macmillan, Elizabeth Torres Martin, Sumit Chawla