Patents by Inventor Sheldon Katz

Sheldon Katz has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10652519
    Abstract: Embodiments relate to insertions in 3D video. Virtual camera models enable insertions to be reconciled relative to left and right channels of the 3D video to maximize 3D accuracy and realism of the insertions. Cameras are formed as composites, and can be derived from other models. The camera models can be based on a visual analysis of the 3D video, and can be based on 3D camera data including toe-in and ocular spacing. The camera data may be derived from information collected using instrumentation connect to a 3D camera system, derived based on visual analysis of the 3D video, or derived using a combination of information collected using instrumentation and visual analysis of 3D video. Insertions can be made on-site or at a remote site, and camera data can be embedded in the 3D video and/or separately transmitted to a remote site.
    Type: Grant
    Filed: September 10, 2010
    Date of Patent: May 12, 2020
    Assignee: Disney Enterprises, Inc.
    Inventors: Sheldon Katz, Gregory House, Howard Kennedy
  • Patent number: 9667887
    Abstract: A method, apparatus, and computer program product are described to improve a lens distortion curve which roughly approximates distortion caused by a camera lens to capture an event onto video. The present invention selects a generic lens distortion curve that roughly approximates the distortion caused by the camera lens while capturing the event onto the video. The video as well as information from the generic lens distortion curve is used to generate a camera model. This camera model is used to integrate virtual insertions into the video. If the camera model is sufficiently accurate to present a realistic appearance of the virtual insertions to the remote viewer, this camera model is then used to integrate more virtual insertions into the video. However, if the camera model is not sufficiently accurate, an iterative process is employed to refine this camera model.
    Type: Grant
    Filed: November 19, 2010
    Date of Patent: May 30, 2017
    Assignee: DISNEY ENTERPRISES, INC.
    Inventors: Sheldon Katz, Gregory House
  • Patent number: 8665374
    Abstract: Embodiments of this invention relate to controlling insertion of visual elements integrated into video. In an embodiment, a method enables control of insertions in a video. In the embodiment, control data is received from a user input device. Movement of at least one point of interest in a video is analyzed to determine video metadata. Finally, a visual element is inserted into a video according to the control data, and the visual element changes or moves with the video as specified by the video metadata to appear integrated with the video.
    Type: Grant
    Filed: August 13, 2009
    Date of Patent: March 4, 2014
    Assignee: Disney Enterprises, Inc.
    Inventors: Sheldon Katz, Gregory House, Howard Kennedy, Joseph DiGiovanni, Smadar Gefen
  • Patent number: 8599317
    Abstract: A method of adding a virtual insertion to an image, according to an embodiment, includes extracting dynamic features from an input image, associating the dynamic extracted features with dynamic reference features in a reference feature database, generating a camera model based on the associations, mixing a virtual insertion into the input image based on the camera model, and outputting an image containing both the input image and the virtual insertion. According to another embodiment, a method of adding a virtual insertion to an image includes generating a biased camera model using a statistically selected subset of a plurality of non-fixed regions of the image, locating fixed reference objects in the image using the biased camera model as an entry point for a search, generating a corrected camera model using the fixed reference objects in the image, and adding a virtual insertion to the image using the corrected camera model.
    Type: Grant
    Filed: March 15, 2010
    Date of Patent: December 3, 2013
    Assignee: Disney Enterprises, Inc.
    Inventors: Eyal Shamur, Sheldon Katz, Gregory House, Ximin Gong
  • Publication number: 20110216167
    Abstract: Embodiments relate to insertions in 3D video. Virtual camera models enable insertions to be reconciled relative to left and right channels of the 3D video to maximize 3D accuracy and realism of the insertions. Cameras are formed as composites, and can be derived from other models. The camera models can be based on a visual analysis of the 3D video, and can be based on 3D camera data including toe-in and ocular spacing. The camera data may be derived from information collected using instrumentation connect to a 3D camera system, derived based on visual analysis of the 3D video, or derived using a combination of information collected using instrumentation and visual analysis of 3D video. Insertions can be made on-site or at a remote site, and camera data can be embedded in the 3D video and/or separately transmitted to a remote site.
    Type: Application
    Filed: September 10, 2010
    Publication date: September 8, 2011
    Inventors: Sheldon Katz, Gregory House, Howard Kennedy
  • Publication number: 20110128377
    Abstract: A method, apparatus, and computer program product are described to improve a lens distortion curve which roughly approximates distortion caused by a camera lens to capture an event onto video. The present invention selects a generic lens distortion curve that roughly approximates the distortion caused by the camera lens while capturing the event onto the video. The video as well as information from the generic lens distortion curve is used to generate a camera model. This camera model is used to integrate virtual insertions into the video. If the camera model is sufficiently accurate to present a realistic appearance of the virtual insertions to the remote viewer, this camera model is then used to integrate more virtual insertions into the video. However, if the camera model is not sufficiently accurate, an iterative process is employed to refine this camera model.
    Type: Application
    Filed: November 19, 2010
    Publication date: June 2, 2011
    Applicant: PVI Virtual Media Services, LLC
    Inventors: Sheldon Katz, Gregory House
  • Publication number: 20100238351
    Abstract: A method of adding a virtual insertion to an image, according to an embodiment, includes extracting dynamic features from an input image, associating the dynamic extracted features with dynamic reference features in a reference feature database, generating a camera model based on the associations, mixing a virtual insertion into the input image based on the camera model, and outputting an image containing both the input image and the virtual insertion. According to another embodiment, a method of adding a virtual insertion to an image includes generating a biased camera model using a statistically selected subset of a plurality of non-fixed regions of the image, locating fixed reference objects in the image, using the biased camera model as an entry point for a search, generating a corrected camera model using the fixed reference objects in the image, and adding a virtual insertion to the image using the corrected camera model.
    Type: Application
    Filed: March 15, 2010
    Publication date: September 23, 2010
    Inventors: Eyal Shamur, Sheldon Katz, Gregory House, Ximin Gong
  • Publication number: 20100050082
    Abstract: Embodiments of this invention relate to controlling insertion of visual elements integrated into video. In an embodiment, a method enables control of insertions in a video. In the embodiment, control data is received from a user input device. Movement of at least one point of interest in a video is analyzed to determine video metadata. Finally, a visual element is inserted into a video according to the control data, and the visual element changes or moves with the video as specified by the video metadata to appear integrated with the video.
    Type: Application
    Filed: August 13, 2009
    Publication date: February 25, 2010
    Applicant: PVI Virtual Media Services, LLC
    Inventors: Sheldon Katz, Gregory House, Howard Kennedy, Joseph DiGiovanni, Smadar Gefen
  • Patent number: 4466374
    Abstract: A fabric wind shield replaces conventional wind shields especially for use in boats having a central cockpit. The wind shield contains pockets on either side which are expandable to provide convenient and variable storage areas and on which windows are provided to permit visual determination of the contents.
    Type: Grant
    Filed: September 28, 1982
    Date of Patent: August 21, 1984
    Inventor: Sheldon Katz