Patents by Inventor Ximin Gong

Ximin Gong has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10080066
    Abstract: One embodiment provides a method for rendering a virtual mark on a video frame, including: receiving the video frame, captured by a camera, comprising a scene; obtaining a three-dimensional model of a mark in the scene; obtaining a foreground mask of the video frame; denoting a predetermined region corresponding to a mark mask, wherein the mark mask is an image projection of the mark on the video frame; updating the mark mask to exclude foreground regions, wherein the updating comprises: partitioning the predetermined region into a plurality of segments; and filtering out, from the mark mask, foreground pixels based on the plurality of segments and the foreground mask; and rendering, on the video frame, the virtual mark using the updated mark mask. Other aspects are described and claimed.
    Type: Grant
    Filed: August 23, 2016
    Date of Patent: September 18, 2018
    Assignee: Disney Enterprises, Inc.
    Inventors: Cen Rao, Ximin Gong, Nikhil Deshpande, Ilke Akin
  • Publication number: 20170223431
    Abstract: One embodiment provides a method for rendering a virtual mark on a video frame, including: receiving the video frame, captured by a camera, comprising a scene; obtaining a three-dimensional model of a mark in the scene; obtaining a foreground mask of the video frame; denoting a predetermined region corresponding to a mark mask, wherein the mark mask is an image projection of the mark on the video frame; updating the mark mask to exclude foreground regions, wherein the updating comprises: partitioning the predetermined region into a plurality of segments; and filtering out, from the mark mask, foreground pixels based on the plurality of segments and the foreground mask; and rendering, on the video frame, the virtual mark using the updated mark mask. Other aspects are described and claimed.
    Type: Application
    Filed: August 23, 2016
    Publication date: August 3, 2017
    Inventors: Cen Rao, Ximin Gong, Nikhil Deshpande, Ilke Akin
  • Patent number: 9313421
    Abstract: A system and method for delaying a first version of a video feed from a video camera according to a first delay to generate a second version of the feed, supplying the first version to an insertion system, wherein the insertion system inserts an indicia into the first version to create an enhanced version with a second delay substantially matching the first delay and supplying the enhanced version and the second version to a production switcher, wherein the enhanced version and the second version supplied to the production switcher are synchronized with one another.
    Type: Grant
    Filed: July 21, 2014
    Date of Patent: April 12, 2016
    Assignee: DISNEY ENTERPRISES, INC.
    Inventors: Nikhil Deshpande, Ximin Gong, Peter A. von Kaenel, James W. Appleby, II, Randy W. Sills, Sr.
  • Patent number: 9154710
    Abstract: An apparatus and method for receiving a current video frame of a program video having a plurality of scene cuts switching between video segments originating from respective cameras of a plurality of cameras and automatically identifying the camera from which the current video frame originated. The apparatus having a feature database storing predetermined features for a plurality of cameras filming a program video originating from the plurality of cameras, a recognition unit receiving a current video frame of the program video, extracting features from the current video frame, and comparing the features to the previously stored features and a camera model estimator computing an estimated camera model based on corresponding feature pairs and previously stored features, wherein if the estimated camera model is within a predetermined threshold of a stored camera model for one of the plurality of cameras, that camera is identified as originating the current video frame.
    Type: Grant
    Filed: September 12, 2013
    Date of Patent: October 6, 2015
    Assignee: DISNEY ENTERPRISES, INC.
    Inventor: Ximin Gong
  • Patent number: 8922718
    Abstract: A method, apparatus, and computer program product are described that utilizes spatial modeling to represent foreground objects of an event to allow virtual graphics to be integrated into a background of the event in the presence of dynamic objects. The present invention detects a presence of dynamic objects within a region of interest from a video depicting the event. The present invention produces a suppression key corresponding to the dynamic object when present in the video or a suppression key with a default value when and where no dynamic object is present in the video.
    Type: Grant
    Filed: October 21, 2010
    Date of Patent: December 30, 2014
    Assignee: Disney Enterprises, Inc.
    Inventors: Gregory House, Ximin Gong, Cen Rao, Yuecheng Zhang
  • Publication number: 20140327830
    Abstract: A system and method for delaying a first version of a video feed from a video camera according to a first delay to generate a second version of the feed, supplying the first version to an insertion system, wherein the insertion system inserts an indicia into the first version to create an enhanced version with a second delay substantially matching the first delay and supplying the enhanced version and the second version to a production switcher, wherein the enhanced version and the second version supplied to the production switcher are synchronized with one another.
    Type: Application
    Filed: July 21, 2014
    Publication date: November 6, 2014
    Inventors: Nikhil Deshpande, Ximin GONG, Peter A. von KAENEL, James W. APPLEBY, II, Randy W. SILLS, SR.
  • Patent number: 8786782
    Abstract: A system and method for delaying a first version of a video feed from a video camera according to a first delay to generate a second version of the feed, supplying the first version to an insertion system, wherein the insertion system inserts an indicia into the first version to create an enhanced version with a second delay substantially matching the first delay and supplying the enhanced version and the second version to a production switcher, wherein the enhanced version and the second version supplied to the production switcher are synchronized with one another.
    Type: Grant
    Filed: August 31, 2011
    Date of Patent: July 22, 2014
    Assignee: Disney Enterprises, Inc.
    Inventors: Nikhil Deshpande, Ximin Gong, Peter A. von Kaenel, James W. Appleby, II, Randy W. Sills, Sr.
  • Publication number: 20140085478
    Abstract: An apparatus and method for receiving a current video frame of a program video having a plurality of scene cuts switching between video segments originating from respective cameras of a plurality of cameras and automatically identifying the camera from which the current video frame originated. The apparatus having a feature database storing predetermined features for a plurality of cameras filming a program video originating from the plurality of cameras, a recognition unit receiving a current video frame of the program video, extracting features from the current video frame, and comparing the features to the previously stored features and a camera model estimator computing an estimated camera model based on corresponding feature pairs and previously stored features, wherein if the estimated camera model is within a predetermined threshold of a stored camera model for one of the plurality of cameras, that camera is identified as originating the current video frame.
    Type: Application
    Filed: September 12, 2013
    Publication date: March 27, 2014
    Applicant: Disney Enterprises, Inc.
    Inventor: Ximin GONG
  • Patent number: 8599317
    Abstract: A method of adding a virtual insertion to an image, according to an embodiment, includes extracting dynamic features from an input image, associating the dynamic extracted features with dynamic reference features in a reference feature database, generating a camera model based on the associations, mixing a virtual insertion into the input image based on the camera model, and outputting an image containing both the input image and the virtual insertion. According to another embodiment, a method of adding a virtual insertion to an image includes generating a biased camera model using a statistically selected subset of a plurality of non-fixed regions of the image, locating fixed reference objects in the image using the biased camera model as an entry point for a search, generating a corrected camera model using the fixed reference objects in the image, and adding a virtual insertion to the image using the corrected camera model.
    Type: Grant
    Filed: March 15, 2010
    Date of Patent: December 3, 2013
    Assignee: Disney Enterprises, Inc.
    Inventors: Eyal Shamur, Sheldon Katz, Gregory House, Ximin Gong
  • Patent number: 8538233
    Abstract: An apparatus and method for receiving a current video frame of a program video having a plurality of scene cuts switching between video segments originating from respective cameras of a plurality of cameras and automatically identifying the camera from which the current video frame originated. The apparatus having a feature database storing predetermined features for a plurality of cameras filming a program video originating from the plurality of cameras, a recognition unit receiving a current video frame of the program video, extracting features from the current video frame, and comparing the features to the previously stored features and a camera model estimator computing an estimated camera model based on corresponding feature pairs and previously stored features, wherein if the estimated camera model is within a predetermined threshold of a stored camera model for one of the plurality of cameras, that camera is identified as originating the current video frame.
    Type: Grant
    Filed: August 24, 2011
    Date of Patent: September 17, 2013
    Assignee: Disney Enterprises, Inc.
    Inventor: Ximin Gong
  • Publication number: 20130051763
    Abstract: An apparatus and method for receiving a current video frame of a program video having a plurality of scene cuts switching between video segments originating from respective cameras of a plurality of cameras and automatically identifying the camera from which the current video frame originated. The apparatus having a feature database storing predetermined features for a plurality of cameras filming a program video originating from the plurality of cameras, a recognition unit receiving a current video frame of the program video, extracting features from the current video frame, and comparing the features to the previously stored features and a camera model estimator computing an estimated camera model based on corresponding feature pairs and previously stored features, wherein if the estimated camera model is within a predetermined threshold of a stored camera model for one of the plurality of cameras, that camera is identified as originating the current video frame.
    Type: Application
    Filed: August 24, 2011
    Publication date: February 28, 2013
    Inventor: Ximin GONG
  • Publication number: 20130050581
    Abstract: A system and method for delaying a first version of a video feed from a video camera according to a first delay to generate a second version of the feed, supplying the first version to an insertion system, wherein the insertion system inserts an indicia into the first version to create an enhanced version with a second delay substantially matching the first delay and supplying the enhanced version and the second version to a production switcher, wherein the enhanced version and the second version supplied to the production switcher are synchronized with one another.
    Type: Application
    Filed: August 31, 2011
    Publication date: February 28, 2013
    Inventors: Nikhil Deshpande, Ximin Gong, Peter A. von Kaenel, James W. Appleby, II, Randy W. Sills, SR.
  • Publication number: 20110102678
    Abstract: A method, apparatus, and computer program product are described that utilizes spatial modeling to represent foreground objects of an event to allow virtual graphics to be integrated into a background of the event in the presence of dynamic objects. The present invention detects a presence of dynamic objects within a region of interest from a video depicting the event. The present invention produces a suppression key corresponding to the dynamic object when present in the video or a suppression key with a default value when and where no dynamic object is present in the video.
    Type: Application
    Filed: October 21, 2010
    Publication date: May 5, 2011
    Applicant: PVI Virtual Media Services, LLC
    Inventors: Gregory House, Ximin Gong, Cen Rao, Yuecheng Zhang
  • Publication number: 20100238351
    Abstract: A method of adding a virtual insertion to an image, according to an embodiment, includes extracting dynamic features from an input image, associating the dynamic extracted features with dynamic reference features in a reference feature database, generating a camera model based on the associations, mixing a virtual insertion into the input image based on the camera model, and outputting an image containing both the input image and the virtual insertion. According to another embodiment, a method of adding a virtual insertion to an image includes generating a biased camera model using a statistically selected subset of a plurality of non-fixed regions of the image, locating fixed reference objects in the image, using the biased camera model as an entry point for a search, generating a corrected camera model using the fixed reference objects in the image, and adding a virtual insertion to the image using the corrected camera model.
    Type: Application
    Filed: March 15, 2010
    Publication date: September 23, 2010
    Inventors: Eyal Shamur, Sheldon Katz, Gregory House, Ximin Gong
  • Patent number: 6100925
    Abstract: A live video insertion system (LVIS) is disclosed that allows insertion of static or dynamic images into a live video broadcast in a realistic fashion on a real time basis. Initially, natural landmarks in a scene that are suitable for subsequent detection and tracking are selected. The landmarks are typically distributed throughout the entire scene, such as a ballpark or football stadium. The field of view of the camera at any instant is normally significantly smaller than the full scene that may be panned. The LVIS uses a combination of pattern recognition techniques and camera sensor data (e.g., pan, tilt, zoom, etc.) to locate, verify and track target data. Camera sensors are well suited for the searching requirements of an LVIS, while pattern recognition and landmark tracking techniques are better suited for the image tracking requirements of LVIS.
    Type: Grant
    Filed: January 19, 1999
    Date of Patent: August 8, 2000
    Assignee: Princeton Video Image, Inc.
    Inventors: Roy J. Rosser, Yi Tan, Howard J. Kennedy, Jr., James L. Jeffers, Darrell S. DiCicco, Ximin Gong