Patents by Inventor Ximin Gong
Ximin Gong has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 10080066Abstract: One embodiment provides a method for rendering a virtual mark on a video frame, including: receiving the video frame, captured by a camera, comprising a scene; obtaining a three-dimensional model of a mark in the scene; obtaining a foreground mask of the video frame; denoting a predetermined region corresponding to a mark mask, wherein the mark mask is an image projection of the mark on the video frame; updating the mark mask to exclude foreground regions, wherein the updating comprises: partitioning the predetermined region into a plurality of segments; and filtering out, from the mark mask, foreground pixels based on the plurality of segments and the foreground mask; and rendering, on the video frame, the virtual mark using the updated mark mask. Other aspects are described and claimed.Type: GrantFiled: August 23, 2016Date of Patent: September 18, 2018Assignee: Disney Enterprises, Inc.Inventors: Cen Rao, Ximin Gong, Nikhil Deshpande, Ilke Akin
-
Publication number: 20170223431Abstract: One embodiment provides a method for rendering a virtual mark on a video frame, including: receiving the video frame, captured by a camera, comprising a scene; obtaining a three-dimensional model of a mark in the scene; obtaining a foreground mask of the video frame; denoting a predetermined region corresponding to a mark mask, wherein the mark mask is an image projection of the mark on the video frame; updating the mark mask to exclude foreground regions, wherein the updating comprises: partitioning the predetermined region into a plurality of segments; and filtering out, from the mark mask, foreground pixels based on the plurality of segments and the foreground mask; and rendering, on the video frame, the virtual mark using the updated mark mask. Other aspects are described and claimed.Type: ApplicationFiled: August 23, 2016Publication date: August 3, 2017Inventors: Cen Rao, Ximin Gong, Nikhil Deshpande, Ilke Akin
-
Patent number: 9313421Abstract: A system and method for delaying a first version of a video feed from a video camera according to a first delay to generate a second version of the feed, supplying the first version to an insertion system, wherein the insertion system inserts an indicia into the first version to create an enhanced version with a second delay substantially matching the first delay and supplying the enhanced version and the second version to a production switcher, wherein the enhanced version and the second version supplied to the production switcher are synchronized with one another.Type: GrantFiled: July 21, 2014Date of Patent: April 12, 2016Assignee: DISNEY ENTERPRISES, INC.Inventors: Nikhil Deshpande, Ximin Gong, Peter A. von Kaenel, James W. Appleby, II, Randy W. Sills, Sr.
-
Patent number: 9154710Abstract: An apparatus and method for receiving a current video frame of a program video having a plurality of scene cuts switching between video segments originating from respective cameras of a plurality of cameras and automatically identifying the camera from which the current video frame originated. The apparatus having a feature database storing predetermined features for a plurality of cameras filming a program video originating from the plurality of cameras, a recognition unit receiving a current video frame of the program video, extracting features from the current video frame, and comparing the features to the previously stored features and a camera model estimator computing an estimated camera model based on corresponding feature pairs and previously stored features, wherein if the estimated camera model is within a predetermined threshold of a stored camera model for one of the plurality of cameras, that camera is identified as originating the current video frame.Type: GrantFiled: September 12, 2013Date of Patent: October 6, 2015Assignee: DISNEY ENTERPRISES, INC.Inventor: Ximin Gong
-
Patent number: 8922718Abstract: A method, apparatus, and computer program product are described that utilizes spatial modeling to represent foreground objects of an event to allow virtual graphics to be integrated into a background of the event in the presence of dynamic objects. The present invention detects a presence of dynamic objects within a region of interest from a video depicting the event. The present invention produces a suppression key corresponding to the dynamic object when present in the video or a suppression key with a default value when and where no dynamic object is present in the video.Type: GrantFiled: October 21, 2010Date of Patent: December 30, 2014Assignee: Disney Enterprises, Inc.Inventors: Gregory House, Ximin Gong, Cen Rao, Yuecheng Zhang
-
Publication number: 20140327830Abstract: A system and method for delaying a first version of a video feed from a video camera according to a first delay to generate a second version of the feed, supplying the first version to an insertion system, wherein the insertion system inserts an indicia into the first version to create an enhanced version with a second delay substantially matching the first delay and supplying the enhanced version and the second version to a production switcher, wherein the enhanced version and the second version supplied to the production switcher are synchronized with one another.Type: ApplicationFiled: July 21, 2014Publication date: November 6, 2014Inventors: Nikhil Deshpande, Ximin GONG, Peter A. von KAENEL, James W. APPLEBY, II, Randy W. SILLS, SR.
-
Patent number: 8786782Abstract: A system and method for delaying a first version of a video feed from a video camera according to a first delay to generate a second version of the feed, supplying the first version to an insertion system, wherein the insertion system inserts an indicia into the first version to create an enhanced version with a second delay substantially matching the first delay and supplying the enhanced version and the second version to a production switcher, wherein the enhanced version and the second version supplied to the production switcher are synchronized with one another.Type: GrantFiled: August 31, 2011Date of Patent: July 22, 2014Assignee: Disney Enterprises, Inc.Inventors: Nikhil Deshpande, Ximin Gong, Peter A. von Kaenel, James W. Appleby, II, Randy W. Sills, Sr.
-
Publication number: 20140085478Abstract: An apparatus and method for receiving a current video frame of a program video having a plurality of scene cuts switching between video segments originating from respective cameras of a plurality of cameras and automatically identifying the camera from which the current video frame originated. The apparatus having a feature database storing predetermined features for a plurality of cameras filming a program video originating from the plurality of cameras, a recognition unit receiving a current video frame of the program video, extracting features from the current video frame, and comparing the features to the previously stored features and a camera model estimator computing an estimated camera model based on corresponding feature pairs and previously stored features, wherein if the estimated camera model is within a predetermined threshold of a stored camera model for one of the plurality of cameras, that camera is identified as originating the current video frame.Type: ApplicationFiled: September 12, 2013Publication date: March 27, 2014Applicant: Disney Enterprises, Inc.Inventor: Ximin GONG
-
Patent number: 8599317Abstract: A method of adding a virtual insertion to an image, according to an embodiment, includes extracting dynamic features from an input image, associating the dynamic extracted features with dynamic reference features in a reference feature database, generating a camera model based on the associations, mixing a virtual insertion into the input image based on the camera model, and outputting an image containing both the input image and the virtual insertion. According to another embodiment, a method of adding a virtual insertion to an image includes generating a biased camera model using a statistically selected subset of a plurality of non-fixed regions of the image, locating fixed reference objects in the image using the biased camera model as an entry point for a search, generating a corrected camera model using the fixed reference objects in the image, and adding a virtual insertion to the image using the corrected camera model.Type: GrantFiled: March 15, 2010Date of Patent: December 3, 2013Assignee: Disney Enterprises, Inc.Inventors: Eyal Shamur, Sheldon Katz, Gregory House, Ximin Gong
-
Patent number: 8538233Abstract: An apparatus and method for receiving a current video frame of a program video having a plurality of scene cuts switching between video segments originating from respective cameras of a plurality of cameras and automatically identifying the camera from which the current video frame originated. The apparatus having a feature database storing predetermined features for a plurality of cameras filming a program video originating from the plurality of cameras, a recognition unit receiving a current video frame of the program video, extracting features from the current video frame, and comparing the features to the previously stored features and a camera model estimator computing an estimated camera model based on corresponding feature pairs and previously stored features, wherein if the estimated camera model is within a predetermined threshold of a stored camera model for one of the plurality of cameras, that camera is identified as originating the current video frame.Type: GrantFiled: August 24, 2011Date of Patent: September 17, 2013Assignee: Disney Enterprises, Inc.Inventor: Ximin Gong
-
Publication number: 20130051763Abstract: An apparatus and method for receiving a current video frame of a program video having a plurality of scene cuts switching between video segments originating from respective cameras of a plurality of cameras and automatically identifying the camera from which the current video frame originated. The apparatus having a feature database storing predetermined features for a plurality of cameras filming a program video originating from the plurality of cameras, a recognition unit receiving a current video frame of the program video, extracting features from the current video frame, and comparing the features to the previously stored features and a camera model estimator computing an estimated camera model based on corresponding feature pairs and previously stored features, wherein if the estimated camera model is within a predetermined threshold of a stored camera model for one of the plurality of cameras, that camera is identified as originating the current video frame.Type: ApplicationFiled: August 24, 2011Publication date: February 28, 2013Inventor: Ximin GONG
-
Publication number: 20130050581Abstract: A system and method for delaying a first version of a video feed from a video camera according to a first delay to generate a second version of the feed, supplying the first version to an insertion system, wherein the insertion system inserts an indicia into the first version to create an enhanced version with a second delay substantially matching the first delay and supplying the enhanced version and the second version to a production switcher, wherein the enhanced version and the second version supplied to the production switcher are synchronized with one another.Type: ApplicationFiled: August 31, 2011Publication date: February 28, 2013Inventors: Nikhil Deshpande, Ximin Gong, Peter A. von Kaenel, James W. Appleby, II, Randy W. Sills, SR.
-
Publication number: 20110102678Abstract: A method, apparatus, and computer program product are described that utilizes spatial modeling to represent foreground objects of an event to allow virtual graphics to be integrated into a background of the event in the presence of dynamic objects. The present invention detects a presence of dynamic objects within a region of interest from a video depicting the event. The present invention produces a suppression key corresponding to the dynamic object when present in the video or a suppression key with a default value when and where no dynamic object is present in the video.Type: ApplicationFiled: October 21, 2010Publication date: May 5, 2011Applicant: PVI Virtual Media Services, LLCInventors: Gregory House, Ximin Gong, Cen Rao, Yuecheng Zhang
-
Publication number: 20100238351Abstract: A method of adding a virtual insertion to an image, according to an embodiment, includes extracting dynamic features from an input image, associating the dynamic extracted features with dynamic reference features in a reference feature database, generating a camera model based on the associations, mixing a virtual insertion into the input image based on the camera model, and outputting an image containing both the input image and the virtual insertion. According to another embodiment, a method of adding a virtual insertion to an image includes generating a biased camera model using a statistically selected subset of a plurality of non-fixed regions of the image, locating fixed reference objects in the image, using the biased camera model as an entry point for a search, generating a corrected camera model using the fixed reference objects in the image, and adding a virtual insertion to the image using the corrected camera model.Type: ApplicationFiled: March 15, 2010Publication date: September 23, 2010Inventors: Eyal Shamur, Sheldon Katz, Gregory House, Ximin Gong
-
Patent number: 6100925Abstract: A live video insertion system (LVIS) is disclosed that allows insertion of static or dynamic images into a live video broadcast in a realistic fashion on a real time basis. Initially, natural landmarks in a scene that are suitable for subsequent detection and tracking are selected. The landmarks are typically distributed throughout the entire scene, such as a ballpark or football stadium. The field of view of the camera at any instant is normally significantly smaller than the full scene that may be panned. The LVIS uses a combination of pattern recognition techniques and camera sensor data (e.g., pan, tilt, zoom, etc.) to locate, verify and track target data. Camera sensors are well suited for the searching requirements of an LVIS, while pattern recognition and landmark tracking techniques are better suited for the image tracking requirements of LVIS.Type: GrantFiled: January 19, 1999Date of Patent: August 8, 2000Assignee: Princeton Video Image, Inc.Inventors: Roy J. Rosser, Yi Tan, Howard J. Kennedy, Jr., James L. Jeffers, Darrell S. DiCicco, Ximin Gong