Patents by Inventor Mario Botsch
Mario Botsch has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 10319080Abstract: Enhanced removing of noise and outliers from one or more point sets generated by image-based 3D reconstruction techniques is provided. In accordance with the disclosure, input images and corresponding depth maps can be used to remove pixels that are geometrically and/or photometrically inconsistent with the colored surface implied by the input images. This allows standard surface reconstruction methods (such as Poisson surface reconstruction) to perform less smoothing and thus achieve higher quality surfaces with more features. In some implementations, the enhanced point-cloud noise removal in accordance with the disclosure can include computing per-view depth maps, and detecting and removing noisy points and outliers from each per-view point cloud by checking if points are consistent with the surface implied by the other input views.Type: GrantFiled: July 6, 2018Date of Patent: June 11, 2019Assignees: DISNEY ENTERPRISES, INC., ETH ZÜRICH (EIDGENÖSSISCHE TECHNISCHE HOCHSCHULE ZÜRICH)Inventors: Changil Kim, Olga Sorkine-Hornung, Christopher Schroers, Henning Zimmer, Katja Wolff, Mario Botsch, Alexander Sorkine-Hornung
-
Publication number: 20180315168Abstract: Enhanced removing of noise and outliers from one or more point sets generated by image-based 3D reconstruction techniques is provided. In accordance with the disclosure, input images and corresponding depth maps can be used to remove pixels that are geometrically and/or photometrically inconsistent with the colored surface implied by the input images. This allows standard surface reconstruction methods (such as Poisson surface reconstruction) to perform less smoothing and thus achieve higher quality surfaces with more features. In some implementations, the enhanced point-cloud noise removal in accordance with the disclosure can include computing per-view depth maps, and detecting and removing noisy points and outliers from each per-view point cloud by checking if points are consistent with the surface implied by the other input views.Type: ApplicationFiled: July 6, 2018Publication date: November 1, 2018Applicants: Disney Enterprises, Inc., ETH ZÜRICH (EIDGENÖSSISCHE TECHNISCHE HOCHSCHULE ZÜRICH)Inventors: Changil KIM, Olga SORKINE-HORNUNG, Christopher SCHROERS, Henning ZIMMER, Katja WOLFF, Mario BOTSCH, Alexander SORKINE-HORNUNG
-
Patent number: 10091435Abstract: The disclosure provides an approach for image segmentation from an uncalibrated camera array. In one aspect, a segmentation application computes a pseudo depth map for each frame of a video sequence recorded with a camera array based on dense correspondences between cameras in the array. The segmentation application then fuses such pseudo depth maps computed for satellite cameras of the camera array to obtain a pseudo depth map at a central camera. Further, the segmentation application interpolates virtual green screen positions for an entire frame based on user input which provides control points and pseudo depth thresholds at the control points. The segmentation application then computes an initial segmentation based on a thresholding using the virtual green screen positions, and refines the initial segmentation by solving a binary labeling problem in a Markov random field to better align the segmentation with image edges and provide temporal coherency for the segmentation.Type: GrantFiled: June 7, 2016Date of Patent: October 2, 2018Assignees: Disney Enterprises, Inc., ETH Zurich (Eidgenoessische Technische Hochschule Zurich)Inventors: Henning Zimmer, Alexander Sorkine Hornung, Mario Botsch, Federico Perazzi
-
Patent number: 10074160Abstract: Enhanced removing of noise and outliers from one or more point sets generated by image-based 3D reconstruction techniques is provided. In accordance with the disclosure, input images and corresponding depth maps can be used to remove pixels that are geometrically and/or photometrically inconsistent with the colored surface implied by the input images. This allows standard surface reconstruction methods (such as Poisson surface reconstruction) to perform less smoothing and thus achieve higher quality surfaces with more features. In some implementations, the enhanced point-cloud noise removal in accordance with the disclosure can include computing per-view depth maps, and detecting and removing noisy points and outliers from each per-view point cloud by checking if points are consistent with the surface implied by the other input views.Type: GrantFiled: September 30, 2016Date of Patent: September 11, 2018Assignees: DISNEY ENTERPRISES, INC., ETH ZÜRICH (EIDGENÖSSISCHE TECHNISCHE HOCHSCHULE ZÜRICH)Inventors: Changil Kim, Olga Sorkine-Hornung, Christopher Schroers, Henning Zimmer, Katja Wolff, Mario Botsch, Alexander Sorkine-Hornung
-
Publication number: 20180096463Abstract: Enhanced removing of noise and outliers from one or more point sets generated by image-based 3D reconstruction techniques is provided. In accordance with the disclosure, input images and corresponding depth maps can be used to remove pixels that are geometrically and/or photometrically inconsistent with the colored surface implied by the input images. This allows standard surface reconstruction methods (such as Poisson surface reconstruction) to perform less smoothing and thus achieve higher quality surfaces with more features. In some implementations, the enhanced point-cloud noise removal in accordance with the disclosure can include computing per-view depth maps, and detecting and removing noisy points and outliers from each per-view point cloud by checking if points are consistent with the surface implied by the other input views.Type: ApplicationFiled: September 30, 2016Publication date: April 5, 2018Applicants: Disney Enterprises, Inc., ETH Zürich (Eidgenössische Technische Hochschule Zürich)Inventors: Changil Kim, Olga Sorkine-Hornung, Christopher Schroers, Henning Zimmer, Katja Wolff, Mario Botsch, Alexander Sorkine-Hornung
-
Publication number: 20170353670Abstract: The disclosure provides an approach for image segmentation from an uncalibrated camera array. In one aspect, a segmentation application computes a pseudo depth map for each frame of a video sequence recorded with a camera array based on dense correspondences between cameras in the array. The segmentation application then fuses such pseudo depth maps computed for satellite cameras of the camera array to obtain a pseudo depth map at a central camera. Further, the segmentation application interpolates virtual green screen positions for an entire frame based on user input which provides control points and pseudo depth thresholds at the control points. The segmentation application then computes an initial segmentation based on a thresholding using the virtual green screen positions, and refines the initial segmentation by solving a binary labeling problem in a Markov random field to better align the segmentation with image edges and provide temporal coherency for the segmentation.Type: ApplicationFiled: June 7, 2016Publication date: December 7, 2017Inventors: Henning ZIMMER, Alexander SORKINE HORNUNG, Mario BOTSCH, Federico PERAZZI
-
Patent number: 9641822Abstract: Provided is point-based efficient three-dimensional (3D) information representation from a color image that is obtained from a general Charge-Coupled Device (CCD)/Complementary Metal Oxide Semiconductor (CMOS) camera, and a depth image that is obtained from a depth camera. A 3D image processing method includes storing a depth image associated with an object as first data of a 3D data format, and storing a color image associated with the object as color image data of a 2D image format, independent of the first data.Type: GrantFiled: February 11, 2009Date of Patent: May 2, 2017Assignee: Samsung Electronics Co., Ltd.Inventors: Jae Young Sim, Do Kyoon Kim, Kee Chang Lee, Gael Guennebaud, Mario Botsch, Markus Gross, Robert Carnecky
-
Patent number: 8363049Abstract: Disclosed are data storing and processing methods or apparatuses which may efficiently perform a process of retrieving neighboring points between points stored in a leaf cell in a point-based 3D data expressing method. A computer-readable recording medium having stored thereon instructions for implementing a method of three-Dimensional (3D) data processing, the instructions including an instruction set of connecting each of a plurality of points with a leaf cell of a spatial tree structure; an instruction set of assigning a ball to correspond to each of the plurality of points; and an instruction set of connecting the ball with a leaf cell intersecting the ball.Type: GrantFiled: October 16, 2008Date of Patent: January 29, 2013Assignee: Samsung Electronics Co., Ltd.Inventors: Jae Young Sim, Do Kyoon Kim, Kae Chang Lee, Gael Guennebaud, Mario Botsch, Markus Gross, Robert Carnecky
-
Publication number: 20090213113Abstract: Disclosed are data storing and processing methods or apparatuses which may efficiently perform a process of retrieving neighboring points between points stored in a leaf cell in a point-based 3D data expressing method. A computer-readable recording medium having stored thereon instructions for implementing a method of three-Dimensional (3D) data processing, the instructions including an instruction set of connecting each of a plurality of points with a leaf cell of a spatial tree structure; an instruction set of assigning a ball to correspond to each of the plurality of points; and an instruction set of connecting the ball with a leaf cell intersecting the ball.Type: ApplicationFiled: October 16, 2008Publication date: August 27, 2009Applicant: SAMSUNG ELECTRONICS CO., LTD.Inventors: Jae Young Sim, Do Kyoon Kim, Kae Chang Lee, Gael Guennebaud, Mario Botsch, Markus Gross, Robert Carnecky
-
Publication number: 20090213240Abstract: Provided is point-based efficient three-dimensional (3D) information representation from a color image that is obtained from a general Charge-Coupled Device (CCD)/Complementary Metal Oxide Semiconductor (CMOS) camera, and a depth image that is obtained from a depth camera. A 3D image processing method includes storing a depth image associated with an object as first data of a 3D data format, and storing a color image associated with the object as color image data of a 2D image format, independent of the first data.Type: ApplicationFiled: February 11, 2009Publication date: August 27, 2009Applicant: SAMSUNG ELECTRONICS CO., LTD.Inventors: Jae Young Sim, Do Kyoon Kim, Kee Chang Lee, Gael Guennebaud, Mario Botsch, Markus Gross, Robert Carnecky