Patents by Inventor Sebastian Lieberknecht
Sebastian Lieberknecht has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11968479Abstract: A method of tracking a mobile device comprising at least one camera in a real environment comprises the steps of receiving image information associated with at least one image captured by the at least one camera, generating a first geometrical model of at least part of the real environment based on environmental data or mobile system state data acquired in an acquisition process by at least one sensor of a mobile system, which is different from the mobile device, and performing a tracking process based on the image information associated with the at least one image and at least partially according to the first geometrical model, wherein the tracking process determines at least one parameter of a pose of the mobile device relative to the real environment. The invention is also related to a method of generating a geometrical model of at least part of a real environment using image information from at least one camera of a mobile device.Type: GrantFiled: May 16, 2022Date of Patent: April 23, 2024Assignee: Apple Inc.Inventors: Peter Meier, Sebastian Lieberknecht
-
Publication number: 20220279147Abstract: A method of tracking a mobile device comprising at least one camera in a real environment comprises the steps of receiving image information associated with at least one image captured by the at least one camera, generating a first geometrical model of at least part of the real environment based on environmental data or mobile system state data acquired in an acquisition process by at least one sensor of a mobile system, which is different from the mobile device, and performing a tracking process based on the image information associated with the at least one image and at least partially according to the first geometrical model, wherein the tracking process determines at least one parameter of a pose of the mobile device relative to the real environment.Type: ApplicationFiled: May 16, 2022Publication date: September 1, 2022Inventors: Peter Meier, Sebastian Lieberknecht
-
Patent number: 11336867Abstract: A method of tracking a mobile device comprising at least one camera in a real environment comprises the steps of receiving image information associated with at least one image captured by the at least one camera, generating a first geometrical model of at least part of the real environment based on environmental data or mobile system state data acquired in an acquisition process by at least one sensor of a mobile system, which is different from the mobile device, and performing a tracking process based on the image information associated with the at least one image and at least partially according to the first geometrical model, wherein the tracking process determines at least one parameter of a pose of the mobile device relative to the real environment. The invention is also related to a method of generating a geometrical model of at least part of a real environment using image information from at least one camera of a mobile device.Type: GrantFiled: January 22, 2020Date of Patent: May 17, 2022Assignee: Apple Inc.Inventors: Peter Meier, Sebastian Lieberknecht
-
Patent number: 10671662Abstract: A method for analyzing an image of a real object, generated by at least one camera includes the following steps: generating at least a first image by the camera capturing at least one real object, defining a first search domain comprising multiple data sets of the real object, each of the data sets being indicative of a respective portion of the real object, and analyzing at least one characteristic property of the first image with respect to the first search domain, in order to determine whether the at least one characteristic property corresponds to information of at least a particular one of the data sets of the first search domain. If it is determined that the at least one characteristic property corresponds to information of at least a particular one of the data sets, a second search domain comprising only the particular one of the data sets is defined and the second search domain is used for analyzing the first image and/or at least a second image.Type: GrantFiled: March 13, 2018Date of Patent: June 2, 2020Assignee: Apple Inc.Inventors: Sebastian Lieberknecht, Peter Meier
-
Publication number: 20200162703Abstract: A method of tracking a mobile device comprising at least one camera in a real environment comprises the steps of receiving image information associated with at least one image captured by the at least one camera, generating a first geometrical model of at least part of the real environment based on environmental data or mobile system state data acquired in an acquisition process by at least one sensor of a mobile system, which is different from the mobile device, and performing a tracking process based on the image information associated with the at least one image and at least partially according to the first geometrical model, wherein the tracking process determines at least one parameter of a pose of the mobile device relative to the real environment.Type: ApplicationFiled: January 22, 2020Publication date: May 21, 2020Inventors: Peter Meier, Sebastian Lieberknecht
-
Patent number: 10582166Abstract: A method of tracking a mobile device comprising at least one camera in a real environment comprises the steps of receiving image information associated with at least one image captured by the at least one camera, generating a first geometrical model of at least part of the real environment based on environmental data or mobile system state data acquired in an acquisition process by at least one sensor of a mobile system, which is different from the mobile device, and performing a tracking process based on the image information associated with the at least one image and at least partially according to the first geometrical model, wherein the tracking process determines at least one parameter of a pose of the mobile device relative to the real environment. The invention is also related to a method of generating a geometrical model of at least part of a real environment using image information from at least one camera of a mobile device.Type: GrantFiled: November 5, 2018Date of Patent: March 3, 2020Assignee: Apple Inc.Inventors: Peter Meier, Sebastian Lieberknecht
-
Publication number: 20190075274Abstract: A method of tracking a mobile device comprising at least one camera in a real environment comprises the steps of receiving image information associated with at least one image captured by the at least one camera, generating a first geometrical model of at least part of the real environment based on environmental data or mobile system state data acquired in an acquisition process by at least one sensor of a mobile system, which is different from the mobile device, and performing a tracking process based on the image information associated with the at least one image and at least partially according to the first geometrical model, wherein the tracking process determines at least one parameter of a pose of the mobile device relative to the real environment.Type: ApplicationFiled: November 5, 2018Publication date: March 7, 2019Inventors: Peter Meier, Sebastian Lieberknecht
-
Patent number: 10176402Abstract: Systems, methods, and computer readable media to categorize a pixel (or other element) in an image into one of a number of different categories are described. In general, techniques are disclosed for using properties (e.g., statistics) of the regions being categorized to determine the appropriate size of window around a target pixel (element) and, when necessary, the manner in which the window may be changed if the current size is inappropriate. More particularly, adaptive window size selection techniques are disclosed for use when categorizing an image's pixels into one of two categories (e.g., black or white). Statistics of the selected region may be cascaded to determine whether the current evaluation window is acceptable and, if it is not, an appropriate factor by which to change the currently selected window's size.Type: GrantFiled: July 18, 2016Date of Patent: January 8, 2019Assignee: Apple Inc.Inventors: Lejing Wang, Daniel Ulbricht, Lorenz Kern, Sebastian Lieberknecht, Tobias Hall
-
Patent number: 10121247Abstract: A method of tracking a mobile device comprising at least one camera in a real environment comprises the steps of receiving image information associated with at least one image captured by the at least one camera, generating a first geometrical model of at least part of the real environment based on environmental data or mobile system state data acquired in an acquisition process by at least one sensor of a mobile system, which is different from the mobile device, and performing a tracking process based on the image information associated with the at least one image and at least partially according to the first geometrical model, wherein the tracking process determines at least one parameter of a pose of the mobile device relative to the real environment. The invention is also related to a method of generating a geometrical model of at least part of a real environment using image information from at least one camera of a mobile device.Type: GrantFiled: May 27, 2016Date of Patent: November 6, 2018Assignee: Apple Inc.Inventors: Peter Meier, Sebastian Lieberknecht
-
Publication number: 20180307708Abstract: A method for analyzing an image of a real object, generated by at least one camera includes the following steps: generating at least a first image by the camera capturing at least one real object, defining a first search domain comprising multiple data sets of the real object, each of the data sets being indicative of a respective portion of the real object, and analyzing at least one characteristic property of the first image with respect to the first search domain, in order to determine whether the at least one characteristic property corresponds to information of at least a particular one of the data sets of the first search domain. If it is determined that the at least one characteristic property corresponds to information of at least a particular one of the data sets, a second search domain comprising only the particular one of the data sets is defined and the second search domain is used for analyzing the first image and/or at least a second image.Type: ApplicationFiled: March 13, 2018Publication date: October 25, 2018Inventors: Sebastian Lieberknecht, Peter Meier
-
Patent number: 9916330Abstract: A method for analyzing an image of a real object, generated by at least one camera includes the following steps: generating at least a first image by the camera capturing at least one real object, defining a first search domain comprising multiple data sets of the real object, each of the data sets being indicative of a respective portion of the real object, and analyzing at least one characteristic property of the first image with respect to the first search domain, in order to determine whether the at least one characteristic property corresponds to information of at least a particular one of the data sets of the first search domain. If it is determined that the at least one characteristic property corresponds to information of at least a particular one of the data sets, a second search domain comprising only the particular one of the data sets is defined and the second search domain is used for analyzing the first image and/or at least a second image.Type: GrantFiled: February 15, 2016Date of Patent: March 13, 2018Assignee: Apple Inc.Inventors: Sebastian Lieberknecht, Peter Meier
-
Publication number: 20180018541Abstract: Systems, methods, and computer readable media to categorize a pixel (or other element) in an image into one of a number of different categories are described. In general, techniques are disclosed for using properties (e.g., statistics) of the regions being categorized to determine the appropriate size of window around a target pixel (element) and, when necessary, the manner in which the window may be changed if the current size is inappropriate. More particularly, adaptive window size selection techniques are disclosed for use when categorizing an image's pixels into one of two categories (e.g., black or white).Type: ApplicationFiled: July 18, 2016Publication date: January 18, 2018Inventors: Lejing Wang, Daniel Ulbricht, Lorenz Kern, Sebastian Lieberknecht, Tobias Holl
-
Patent number: 9830715Abstract: The specification relates to determining either or both of the pose of a camera with respect to a real object or a three dimensional structure of the real object. In some of the described embodiments, a captured image including the real object is analyzed with respect to a reference image that also includes the real object. A parameter set is estimated by using a homography between the reference image and the captured image. An update to the parameter set is made by using an iterative minimization process that includes comparing a first set of pixels in the reference image with a computed set of pixels in the captured image, where the computed set of pixels used for comparison varies in different iterations of the iterative minimization process.Type: GrantFiled: December 7, 2015Date of Patent: November 28, 2017Assignee: Apple Inc.Inventors: Selim Benhimane, Sebastian Lieberknecht
-
Patent number: 9525862Abstract: A method for estimating a camera motion and for determining a three-dimensional model of an environment is provided that includes the steps of: providing intrinsic parameters of a camera; providing a set of reference two-dimensional imaged points captured by the camera at a first camera pose and reference depth samples; determining a three-dimensional model of the environment; providing a set of current two-dimensional imaged points captured by the camera at a second camera pose and current depth samples associated to the set of current two-dimensional imaged points and determining a current three-dimensional model; estimating a camera motion between the first camera pose and the second camera pose; determining a similarity measure between the three-dimensional model and the current three-dimensional model, and if it is determined that the similarity measure meets a first condition, updating the three-dimensional model of the environment and adding the set of current two-dimensional imaged points to the set oType: GrantFiled: August 31, 2011Date of Patent: December 20, 2016Assignee: Metaio GmbHInventors: Selim Benhimane, Sebastian Lieberknecht, Andrea Huber
-
Publication number: 20160350906Abstract: A method of tracking a mobile device comprising at least one camera in a real environment comprises the steps of receiving image information associated with at least one image captured by the at least one camera, generating a first geometrical model of at least part of the real environment based on environmental data or mobile system state data acquired in an acquisition process by at least one sensor of a mobile system, which is different from the mobile device, and performing a tracking process based on the image information associated with the at least one image and at least partially according to the first geometrical model, wherein the tracking process determines at least one parameter of a pose of the mobile device relative to the real environment.Type: ApplicationFiled: May 27, 2016Publication date: December 1, 2016Inventors: Peter Meier, Sebastian Lieberknecht
-
Publication number: 20160321811Abstract: A method for determining a parameter set which is designed to be used for determining the pose of a camera with regard to at least one real object and/or for determining a three-dimensional structure of the at least one real object, comprises the steps of providing a reference image including at least a part of the at least one real object, capturing at least one current image including at least a part of the at least one real object, providing an initial estimate of a parameter set which is including at least the three-dimensional translation in the common coordinate system between the pose of the camera when capturing the reference image and the pose of the camera when capturing the current image, and the depth of at least a first point of the at least one real object in the common coordinate system, and determining an update of the estimate of the parameter set by means of an iterative minimization process, wherein in the iterative minimization process a first set of pixels in the reference image is comparType: ApplicationFiled: December 7, 2015Publication date: November 3, 2016Inventors: Selim Benhimane, Sebastian Lieberknecht
-
Publication number: 20160246818Abstract: A method for analyzing an image of a real object, generated by at least one camera includes the following steps: generating at least a first image by the camera capturing at least one real object, defining a first search domain comprising multiple data sets of the real object, each of the data sets being indicative of a respective portion of the real object, and analyzing at least one characteristic property of the first image with respect to the first search domain, in order to determine whether the at least one characteristic property corresponds to information of at least a particular one of the data sets of the first search domain. If it is determined that the at least one characteristic property corresponds to information of at least a particular one of the data sets, a second search domain comprising only the particular one of the data sets is defined and the second search domain is used for analyzing the first image and/or at least a second image.Type: ApplicationFiled: February 15, 2016Publication date: August 25, 2016Inventors: Sebastian Lieberknecht, Peter Meier
-
Patent number: 9262678Abstract: A method for analyzing an image of a real object, generated by at least one camera includes the following steps: generating at least a first image by the camera capturing at least one real object, defining a first search domain comprising multiple data sets of the real object, each of the data sets being indicative of a respective portion of the real object, and analyzing at least one characteristic property of the first image with respect to the first search domain, in order to determine whether the at least one characteristic property corresponds to information of at least a particular one of the data sets of the first search domain. If it is determined that the at least one characteristic property corresponds to information of at least a particular one of the data sets, a second search domain comprising only the particular one of the data sets is defined and the second search domain is used for analyzing the first image and/or at least a second image.Type: GrantFiled: March 5, 2014Date of Patent: February 16, 2016Assignee: Metaio GmbHInventors: Sebastian Lieberknecht, Peter Meier
-
Patent number: 9208563Abstract: A method for determining a parameter set which is designed to be used for determining the pose of a camera with regard to at least one real object and/or for determining a three-dimensional structure of the at least one real object, comprises the steps of providing a reference image including at least a part of the at least one real object, capturing at least one current image including at least a part of the at least one real object, providing an initial estimate of a parameter set which is including at least the three-dimensional translation in the common coordinate system between the pose of the camera when capturing the reference image and the pose of the camera when capturing the current image, and the depth of at least a first point of the at least one real object in the common coordinate system, and determining an update of the estimate of the parameter set by means of an iterative minimization process, wherein in the iterative minimization process a first set of pixels in the reference image is comparType: GrantFiled: December 21, 2010Date of Patent: December 8, 2015Assignee: Metaio GmbHInventors: Selim Benhimane, Sebastian Lieberknecht
-
Publication number: 20140293016Abstract: A method for estimating a camera motion and for determining a three-dimensional model of an environment is provided that includes the steps of: providing intrinsic parameters of a camera; providing a set of reference two-dimensional imaged points captured by the camera at a first camera pose and reference depth samples; determining a three-dimensional model of the environment; providing a set of current two-dimensional imaged points captured by the camera at a second camera pose and current depth samples associated to the set of current two-dimensional imaged points and determining a current three-dimensional model; estimating a camera motion between the first camera pose and the second camera pose; determining a similarity measure between the three-dimensional model and the current three-dimensional model, and if it is determined that the similarity measure meets a first condition, updating the three-dimensional model of the environment and adding the set of current two-dimensional imaged points to the set oType: ApplicationFiled: August 31, 2011Publication date: October 2, 2014Applicant: Metaio GmbhInventors: Selime Benhimane, Sebastian Lieberknecht, Andrea Huber