Patents by Inventor Markus Spies

Markus Spies has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11986960
    Abstract: A method for training a machine learning model to recognize an object topology of an object from an image of the object. The method includes: obtaining a 3D model of the object; determining a descriptor component value for each vertex of the grid; generating training data image pairs each having a training input image and a target image. The target image is generated by determining the vertex positions in the training input image; assigning the descriptor component value determined for the vertex at the vertex position to the position in the target image; and adapting at least some of the descriptor component values assigned to the positions in the target image or adding descriptor component values to the positions of the target image.
    Type: Grant
    Filed: November 9, 2021
    Date of Patent: May 21, 2024
    Assignee: ROBERT BOSCH GMBH
    Inventors: Andras Gabor Kupcsik, Marco Todescato, Markus Spies, Nicolai Waniek, Philipp Christian Schillinger, Mathias Buerger
  • Patent number: 11964400
    Abstract: A method for controlling a robot to pick up an object in various positions. The method includes: defining a plurality of reference points on the object; mapping a first camera image of the object in a known position onto a first descriptor image; identifying the descriptors of the reference points from the first descriptor image; mapping a second camera image of the object in an unknown position onto a second descriptor image; searching the identified descriptors of the reference points in the second descriptor image; ascertaining the positions of the reference points in the three-dimensional space in the unknown position from the found positions; and ascertaining a pickup pose of the object for the unknown position from the ascertained positions of the reference points.
    Type: Grant
    Filed: November 8, 2021
    Date of Patent: April 23, 2024
    Assignee: ROBERT BOSCH GMBH
    Inventors: Andras Gabor Kupcsik, Marco Todescato, Markus Spies, Nicolai Waniek, Philipp Christian Schillinger, Mathias Buerger
  • Patent number: 11961705
    Abstract: The present invention relates to a method for examining a beam of charged particles, including the following steps: producing persistent interactions of the beam with a sample at a plurality of positions of the sample relative to the beam and deriving at least one property of the beam by analyzing the spatial distribution of the persistent interactions at the plurality of positions.
    Type: Grant
    Filed: December 22, 2020
    Date of Patent: April 16, 2024
    Assignee: Carl Zeiss SMT GmbH
    Inventors: Daniel Rhinow, Markus Bauer, Rainer Fettig, David Lämmle, Marion Batz, Katharina Gries, Sebastian Vollmar, Petra Spies, Ottmar Hoinkis
  • Patent number: 11941846
    Abstract: A method for ascertaining the pose of an object. The method includes recording a first and a second camera image of the object, ascertaining a correspondence between camera pixels of the camera images and vertices of a 3D model of the object, and ascertaining the pose of the object from a set of poses by minimizing, across the set of poses, a loss function, the loss function for a pose being provided by accumulation of distance measures between projections of the object in the pose onto the respective camera image plane and the corresponding pixels of the respective camera image.
    Type: Grant
    Filed: February 22, 2022
    Date of Patent: March 26, 2024
    Assignee: ROBERT BOSCH GMBH
    Inventor: Markus Spies
  • Publication number: 20230321826
    Abstract: A method for controlling a robotic device includes, for each control vector from a plurality of control vectors: controlling the robotic device to perform a sequence of actions, the control vector indicating which action is to be performed for a respectively observed control situation; and determining, by the sequence of actions, values of multiple target metrics that evaluate the performance of a specified task. The method then adjusts a probability distribution of the control vectors such that the probability of control vectors is increased for which the specified task was performed with high evaluations and the multiple target metrics have satisfied at least one target condition; randomly selects a control vector according to the probability distribution for performing the task in a current control scenario; and controls the robotic device to perform a sequence of actions, the control vector indicating which action is performed for a respectively observed control situation.
    Type: Application
    Filed: April 4, 2023
    Publication date: October 12, 2023
    Inventors: Markus Spies, Meng Guo, Philipp Christian Schillinger, Sergey Alatartsev
  • Patent number: 11703871
    Abstract: A method of controlling a vehicle or robot. The method includes the following steps: determining a first control sequence, determining a second control sequence for controlling the vehicle or robot depending on the first control sequence, a current state of the vehicle or robot, and on a model characterizing a dynamic behavior of the vehicle or robot, controlling the vehicle or robot depending on the second control sequence, wherein the determining of the first control sequence is performed depending on a first candidate control sequence and a second candidate control sequence.
    Type: Grant
    Filed: April 29, 2020
    Date of Patent: July 18, 2023
    Assignee: ROBERT BOSCH GMBH
    Inventors: Kai Oliver Arras, Luigi Palmieri, Markus Spies, Raphael Kusumoto Barbosa de Almeida
  • Publication number: 20230150142
    Abstract: A method for training a machine learning model for generating descriptor images for images of one or of multiple objects. The method includes: formation of pairs of images which show the one or the multiple objects from different perspectives; generation, for each image pair, using the machine learning model, of a first descriptor image for the first image, and of a second descriptor image for the second image, which assigns descriptors to points of the one or multiple objects shown in the second image; sampling, for each image pair, of descriptor pairs, which include in each case a first descriptor from the first descriptor image and a second descriptor from the second descriptor image, which are assigned to the same point, and the adaptation of the machine learning method for reducing a loss.
    Type: Application
    Filed: November 7, 2022
    Publication date: May 18, 2023
    Inventors: David Adrian, Andras Gabor Kupcsik, Markus Spies
  • Publication number: 20230115521
    Abstract: A method for training a machine learning model for recognizing an object topology of an object from an image of the object. The method includes obtaining a 3D model of the object, wherein the 3D model comprises a mesh of vertices connected by edges, wherein each edge has a weight which specifies proximity of two vertices connected by the edge in the object; determining a descriptor for each vertex of the mesh by searching descriptors for the vertices which minimize the sum, over pairs of connected vertices, of distances between the descriptors of the pair of vertices weighted by the weight of the edge between the pair of vertices; generating training data image pairs, wherein each training data image pair comprises a training input image showing the object and a target image; and training the machine learning model by supervised learning using the training data image pairs as training data.
    Type: Application
    Filed: June 22, 2021
    Publication date: April 13, 2023
    Inventors: Andras Gabor Kupcsik, Markus Spies
  • Patent number: 11498212
    Abstract: A method for planning a manipulation task of an agent, particularly a robot. The method includes: learning a number of manipulation skills wherein a symbolic abstraction of the respective manipulation skill is generated; determining a concatenated sequence of manipulation skills selected from the number of learned manipulation skills based on their symbolic abstraction so that a given goal specification indicating a given complex manipulation task is satisfied; and executing the sequence of manipulation skills.
    Type: Grant
    Filed: June 4, 2020
    Date of Patent: November 15, 2022
    Assignee: Robert Bosch GmbH
    Inventors: Andras Gabor Kupcsik, Leonel Rozo, Marco Todescato, Markus Spies, Markus Giftthaler, Mathias Buerger, Meng Guo, Nicolai Waniek, Patrick Kesper, Philipp Christian Schillinger
  • Publication number: 20220274257
    Abstract: A method for controlling a robot for picking up an object. The method includes: receiving a camera image of an object; ascertaining an image region in the camera image showing an area of the object where it may not be picked up, by conveying the camera image to a machine learning model which is trained to allocate values to regions in camera images that represent whether the regions show areas of an object where it may not be picked up, allocating the ascertained image region to a spatial region; and controlling the robot to grasp the object in a spatial region other than the ascertained spatial region.
    Type: Application
    Filed: February 25, 2022
    Publication date: September 1, 2022
    Inventors: Andras Gabor Kupcsik, Markus Spies, Philipp Christian Schillinger
  • Publication number: 20220277483
    Abstract: A method for ascertaining the pose of an object. The method includes recording a first and a second camera image of the object, ascertaining a correspondence between camera pixels of the camera images and vertices of a 3D model of the object, and ascertaining the pose of the object from a set of poses by minimizing, across the set of poses, a loss function, the loss function for a pose being provided by accumulation of distance measures between projections of the object in the pose onto the respective camera image plane and the corresponding pixels of the respective camera image.
    Type: Application
    Filed: February 22, 2022
    Publication date: September 1, 2022
    Inventor: Markus Spies
  • Publication number: 20220152818
    Abstract: A method for training a machine learning model to recognize an object topology of an object from an image of the object. The method includes: obtaining a 3D model of the object; determining a descriptor component value for each vertex of the grid; generating training data image pairs each having a training input image and a target image. The target image is generated by determining the vertex positions in the training input image; assigning the descriptor component value determined for the vertex at the vertex position to the position in the target image; and adapting at least some of the descriptor component values assigned to the positions in the target image or adding descriptor component values to the positions of the target image.
    Type: Application
    Filed: November 9, 2021
    Publication date: May 19, 2022
    Inventors: Andras Gabor Kupcsik, Marco Todescato, Markus Spies, Nicolai Waniek, Philipp Christian Schillinger, Mathias Buerger
  • Publication number: 20220152834
    Abstract: A method for controlling a robot to pick up an object in various positions. The method includes: defining a plurality of reference points on the object; mapping a first camera image of the object in a known position onto a first descriptor image; identifying the descriptors of the reference points from the first descriptor image; mapping a second camera image of the object in an unknown position onto a second descriptor image; searching the identified descriptors of the reference points in the second descriptor image; ascertaining the positions of the reference points in the three-dimensional space in the unknown position from the found positions; and ascertaining a pickup pose of the object for the unknown position from the ascertained positions of the reference points.
    Type: Application
    Filed: November 8, 2021
    Publication date: May 19, 2022
    Inventors: Andras Gabor Kupcsik, Marco Todescato, Markus Spies, Nicolai Waniek, Philipp Christian Schillinger, Mathias Buerger
  • Patent number: 11253997
    Abstract: A method for tracking multiple target objects, moving objects to be tracked being projected onto a grid map having grid cells, the method including the following tasks to be executed in each time: computing the velocity distribution for the next time step with the aid of a transition velocity distribution, which indicates how the objects associated with a grid cell in question move from one time step to the next, based on the preceding velocity distribution; for each grid cell, calculating a transitional probability information item, which indicates, for objects in each grid cell, probabilities of the objects in question reaching possible, further grid cells, as a function of the velocity distribution; calculating an occupancy probability for each grid cell for a subsequent time, based on the transitional probability information item; operating a system as a function of the occupancy probabilities for the grid cells.
    Type: Grant
    Filed: January 29, 2019
    Date of Patent: February 22, 2022
    Assignee: Robert Bosch GmbH
    Inventors: Markus Spies, Johannes Maximilian Doellinger, Liangcheng Fu
  • Publication number: 20200398427
    Abstract: A method for planning a manipulation task of an agent, particularly a robot. The method includes: learning a number of manipulation skills wherein a symbolic abstraction of the respective manipulation skill is generated; determining a concatenated sequence of manipulation skills selected from the number of learned manipulation skills based on their symbolic abstraction so that a given goal specification indicating a given complex manipulation task is satisfied; and executing the sequence of manipulation skills.
    Type: Application
    Filed: June 4, 2020
    Publication date: December 24, 2020
    Inventors: Andras Gabor Kupcsik, Leonel Rozo, Marco Todescato, Markus Spies, Markus Giftthaler, Mathias Buerger, Meng Guo, Nicolai Waniek, Patrick Kesper, Philipp Christian Schillinger
  • Publication number: 20200363810
    Abstract: A method of controlling a vehicle or robot. The method includes the following steps: determining a first control sequence, determining a second control sequence for controlling the vehicle or robot depending on the first control sequence, a current state of the vehicle or robot, and on a model characterizing a dynamic behavior of the vehicle or robot, controlling the vehicle or robot depending on the second control sequence, wherein the determining of the first control sequence is performed depending on a first candidate control sequence and a second candidate control sequence.
    Type: Application
    Filed: April 29, 2020
    Publication date: November 19, 2020
    Inventors: Kai Oliver Arras, Luigi Palmieri, Markus Spies, Raphael Kusumoto Barbosa de Almeida
  • Publication number: 20190232487
    Abstract: A method for tracking multiple target objects, moving objects to be tracked being projected onto a grid map having grid cells, the method including the following tasks to be executed in each time: computing the velocity distribution for the next time step with the aid of a transition velocity distribution, which indicates how the objects associated with a grid cell in question move from one time step to the next, based on the preceding velocity distribution; for each grid cell, calculating a transitional probability information item, which indicates, for objects in each grid cell, probabilities of the objects in question reaching possible, further grid cells, as a function of the velocity distribution; calculating an occupancy probability for each grid cell for a subsequent time, based on the transitional probability information item; operating a system as a function of the occupancy probabilities for the grid cells.
    Type: Application
    Filed: January 29, 2019
    Publication date: August 1, 2019
    Inventors: Markus Spies, Johannes Maximilian Doellinger, Liangcheng Fu