Patents by Inventor Dirk Balthasar

Dirk Balthasar has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 12657858
    Abstract: A bulk sorting system for sorting objects in bulk is provided. The bulk sorting system includes: at least one radiation source arranged to radiate the objects, at least one optical sensor arranged to capture reflected radiation of the objects and acquire the reflected radiation as multi- or hyperspectral data; a processing circuit configured to analyze the reflected radiation of the objects by inputting the multi- or hyperspectral data into a convolutional neural network (CNN) with at least two convolutional layers in order to either detect and classify the objects in the multi- or hyperspectral data and/or semantically segment the multi- or hyperspectral data; and a mechanical sorter configured to sort the objects according to their classification and/or segmentation using the analysis of the processing circuit such that different overlapping and/or stacked objects are separated or treated as a single group of objects.
    Type: Grant
    Filed: June 25, 2024
    Date of Patent: June 16, 2026
    Assignee: Tomra Sorting GmbH
    Inventors: Dirk Balthasar, Daniel Bender, Frank Schmitt
  • Patent number: 12511878
    Abstract: A method of training a neural network stored on a computer-readable storage medium to classify objects in a bulk flow, the method including: providing input image data depicting objects to be classified, which input image data is captured by means of an input imaging sensor of a first sensor technology design; providing auxiliary image data, which auxiliary image data is captured by means of an auxiliary imaging sensor of a second sensor technology design, and which auxiliary image data depicts said or similar objects which are classified in accordance with a predetermined classifying scheme; by means of a processing unit, train the neural network stored on the computer-readable storage medium to classify the depicted objects in the input image data based on classifications of depicted objects in the auxiliary image data, wherein the depicted objects in the input image data correspond to objects in a bulk flow.
    Type: Grant
    Filed: June 2, 2021
    Date of Patent: December 30, 2025
    Assignee: Tomra Sorting GmbH
    Inventor: Dirk Balthasar
  • Patent number: 12480871
    Abstract: An apparatus for detecting matter including: a light source arrangement adapted to emit a first and a second set of light beams towards a first detection zone through which the matter is provided. A spectroscopy system adapted to receive and analyse light which is reflected and/or scattered by matter in the first detection zone. A laser triangulation system including, a laser arrangement adapted to emit a line of laser light towards a second detection zone. A camera-based sensor arrangement configured to receive and analyse light which is reflected and/or scattered by matter in the second detection zone. The received light of the spectroscopy system completely or partially intersects the received light of the camera-based sensor arrangement and/or the line of laser light.
    Type: Grant
    Filed: May 4, 2021
    Date of Patent: November 25, 2025
    Assignee: Tomra Sorting GmbH
    Inventors: Dirk Balthasar, Michael Mayer, Patrick Sturm, Tobias Tückmantel
  • Publication number: 20250244255
    Abstract: The present disclosure relates to an inspection system for inspecting objects passing through an inspection area, which inspection area is divided into a plurality of elongated inspection zones having a longitudinal extension, the inspection system comprising: at least one detector and a scanning element adapted for redirecting the detector's field of view to any one of the plurality of elongated inspection zones, wherein the scanning element is adapted to rotate around a first rotational axis and comprises at least two reflective surfaces which redirect the detector's field of view to different inspection zones of the inspection are. A method for inspecting objects passing through an inspection area by an inspection system is also disclosed.
    Type: Application
    Filed: April 14, 2023
    Publication date: July 31, 2025
    Applicant: Tomra Food (Belgium) N.V.
    Inventors: Dirk BALTHASAR, James FRENCH
  • Publication number: 20250146937
    Abstract: The present invention relates to an apparatus for classification of matter comprising: a scanning element is configured to redirect the at least one illumination beam and to shift a plurality of inspection zones and an irradiated area relative said matter in the first direction. A processing circuitry configured to execute: a second zone collection function configured to collect second zone data based which pertains to said optical radiation emitted by said matter in the second inspection zone, a third zone collection function configured to collect third zone data based which pertains to optical radiation emitted by said matter in the third inspection zone, a classification function configured to classify said matter based on the second zone data and the third zone data.
    Type: Application
    Filed: December 6, 2022
    Publication date: May 8, 2025
    Applicant: Tomra Sorting GmbH
    Inventor: Dirk BALTHASAR
  • Publication number: 20250018433
    Abstract: We provide an apparatus for detecting matter comprising: An irradiation arrangement adapted to emit one of a first and a second set of illumination beams towards a detection zone where the matter is provided. A detection system receives and analyzes light reflected, emitted and/or scattered by matter in the detection zone. A switching device comprising a carrier movable between a first position, wherein the only the first illumination device in an active illumination position, and a second position wherein only said second illumination device in said active illumination position, and wherein said irradiation arrangement is configured to emit an illumination beam only from the one of said first and second illumination devices arranged in said active illumination position and an actuator for physically moving said carrier from said first position to said second position based on the condition of said first illumination device and/or in response to user-initiated input.
    Type: Application
    Filed: December 6, 2022
    Publication date: January 16, 2025
    Applicant: Tomra Sorting GmbH
    Inventor: Dirk BALTHASAR
  • Publication number: 20240431067
    Abstract: A cooling device for optical and/or electronic elements of an apparatus, includes at least one vortex tube for generating cold air; at least one air-to-air heat exchanger including at least one closed heat exchanger channel; the air-to-air heat exchanger further including a heat exchanger inlet for receiving the cold air and guiding it into the at least one closed heat exchanger channel, and a heat exchanger outlet for exhausting air from the at least one closed heat exchanger channel.
    Type: Application
    Filed: October 12, 2022
    Publication date: December 26, 2024
    Inventors: Dirk Balthasar, Michael Waldorf, Nils Noack, Nils Brinkmann
  • Publication number: 20240346794
    Abstract: A bulk sorting system for sorting objects in bulk is provided. The bulk sorting system includes: at least one radiation source arranged to radiate the objects, at least one optical sensor arranged to capture reflected radiation of the objects and acquire the reflected radiation as multi- or hyperspectral data; a processing circuit configured to analyze the reflected radiation of the objects by inputting the multi- or hyperspectral data into a convolutional neural network (CNN) with at least two convolutional layers in order to either detect and classify the objects in the multi- or hyperspectral data and/or semantically segment the multi- or hyperspectral data; and a mechanical sorter configured to sort the objects according to their classification and/or segmentation using the analysis of the processing circuit such that different overlapping and/or stacked objects are separated or treated as a single group of objects.
    Type: Application
    Filed: June 25, 2024
    Publication date: October 17, 2024
    Applicant: Tomra Sorting GmbH
    Inventors: Dirk BALTHASAR, Daniel BENDER, Frank SCHMITT
  • Patent number: 12046010
    Abstract: A bulk sorting system for sorting objects in bulk is provided. The bulk sorting system includes: at least one radiation source arranged to radiate the objects, at least one optical sensor arranged to capture reflected radiation of the objects and acquire the reflected radiation as multi- or hyperspectral data; a processing circuit configured to analyze the reflected radiation of the objects by inputting the multi- or hyperspectral data into a convolutional neural network (CNN) with at least two convolutional layers in order to either detect and classify the objects in the multi- or hyperspectral data and/or semantically segment the multi- or hyperspectral data; and a mechanical sorter configured to sort the objects according to their classification and/or segmentation using the analysis of the processing circuit such that different overlapping and/or stacked objects are separated or treated as a single group of objects.
    Type: Grant
    Filed: November 4, 2020
    Date of Patent: July 23, 2024
    Assignee: TOMRA SORTING GMBH
    Inventors: Dirk Balthasar, Daniel Bender, Frank Schmitt
  • Publication number: 20240149470
    Abstract: The inventive concept is based on the inventors' realization that by providing a sorting device for a robotic system that has two tubes being telescopically arranged and resiliently separated with a springing means, the picking and releasing of heavy objects may be improved. The inventive concept includes a method and system for conducting the sorting with a robotic arm and suction gripping system.
    Type: Application
    Filed: March 22, 2022
    Publication date: May 9, 2024
    Inventors: Dirk Balthasar, Nils Noack, Daniel Waldorf
  • Patent number: 11724286
    Abstract: An apparatus for detecting matter comprises bulk feeding means configured for feeding a plurality of objects into a detecting region; at least one light source having a focusing element and being configured for illuminating at least one object moving in an object plane in the detecting region; and a first light-analyzing apparatus arranged to sense light that has been transmitted through the object. In the associated method, the object is caused to move in the plane and the object is illuminated with incident light. Light that has been transmitted through the object and is falling in a measuring plane is detected, and an object-specific parameter based on the detected transmitted light is determined.
    Type: Grant
    Filed: November 3, 2014
    Date of Patent: August 15, 2023
    Assignee: TOMRA SORTING NV
    Inventors: Dirk Balthasar, Tobias Hartmann, John McGloughlin, Douglas Alexander Reid
  • Publication number: 20230213443
    Abstract: An apparatus for detecting matter including: a light source arrangement adapted to emit a first and a second set of light beams towards a first detection zone through which the matter is provided. A spectroscopy system adapted to receive and analyse light which is reflected and/or scattered by matter in the first detection zone. A laser triangulation system including, a laser arrangement adapted to emit a line of laser light towards a second detection zone. A camera-based sensor arrangement configured to receive and analyse light which is reflected and/or scattered by matter in the second detection zone. The received light of the spectroscopy system completely or partially intersects the received light of the camera-based sensor arrangement and/or the line of laser light.
    Type: Application
    Filed: May 4, 2021
    Publication date: July 6, 2023
    Applicant: Tomra Sorting GmbH
    Inventors: Dirk BALTHASAR, Michael MAYER, Patrick STURM, Tobias TÜCKMANTEL
  • Publication number: 20230206606
    Abstract: A method of training a neural network stored on a computer-readable storage medium to classify objects in a bulk flow, the method including: providing input image data depicting objects to be classified, which input image data is captured by means of an input imaging sensor of a first sensor technology design; providing auxiliary image data, which auxiliary image data is captured by means of an auxiliary imaging sensor of a second sensor technology design, and which auxiliary image data depicts said or similar objects which are classified in accordance with a predetermined classifying scheme; by means of a processing unit, train the neural network stored on the computer-readable storage medium to classify the depicted objects in the input image data based on classifications of depicted objects in the auxiliary image data, wherein the depicted objects in the input image data correspond to objects in a bulk flow.
    Type: Application
    Filed: June 2, 2021
    Publication date: June 29, 2023
    Applicant: Tomra Sorting GmbH
    Inventor: Dirk BALTHASAR
  • Publication number: 20230011383
    Abstract: A bulk sorting system for sorting objects in bulk is provided. The bulk sorting system includes: at least one radiation source arranged to radiate the objects, at least one optical sensor arranged to capture reflected radiation of the objects and acquire the reflected radiation as multi- or hyperspectral data; a processing circuit configured to analyze the reflected radiation of the objects by inputting the multi- or hyperspectral data into a convolutional neural network (CNN) with at least two convolutional layers in order to either detect and classify the objects in the multi- or hyperspectral data and/or semantically segment the multi- or hyperspectral data; and a mechanical sorter configured to sort the objects according to their classification and/or segmentation using the analysis of the processing circuit such that different overlapping and/or stacked objects are separated or treated as a single group of objects.
    Type: Application
    Filed: November 4, 2020
    Publication date: January 12, 2023
    Applicant: Tomra Sorting GmbH
    Inventors: Dirk BALTHASAR, Daniel BENDER, Frank SCHMITT
  • Patent number: 10888902
    Abstract: A method for object classification, including: guiding a continuous stream of objects from a transport mechanism directly into an unsupported path, along which the object stream is fed through a detection region; illuminating the detection region with a radiation band in a first direction; optically scanning the detection region to detect electromagnetic radiation reflected by the at least one object in the detection region by viewing the detection region along a second direction, wherein the directions have a cross-section in the detection region and form an angle relative each other of 10°-80°; analyzing the information; and classifying objects in at least two different directions based on the analysis of the transparency information from the optical scanning; wherein the step of analyzing the information from the optical scanning includes analyzing the objects based on the intensity, spread and texture of the detected radiation from the optical scanning.
    Type: Grant
    Filed: September 3, 2018
    Date of Patent: January 12, 2021
    Assignee: TOMRA SORTING GMBH
    Inventors: Dirk Balthasar, Michael Mayer, John McGloughlin
  • Publication number: 20200331034
    Abstract: A method for object classification, including: guiding a continuous stream of objects from a transport mechanism directly into an unsupported path, along which the object stream is fed through a detection region; illuminating the detection region with a radiation band in a first direction; optically scanning the detection region to detect electromagnetic radiation reflected by the at least one object in the detection region by viewing the detection region along a second direction, wherein the directions have a cross-section in the detection region and form an angle relative each other of 10°-80°; analyzing the information; and classifying objects in at least two different directions based on the analysis of the transparency information from the optical scanning; wherein the step of analyzing the information from the optical scanning includes analyzing the objects based on the intensity, spread and texture of the detected radiation from the optical scanning.
    Type: Application
    Filed: September 3, 2018
    Publication date: October 22, 2020
    Applicant: Tomra Sorting GmbH
    Inventors: Dirk BALTHASAR, Michael MAYER, John MCGLOUGHLIN
  • Patent number: 9594040
    Abstract: A method for analyzing objects depending on their electromagnetic properties. The method including the steps of conveying the objects to be analyzed on a conveyer belt; scanning the electromagnetic properties of the objects and the conveyer belt by an electromagnetic sensor, wherein the electromagnetic properties of the conveyer belt are dependent on metallic contaminants which are stuck in the conveyer belt; generating belt properties data representing the electromagnetic properties of the conveyer belt, and analyzing the objects according to the scanned electromagnetic properties and the belt properties data. This has the benefits that the electromagnetic properties of the conveyer belt are considered when distinguishing between metallic and non-metallic objects which have to be sorted. This way, the objects which got stuck in the conveyer belt over time, may influence a sorting less, which may improve sorting results. Further, an apparatus for executing such a method.
    Type: Grant
    Filed: August 16, 2013
    Date of Patent: March 14, 2017
    Assignee: TOMRA SORTING AS
    Inventors: Dirk Balthasar, Thomas Erdmann, Volker Rehrmann, Stefan Jürgensen, Slah Gharbi
  • Patent number: 9575005
    Abstract: An apparatus for inspecting a stream of matter including: a first and a second light source for emitting a first and a second light beam; a first and a second detector; a first scanning element adapted to redirect the detection area of the second detector from side to side across said stream, and a beam splitting element arranged to receive said first and second light beams, after they have been reflected against said matter, wherein said beam splitting element is adapted to guide said reflected first light beam towards said first detector and to guide said reflected second light beam towards said second detector.
    Type: Grant
    Filed: November 3, 2014
    Date of Patent: February 21, 2017
    Assignee: TOMRA SORTING NV
    Inventors: Dirk Balthasar, Hartmut Harbeck
  • Patent number: 9557265
    Abstract: An apparatus for detecting matter, the apparatus including: a first light source adapted to emit a first light beam; a second light source adapted to emit a second light beam, wherein the apparatus is arranged such that the first and second light beams converge towards a scanning element; the scanning element adapted to redirect the converging first and second light beams towards the matter to be detected; and a detector adapted to receive light reflected by the matter via the scanning element. Also, a system and method of detecting matter.
    Type: Grant
    Filed: January 24, 2013
    Date of Patent: January 31, 2017
    Assignee: TOMRA SOTRING AS
    Inventors: Dirk Balthasar, Ole Onsrud
  • Publication number: 20160263624
    Abstract: An apparatus for detecting matter comprises bulk feeding means configured for feeding a plurality of objects into a detecting region; at least one light source having a focusing element and being configured for illuminating at least one object moving in an object plane in the detecting region; and a first light-analyzing apparatus arranged to sense light that has been transmitted through the object. In the associated method, the object is caused to move in the plane and the object is illuminated with incident light. Light that has been transmitted through the object and is falling in a measuring plane is detected, and an object-specific parameter based on the detected transmitted light is determined.
    Type: Application
    Filed: November 3, 2014
    Publication date: September 15, 2016
    Applicant: TOMRA SORTING NV
    Inventors: Dirk BALTHASAR, Tobias HARTMANN, John MCGLOUGHLIN, Douglas Alexander REID