Patents by Inventor Johnny Holmberg

Johnny Holmberg has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11511435
    Abstract: A method for calibrating a robot coordinate system of a robot with a conveyor coordinate system of a movable conveyor member, the method including providing a sensor configured to detect positions of the robot in a non-contact manner; detecting a position of the robot when the conveyor member is positioned at a first operating position; detecting a position of the robot and/or of the conveyor member by the sensor in the sensor coordinate system when the conveyor member is positioned at a second operating position different from the first operating position; and determining a relationship between the robot coordinate system and the conveyor coordinate system based on at least one detected position of the robot in the sensor coordinate system. A robot system and a control system are also provided.
    Type: Grant
    Filed: May 22, 2017
    Date of Patent: November 29, 2022
    Assignee: ABB Schweiz AG
    Inventors: Anders Lager, Johnny Holmberg, Magnus Wahlström, Michael Stenbacka
  • Patent number: 11491650
    Abstract: Robotic visualization systems and methods include running and analyzing perception algorithms and models for robotic visualization systems on multiple computing platforms to obtain a successful complete an object processing request.
    Type: Grant
    Filed: December 19, 2019
    Date of Patent: November 8, 2022
    Assignee: ABB Schweiz AG
    Inventors: Remus Boca, Zhou Teng, Thomas Fuhlbrigge, Magnus Wahlstrom, Johnny Holmberg
  • Patent number: 11420323
    Abstract: A method for controlling movement sequences of a robot, the method including predicting values of at least one parameter related to the execution of alternative movement sequences by the robot, where each movement sequence includes at least one movement segment associated with a handling location; selecting a movement sequence based on the predicted values of the at least one parameter; and executing the selected movement sequence by the robot. A control system for controlling movement sequences of a robot is also provided.
    Type: Grant
    Filed: May 16, 2017
    Date of Patent: August 23, 2022
    Assignee: ABB Schweiz AG
    Inventors: Anders Lager, Johnny Holmberg, Magnus Wahlström
  • Patent number: 11407111
    Abstract: A robot is configured to perform a task on an object using a method for generating a 3D model sufficient to determine a collision free path and identify the object in an industrial scene. The method includes determining a predefined collision free path and scanning an industrial scene around the robot. Stored images of the industrial scene are retrieved from a memory and analyzed to construct a new 3D model. After an object is detected in the new 3D model, the robot can further scan the image in the industrial scene while moving along a collision free path until the object is identified at a predefined certainty level. The robot can then perform a robot task on the object.
    Type: Grant
    Filed: June 27, 2018
    Date of Patent: August 9, 2022
    Assignee: ABB Schweiz AG
    Inventors: Biao Zhang, Remus Boca, Carlos W. Morato, Carlos Martinez, Jianjun Wang, Zhou Teng, Jinmiao Huang, Magnus Wahlstrom, Johnny Holmberg
  • Publication number: 20200198129
    Abstract: Robotic visualization systems and methods include running and analyzing perception algorithms and models for robotic visualization systems on multiple computing platforms to obtain a successful complete an object processing request.
    Type: Application
    Filed: December 19, 2019
    Publication date: June 25, 2020
    Inventors: Remus Boca, Zhou Teng, Thomas Fuhlbrigge, Magnus Wahlstrom, Johnny Holmberg
  • Publication number: 20200202178
    Abstract: A robotic system is provided to automatically generate and evaluate visual data used for training neural networks. The robotic system includes a first robotic cell for generating a first visual data set and a second robotic cell for generating a second visual data set for comparison to the first visual data set.
    Type: Application
    Filed: December 19, 2019
    Publication date: June 25, 2020
    Inventors: Remus Boca, Zhou Teng, Thomas Fuhlbrigge, Magnus Wahlstrom, Johnny Holmberg
  • Publication number: 20200164518
    Abstract: A method for calibrating a robot coordinate system of a robot with a conveyor coordinate system of a movable conveyor member, the method including providing a sensor configured to detect positions of the robot in a non-contact manner; detecting a position of the robot when the conveyor member is positioned at a first operating position; detecting a position of the robot and/or of the conveyor member by the sensor in the sensor coordinate system when the conveyor member is positioned at a second operating position different from the first operating position; and determining a relationship between the robot coordinate system and the conveyor coordinate system based on at least one detected position of the robot in the sensor coordinate system. A robot system and a control system are also provided.
    Type: Application
    Filed: May 22, 2017
    Publication date: May 28, 2020
    Applicant: ABB Schweiz AG
    Inventors: Anders Lager, Johnny Holmberg, Magnus Wahlström, Michael Stenbacka
  • Publication number: 20200156236
    Abstract: A method for controlling movement sequences of a robot, the method including predicting values of at least one parameter related to the execution of alternative movement sequences by the robot, where each movement sequence includes at least one movement segment associated with a handling location; selecting a movement sequence based on the predicted values of the at least one parameter; and executing the selected movement sequence by the robot. A control system for controlling movement sequences of a robot is also provided.
    Type: Application
    Filed: May 16, 2017
    Publication date: May 21, 2020
    Inventors: Anders Lager, Johnny Holmberg, Magnus Wahlström
  • Publication number: 20200001458
    Abstract: A robot is configured to perform a task on an object using a method for generating a 3D model sufficient to determine a collision free path and identify the object in an industrial scene. The method includes determining a predefined collision free path and scanning an industrial scene around the robot. Stored images of the industrial scene are retrieved from a memory and analyzed to construct a new 3D model. After an object is detected in the new 3D model, the robot can further scan the image in the industrial scene while moving along a collision free path until the object is identified at a predefined certainty level. The robot can then perform a robot task on the object.
    Type: Application
    Filed: June 27, 2018
    Publication date: January 2, 2020
    Inventors: Biao Zhang, Remus Boca, Carlos W. Morato, Carlos Martinez, Jianjun Wang, Zhou Teng, Jinmiao Huang, Magnus Wahlstrom, Johnny Holmberg
  • Publication number: 20180206771
    Abstract: A monitoring system and method for monitoring and/or predicting drowsiness of a driver of a vehicle or a machinery operator are provided. A set of infrared, IR, or near infrared, NIR, light sources, is arranged such that an amount of the light emitted from the light source incidents on an eye of the driver or operator. The light that impinges on the eye of the driver or operator forms a virtual image of the signal sources on the eye including the sclera and/or cornea. An image sensor obtains consecutive images capturing the reflected light, wherein each image will contain glints from at least a subset or all of the light sources. A drowsiness index can be determined based on the extracted information of the glints of the sequence of images, wherein the drowsiness index indicates a degree of drowsiness of the driver or operator.
    Type: Application
    Filed: March 21, 2018
    Publication date: July 26, 2018
    Applicant: Tobii AB
    Inventors: Miroslav Kobetski, Johnny Holmberg, Peter Blixt, John Mikael Elvesjö
  • Patent number: 9955903
    Abstract: A monitoring system and method for monitoring and/or predicting drowsiness of a driver of a vehicle or a machinery operator are provided. A set of infrared, IR, or near infrared, NIR, light sources, is arranged such that an amount of the light emitted from the light source incidents on an eye of the driver or operator. The light that impinges on the eye of the driver or operator forms a virtual image of the signal sources on the eye including the sclera and/or cornea. An image sensor obtains consecutive images capturing the reflected light, wherein each image will contain glints from at least a subset or all of the light sources. A drowsiness index can be determined based on the extracted information of the glints of the sequence of images, wherein the drowsiness index indicates a degree of drowsiness of the driver or operator.
    Type: Grant
    Filed: October 24, 2014
    Date of Patent: May 1, 2018
    Assignee: Tobii AB
    Inventors: Miroslav Kobetski, Johnny Holmberg, Peter Blixt, John Mikael Elvesjö
  • Publication number: 20150042477
    Abstract: A monitoring system and method for monitoring and/or predicting drowsiness of a driver of a vehicle or a machinery operator are provided. A set of infrared, IR, or near infrared, NIR, light sources, is arranged such that an amount of the light emitted from the light source incidents on an eye of the driver or operator. The light that impinges on the eye of the driver or operator forms a virtual image of the signal sources on the eye including the sclera and/or cornea. An image sensor obtains consecutive images capturing the reflected light, wherein each image will contain glints from at least a subset or all of the light sources. A drowsiness index can be determined based on the extracted information of the glints of the sequence of images, wherein the drowsiness index indicates a degree of drowsiness of the driver or operator.
    Type: Application
    Filed: October 24, 2014
    Publication date: February 12, 2015
    Inventors: Miroslav Kobetski, Johnny Holmberg, Peter Blixt, John Mikael Elvesjö
  • Patent number: 8902070
    Abstract: A monitoring system and method for monitoring and/or predicting drowsiness of a driver of a vehicle or a machinery operator are provided. A set of infrared, IR, or near infrared, NIR, light sources, is arranged such that an amount of the light emitted from the light source incidents on an eye of the driver or operator. The light that impinges on the eye of the driver or operator forms a virtual image of the signal sources on the eye including the sclera and/or cornea. An image sensor obtains consecutive images capturing the reflected light, wherein each image will contain glints from at least a subset or all of the light sources. A drowsiness index can be determined based on the extracted information of the glints of the sequence of images, wherein the drowsiness index indicates a degree of drowsiness of the driver or operator.
    Type: Grant
    Filed: November 16, 2012
    Date of Patent: December 2, 2014
    Assignee: Tobii Technology AB
    Inventors: Miroslav Kobetski, Peter Blixt, Johnny Holmberg, John Mikael Elvesjo
  • Patent number: 8610768
    Abstract: The invention generally relates to systems and methods for eye detection for use in, for example, installations and systems for tracking eyes and gaze angle/directions. The system includes a plurality of eye detection units connected to an image sensor. The eye detection units are adapted to receive regions of picture elements of a digital image frame substantially in parallel and wherein the eye detection units are adapted to operate substantially in parallel, each eye detection unit being adapted to receive a specified region of the picture elements of at least one digital image frame and including an eye feature extraction module adapted to perform a eye feature extraction process on the received picture elements to identify predetermined eye features.
    Type: Grant
    Filed: July 9, 2010
    Date of Patent: December 17, 2013
    Assignee: Tobii Technology AB
    Inventors: Johnny Holmberg, Peter Blixt, John Elvesjö
  • Patent number: 8314707
    Abstract: A monitoring system monitors and/or predicts drowsiness of a driver of a vehicle or a machine operator. A set of infrared or near infrared light sources is arranged such that an amount of the light emitted from the light source strikes an eye of the driver or operator. The light that impinges on the eye of the driver or operator forms a virtual image of the signal sources on the eye, including the sclera and/or cornea. An image sensor obtains consecutive images capturing the reflected light. Each image contains glints from at least a subset or from all of the light sources. A drowsiness index can be determined based on the extracted information of the glints of the sequence of images. The drowsiness index indicates a degree of drowsiness of the driver or operator.
    Type: Grant
    Filed: March 30, 2010
    Date of Patent: November 20, 2012
    Assignee: Tobii Technology AB
    Inventors: Miroslav Kobetski, Peter Blixt, Johnny Holmberg, John Mikael Holtz Elvesjo
  • Patent number: 7970086
    Abstract: A method for processing a signal includes monitoring an over-sampled signal to detect deviations in a number of fill samples, and providing an electronic delay adjustment to a signal path. If a deviation in the number of fill samples is detected, the electronic delay adjustment from the signal path is removed in one or more steps until all of the electronic delay adjustment is removed from the signal path.
    Type: Grant
    Filed: August 15, 2007
    Date of Patent: June 28, 2011
    Assignee: Infineon Technologies AG
    Inventors: Johnny Holmberg, Mikael Hjelm
  • Publication number: 20110013007
    Abstract: The invention generally relates to systems and methods for eye detection for use in, for example, installations and systems for tracking eyes and gaze angle/directions. The system includes a plurality of eye detection units connected to an image sensor. The eye detection units are adapted to receive regions of picture elements of a digital image frame substantially in parallel and wherein the eye detection units are adapted to operate substantially in parallel, each eye detection unit being adapted to receive a specified region of the picture elements of at least one digital image frame and including an eye feature extraction module adapted to perform a eye feature extraction process on the received picture elements to identify predetermined eye features.
    Type: Application
    Filed: July 9, 2010
    Publication date: January 20, 2011
    Applicant: Tobii Technology Ab
    Inventors: JOHNNY HOLMBERG, Peter Blixt, John Elvesjö
  • Publication number: 20100245093
    Abstract: A monitoring system monitors and/or predicts drowsiness of a driver of a vehicle or a machine operator. A set of infrared or near infrared light sources is arranged such that an amount of the light emitted from the light source strikes an eye of the driver or operator. The light that impinges on the eye of the driver or operator forms a virtual image of the signal sources on the eye, including the sclera and/or cornea. An image sensor obtains consecutive images capturing the reflected light. Each image contains glints from at least a subset or from all of the light sources. A drowsiness index can be determined based on the extracted information of the glints of the sequence of images. The drowsiness index indicates a degree of drowsiness of the driver or operator.
    Type: Application
    Filed: March 30, 2010
    Publication date: September 30, 2010
    Applicant: Tobii Technology AB
    Inventors: Miroslav Kobetski, Peter Blixt, Johnny Holmberg, John Mikael Holtz Elvesjo
  • Publication number: 20090046822
    Abstract: Embodiments for compensating clock drift in a system have been described and depicted.
    Type: Application
    Filed: August 15, 2007
    Publication date: February 19, 2009
    Inventors: Johnny Holmberg, Mikael Hjelm