Patents by Inventor Johnny Holmberg
Johnny Holmberg has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11511435Abstract: A method for calibrating a robot coordinate system of a robot with a conveyor coordinate system of a movable conveyor member, the method including providing a sensor configured to detect positions of the robot in a non-contact manner; detecting a position of the robot when the conveyor member is positioned at a first operating position; detecting a position of the robot and/or of the conveyor member by the sensor in the sensor coordinate system when the conveyor member is positioned at a second operating position different from the first operating position; and determining a relationship between the robot coordinate system and the conveyor coordinate system based on at least one detected position of the robot in the sensor coordinate system. A robot system and a control system are also provided.Type: GrantFiled: May 22, 2017Date of Patent: November 29, 2022Assignee: ABB Schweiz AGInventors: Anders Lager, Johnny Holmberg, Magnus Wahlström, Michael Stenbacka
-
Patent number: 11491650Abstract: Robotic visualization systems and methods include running and analyzing perception algorithms and models for robotic visualization systems on multiple computing platforms to obtain a successful complete an object processing request.Type: GrantFiled: December 19, 2019Date of Patent: November 8, 2022Assignee: ABB Schweiz AGInventors: Remus Boca, Zhou Teng, Thomas Fuhlbrigge, Magnus Wahlstrom, Johnny Holmberg
-
Patent number: 11420323Abstract: A method for controlling movement sequences of a robot, the method including predicting values of at least one parameter related to the execution of alternative movement sequences by the robot, where each movement sequence includes at least one movement segment associated with a handling location; selecting a movement sequence based on the predicted values of the at least one parameter; and executing the selected movement sequence by the robot. A control system for controlling movement sequences of a robot is also provided.Type: GrantFiled: May 16, 2017Date of Patent: August 23, 2022Assignee: ABB Schweiz AGInventors: Anders Lager, Johnny Holmberg, Magnus Wahlström
-
Patent number: 11407111Abstract: A robot is configured to perform a task on an object using a method for generating a 3D model sufficient to determine a collision free path and identify the object in an industrial scene. The method includes determining a predefined collision free path and scanning an industrial scene around the robot. Stored images of the industrial scene are retrieved from a memory and analyzed to construct a new 3D model. After an object is detected in the new 3D model, the robot can further scan the image in the industrial scene while moving along a collision free path until the object is identified at a predefined certainty level. The robot can then perform a robot task on the object.Type: GrantFiled: June 27, 2018Date of Patent: August 9, 2022Assignee: ABB Schweiz AGInventors: Biao Zhang, Remus Boca, Carlos W. Morato, Carlos Martinez, Jianjun Wang, Zhou Teng, Jinmiao Huang, Magnus Wahlstrom, Johnny Holmberg
-
Publication number: 20200198129Abstract: Robotic visualization systems and methods include running and analyzing perception algorithms and models for robotic visualization systems on multiple computing platforms to obtain a successful complete an object processing request.Type: ApplicationFiled: December 19, 2019Publication date: June 25, 2020Inventors: Remus Boca, Zhou Teng, Thomas Fuhlbrigge, Magnus Wahlstrom, Johnny Holmberg
-
Publication number: 20200202178Abstract: A robotic system is provided to automatically generate and evaluate visual data used for training neural networks. The robotic system includes a first robotic cell for generating a first visual data set and a second robotic cell for generating a second visual data set for comparison to the first visual data set.Type: ApplicationFiled: December 19, 2019Publication date: June 25, 2020Inventors: Remus Boca, Zhou Teng, Thomas Fuhlbrigge, Magnus Wahlstrom, Johnny Holmberg
-
Publication number: 20200164518Abstract: A method for calibrating a robot coordinate system of a robot with a conveyor coordinate system of a movable conveyor member, the method including providing a sensor configured to detect positions of the robot in a non-contact manner; detecting a position of the robot when the conveyor member is positioned at a first operating position; detecting a position of the robot and/or of the conveyor member by the sensor in the sensor coordinate system when the conveyor member is positioned at a second operating position different from the first operating position; and determining a relationship between the robot coordinate system and the conveyor coordinate system based on at least one detected position of the robot in the sensor coordinate system. A robot system and a control system are also provided.Type: ApplicationFiled: May 22, 2017Publication date: May 28, 2020Applicant: ABB Schweiz AGInventors: Anders Lager, Johnny Holmberg, Magnus Wahlström, Michael Stenbacka
-
Publication number: 20200156236Abstract: A method for controlling movement sequences of a robot, the method including predicting values of at least one parameter related to the execution of alternative movement sequences by the robot, where each movement sequence includes at least one movement segment associated with a handling location; selecting a movement sequence based on the predicted values of the at least one parameter; and executing the selected movement sequence by the robot. A control system for controlling movement sequences of a robot is also provided.Type: ApplicationFiled: May 16, 2017Publication date: May 21, 2020Inventors: Anders Lager, Johnny Holmberg, Magnus Wahlström
-
Publication number: 20200001458Abstract: A robot is configured to perform a task on an object using a method for generating a 3D model sufficient to determine a collision free path and identify the object in an industrial scene. The method includes determining a predefined collision free path and scanning an industrial scene around the robot. Stored images of the industrial scene are retrieved from a memory and analyzed to construct a new 3D model. After an object is detected in the new 3D model, the robot can further scan the image in the industrial scene while moving along a collision free path until the object is identified at a predefined certainty level. The robot can then perform a robot task on the object.Type: ApplicationFiled: June 27, 2018Publication date: January 2, 2020Inventors: Biao Zhang, Remus Boca, Carlos W. Morato, Carlos Martinez, Jianjun Wang, Zhou Teng, Jinmiao Huang, Magnus Wahlstrom, Johnny Holmberg
-
Publication number: 20180206771Abstract: A monitoring system and method for monitoring and/or predicting drowsiness of a driver of a vehicle or a machinery operator are provided. A set of infrared, IR, or near infrared, NIR, light sources, is arranged such that an amount of the light emitted from the light source incidents on an eye of the driver or operator. The light that impinges on the eye of the driver or operator forms a virtual image of the signal sources on the eye including the sclera and/or cornea. An image sensor obtains consecutive images capturing the reflected light, wherein each image will contain glints from at least a subset or all of the light sources. A drowsiness index can be determined based on the extracted information of the glints of the sequence of images, wherein the drowsiness index indicates a degree of drowsiness of the driver or operator.Type: ApplicationFiled: March 21, 2018Publication date: July 26, 2018Applicant: Tobii ABInventors: Miroslav Kobetski, Johnny Holmberg, Peter Blixt, John Mikael Elvesjö
-
Patent number: 9955903Abstract: A monitoring system and method for monitoring and/or predicting drowsiness of a driver of a vehicle or a machinery operator are provided. A set of infrared, IR, or near infrared, NIR, light sources, is arranged such that an amount of the light emitted from the light source incidents on an eye of the driver or operator. The light that impinges on the eye of the driver or operator forms a virtual image of the signal sources on the eye including the sclera and/or cornea. An image sensor obtains consecutive images capturing the reflected light, wherein each image will contain glints from at least a subset or all of the light sources. A drowsiness index can be determined based on the extracted information of the glints of the sequence of images, wherein the drowsiness index indicates a degree of drowsiness of the driver or operator.Type: GrantFiled: October 24, 2014Date of Patent: May 1, 2018Assignee: Tobii ABInventors: Miroslav Kobetski, Johnny Holmberg, Peter Blixt, John Mikael Elvesjö
-
Publication number: 20150042477Abstract: A monitoring system and method for monitoring and/or predicting drowsiness of a driver of a vehicle or a machinery operator are provided. A set of infrared, IR, or near infrared, NIR, light sources, is arranged such that an amount of the light emitted from the light source incidents on an eye of the driver or operator. The light that impinges on the eye of the driver or operator forms a virtual image of the signal sources on the eye including the sclera and/or cornea. An image sensor obtains consecutive images capturing the reflected light, wherein each image will contain glints from at least a subset or all of the light sources. A drowsiness index can be determined based on the extracted information of the glints of the sequence of images, wherein the drowsiness index indicates a degree of drowsiness of the driver or operator.Type: ApplicationFiled: October 24, 2014Publication date: February 12, 2015Inventors: Miroslav Kobetski, Johnny Holmberg, Peter Blixt, John Mikael Elvesjö
-
Patent number: 8902070Abstract: A monitoring system and method for monitoring and/or predicting drowsiness of a driver of a vehicle or a machinery operator are provided. A set of infrared, IR, or near infrared, NIR, light sources, is arranged such that an amount of the light emitted from the light source incidents on an eye of the driver or operator. The light that impinges on the eye of the driver or operator forms a virtual image of the signal sources on the eye including the sclera and/or cornea. An image sensor obtains consecutive images capturing the reflected light, wherein each image will contain glints from at least a subset or all of the light sources. A drowsiness index can be determined based on the extracted information of the glints of the sequence of images, wherein the drowsiness index indicates a degree of drowsiness of the driver or operator.Type: GrantFiled: November 16, 2012Date of Patent: December 2, 2014Assignee: Tobii Technology ABInventors: Miroslav Kobetski, Peter Blixt, Johnny Holmberg, John Mikael Elvesjo
-
Patent number: 8610768Abstract: The invention generally relates to systems and methods for eye detection for use in, for example, installations and systems for tracking eyes and gaze angle/directions. The system includes a plurality of eye detection units connected to an image sensor. The eye detection units are adapted to receive regions of picture elements of a digital image frame substantially in parallel and wherein the eye detection units are adapted to operate substantially in parallel, each eye detection unit being adapted to receive a specified region of the picture elements of at least one digital image frame and including an eye feature extraction module adapted to perform a eye feature extraction process on the received picture elements to identify predetermined eye features.Type: GrantFiled: July 9, 2010Date of Patent: December 17, 2013Assignee: Tobii Technology ABInventors: Johnny Holmberg, Peter Blixt, John Elvesjö
-
Patent number: 8314707Abstract: A monitoring system monitors and/or predicts drowsiness of a driver of a vehicle or a machine operator. A set of infrared or near infrared light sources is arranged such that an amount of the light emitted from the light source strikes an eye of the driver or operator. The light that impinges on the eye of the driver or operator forms a virtual image of the signal sources on the eye, including the sclera and/or cornea. An image sensor obtains consecutive images capturing the reflected light. Each image contains glints from at least a subset or from all of the light sources. A drowsiness index can be determined based on the extracted information of the glints of the sequence of images. The drowsiness index indicates a degree of drowsiness of the driver or operator.Type: GrantFiled: March 30, 2010Date of Patent: November 20, 2012Assignee: Tobii Technology ABInventors: Miroslav Kobetski, Peter Blixt, Johnny Holmberg, John Mikael Holtz Elvesjo
-
Patent number: 7970086Abstract: A method for processing a signal includes monitoring an over-sampled signal to detect deviations in a number of fill samples, and providing an electronic delay adjustment to a signal path. If a deviation in the number of fill samples is detected, the electronic delay adjustment from the signal path is removed in one or more steps until all of the electronic delay adjustment is removed from the signal path.Type: GrantFiled: August 15, 2007Date of Patent: June 28, 2011Assignee: Infineon Technologies AGInventors: Johnny Holmberg, Mikael Hjelm
-
Publication number: 20110013007Abstract: The invention generally relates to systems and methods for eye detection for use in, for example, installations and systems for tracking eyes and gaze angle/directions. The system includes a plurality of eye detection units connected to an image sensor. The eye detection units are adapted to receive regions of picture elements of a digital image frame substantially in parallel and wherein the eye detection units are adapted to operate substantially in parallel, each eye detection unit being adapted to receive a specified region of the picture elements of at least one digital image frame and including an eye feature extraction module adapted to perform a eye feature extraction process on the received picture elements to identify predetermined eye features.Type: ApplicationFiled: July 9, 2010Publication date: January 20, 2011Applicant: Tobii Technology AbInventors: JOHNNY HOLMBERG, Peter Blixt, John Elvesjö
-
Publication number: 20100245093Abstract: A monitoring system monitors and/or predicts drowsiness of a driver of a vehicle or a machine operator. A set of infrared or near infrared light sources is arranged such that an amount of the light emitted from the light source strikes an eye of the driver or operator. The light that impinges on the eye of the driver or operator forms a virtual image of the signal sources on the eye, including the sclera and/or cornea. An image sensor obtains consecutive images capturing the reflected light. Each image contains glints from at least a subset or from all of the light sources. A drowsiness index can be determined based on the extracted information of the glints of the sequence of images. The drowsiness index indicates a degree of drowsiness of the driver or operator.Type: ApplicationFiled: March 30, 2010Publication date: September 30, 2010Applicant: Tobii Technology ABInventors: Miroslav Kobetski, Peter Blixt, Johnny Holmberg, John Mikael Holtz Elvesjo
-
Publication number: 20090046822Abstract: Embodiments for compensating clock drift in a system have been described and depicted.Type: ApplicationFiled: August 15, 2007Publication date: February 19, 2009Inventors: Johnny Holmberg, Mikael Hjelm