Patents by Inventor Rosen Nikolaev Diankov

Rosen Nikolaev Diankov has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230008946
    Abstract: A method for operating a robotic system includes determining a discretized object model representative of a target object; determining a discretized platform model representative of a task location; determining height measures based on real-time sensor data representative of the task location; and dynamically deriving a placement location based on (1) overlapping the discretized object model and the discretized platform model for stacking objects at the task location and (2) calculating a placement score associated with the overlapping based on the height measures.
    Type: Application
    Filed: September 26, 2022
    Publication date: January 12, 2023
    Inventors: Rosen Nikolaev Diankov, Denys Kanunikov
  • Publication number: 20220371200
    Abstract: Systems and methods for object detection and robotic control or pickup of the detected objects are provided. Systems and methods described herein provide for the determination and adjustment of minimum viable regions on a surface of an object for robotic pickup. Determination of a minimum viable region may increase the accuracy and efficiency of robotic object handling. The minimum viable region may be used to select grasping areas for a movement operation configured to provide supplemental image information for estimating dimensions of a target object.
    Type: Application
    Filed: May 17, 2022
    Publication date: November 24, 2022
    Inventors: Jinze YU, Yoshiki KANEMOTO, Jose Jeronimo MOREIRA RODRIGUES, Rosen Nikolaev DIANKOV
  • Publication number: 20220375097
    Abstract: A computing system including a processing circuit in communication with a camera having a field of view, The processing circuit obtains image information based on the objects in the field of view and defines a minimum viable region for a target open corner. Potential minimum viable regions are defined by identifying candidate edges of an object and determining potential intersection points based on the candidate edges. The minimum viable region may then be identified and validated from the potential minimum viable regions.
    Type: Application
    Filed: May 17, 2022
    Publication date: November 24, 2022
    Inventors: Jinze YU, Yoshiki KANEMOTO, Jose Jeronimo MOREIRA RODRIGUES, Rosen Nikolaev DIANKOV
  • Patent number: 11501445
    Abstract: A system and method for operating a robotic system to scan and register unrecognized objects is disclosed. The robotic system may use an image data representative of an unrecognized object located at a start location to implement operations for transferring the unrecognized object from the start location. While implementing the operations, the robotic system may obtain additional data, including scanning results of one or more portions of the unrecognized object not included in the image data. The robotic system may use the additional data to register the unrecognized object.
    Type: Grant
    Filed: October 29, 2019
    Date of Patent: November 15, 2022
    Assignee: MUJIN, Inc.
    Inventors: Rosen Nikolaev Diankov, Huan Liu, Xutao Ye, Jose Jeronimo Moreira Rodrigues, Yoshiki Kanemoto, Jinze Yu, Russell Islam
  • Publication number: 20220355474
    Abstract: A method and computing system for transferring objects between a source repository and a destination repository is provided. The computing system is configured to operate by a combination of pre-planned and image base trajectories to improve speed and reliability of object transfer. The computing system is configured to capture image information of repositories and use the captured information to alter or adjust pre-planned trajectories to improve performance.
    Type: Application
    Filed: April 29, 2022
    Publication date: November 10, 2022
    Inventors: Xutao YE, Hamdi SAHLOUL, Puttichai LERTKULTANON, Rosen Nikolaev DIANKOV
  • Patent number: 11491654
    Abstract: A system and method for operating a robotic system to place objects into containers that have support walls is disclosed. The robotic system may detect an unexpected condition associated with a container during or before a real-time operation. Accordingly, the robotic system may dynamically adjust an existing packing plan based on detecting the unexpected condition.
    Type: Grant
    Filed: August 26, 2020
    Date of Patent: November 8, 2022
    Assignee: MUJIN, Inc.
    Inventors: Denys Kanunikov, Rosen Nikolaev Diankov
  • Patent number: 11488323
    Abstract: A method for operating a robotic system includes determining a discretized object model representative of a target object; determining a discretized platform model representative of a task location; determining height measures based on real-time sensor data representative of the task location; and dynamically deriving a placement location based on (1) overlapping the discretized object model and the discretized platform model for stacking objects at the task location and (2) calculating a placement score associated with the overlapping based on the height measures.
    Type: Grant
    Filed: April 24, 2020
    Date of Patent: November 1, 2022
    Assignee: MUJIN, Inc.
    Inventors: Rosen Nikolaev Diankov, Denys Kanunikov
  • Publication number: 20220332524
    Abstract: A system and method for operating a transfer robot and a multi-surface gripper to grasp and transfer objects is disclosed.
    Type: Application
    Filed: April 13, 2022
    Publication date: October 20, 2022
    Inventors: Shintaro Matsuoka, Hironori Mizoguchi, Rosen Nikolaev Diankov, Yoshiki Kanemoto, Jinze Yu
  • Patent number: 11472640
    Abstract: A robotic system for arranging packages at a destination in a specified arrangement. The robotic system processes incoming packages, stores the packages in a temporary storage area, executes a simulate function to generate or update a simulated stacking plan, determines the occurrence of a palletizing trigger, and places the packages on the pallet according to the simulated stacking plan upon determining the occurrence of the palletizing trigger. The palletizing trigger can be one of a time limit trigger, a uniform layer trigger, a storage capacity trigger, or receiving a placement initiation command.
    Type: Grant
    Filed: February 28, 2020
    Date of Patent: October 18, 2022
    Assignee: MUJIN, Inc.
    Inventors: Rosen Nikolaev Diankov, Denys Kanunikov
  • Publication number: 20220305656
    Abstract: The present disclosure provides a control method of a robotic system. The control method includes: deriving an approach location at which the end effector grips an operation object; deriving a scan location for scanning an identifier of the operation object; and based on the approach location and the scan location, creating or deriving a control sequence to instruct the robot to execute the control sequence. The control sequence includes (1) gripping the operation object from a start location; (2) scanning an identifier of the operation object with a scanner located between the start location and a task location; (3) temporarily releasing the operation object from the end effector and regripping the operation object by the end effector to be shifted, at a shift location, when a predetermined condition is satisfied; and (4) moving the operation object to the task location.
    Type: Application
    Filed: June 10, 2022
    Publication date: September 29, 2022
    Inventors: Rosen Nikolaev Diankov, Yoshiki Kanemoto, Denys Kanunikov
  • Publication number: 20220284216
    Abstract: A method and computing system for performing the method are presented. The method may include receiving image information representing an object; identifying a set of one or more matching object recognition templates associated with a set of one or more detection hypotheses. The method may further include selecting a primary detection hypothesis associated with a matching object recognition template; generating a primary candidate region based on the matching object recognition template; determining at least one of: (i) whether the set of one or more matching object recognition templates has a subset of one or more remaining matching templates, or (ii) whether the image information has a portion representing an unmatched region; and generating a safety volume list based on at least one of: (i) the unmatched region, or (ii) one or more additional candidate regions that are generated based on the subset of one or more remaining matching templates.
    Type: Application
    Filed: March 5, 2021
    Publication date: September 8, 2022
    Inventors: Jose Jeronimo MOREIRA RODRIGUES, Rosen Nikolaev Diankov, Jinze Yu, Ahmed Abouelela, Yoshiki Kanemoto
  • Publication number: 20220281114
    Abstract: A method performed by a computing system is presented. The method may include the computing system receiving image information that represents an object surface associated with a flexible object, and identifying, as a grip region, a surface region of the object surface that satisfies a defined smoothness condition and has a region size that is larger than or equal to a defined region size threshold, wherein the grip region is identified based on the image information. The method may further include identifying, as a safety region, a three-dimensional (3D) region which surrounds the grip region in one or more horizontal dimensions, and which extends from the grip region along a vertical dimension that is perpendicular to the one or more horizontal dimensions. The method may further include performing robot motion planning based on the grip region and the safety region.
    Type: Application
    Filed: March 5, 2021
    Publication date: September 8, 2022
    Inventors: Jose Jeronimo MOREIRA RODRIGUES, Rosen Nikolaev DIANKOV, Jinze YU, Ahmed ABOUELELA, Yoshiki KANEMOTO
  • Patent number: 11413753
    Abstract: A control method includes: deriving an approach location at which the end effector grips an operation object; deriving a scan location for scanning an identifier of the operation object; and based on the approach location and the scan location, creating or deriving a control sequence to instruct the robot to execute the control sequence. The control sequence includes (1) gripping the operation object from a start location; (2) scanning an identifier of the operation object with a scanner located between the start location and a task location; (3) temporarily releasing the operation object from the end effector and regripping the operation object by the end effector to be shifted, at a shift location, when a predetermined condition is satisfied; and (4) moving the operation object to the task location.
    Type: Grant
    Filed: December 2, 2020
    Date of Patent: August 16, 2022
    Assignee: MUJIN, Inc.
    Inventors: Rosen Nikolaev Diankov, Yoshiki Kanemoto, Denys Kanunikov
  • Publication number: 20220241963
    Abstract: A method for operating a transport robot includes receiving image data representative of a group of objects. One or more target objects are identified in the group based on the received image data. Addressable vacuum regions are selected based on the identified one or more target objects. The transport robot is command to cause the selected addressable vacuum regions to hold and transport the identified one or more target objects. The transport robot includes a multi-gripper assembly having an array of addressable vacuum regions each configured to independently provide a vacuum. A vision sensor device can capture the image data, which is representative of the target objects adjacent to or held by the multi-gripper assembly.
    Type: Application
    Filed: April 18, 2022
    Publication date: August 4, 2022
    Inventors: Hironori Mizoguchi, Rosen Nikolaev Diankov
  • Publication number: 20220219317
    Abstract: An object gripping assembly and associated systems and methods are disclosed herein. In some embodiments, the object gripping assembly includes a first carrying plate with a first mounting track extending along a first axis and two or more second carrying plates movably carried by the first mounting track. Each of the two or more second carrying plates can include a second mounting track extending along a second axis at least and extendable gripping components movably carried by the second mounting track. A first pitch adjusting component can be operably coupled the two or more second carrying plates to controllably change the pitch of the two or more second carrying plates along the first mounting track. A second pitch adjusting component can be operably coupled to the extendable gripping components on a corresponding second carrying plate to controllably change the pitch of the extendable gripping components along the second mounting track.
    Type: Application
    Filed: October 20, 2021
    Publication date: July 14, 2022
    Inventors: Lei Lei, Xu Chen, Yixuan Zhang, Pai Zheng, Yufan Du, Hironori Mizoguchi, Shekhar Gupta, Rosen Nikolaev Diankov
  • Publication number: 20220219916
    Abstract: A method for operating a robotic system includes determining package groupings for placing available packages on a platform; generating a two-dimensional (2D) placement plan based on discretized models representative of the available packages and the platform; generating a three-dimensional (3D) stacking plan based on the 2D placement plan; and implementing the 3D stacking plan for placing the available packages on the platform.
    Type: Application
    Filed: March 31, 2022
    Publication date: July 14, 2022
    Inventors: Rosen Nikolaev Diankov, Denys Kanunikov
  • Patent number: 11345029
    Abstract: A method for operating a transport robot includes receiving image data representative of a group of objects. One or more target objects are identified in the group based on the received image data. Addressable vacuum regions are selected based on the identified one or more target objects. The transport robot is command to cause the selected addressable vacuum regions to hold and transport the identified one or more target objects. The transport robot includes a multi-gripper assembly having an array of addressable vacuum regions each configured to independently provide a vacuum. A vision sensor device can capture the image data, which is representative of the target objects adjacent to or held by the multi-gripper assembly.
    Type: Grant
    Filed: April 22, 2020
    Date of Patent: May 31, 2022
    Assignee: MUJIN, Inc.
    Inventors: Hironori Mizoguchi, Rosen Nikolaev Diankov
  • Publication number: 20220135346
    Abstract: A system and method for operating a robotic system to use two or more tools to manipulate objects. The robotic system may coordinate planning processes and/or plan implementations based on grouping the objects.
    Type: Application
    Filed: August 2, 2021
    Publication date: May 5, 2022
    Inventors: Shintaro Matsuoka, Hironori Mizoguchi, Rosen Nikolaev Diankov
  • Patent number: 11319166
    Abstract: A method for operating a robotic system includes determining package groupings for placing available packages on a platform; generating a two-dimensional (2D) placement plan based on discretized models representative of the available packages and the platform; generating a three-dimensional (3D) stacking plan based on the 2D placement plan; and implementing the 3D stacking plan for placing the available packages on the platform.
    Type: Grant
    Filed: May 13, 2020
    Date of Patent: May 3, 2022
    Assignee: MUJIN, Inc.
    Inventors: Rosen Nikolaev Diankov, Denys Kanunikov
  • Publication number: 20220076425
    Abstract: The present disclosure relates to detecting and registering unrecognized or unregistered objects. A minimum viable range (MVR) may be derived based on inspecting image data that represents objects. The MVR may be determined to be a certain MVR or an uncertain MVR according to one or more features represented in the image data. The MVR may be used to register corresponding objects according to the certain or uncertain determination.
    Type: Application
    Filed: November 15, 2021
    Publication date: March 10, 2022
    Inventors: Jinze Yu, Jose Jeronimo Moreira Rodrigues, Rosen Nikolaev Diankov, Xutao Ye, Russell Islam