SELF-DRIVING SYSTEMS WITH INVENTORY HOLDER
Embodiments of the present disclosure relate to a self-driving system that can engage and move an inventory holder. In one embodiment, the self-driving system includes a mobile base comprising motorized wheels, an actuator disposed within the mobile base, the actuator is operable to adjust a height of the mobile base, a console having an upper portion and a main body, the main body being coupled to a first end of the mobile base in a standing configuration, and a first camera disposed on a first side of the upper portion of the console, the first camera facing a second end of the mobile base opposing the first end.
This application is a continuation application of U.S. patent application Ser. No. 16/083,847 filed on Sep. 10, 2018, which claims priority to PCT application no. PCT/CN2018/102640 filed on Aug. 28, 2018.
BACKGROUND FieldEmbodiments disclosed herein relate to improved self-driving systems that can engage and move an inventory holder.
Description of the Related ArtAutomatic Guided Vehicles (AGVs) are driverless, programmable controlled vehicles that can transport articles or inventory items from designated pickup area(s) to unloading area(s) within a facility. These vehicles may be guided by magnetic tapes, optical, or other suitable systems for route guidance and collision avoidance. AGVs can provide a safer environment for workers, inventory items, and equipment with precise and controlled movement. However, workers may still be required to use wheeled carts to help AGVs load, unload or move inventory items at designated areas, thereby limiting the benefits of automation.
SUMMARYIn one embodiment, a self-driving system includes a mobile base comprising motorized wheels, an actuator disposed within the mobile base, the actuator is operable to adjust a height of the mobile base, a console having an upper portion and a main body, the main body being coupled to a first end of the mobile base in a standing configuration, and a first camera disposed on a first side of the upper portion of the console, the first camera facing a second end of the mobile base opposing the first end.
In one embodiment, a method of operating a self-driving system includes identifying boundaries of an inventory holder using a camera disposed on a console of a self-driving system, the console being coupled to an end of the self-driving system in a standing configuration, moving the self-driving system into a docking position with the inventory holder based on the identified boundaries, determining if the inventory holder is properly docked with the self-driving system, and raising a portion of the self-driving system to lift the inventory holder.
In one embodiment, a self-driving system includes a mobile base comprising a support surface and motorized wheels disposed under the support surface, the support surface having a first sensor disposed at a first end of the mobile base and a second sensor disposed at a second end of the mobile base opposing the first end, an actuator disposed within the mobile base, a console coupled to the first end of the mobile base in a standing configuration, wherein the actuator is operable to adjust a height of the mobile base when the first and second sensors detect a change of state from non-blocked to being blocked or from being blocked to non-blocked.
In one embodiment, a self-driving system includes a mobile base comprising a first sensor, a second sensor, a support surface, and motorized wheels disposed under the support surface, wherein the first sensor is disposed at a first side of the mobile base, the second sensor is disposed at a second side of the mobile base opposing the first side, an actuator disposed within the mobile base, and a console coupled to a first end of the mobile base in a standing configuration, wherein the actuator is operable to adjust a height of the mobile base when the first and second sensors detect a change of state from non-blocked to being blocked or from being blocked to non-blocked.
In one embodiment, a self-driving system includes a mobile base comprising a support surface and motorized wheels disposed under the support surface, an actuator disposed within the mobile base, a console coupled to a first end of the mobile base in a standing configuration, and a plurality of proximity sensors disposed on long sides of the mobile base, wherein the actuator is operable to adjust a height of the mobile base when the plurality of proximity sensors on long sides of the mobile base detect a change of state from non-blocked to being blocked or from being blocked to non-blocked.
In one embodiment, a self-driving system includes a mobile base comprising a support surface and motorized wheels disposed under the support surface, the support surface having a first sensor and a second sensor, an actuator disposed within the mobile base, a console coupled to a first end of the mobile base in a standing configuration, and a contact type sensor disposed on the upper surface, wherein the actuator is operable to adjust a height of the mobile base when the contact type sensor detects a contact with an object.
To facilitate understanding, identical reference numerals have been used, where possible, to designate identical elements that are common to the figures. It is contemplated that elements disclosed in one embodiment may be beneficially utilized with other embodiments without specific recitation.
DETAILED DESCRIPTIONEmbodiments of the present disclosure include an automated guided vehicle (AGV) that is a self-driving system and can securely raise and move an inventory holder. The AGV has a console coupled to a mobile base in a standing configuration. The mobile base is capable of moving the inventory holder within a facility based on a given instruction, such as routing and task instructions. The console and the mobile base use one or more sensors or cameras to ensure proper docking or engagement with the inventory holder. While the term AGV is used, the concept of this disclosure can be applied to any mobile robots, such as autonomously-navigating mobile robots, inertially-guided robots, remote-controlled mobile robots, and robots guided by laser targeting, vision systems, or roadmaps. In addition, while the embodiments of this disclosure are described with respect to AGVs moving inventory in a warehouse environment, the embodiments and the concept may also be used in a warehouse environment or any type of environment such as hospital, airport, or shopping center, etc. Various embodiments are discussed in greater detail below with respect to
The mobile base 102 has a plurality of motorized wheels 110 and a plurality of stabilizing wheels 112. In one embodiment, the mobile base 102 has two motorized wheels 110 and four stabilizing wheels 112. The stabilizing wheels 112 may be caster-type wheels and positioned at four corners of the mobile base 102. The motorized wheels 110 may be located underneath the mobile base 102 between the front stabilizing wheels 112 and the rear stabilizing wheels 112. Each of the motorized wheels 110 is configured to rotate and/or roll in any given directions. For example, the motorized wheels 110 can rotate about the Z-axis and roll on the ground along the X-axis or Y-axis. The motorized wheels 110 may be controlled to roll at different speed. If desired, any or all of the stabilizing wheels 112 may be motorized.
The mobile base 102 has an upper surface 106 that can be used to support a portion of an inventory holder 103. The inventory holder 103 generally includes a support plate 105, a handle 107 attached to a side of the support plate 105, and four wheels 109 coupled to the support plate 105 through support legs 123. The support plate 105 can be a flat solid plate or a grill-like structure. The inventory holder 103 may optionally include one or more rods 121 connecting the support legs 123 to enhance the mechanical strength of the inventory holder 103. The inventory holder 103 is sized to accommodate with the mobile base 102. For example, the height of the support plate 105 and the distance between the front wheels 109 can be configured to allow a portion of the mobile base 102 (e.g., upper surface 106) to get under the support plate 105.
The AGV 100 is programmed and/or controlled to locate the inventory holder 103. Once the inventory holder 103 is located, the AGV 100 will move towards the inventory holder 103 along a direction indicated by an arrow 111. The arrow 111 is parallel with the longitudinal direction of the inventory holder 103. The AGV 100 has or can obtain information about the inventory holder 103, such as the specification, dimension, or shape, etc. The sensors or cameras of the AGV 100 can help identify the inventory holder 103 and guide the docking procedure of the AGV 100 with the inventory holder 103. Alternatively, the operator may manually dock the inventory holder 103 with the AGV 100. In either case, the inventory holder 103 is considered properly docked with the AGV 100 when the upper surface 106 of the mobile base 102 is substantially covered by the support plate 105, or when the AGV 100 is notified by sensors and/or cameras that a proper docking with the inventory holder 103 has been established. As will be discussed in greater detail below, various sensors and/or cameras can be used to align and ensure proper docking between the inventory holder and the AGV 100.
The AGV 100 has a lifting system disposed within the housing of the mobile base 102. The lifting system includes one or more actuators 117. The location of the actuators 117 is shown for illustration purposes. The actuators 117 can be disposed at different locations within the mobile base 102. Each actuator 117 may use a motorized shaft that is operable to move the mobile base 102 vertically with respect to the ground, thereby adjusting a height of the mobile base 102. The upper surface 106 may have a cutout 114 disposed at the front side of the mobile base 102. The cutout 114 is shaped according to the profile of the console 104. In operation, the console 104 may be kept stationary and the upper surface 106 may be moved with respect to the console 104. Therefore, the console 104 does not interfere with the upper surface 106 during the movement of the mobile base 102.
After the inventory holder 103 is docked with the mobile base 102, the actuator 117 is operable to raise the mobile base 102 (and thus the upper surface 106) as appropriate for supporting the inventory holder 103. The mobile base 102 is raised up and in contact with the backside of the support plate 105 to lift the inventory holder 103 off the ground. Therefore, the latitude of the wheels 109 is higher than that of the motorized wheels and the stabilizing wheels 110, 112. Alternatively, the mobile base 102 may be engaged with the inventory holder 103 so that the inventory holder 103 can be pushed, pulled, rolled, carried, or otherwise moved by the mobile base 102. The term “engaged” used in this disclosure is refer to elements which are connected, attached, and/or coupled, either directly or integrally or indirectly via other elements, and either temporarily, removably, or even permanently.
The AGV 100 is then moved autonomously between designated areas within a facility based on commands or instructions received by the AGV 100. For example, the AGV 100 may receive a command that transports the inventory holder 103 to inventory storage, or to a pick-up/drop off area where inventory items are to be loaded/unloaded. Upon arrival of the designated area, the AGV 100 may instruct the actuators 117 to lower the inventory holder 103 and return to location of departure or other pre-determined destinations.
It is contemplated that the command or instruction may be any information associated with various tasks that may be performed within the facility. For example, the information may identify an inventory holder to be moved by the AGV 100, inventory storage, a destination of the inventory holder and/or the AGV 100, a current location of the AGV 100, and/or adjust the height of the upper surface 106 of the mobile base 102 of the AGV 100, etc. The command or instruction may be sent wirelessly over an internet, through a wired connection, or using any suitable manner to communicate with an operator or a management system. Examples of wireless communication may include, but are not limited to, ultra-wideband, radio frequency identification (active and/or passive), Bluetooth, WiFi, and/or any other form of communication of the communication.
The AGV 100 includes one or more sensors or cameras to ensure proper docking or engagement with the inventory holder 103 or any other objects such as inventory items. The sensors or cameras to be discussed below with respect to
In one embodiment, the sensors 402, 404 are reflective-type photosensors. In such a case, each sensor 402, 404 may include an emitter and a receiver. Light from the emitter is transmitted in a straight line. When an inventory holder (or any object such as inventory items) blocks the light path, the transmitted light is reflected by the inventory holder (or the object) and received by the receiver, which changes the state of the sensors 402, 404. When both sensors 402, 404 are blocked, the AGV 100 is notified that the inventory holder is properly docked and ready to be lifted up. For example, the one or more actuators 117 may raise or adjust the height of the upper surface 106 of the mobile base 102 if both sensors 402, 404 detect a change of state from non-blocked to being blocked. Likewise, the one or more actuators 117 may lower or adjust the height of the upper surface 106 of the mobile base 102 if both sensors 402, 404 detect a change of state from being blocked to non-blocked.
It is contemplated that the sensors 402, 404 may also be any suitable sensors that can be configured to detect the presence of nearby objects, such as sonar sensors, ultrasonic sensors, infrared sensors, radar sensors, LiDAR, and any combination thereof.
In one embodiment, which can be combined with any one or more embodiments described in this disclosure, the AGV 100 may include one or more contact type sensors to detect contact with an object, such as the inventory holder 103. The contact type sensor can be a pressure sensor or any suitable or component that is capable of detecting physical contact or applied force.
In one embodiment, which can be combined with any one or more embodiments described in this disclosure, the AGV 100 may include one or more cameras to determine whether an object, such as the inventory holder 103, is in proper docking position with the AGV 100. The cameras 134, 136 may include a monocular camera, a binocular camera, and/or a stereo camera. The cameras 134, 136 can be a camera having a 360 degree viewing range. The camera is configured to take and/or record visual images and detect the presence of nearby objects (similar to proximity sensors 402, 404).
In one embodiment, two cameras 134, 136 are provided on the upper portion 138 of the console 104 facing the rear side (i.e., the side away from the console 104) of the mobile base 102. Any number of cameras may be used and located at different positions on the AGV 100. The longitudinal direction of the upper portion 138 of the console 104 is held at an angle with respect to the longitudinal direction of the main body 140. The angle is chosen to allow the cameras 134, 136 to identify or measure the boundaries 142 (represented by dotted lines) of the inventory holder 103, such as boundaries of a portion of the support plate 105. The cameras 134, 136 can also be configured to provide an image capturing range that includes areas in the back and on both sides of the AGV 100. The image capturing range may include a 180 degree viewing area, a 270 degree viewing area, a 360 degree viewing area, or any viewing area between 180 degrees and 360 degrees. For example, the angle may be in a range from about 105 degrees to about 165 degrees, such as about 120 degrees to about 150 degrees. Wider or narrower range of angles is contemplated and can be adjusted depending on the size of the AGV or inventory holder.
In one embodiment, the cameras 134, 136 are configured to cover at least the boundaries of the support plate 105 and the handle 107. The identified boundaries 142 may be recorded as images or any appropriate form of data. The images or data are then compared and calculated by the AGV 100 to determine whether the inventory holder 103 is close enough to the AGV 100. Once the AGV 100 determines the inventory holder is properly docked, the mobile base 102 will lift the inventory holder 103 and go to the designated area.
In some embodiments, one or more cameras 137 are further provided on the upper portion 138 of the console 104 facing away from the mobile base 102. The cameras 137 can be identical to the cameras 134, 136. The one or more cameras 137 are located on the opposite side of the console 104 from where the cameras 134, 136 are located. The camera 137 can be used for obstacle detection and avoidance. In some cases, the camera 137 is configured to follow a target, such as an operator. In some cases, the camera 137 can also be configured to identify the shape, body, or boundaries of the operator so that the AGV 100 can maintain in the side follow position as the operator moves in a given direction. In some cases, the camera 137 can be configured to read/identify a barcode or identifier (e.g., a marker) that may be seen in the facility, such as on a pole or a working station. Any number of sensors or cameras 137 may be used and located at different positions on the console 104.
In some embodiments, the cameras 134, 136 can include a scanner or be configured to scan a barcode or identifier (e.g., a marker) on the inventory items that are already placed on, or to be put onto the inventory holder 103. The barcode or identifier may contain information associated with the inventory items. The cameras 134, 136 can determine whether all the inventory items have been collected based on the commands or information received from the management system.
In some embodiments, the inventory holder 103 may have one or more marks 141 disposed at the front side, or any appropriate locations of the inventory holder 103, such as on the support plate 105, handle 107, rod 121 or support legs 123. The marks 141 may be a reflective marker or radio-frequency (RF) emitter that is configured to allow the cameras 134, 136, or any sensors described in various embodiments of this disclosure to detect and read. The AGV 100 is programmed or controlled to align, dock and undock with the inventory holder 103 based on the inventory holder information pre-stored in the AGV 100 or obtained from the operator or management system.
In some embodiments, the inventory holder 103 may have one or more marks 143 disposed on the backside of the support plate 105. The marks 143 may be disposed at locations corresponding to the sensors, for example the sensors 402, 404 on the mobile base 102. The marks 143 may be reflective markers or any suitable identifiers. The sensors can detect the marks 143 and determine its location relative to the mobile base 102, thereby facilitating alignment and/or docking of the inventory holder 103 with the AGV 100.
In one embodiment, which can be combined with any one or more embodiments described in this disclosure, the AGV 100 may include one or more sensors for obstacle detection and avoidance. The sensors can also be used to detect a portion of an object, such as the rods on the inventory holder 103. With the detected information, the AGV 100 can determine whether the inventory holder is in proper docking position with the AGV 100.
In one embodiment shown in
The first and second sensors 144, 146 may be any suitable sonar sensors, ultrasonic sensors, infrared sensors, radar sensors, and/or laser sensors such as LiDAR sensors that can be configured to detect the presence of nearby objects that are stationary or moving. The first and second sensors 144, 146 may be oriented to scan the area in the AGV's direction of travel. For example, the first and second sensors 144, 146 can scan in two-dimensional planes roughly parallel with the ground. The first and second sensors 144, 146 may be configured to scan a field of view of up to 360 degrees, for example about 270 degrees.
In one embodiment, which can be combined with any one or more embodiments described in this disclosure, the AGV 100 may include one or more sensors to determine whether an object, such as the inventory holder 103, is in proper docking position with the AGV 100.
The sensors 156 may be in a linear arrangement or any suitable arrangement to provide a desired sensing area. Each sensor 156 can be configured to sense a field of view greater or less than about 90 degrees. In one embodiment, the sensors 156 are arranged in accordance with the support legs 123 or rods 121 of the inventory holder 103. When the inventory holder 103 is properly docked with the AGV 100, the sensors 156 on the long side of the mobile base 102 will be blocked by the support legs 123 and/or rods 121 of the inventory holder 103. The sensors 156 will notify the AGV 100 that the inventory holder is properly docked and ready to be lifted up. For example, the one or more actuators 117 may raise or adjust the height of the upper surface 106 of the mobile base 102 if sensors 156 on both long sides of the mobile base 102 detect a change of state from non-blocked to being blocked. Likewise, the one or more actuators 117 may lower or adjust the height of the upper surface 106 of the mobile base 102 if sensors 156 on both long sides of the mobile base 102 detect a change of state from being blocked to non-blocked.
The processor 702 is also in communication with proximity sensors 706, contact type sensors 708, and image acquiring device 710. The proximity sensors 706 may include any non-contact type sensors described above such as photosensors, laser scanners, sonar sensors, etc. The contact type sensors may include any sensors described above such as pressure sensors. The image acquiring device 710 may include any image taking or recording cameras described above. The information detected or collected by the proximity sensors 706, contact type sensors 708 and the image acquiring device 710 are provided to the processor 702 so that it can determine whether the inventory holder is properly docked and ready to be lifted up. In addition, the combination of the information recorded, detected, or gathered by the sensors and/or cameras can be used to help autonomously move the AGV 100 in a given direction while avoiding nearby obstacles.
The processor 702 is also in communication with a user input device 712. The user input device 712 may include the display as discussed above to display needed information. The user input device 712 also allows the operator to provide commands/instructions to the AGV system manually, or wirelessly via a remote control.
The processor 702 is further in communication with a lifting system 714, an inventory checking system 716, and an autonomous driving system 718. The lifting system 714 may include an actuator as discussed above for raising or lowering the inventory holder. The inventory checking system 716 may include one or more cameras described above and configured to scan a barcode on the inventory items that are already placed on, or to be put onto the inventory holder during inventory loading process. The processor 702 can also use the information obtained by the cameras to determine whether certain or all the inventory items have been collected based on the commands or information received from the management system. The autonomous driving system 718 may include a mobile base as discussed above. The mobile base can be controlled by the processor 702 to autonomously move in any given direction from one location to another location based on a set of pre-programmed instructions stored in the storage device 704, or commands provided by the operator, management system, or any combination of the information recorded, detected, or gathered by the sensors and/or cameras during operation. The mobile base can also be controlled to follow an operator in a rear follow position and/or a side follow position as discussed above.
While the foregoing is directed to embodiments of the disclosure, other and further embodiments of the disclosure thus may be devised without departing from the basic scope thereof, and the scope thereof is determined by the claims that follow.
Claims
1. A self-driving system, comprising:
- a mobile base comprising motorized wheels, the mobile base having a first end and a second end opposing the first end;
- an actuator disposed within the mobile base, the actuator is operable to adjust a height of the mobile base;
- a console coupled to the first end of the mobile base in a standing configuration; and
- a camera disposed on a front side of the upper portion, the front side being faced away from the second end, and the camera being operable to capture visual images and detect the presence of an obstacle.
2. The self-driving system of claim 1, further comprising:
- one or more sensors disposed on an upper surface of the mobile base, the one or more sensors are operable to detect the presence of an object to be supported by the upper surface of the mobile base.
3. The self-driving system of claim 2, further comprising:
- a first LiDAR sensor disposed at the first end of the mobile base.
4. The self-driving system of claim 3, wherein the first LiDAR sensor is disposed within a first cutout extending along a width of the first end of the mobile base.
5. The self-driving system of claim 4, further comprising:
- a second LiDAR sensor disposed at the second end of the mobile base.
6. The self-driving system of claim 5, wherein the second LiDAR sensor is disposed within a second cutout extending along a width of the second end of the mobile base.
7. A self-driving system, comprising:
- a mobile base comprising motorized wheels, the mobile base having a first end and a second end opposing the first end;
- an actuator disposed within the mobile base, the actuator is operable to adjust a height of the mobile base;
- a console having a first portion extending along a first direction and a second portion extending along a second direction different from the first direction, the first portion comprising a display, and the second portion being coupled to the first end of the mobile base in a standing configuration; and
- a camera disposed on the second portion of the console, the camera being faced away from the second end and operable to follow a target.
8. The self-driving system of claim 7, further comprising:
- a first LiDAR sensor disposed at the first end of the mobile base, the first LiDAR sensor being operable to scan a field of view of about 270 degrees.
9. The self-driving system of claim 8, further comprising:
- a second LiDAR sensor disposed at the second end of the mobile base, the second LiDAR sensor being operable to scan a field of view of about 270 degrees.
10. The self-driving system of claim 9, wherein the mobile base is directed to follow the target by maintaining a side distance of the target, and the side distance is adjustable based on information received by the camera.
11. The self-driving system of claim 10, wherein the side distance is adjusted in response to a mobile phone, a wristband, and/or a gesture of the target.
12. A self-driving system, comprising:
- a mobile base comprising motorized wheels, the mobile base having a first end and a second end opposing the first end;
- a console having a first portion extending along a first direction and a second portion extending along a second direction different from the first direction, and the second portion being coupled to the first end of the mobile base;
- a camera disposed on the second portion of the console, the camera being faced away from the second end; and
- a first LiDAR sensor disposed at the first end of the mobile base.
13. The self-driving system of claim 12, wherein the mobile base is directed to follow a target in a side follow position based on information received by the camera.
14. The self-driving system of claim 12, further comprising:
- a second LiDAR sensor disposed at the second end of the mobile base.
15. The self-driving system of claim 14, wherein the first LiDAR sensor is disposed within a first cutout extending along a width of the first end of the mobile base, and the second LiDAR sensor is disposed within a second cutout extending along a width of the second end of the mobile base.
16. The self-driving system of claim 15, wherein the first and second LiDAR sensors are operable to scan a field of view of about 270 degrees.
17. The self-driving system of claim 16, further comprising:
- a first sensor disposed adjacent the console on the upper surface of the mobile base; and
- a second sensor disposed adjacent a periphery of the upper surface and away from the console.
18. The self-driving system of claim 17, wherein the first and second sensors are reflective-type photosensors.
19. The self-driving system of claim 17, wherein the first and second sensors are pressure sensors and the actuator is operable to move the upper surface of the mobile base in response to a force applied on the first and second sensors.
20. The self-driving system of claim 17, wherein the actuator is operable to move the upper surface of the mobile base in response to a change of state of the first and second sensors from non-blocked to being blocked.
Type: Application
Filed: Jul 19, 2021
Publication Date: Nov 4, 2021
Inventors: Yaming TANG (Beijing), Chiung Lin CHEN (Beijing)
Application Number: 17/379,002