Abstract: A virtual facility robotics system may include a storage system, a data engine, an integration system, a virtual facility interface system, and a simulator engine. The storage system may store video data of a real facility. The data engine may train a neural rendering model providing a photorealistic three-dimensional representation of the real facility. The integration system may provide facilitate communication with a robot fleet manager configured to control one or more robots operating within the real facility. The virtual facility interface system may provide access to information stored in a virtual facility that includes the photorealistic three-dimensional representation of the real facility. The virtual facility interface system may be configured to provide information to the robot fleet manager via the integration system upon request. The simulator engine may simulate a future state of the real facility including one or more novel views generated based on the neural rendering model.

Abstract: A virtual facility system may include a storage system, a data engine, an integration system, a virtual facility interface system, and a simulator engine. The storage system may store data including video of the real facility. The data engine may train a neural rendering model of the real facility based on the data providing a photorealistic three-dimensional representation of the real facility. The integration system may provide one or more interfaces facilitating communication with one or more control systems associated with the real facility including a management system providing historical or live inventory tracking data and facility operations process data characterizing of locations and tasks corresponding with inventory items or materials stored or handled in the real facility. The virtual facility interface system may provide access to information stored in a virtual facility. The simulator engine may simulate novel views generated based on the neural rendering model.

Abstract: A virtual facility system may include a storage system, a data engine, an integration system, a virtual facility interface system, and a simulator engine. The storage system may store data including video of the real facility. The data engine may train a neural rendering model of the real facility based on the data providing a photorealistic three-dimensional representation of the real facility. The integration system may provide one or more interfaces facilitating communication with one or more control systems associated with the real facility including a management system providing historical or live inventory tracking data and facility operations process data characterizing of locations and tasks corresponding with inventory items or materials stored or handled in the real facility. The virtual facility interface system may provide access to information stored in a virtual facility. The simulator engine may simulate novel views generated based on the neural rendering model.

Abstract: A virtual facility robotics system may include a storage system, a data engine, an integration system, a virtual facility interface system, and a simulator engine. The storage system may store video data of a real facility. The data engine may train a neural rendering model providing a photorealistic three-dimensional representation of the real facility. The integration system may provide facilitate communication with a robot fleet manager configured to control one or more robots operating within the real facility. The virtual facility interface system may provide access to information stored in a virtual facility that includes the photorealistic three-dimensional representation of the real facility. The virtual facility interface system may be configured to provide information to the robot fleet manager via the integration system upon request. The simulator engine may simulate a future state of the real facility including one or more novel views generated based on the neural rendering model.

Abstract: A method includes: obtaining a task definition for a mobile robot, the task definition including (i) a position on an item support carried by the mobile robot, and (ii) an identifier of an item to be placed at the position to form a unit load with the item support; controlling the mobile robot carrying the item support to travel to a pick location for receiving the item from a picker; controlling an output device to render an indication of the position for the picker at the pick location; responsive to placement of the item at the position by the picker, controlling the mobile robot to travel to a handling location.

Abstract: A system for facility monitoring and reporting to improve safety using one or more robots includes: a network; a plurality of autonomous mobile robots operating in a facility, the robots configured to monitor facility operation, the robots further configured to detect a predetermined critical condition, the robots operably connected to the network; a server operably connected to the robots over the network; and an individual robot operably connected to the server over the network, the individual robot operating in the facility, the robots not comprising the individual robot, the individual robot configured to monitor facility operation; wherein the robots are configured to regularly produce a regular report under normal operating conditions, the report displaying data received from the server, wherein the robots are further configured to produce to the server a critical condition report upon occurrence of the critical condition.

Abstract: A system for facility monitoring and reporting to improve safety using one or more robots includes: a network; a plurality of autonomous mobile robots operating in a facility, the robots configured to monitor facility operation, the robots further configured to detect a predetermined critical condition, the robots operably connected to the network; a server operably connected to the robots over the network; and an individual robot operably connected to the server over the network, the individual robot operating in the facility, the robots not comprising the individual robot, the individual robot configured to monitor facility operation; wherein the robots are configured to regularly produce a regular report under normal operating conditions, the report displaying data received from the server, wherein the robots are further configured to produce to the server a critical condition report upon occurrence of the critical condition.

Abstract: A system for facility monitoring and reporting to improve safety using one or more robots includes: a network; a plurality of autonomous mobile robots operating in a facility, the robots configured to monitor facility operation, the robots further configured to detect a predetermined critical condition, the robots operably connected to the network; a server operably connected to the robots over the network; and an individual robot operably connected to the server over the network, the individual robot operating in the facility, the robots not comprising the individual robot, the individual robot configured to monitor facility operation; wherein the robots are configured to regularly produce a regular report under normal operating conditions, the report displaying data received from the server, wherein the robots are further configured to produce to the server a critical condition report upon occurrence of the critical condition.

Abstract: A system for facility monitoring and reporting to improve safety using one or more robots includes: a network; a plurality of autonomous mobile robots operating in a facility, the robots configured to monitor facility operation, the robots further configured to detect a predetermined critical condition, the robots operably connected to the network; a server operably connected to the robots over the network; and an individual robot operably connected to the server over the network, the individual robot operating in the facility, the robots not comprising the individual robot, the individual robot configured to monitor facility operation; wherein the robots are configured to regularly produce a regular report under normal operating conditions, the report displaying data received from the server, wherein the robots are further configured to produce to the server a critical condition report upon occurrence of the critical condition.

Abstract: A system for facility monitoring and reporting to improve safety using one or more robots includes: a network; a plurality of autonomous mobile robots operating in a facility, the robots configured to monitor facility operation, the robots further configured to detect a predetermined critical condition, the robots operably connected to the network; a server operably connected to the robots over the network; and an individual robot operably connected to the server over the network, the individual robot operating in the facility, the robots not comprising the individual robot, the individual robot configured to monitor facility operation; wherein the robots are configured to regularly produce a regular report under normal operating conditions, the report displaying data received from the server, wherein the robots are further configured to produce to the server a critical condition report upon occurrence of the critical condition.

Abstract: A system for facility monitoring and reporting to improve safety using one or more robots includes: a network; a plurality of autonomous mobile robots operating in a facility, the robots configured to monitor facility operation, the robots further configured to detect a predetermined critical condition, the robots operably connected to the network; a server operably connected to the robots over the network; and an individual robot operably connected to the server over the network, the individual robot operating in the facility, the robots not comprising the individual robot, the individual robot configured to monitor facility operation; wherein the robots are configured to regularly produce a regular report under normal operating conditions, the report displaying data received from the server, wherein the robots are further configured to produce to the server a critical condition report upon occurrence of the critical condition.

Abstract: A system is provided, including one or more servers in communication with a robotic system. The one or more servers may be configured to receive operational data from the robotic system, and determine one or more operational performance metrics based on the received operational data. The system may also include a first computing device in communication with the robotic system including a workstation authoring software application configured to program the given task to be completed by the robotic system, and determine one or more subtasks required for the robotic system to perform the given task. The system may also include a second computing device in communication with the robotic system including an operational dashboard software application configured to control various operations of the robotic system, and provide for display a visual representation of the operational data and the operational performance metrics on an interface of the second computing device.

Abstract: An example modular reconfigurable workcell for quick connection of peripherals is described. In one example, a modular reconfigurable workcell comprises modular docking bays on a surface of the workcell that support attachment of docking modules in a fixed geometric configuration, and respective modular docking bays include electrical connections for a variety of power and communication busses of the docking modules to be attached. The workcell also includes an electrical subsystem for coupling the communication busses between the modular docking bays and providing power circuitry to the modular docking bays, and structural features in the modular docking bays to enable insertion of the docking modules in the fixed geometric configuration. The workcell also includes a processor for determining a geometric calibration of attached peripherals based on a location and the orientation of corresponding docking modules attached to the modular docking bays and based on an identification of the attached peripherals.

Abstract: A method operable by a computing device is provided. The method may include receiving a request for a given task to be performed by a modular reconfigurable workcell. The method may also include determining one or more peripherals required to perform the given task. The method may also include determining an optimal placement of the one or more peripherals based on the given task, wherein the one or more peripherals are coupled to the workcell in a fixed geometric configuration based on the determined optimal placement. The method may also include determining a first calibration of the one or more peripherals based on the orientation of the one or more peripherals relative to the workcell, and determining a second calibration of the one or more peripherals based on the optimal placement of the one or more peripherals with respect to each other.

Abstract: Example systems and methods may provide for a heterogeneous fleet of robotic devices for collaborative object processing in an environment, such as a warehouse. An example system includes a plurality of mobile robotic devices configured to transport one or more objects within an environment, a fixed robotic manipulator positioned within the environment that is configured to manipulate one or more objects within an area of reach of the fixed robotic manipulator, and a control system. The control system may be configured to cause one or more of the plurality of mobile robotic devices to deliver at least one object to at least one location within the area of reach of the fixed robotic manipulator, and to cause the fixed robotic manipulator to distribute the at least one object to a different one or more of the plurality of mobile robotic devices for delivery to one or more other locations within the environment.

Abstract: Example systems and methods may provide for a heterogeneous fleet of robotic devices for collaborative object processing in an environment, such as a warehouse. An example system includes a plurality of mobile robotic devices configured to transport one or more objects within an environment, a fixed robotic manipulator positioned within the environment that is configured to manipulate one or more objects within an area of reach of the fixed robotic manipulator, and a control system. The control system may be configured to cause one or more of the plurality of mobile robotic devices to deliver at least one object to at least one location within the area of reach of the fixed robotic manipulator, and to cause the fixed robotic manipulator to distribute the at least one object to a different one or more of the plurality of mobile robotic devices for delivery to one or more other locations within the environment.

Abstract: Example systems and methods may provide for a heterogeneous fleet of robotic devices for collaborative object processing in an environment, such as a warehouse. An example system includes a plurality of mobile robotic devices configured to transport one or more objects within an environment, a fixed robotic manipulator positioned within the environment that is configured to manipulate one or more objects within an area of reach of the fixed robotic manipulator, and a control system. The control system may be configured to cause one or more of the plurality of mobile robotic devices to deliver at least one object to at least one location within the area of reach of the fixed robotic manipulator, and to cause the fixed robotic manipulator to distribute the at least one object to a different one or more of the plurality of mobile robotic devices for delivery to one or more other locations within the environment.

Abstract: An example apparatus includes an enclosed rectangular container, including an openable first end and an openable second end. The apparatus further includes at least one first supporting base positioned proximate to the first end of the container that has an adjustable height in order to align a floor of the container with a trailer. The apparatus also includes at least one second supporting base positioned proximate to the second end of the container that has an adjustable height in order to align the floor of the container with a loading dock. The apparatus additionally includes a robotic manipulator connected to the floor of the container that is configured to move one or more objects between the trailer and the loading dock by moving the one or more objects through the container when the first end and the second end of the container are opened.

Abstract: A method operable by a computing device is provided. The method may include receiving a request for a given task to be performed by a modular reconfigurable workcell. The method may also include determining one or more peripherals required to perform the given task. The method may also include determining an optimal placement of the one or more peripherals based on the given task, wherein the one or more peripherals are coupled to the workcell in a fixed geometric configuration based on the determined optimal placement. The method may also include determining a first calibration of the one or more peripherals based on the orientation of the one or more peripherals relative to the workcell, and determining a second calibration of the one or more peripherals based on the optimal placement of the one or more peripherals with respect to each other.

Abstract: Methods and systems for distributing remote assistance to facilitate robotic object manipulation are provided herein. Regions of a model of objects in an environment of a robotic manipulator may be determined, where each region corresponds to a different subset of objects with which the robotic manipulator is configured to perform a respective task. Certain tasks may be identified, and a priority queue of requests for remote assistance associated with the identified tasks may be determined based on expected times at which the robotic manipulator will perform the identified tasks. At least one remote assistor device may then be requested, according to the priority queue, to provide remote assistance with the identified tasks. The robotic manipulator may then be caused to perform the identified tasks based on responses to the requesting, received from the at least one remote assistor device, that indicate how to perform the identified tasks.