Abstract: Building infrastructure and robot coordination methods and systems are disclosed herein. An example method can include preregistering an autonomous vehicle with a building controller of a building to inform the building controller of arrival of the autonomous vehicle and a delivery request for a package, the delivery request specifying a recipient of the package, the recipient having a location in the building. The method can include determining completion of a validation routine with the autonomous vehicle, assigning a task management plan to the autonomous vehicle, the task management plan determining how the autonomous vehicle navigates through the building to deliver the package to the location, and tracking the autonomous vehicle through the building.

Abstract: A method for calibrating a map of an autonomous robot, a trajectory of the autonomous robot, or a combination thereof includes obtaining localization data from a localization sensor of the autonomous robot and determining whether a calibration condition of the autonomous robot is satisfied based on the localization data. The method includes, in response to the calibration condition being satisfied: determining a master position coordinate of the autonomous robot based on a plurality of radio frequency (RF) signals broadcasted by a plurality of RF tags, converting the master position coordinate to a local position coordinate of the autonomous robot, and selectively updating the map, the trajectory, or a combination thereof based on the local position coordinate of the autonomous robot.

Abstract: A method for controlling a human driven vehicle (HDV) includes identifying HDV indicia of a fiducial marker disposed on the HDV based on localization data obtained from the plurality of localization sensors, determining a pose of the HDV based on the localization data, where the pose of the HDV includes a location and an orientation of the HDV, and defining a bounding region of the HDV based on the HDV indicia and the pose of the HDV. The method includes determining a location-based characteristic of the one or more autonomous devices, where the location-based characteristic includes a location of the one or more autonomous devices, a trajectory of the one or more autonomous devices, or a combination thereof, selectively generating a notification based on the location-based characteristic and the bounding region, and broadcasting the notification to the HDV in response to generating the notification.

Abstract: A method for controlling a plurality of autonomous mobile robots (AMRs) in a manufacturing environment having an intersection includes obtaining a plurality of routes associated with the plurality of AMRs, velocity information associated with the plurality of AMRs, and priority information associated with the plurality of AMRs, and determining a plurality of arrival times associated with the plurality of AMRs based on the velocity information and the plurality of routes. The method includes generating a plurality of intersection reservations based on the plurality of arrival times and the priority information, where each intersection reservation from among the plurality of intersection reservations corresponds to an AMR from among the plurality of AMRs, and controlling a movement of the plurality of AMRs through the intersection based on the plurality of intersection reservations.

Abstract: A method includes identifying a set of intermediate grids of a grid map of the manufacturing environment based on a location of the first AMR and a destination grid of the grid map and appending temporal information to the set of intermediate grids based on a mobility characteristic of the first AMR. The method includes generating a first reservation based on the set of intermediate grids and the temporal information of the set of intermediate grids, determining a state of the first reservation based on priority information associated with the plurality of AMRs and one or more additional reservations associated with the one or more additional AMRs from among the plurality of AMRs, and assigning the first reservation to the first AMR in response to the first reservation being in an available state.

Abstract: A system for reconfiguring a factory having equipment at different workstations throughout the factory and a plurality of sensors disposed throughout the factory includes a factory configuration module configured to store a plurality of predetermined factory configurations and a plurality of mobile transporters configured to engage and transport the equipment to the different workstations throughout the factory based on the predetermined factory configurations and dynamic inputs, where the dynamic inputs include a status of the equipment, a status of the plurality of mobile transporters, sensor data output by the plurality of sensors, or a combination thereof.

Abstract: A method for navigating a robot within an environment based on a planned route includes providing the planned route to the robot, where the planned route is based on a destination of the robot and an origin of the robot. The method includes determining whether an object obstructs the robot as the robot travels along the planned route, where the environment includes the object. The method includes moving the object from the planned route in response to the robot obstructing the object.

Abstract: A system includes a robotic system including a robot disposable at a mobile workstation, where the robot is configured to perform an automated operation on a workpiece. The system includes one or more transfer robots configured to transfer the robotic system to or from the mobile workstation. The system includes a control system configured to command the transfer robot to perform a transfer operation of the robotic system, where the transfer operation includes at least one of disposing the robotic system at the mobile workstation or retrieving the robotic system from the mobile workstation. The control system is configured to control the mobile workstation and the robotic system based on image data from the one or more infrastructure sensors, position data from the one or more on-board position sensors, the automated operation to be performed by the robot, or a combination thereof.

Abstract: A method includes defining a manufacturing transformation for a mobile workpiece based on mobile workpiece state information of the mobile workpiece, where the manufacturing transformation is an automated operation to be performed on the mobile workpiece. The method includes selecting a set of one or more manufacturing systems from among the one or more manufacturing systems for the mobile workpiece based on the manufacturing transformation and manufacturing system state information associated with the one or more manufacturing systems, where the manufacturing system state information provides data related to at least one of availability, capability, and constraints of the of the one or more manufacturing systems. The method includes defining manufacturing process steps of the manufacturing transformation based on the set of one or more manufacturing systems. The method includes defining a location for performing the manufacturing process steps on the mobile workpiece.

Abstract: Systems and methods that allow a smartphone to be used as an imaging device for undercarriage inspection of a moving vehicle are provided. The method may include locating the smartphone on the ground via one or more sensors of the vehicle. The vehicle may generate a path for the vehicle to drive over the smartphone based on the location of the smartphone, and optionally display the path to facilitate manual driving of the vehicle by the driver over the smartphone. Alternatively, the vehicle may self-drive to follow the path. The smartphone may capture image data indicative of the undercarriage of the vehicle, inspect and analyze the image data to identify one or more issues of the undercarriage of the vehicle, and transmit the analyzed image data to the vehicle for display. The driver may confirm the one or more issues and transmit the data to an inspection professional for additional assistance if needed.

Abstract: Systems and methods that allow a smartphone to be used as an imaging device for undercarriage inspection of a moving vehicle are provided. The method may include locating the smartphone on the ground via one or more sensors of the vehicle. The vehicle may generate a path for the vehicle to drive over the smartphone based on the location of the smartphone, and optionally display the path to facilitate manual driving of the vehicle by the driver over the smartphone. Alternatively, the vehicle may self-drive to follow the path. The smartphone may capture image data indicative of the undercarriage of the vehicle, inspect and analyze the image data to identify one or more issues of the undercarriage of the vehicle, and transmit the analyzed image data to the vehicle for display. The driver may confirm the one or more issues and transmit the data to an inspection professional for additional assistance if needed.

Abstract: This disclosure describes systems, methods, and devices related to automatic annotation. A device may capture data associated with an image comprising an object. The device may acquire input data associated with the object. The device may estimate a plurality of points within a frame of the image, wherein the plurality of point constitute a 3D bounding to around the object. The device may transform the plurality of points to two or more 2D points. The device may construct a bounding box that encapsulates the object using the two or more 2D points. The device may create a segmentation mask of the object using morphological techniques. The device may perform annotation based on the segmentation mask.

Abstract: A method includes generating a workspace model having one or more digital robots, one or more digital sensors, and a digital transport system. The method includes simulating, for a task of the one or more digital robots, a sensor operation of the one or more digital sensors within the workspace model based on sensor characteristics of the one or more digital sensors. The method includes identifying, for the task of the one or more digital robots, an undetectable area within the workspace model based on the simulated sensor operation. The method includes selectively positioning, by a transport system, a set of sensors from among the one or more sensors based on the undetectable areas associated with the task.

Abstract: A system and method for reconfiguring a factory having equipment at different workstations throughout the factory includes a plurality of mobile transporters configured to engage and transport the equipment to the different workstations throughout the factory. Each mobile transporter includes a transmitter, a receiver, at least one proximity sensor, and an engagement mechanism for engaging the equipment. A factory configuration module includes a 3D model of the factory and a plurality of predetermined factory configurations. A supervisory control module is in communication with the plurality of mobile transporters, the equipment, and the factory configuration module. The plurality of mobile transporters are configured to receive instructions from the supervisory control module to engage and reposition the equipment throughout the factory based on the predetermined factory configurations and dynamic inputs.

Abstract: A method includes generating a workspace model having one or more robots and a plurality of image sensors, defining a plurality of pose scenarios of the one or more robots, and defining sensor characteristics of the plurality of image sensors. The method includes, for each of the plurality of pose scenarios, simulating a sensor operation of the plurality of image sensors within the workspace model based on the sensor characteristics and identifying an undetectable area within the workspace model based on the simulated sensor operation. The method includes performing a sensor placement control based on the undetectable areas associated with each of the plurality of pose scenarios.

Abstract: A method includes obtaining acoustic data from a plurality of acoustic sensors disposed on one or more mobile systems, one or more fixed infrastructure elements, or a combination thereof. The method includes obtaining image data from a plurality of image sensors disposed on the one or more mobile systems, the one or more fixed infrastructure elements, or a combination thereof. The method includes determining whether the anomalous state is present based on the image data and the acoustic data. The method includes, in response to the anomalous state being satisfied, identifying a location associated with the anomalous state based on the acoustic data and the image data and transmitting a notification based on the anomalous state and the location.

Abstract: A method includes defining a manufacturing transformation for a mobile workpiece based on mobile workpiece state information of the mobile workpiece, where the manufacturing transformation is an automated operation to be performed on the mobile workpiece. The method includes selecting a set of one or more manufacturing systems from among the one or more manufacturing systems for the mobile workpiece based on the manufacturing transformation and manufacturing system state information associated with the one or more manufacturing systems, where the manufacturing system state information provides data related to at least one of availability, capability, and constraints of the of the one or more manufacturing systems. The method includes defining manufacturing process steps of the manufacturing transformation based on the set of one or more manufacturing systems. The method includes defining a location for performing the manufacturing process steps on the mobile workpiece.

Abstract: A method for navigating a robot within an environment based on a planned route includes providing the planned route to the robot, where the planned route is based on a destination of the robot and an origin of the robot. The method includes determining whether an object obstructs the robot as the robot travels along the planned route, where the environment includes the object. The method includes moving the object from the planned route in response to the robot obstructing the object.

Abstract: A system includes a robotic system including a robot disposable at a mobile workstation, where the robot is configured to perform an automated operation on a workpiece. The system includes one or more transfer robots configured to transfer the robotic system to or from the mobile workstation. The system includes a control system configured to command the transfer robot to perform a transfer operation of the robotic system, where the transfer operation includes at least one of disposing the robotic system at the mobile workstation or retrieving the robotic system from the mobile workstation. The control system is configured to control the mobile workstation and the robotic system based on image data from the one or more infrastructure sensors, position data from the one or more on-board position sensors, the automated operation to be performed by the robot, or a combination thereof.

Abstract: A system and method for reconfiguring a factory having equipment at different workstations throughout the factory includes a plurality of mobile transporters configured to engage and transport the equipment to the different workstations throughout the factory. Each mobile transporter includes a transmitter, a receiver, at least one proximity sensor, and an engagement mechanism for engaging the equipment. A factory configuration module includes a 3D model of the factory and a plurality of predetermined factory configurations. A supervisory control module is in communication with the plurality of mobile transporters, the equipment, and the factory configuration module. The plurality of mobile transporters are configured to receive instructions from the supervisory control module to engage and reposition the equipment throughout the factory based on the predetermined factory configurations and dynamic inputs.