Abstract: This disclosure provides methods and systems for generating a training set for a neural network configured to generate candidate trajectories for an autonomous vehicle, comprising: receiving a set of sensor data representative of one or more portions of a plurality of objects in the environment of the autonomous vehicle; for each object, calculating a representative box enclosing the object, the representative box having portions comprising corners, edges, and planes; for each representative box, calculating at least one vector into the representative box from a position on the autonomous vehicle; for each vector, calculating a first and second corner position of the representative box, an edge of the representative box, and a plane of the representative box; determining the highest confidence corners, edge, and plane of each representative based on calculation from the at least one vector; and generating a training set including the highest confidence corners, edge, and plane of each representative box.

Abstract: Systems, methods, computing platforms, and storage media for dynamically organizing autonomous storage units in a retail control territory are disclosed. Exemplary implementations may identify a plurality of autonomous storage units, wherein each autonomous storage unit is configured to hold one or more inventory items; identify an inventory level for each of the plurality of autonomous storage units; determine a first arrangement for the plurality of autonomous storage units based in part on one or more first factors; organize the plurality of storage units in the first arrangement; identify one or more second factors; determine a second arrangement for at least a portion of the plurality of autonomous storage units based on the one or more second factors; and direct the at least the portion of the plurality of autonomous storage units to organize in the second arrangement.

Abstract: Systems, methods, and apparatus for acoustic inspection of a surface are described. An example system may include an inspection robot structured to traverse an inspection surface in a direction of travel. The inspection robot may include a payload having a plurality of arms, connected to the inspection robot, to rotate around respective ones of a plurality of axes while the inspection robot traverses the inspection surface, where each of the plurality of axes is in the direction of travel. A plurality of sleds may be connected to the plurality of arms, and a plurality of inspection sensors connected to the plurality of sleds. The plurality of inspection sensors may be spaced apart from each other at adjustable positions to inspect the inspection surface at an adjustable resolution.

Abstract: This disclosure provides systems and methods for controlling a vehicle. The method comprises receiving data from a set of sensors, wherein the data represents objects or obstacles in an environment of the autonomous vehicle; identifying objects or obstacles from the received data; determining multiple sets of attributes of the objects or obstacles, wherein each set of attributes of the objects or obstacles are determined based on data received by an individual sensor; determining a candidate trajectory for the autonomous vehicle based on the multiple sets of attributes of the objects or obstacles; and controlling the autonomous vehicle according to the candidate trajectory.

Abstract: This disclosure provides systems and methods for controlling a vehicle based on a combination of high precision detection and high recall detection. The disclosed systems and methods can efficiently generate trajectories by reducing duplicate detection or duplicate calculation of objects or obstacles of common and known object types and objects or obstacles without class identification.

Abstract: This disclosure provides systems and methods for detecting and tracking objects or obstacles in an environment of an autonomous vehicle. The method may include receiving data from a set of sensors, wherein the data represents objects or obstacles in an environment of the autonomous vehicle; and using a processor: generating high precision detection data based on the received data; identifying, from the high precision detection data, a set of objects that are classifiable by at least one known classifier; generating high recall detection data based on the received data; identifying from the high recall detection data a set of obstacles; and performing an operation on the high precision detection data of the objects and the high recall detection data of the obstacles, based on a status of the autonomous vehicle or based on one or more characteristics of the objects or the obstacles.

Abstract: The foodstuff assembly system can include: a robot arm, a frame, a set of foodstuff bins, a sensor suite, a set of food utensils, and a computing system. The system can optionally include: a container management system, a human machine interface (HMI). However, the foodstuff assembly system 100 can additionally or alternatively include any other suitable set of components. The system functions to enable picking of foodstuff from a set of foodstuff bins and placement into a container (such as a bowl, tray, or other foodstuff receptacle). Additionally or alternatively, the system can function to facilitate transferal of bulk material (e.g., bulk foodstuff) into containers, such as containers moving along a conveyor line.

Abstract: This disclosure provides systems and methods for path planning by a planner of an autonomous vehicle. The method may include receiving by the planner perception data from a perception module, wherein the perception data comprises tracking or predicted object data associated with objects or obstacles in an environment of the autonomous vehicle, and wherein the tracking or predicted object data are determined based on high recall detection data and high precision detection data, generating by the planner a trajectory for controlling the autonomous vehicle based on the perception data received from the perception module, and transmitting to a controller of the autonomous vehicle the trajectory such that the autonomous vehicle is navigated by the controller to a destination.

Abstract: A method and system for privacy-aware movement tracking includes receiving a series of images of a field of view, such as captured by a camera. The images containing movement of an unidentified person within the field of view. A body region corresponding to the person is detected within the images. A movement dataset for the unidentified person is generated based on tracking movement of the body region over the fired of view within the images is generated. A characterizing feature set is determined for the unidentified person. The set is associated within the movement dataset to form a first track entry. Anonymizing of the body region can be applied to remove identifying features while or prior to determining the characterizing feature set. A second track entry can be generated from a second series of images and match between the track entries can be determined. A method and system for privacy-aware operation and learning of a computer-implemented classification module is also contemplated.

Abstract: Systems and methods for robotic inspection with simultaneous surface measurements at multiple orientations with obstacle avoidance are described. An example system may have an inspection robot structured to move in a direction of travel along an inspection surface. The robot may have a payload with first and second sensor holders, each sensor holder structured to hold a UT phased array. A sensor holder linking component holds the first and sensor holders such that the two phased arrays are parallel to one another along a long edge of both the phased arrays. The system may have a rastering device to move the payloads in a direction of inspection, whether the direction of inspection is distinct from the direction of travel and distinct from the parallel orientation of the two phased arrays.

Abstract: The foodstuff assembly system can include: a robot arm, a frame, a set of foodstuff bins, a sensor suite, a set of food utensils, and a computing system. The system can optionally include: a container management system, a human machine interface (HMI). However, the foodstuff assembly system 100 can additionally or alternatively include any other suitable set of components. The system functions to enable picking of foodstuff from a set of foodstuff bins and placement into a container (such as a bowl, tray, or other foodstuff receptacle). Additionally or alternatively, the system can function to facilitate transferal of bulk material (e.g., bulk foodstuff) into containers, such as containers moving along a conveyor line.

Abstract: Computer vision and autonomous identification of objects are used for the application of a treatment to an object. Robotics and mobility technologies navigate a delivery system which is configured to identify and apply an agricultural treatment to an identified agricultural object. The delivery system identifies a subset of payloads to provide one or more actions based on data representing a policy for one or more subsets of agricultural objects. The delivery system causes one or more cartridges to be charged based on the subset of payloads.

Abstract: Systems, methods and apparatuses for inspecting a tank containing a flammable fluid are provided. The system includes a vehicle having a propeller, a latch mechanism, a pressure switch, and an inspection device. The system includes a control unit in communication with the propeller, the latch mechanism, and the inspection device, and electrically connected to the pressure switch. The control unit powers on responsive to the pressure switch detecting an ambient pressure greater than a minimum threshold. The control unit receives, from the latch mechanism, an indication of a state of the latch mechanism. The control unit determines that the cable used to lower the vehicle into the tank containing the flammable fluid is detached from the vehicle. The control unit commands the propeller to move the vehicle through the flammable fluid. The control unit determines a quality metric of a portion of the tank.

Abstract: A method includes, at a security agent executing on a computing platform including a set of resources and a first application: authenticating the security agent with a security device; accessing a configuration profile, from the security device, defining identity information associated with the first application and a first security policy defining a subset of resources, in the set of resources, to which the first application is permitted access; authenticating the first application based on the identity information; monitoring the set of resources responsive to execution of the first application on the computing platform; and issuing a command to cause the computing platform to enter a safe state in response to detecting an access by the first application to a first resource in the set of resources, the first resource excluded from the subset of resources.

Abstract: An autonomous mobile system comprising: a means of achieving mobility, a means of navigating, a means of providing autonomous power, and a means of providing general purpose computing. In some embodiments, the system comprises a base unit capable of sensing its environment and computing navigation instructions to direct the system to move to particular locations and execute functions as directed by a set of programmed instructions. In some embodiments, two or more time-of-flight (TOF) imaging systems are attached to measure distance to objects in the environment, which may in turn be used by the means of navigating. In some embodiments, a coupling exists on the base unit to attach additional structures and mechanisms. These structures may comprise a means for carrying packages or other items, robotic manipulators that can grab and move objects, interactive audio and video displays for telepresence applications, a means for serving food and drink, etc.

Abstract: This disclosure provides methods and systems for dynamically detecting and tracking objects in an environment of an autonomous vehicle. In some embodiments, the method comprises: receiving image data from sensors of the autonomous vehicle, the image data comprising a plurality of images representative of objects in a field of view of the autonomous vehicle; detecting the objects in the plurality of images through an object detector; generating image embeddings for the objects detected in the plurality of images; determining similarity scores of the image embeddings of the objects that are detected in images received from two or more different sensors; identifying the objects that are detected in the images received from the two or more different sensors as a candidate object for tracking, if the objects have a similarity score of the image embeddings equal to or greater than a threshold value; and initializing a track for the candidate object.

Abstract: Systems, methods, computing platforms, and storage media for directing and controlling an autonomous storage unit in an autonomous inventory management system are disclosed. Exemplary implementations may negotiate, by a first controller, a dispatch routine for the storage unit with a transport controller and a second controller, assign a token to the storage unit and the second controller, the token providing an identification signal between the storage unit and the second controller, register a departure event with the first controller, provide a secure connection between the storage unit and the second controller, exchange the token between the storage unit and the second controller, authenticate the secure connection based on exchanging the token, and give the storage unit permission to access a control territory assigned to the second controller.

Abstract: A mobile manipulator robot for retrieving inventory items from a storage system. The robot includes a body, a wheel assembly, a sensor to locate a position of the robot within the storage system, an interface configured to send processor readable data to a remote processor and to an operator interface, and receive processor executable instructions from the remote processor and from the operator interface, an imaging device to capture images of the inventory items, a picking manipulator, first and second pneumatic gripping elements for grasping the inventory items, and a coupler configured to mate with a valve to access a pneumatic supply for operating at least one of the first or second pneumatic gripping elements. The robot is configured to transition the valve from a closed condition to an open condition and selectively place one of the first or the second pneumatic gripping elements in communication with the pneumatic supply.

Abstract: Methods and apparatus for verifiable inspection operations are described. An example apparatus may have an inspection description circuit to interpret an inspection definition value and a payload status circuit to provide a payload identification value in response to at least one of a payload specific configuration or signals from a payload. The example apparatus may also have an inspection integrity circuit to determine an inspection description value in response to the inspection definition value and the payload identification value and an inspection reporting circuit to communicate the inspection description value to an external device.

Abstract: A spearing end effector for a robotic spearing device capturing and sorting a selected item from a mass of items and having a robotic manipulator with the spearing end effector mounted at an end thereof. The robotic spearing device comprises: a spearing end effector body; a spike; a linear actuator having the spike mounted thereon; and a propeller. The spike is configurable between a retracted configuration where it is entirely located inside the spearing end effector body and an extended configuration where it extends outwardly from therefrom. The spike is engageable to the selected item when configured in the extended configuration. The linear actuator is movable to configure the spike between the retracted configuration and the extended configuration. The propeller is selectively activatable to propel the selected item in a propelling direction during an ejection of the selected item from the spearing end effector.