Abstract: An autonomous pile driving system identifies using a pile plan map a target location to install a pile. The system autonomously navigates towards the target location. The system autonomously detects using an object sensor system an orientation and location of the pile located within a threshold distance of the system. The system autonomously positions a tool of the autonomous pile driving system based on the detected orientation and location of the pile. The system autonomously picks up the pile using the positioned tool of the autonomous pile driving system. The system autonomously positions the pile based on the target location. The system autonomously drives the pile into ground at the target location.

Abstract: Aspects of this technical solution can include a first layer having a first region and a second region, the first region and the second region having a first transmissivity property corresponding to a first portion of a spectrum of light and a second portion of the spectrum of light, having the first transmissivity property, and a second layer disposed over the first layer and having a third region and a fourth region, the third region and the fourth region having a second transmissivity property corresponding to the first portion of the spectrum of light and the second portion of the spectrum of light.

Abstract: A pile plan map indicating a plurality of locations in a geographic area at which piles are to be installed is accessed. A first set of locations is identified from the plurality of locations and a first set of piles to be driven into the ground at the first set of locations using the pile plan map is identified. An order for driving the first set of piles into the ground is identified and a pile type for each of the first set of piles is identified. Basket assembly instructions are generated for assembling the first set of piles into a basket based on the identified order and the identified pile types. The first set of piles are assembled autonomously or manually into the basket based on the generated basket assembly instructions.

Abstract: An automated fluid dispensing system, apparatus and method may be configured to automatically clean one or more vision-based surfaces. The system may include a hardware controller, a plurality of sensors, manifold ports, a plurality of pressure supply lines, first, second, and third fluid sources, a compressed air source, first, second, and third valves, a nozzle array, or a combination thereof. The controller may be in communication with a plurality of sensors and be configured to receive and adapt to one or more environmental and vision conditions of the one or more vision-based surfaces. The system may include an automatic response system to provide adaptive operations in response to the information herein such as internal and external parameters and operate under one or multiple pulse-width modulation (PWM) dispensing sequences in response to a determined condition (e.g., contamination state or level) associated with one or more vision-based surfaces.

Abstract: An application processor receives first and safety state information from first and second microcontrollers, and respective first and second sets of bytes forming a first identifier of the first microcontroller and a second identifier of the second microcontroller. The processor concatenates a safety message including the first and second safety state information, the safety message including the first set of bytes and the second set of bytes. The processor transmits the safety message to a second application processor of a safety controller, which separates, the first set of bytes and the second set of bytes, compares at least one of the first set of bytes and the second set of bytes to a data structure of known microcontroller identifiers, and verifies the safety state information based on identifying a match.

Abstract: A method for controlling a serving robot is provided. The method includes the steps of: acquiring situation information on at least one customer; dynamically determining a workflow for the at least one customer on the basis of the situation information on the at least one customer, using a workflow determination model for determining workflows related to services capable of being provided in a serving place; and causing a target service to be provided to the at least one customer on the basis of the determined workflow.

Abstract: Embodiments herein include an autonomy system of an automated vehicle performing operations for detecting and avoiding lazy or unpredictable vehicles on a roadway. The autonomy system generates bounding boxes for tracking traffic vehicles recognized in sensor data. For close vehicles, the autonomy system generates expanded bounding boxes. The autonomy system determines the close vehicle is an encroaching vehicle by detecting that the expanded bounding box of the close vehicle overlapped the middle lane line or enters into the automated vehicle's current lane of travel. The autonomy system may simulate the behavior of the close vehicle by forward-propagating predicted positions of the close vehicle and expanded bounding box over some future time. In response to detecting the encroaching vehicle, the autonomy system may determine whether to perform an avoidance action or select a particular avoidance action, such as biasing away from the encroaching vehicle.

Abstract: An autonomous vehicle can include a tractor; a trailer coupled with the tractor; a thermal sensor coupled with the trailer, the thermal sensor configured to measure a temperature of the trailer; and one or more processors. The processors can be configured to receive a plurality of temperature measurements of the trailer from the thermal sensor while the autonomous vehicle is driving; compare the plurality of temperature measurements to a condition; and automatically execute a trailer anomaly response protocol responsive to determining at least one of the plurality of temperature measurements satisfies the condition.

Abstract: Methods and systems are described herein for a layered fail-safe redundancy system and architecture for privileged operation execution. The system may receive vehicle maneuvering commands from a controller over a first channel. When a user input is received to initiate a privileged mode for executing privileged commands, the system may receive a privileged command over a second channel. The system may identify, based on the privileged mode of operation and the privileged command, a privileged operation to be performed by a vehicle. The system may then transmit a request to the vehicle to perform the privileged operation.

Abstract: Systems and methods of manipulating/controlling robots. In many scenarios, data collected by a sensor (connected to a robot) may not have very high precision (e.g., a regular commercial/inexpensive sensor) or may be subjected to dynamic environmental changes. Thus, the data collected by the sensor may not indicate the parameter captured by the sensor with high accuracy. The present robotic control system is directed at such scenarios. In some embodiments, the disclosed embodiments can be used for computing a sliding velocity limit boundary for a spatial controller. In some embodiments, the disclosed embodiments can be used for teleoperation of a vehicle located in the field of view of a camera.

Abstract: An actuator system includes an actuator with a deformable shell defining a pouch, a fluid dielectric contained within the pouch, and first and second electrodes disposed over opposing sides of the pouch, each electrode having two long edges and two short edges. The system also includes a power source for providing a voltage between the electrodes. The electrodes cover 50 to 90% of the first and second sides, respectively, of the pouch, and a gap is defined between long edges of the pouch and the electrodes such that, upon application of the voltage at one of the short edges of the electrodes, respectively, the electrodes selectively zip together from the one of the short edges toward an opposing one of the short edges. The system may also include a support structure for enabling the actuator to maintain its shape regardless of the voltage provided by the power source.

Abstract: System includes a server comprising a receptacle exchange engine, a receptacle, a shelf comprising a plurality of storage locations, and a frame positioned adjacent the shelf. The frame includes a lift traveling about a vertical rail. The vertical rail translating horizontally about two guide tracks arranged parallel to one another. The lift is configured for transferring the receptacle to a storage location of the shelf. System is configured to: determine that the receptacle containing one or more sorted articles is ready to be transferred and direct the lift to transfer the receptacle from an article receiving position to one of: (a) a storage location of the shelf, and (b) a position about a receptacle transport device.

Abstract: Improved security checkpoint includes a security scanning system having multiple personal item intake locations, a security scanner, multiple personal item retrieval locations, and a plurality of computer-controlled vehicles for transporting personal items between the personal item intake locations, the security scanner, and the personal item retrieval locations. Personal items are placed into a tote by an individual, and the computer-controlled vehicles collect the totes containing the personal items, transport the tote to an available security scanner, deposit the tote at the security scanner, and then transport the tote either to a retrieval location or secondary screening location after the personal item has been screened.

Abstract: A method for controlling a robot is provided. The method includes the steps of: determining a target robot to travel to a first loading station among a plurality of robots, on the basis of information on a location of the first loading station and a task situation of each of the plurality of robots, when a first transport target object is placed at the first loading station; and determining a travel route of the target robot with reference to information on the location of the first loading station and a location of a first unloading station associated with the first transport target object.

Abstract: Various embodiments of an apparatus, methods, systems and computer program products described herein are directed to an agricultural observation and treatment system and method of operation. The agricultural treatment system may determine a first real-world geo-spatial location of the treatment system. The system can receive captured images depicting real-world agricultural objects of a geographic scene. The system can associate captured images with the determined geo-spatial location of the treatment system. The treatment system can identify, from a group of mapped and indexed images, images having a second real-word geo-spatial location that is proximate with the first real-world geo-spatial location. The treatment system can compare at least a portion of the identified images with at least a portion of the captured images. The treatment system can determine a target object and emit a fluid projectile at the target object using a treatment device.

Abstract: Systems, apparatus, and methods are described for robotic learning and execution of skills. A robotic apparatus can include a memory, a processor, sensors, and one or more movable components (e.g., a manipulating element and/or a transport element). The processor can be operatively coupled to the memory, the movable elements, and the sensors, and configured to obtain information of an environment, including one or more objects located within the environment. In some embodiments, the processor can be configured to learn skills through demonstration, exploration, user inputs, etc. In some embodiments, the processor can be configured to execute skills and/or arbitrate between different behaviors and/or actions. In some embodiments, the processor can be configured to execute skills and/or behaviors using cached trajectories or plans. In some embodiments, the processor can be configured to execute skills requiring navigation and manipulation behaviors.

Abstract: Systems and methods for safety-enabled control. Input values provided to a control system can be validated. Command gating can be performed for control values provided by the control system. Validation of input values and command gating for control values can be performed in accordance with respective validation windows. Validation windows can be dynamically adjusted based on data received via a sensor or interface.

Abstract: An autonomous vehicle can include a horn; a sensor(s) configured to capture images; and one or more processors. The one or more processors can be configured to receive a sequence of images from the sensor(s), the sequence of images captured by the sensor(s) as the autonomous vehicle was moving; execute a machine learning model using the sequence of images as input to detect a human inside a second vehicle or in the surrounding environment of the autonomous vehicle depicted within the sequence of images; determine, based on the detection of the human inside the second vehicle or in the surrounding environment of the autonomous vehicle within the sequence of images, the human is depicted performing a defined arm gesture within the sequence of images; and activate the horn responsive to the determination that the human is depicted performing the defined arm gesture within the sequence of images.

Abstract: Methods and systems are described herein for determining three-dimensional locations of objects within identified portions of images. An image processing system may receive an image and an identification of location within an image. The image may be input into a machine learning model to detect one or more objects within the identified location. Multiple images may then be used to generate location estimations of those objects. Based on the location estimations, an accurate three-dimensional location may be calculated.