Abstract: Methods and systems for allocating tasks to robotic devices are provided. An example method includes receiving information associated with task logs for a plurality of robotic devices and in a computing system configured to access a processor and memory, determining information associated with a health level for the plurality of robotic devices based on the information associated with the task logs. A health level for a given robotic device may be proportional to a current level of ability to perform a function, which may change over a lifespan of the given robotic device. Information associated with a plurality of tasks to be performed by one or more or the robotic devices may also be determined. The computing system may optimize an allocation of the plurality of tasks such that a high precision task may be allocated to a robotic device having a greater current health level than another robotic device.

Abstract: In one aspect, a method is described. The method may include providing an end effector tool of a robotic device configured to perform a task on a work surface within a worksite coordinate frame. The method may further include providing first location data indicating a first location of the end effector tool with respect to the work surface, providing second location data indicating a second location of the end effector tool within the worksite coordinate frame, and providing third location data indicating a third location of the end effector tool within the worksite coordinate frame. The method may further include tracking the location of the end effector tool based on the first, second, and third location data, and, based on the tracked location of the tool, instructing the robotic device to manipulate the end effector tool to perform a task on the work surface.

Abstract: Example methods and systems enable rearrangement of a warehouse to an optimal layout determined according to customizable goals. An example method includes receiving, at a warehouse management system (WMS), information of a warehouse and items of the warehouse, identifying an item shipment expectation including new items expected to be received at the warehouse at a future date and items present at the warehouse marked for delivery at the future date, determining an optimal layout of the items of the warehouse at a present date based on the item shipment expectation, determining an amount of time to rearrange the items, by one or more of robotic devices rearranging the items, to the optimal layout based on a time measurement for robotic devices to perform tasks, and determining to rearrange the items of the warehouse based on the amount of time to rearrange the items being less than a threshold amount of time.

Abstract: Systems and methods for efficient coupling to low-loss eigenmodes of a spherical waveguide bounded by the Earth's surface and its ionosphere are disclosed. One or more eigenmodes of the Earth-ionosphere waveguide may be computed based on a mathematical model incorporating electrical properties of the terrestrial surface and plasma physics of the ionospheric layer. An array of electrically-connected waveguide-coupling elements may be configured for coupling to the one or more eigenmodes. By adjusting relative phases and/or amplitudes of the waveguide-coupler elements, as well as frequencies, the electrical size of the array may be made much larger than its physical size, and substantial electromagnetic energy may be targeted to preferentially excite the one or more eigenmodes. The adjustments may also account or compensate for non-homogeneous propagation properties of the ionosphere, and help reduce ohmic losses in the ionosphere.

Abstract: In embodiments, acquiring sensor data associated with a plant growing in a field, and analyzing the sensor data to extract, while in the field, one or more phenotypic traits associated with the plant from the sensor data. Indexing, while in the field, the one or more phenotypic traits to one or both of an identifier of the plant or a virtual representation of a part of the plant, and determining one or more plant insights based on the one or more phenotypic traits, wherein the one or more plant insights includes information about one or more of a health, a yield, a planting, a growth, a harvest, a management, a performance, and a state of the plant. One or more of the health, yield, planting, growth, harvest, management, performance, and the state of the plant are included in a plant insights report that is generated.

Abstract: An example method includes determining an expected sound profile corresponding to a given task for a robotic device. The method further includes detecting a sound profile during execution of the given task by the robotic device. The method also includes determining one or more differences in amplitude for at least one frequency range between the detected sound profile and the expected sound profile corresponding to the given task for the robotic device. In response to determining the one or more differences in amplitude for the at least one frequency range between the detected sound profile and the expected sound profile, the method additionally includes identifying at least one component of the robotic device associated with the detected sound profile during execution of the given task. The method further includes adjusting control data for the at least one component of the robotic device.

Abstract: Methods, apparatus, and computer readable media applicable to balancing robots. Some implementations are directed to maintaining a given end effector pose (relative to a world frame) of an end effector of a balancing robot when there is a disturbance to a balancing base of the balancing robot. Some implementations are additionally or alternatively directed to transitioning a balancing robot from a fallen configuration to a balanced configuration. Some implementations are additionally or alternatively directed to mitigating the risk that a balancing robot will fall when interacting with actuable environmental objects (e.g., doors) and/or to lessen the disturbance to a balancing base when interacting with actuable environmental objects.

Abstract: A method and a device for measuring a fluid flow characteristic of an ambient fluid and modifying fluid flow of the ambient fluid, the method including: applying a first voltage between a first electrode and a second electrode, the first voltage being sufficient to generate a plasma in the first space; applying a second voltage between the first electrode and a third electrode, the second voltage being sufficient to generate a plasma in the second space; measuring a first current between the first and second electrodes, and a second current between the first and third electrodes; determining a fluid flow characteristic of the ambient fluid; and applying a third voltage between the first and second electrodes, the third voltage being sufficient to generate a plasma in the first space sufficient to modify fluid flow of the ambient fluid in the first direction in the first space.

Abstract: Methods, systems, and apparatus, including an apparatus that includes a motorized base configured to move the apparatus; an upper portion coupled to the motorized base; one or more load-sensing devices located between the motorized base and the upper portion, the one or more load-sensing devices being configured to (i) detect forces between the upper portion and the motorized base, and (ii) provide force information based on the detected forces between different portions of the upper portion and the motorized base; and one or more processors performs operations of: obtaining the force information provided by the one or more load-sensing devices; determining a difference between the forces indicated by the force information from the one or more load-sensing devices; determining, based the difference in the forces, a movement to be performed by the apparatus; and providing control information to cause the motorized base to perform the determined movement.

Abstract: Methods, apparatus, systems, and computer-readable media are provided that relate to using one or more vision sensors to capture images of a loaded pallet in association with application of stretch wrap to the loaded pallet by an automated pallet wrapping machine. The images are used to generate an image-based identifier for the loaded pallet that is then used for pallet identification by mobile robots and/or other automated agents in a warehouse or other environment. In some implementations, the images are captured by the vision sensor when the pallet is in the wrapping area of the automated pallet wrapping machine and while the vision sensor and/or the pallet are rotating. In some implementations, the image-based identifier may be assigned to pallet attributes and/or a de-palletizing scheme of the loaded pallet.

Abstract: Example systems and methods allow for use of a graphical interface to cause one or more robotic devices to construct an output product. One example method includes causing a graphical interface to be displayed on a display device, receiving input data corresponding to one or more interactions with the graphical interface indicating at least one motion path and at least one sequence of tool actions to execute at one or more points within the at least one motion path for use in construction of an output product, generating a plurality of digital nodes including at least one robot node, at least one motion command node, and at least one tool command node, and providing instructions for the at least one robot actor to move according to the sequence of robot motion commands determined by the at least one motion command node and execute the sequence of tool commands determined by the at least one tool command node to construct the output product.

Abstract: An example system includes one or more laser sensors on a robotic device, where the one or more laser sensors are configured to produce laser sensor data indicative of a first area within a first distance in front of the robotic device. The system further includes one or more stereo sensors on the robotic device, where the stereo sensors on the robotic device are configured to produce stereo sensor data indicative of a second area past a second distance in front of the robotic device. The system also includes a controller configured to receive the laser sensor data, receive the stereo sensor data, detect one or more objects in front of the robotic device based on at least one of the laser sensor data and the stereo sensor data, and provide instructions for the robotic device to navigate based on the one or more detected objects.

Abstract: In some implementations, a method includes receiving, by one or more processing devices configured to control a traffic signal at an intersection of roads, camera data providing images of the intersection, the processing devices being located proximate to the intersection, using one or more local machine learning models to identify objects at the intersection and paths of the objects based on the camera data, providing traffic data generated from outputs of the one or more local machine learning models to a remote traffic planning system over a network, receiving, from the remote traffic planning system, a remote instruction for the traffic signal determined using one or more remote machine learning models, and providing a control instruction to the traffic signal at the intersection that is determined based on (i) the remote instruction from the remote traffic planning system, and (ii) a local instruction generated by the processing devices.

Abstract: Systems and methods related to roadmaps for robotic devices are provided. A computing device can receive a roadmap representing a plurality of paths through an environment. The computing device can discretize the roadmap to obtain a discrete planning graph having a plurality of states corresponding to discretized segments of the plurality of paths of the roadmap such that states corresponding to adjacent discretized path segments are connected in the discrete planning graph. The computing device can determine a Boolean equation representing at least a portion of the discrete planning graph. The computing device can determine a sequence of states from the plurality of states of the discrete planning graph such that the determined sequence of states satisfies the Boolean equation. The computing device can provide a route through the environment for a robotic device based on the determined sequence of states.

Abstract: An example robotic device may include an arm having a palm and fingers, a depth sensor disposed within the palm, and a control system. The control system may be configured to detect an indication to receive an object from an actor, and in response, cause the robotic device to enter a receive-object mode. When the robotic device is in the receive-object mode, the control system is further configured to: receive, from the depth sensor, depth data indicating a distance between the palm and the object; when the distance is greater than a first threshold and less than a second threshold, cause the arm to move towards the object; when the distance exceeds the second threshold, maintain the arm in a fixed position; and when the distance drops below the first threshold, cause the two or more fingers to close to grasp the object.

Abstract: A fully-passive optical system creates a counter-propagating reference beam, which may be used to evaluate a misalignment between a receive beam, a transmit beam, and a tracking beam. The system can be mated to a motorized tip-tilt stage, and can measure power of received signals and automatically adjust the tip-tilt stage in response. Thus, the system would always maintain bore-sight with the received beam regardless of mechanical shift over time.

Abstract: An example method includes determining a path to be followed by a vehicle through an environment. The path includes an ordered sequence of positions. The method also includes determining an intersection between a first object in the environment and a first area planned to be occupied by the vehicle while moving along the path and, in response, sequentially testing the ordered sequence of positions to identify a first ordinal position in the ordered sequence of positions, where the first ordinal position corresponds to a second area planned to be occupied by the vehicle while moving along the path, and where the second area is within a threshold distance of the first object. The method further additionally includes trimming the path to remove (i) the first ordinal position and (ii) any positions subsequent thereto and causing the vehicle to stop at an end of the trimmed path.

Abstract: The disclosure provides for a method and a system for tracking an optical communication beam based on polarization modulation of the optical communication beam. The method includes polarizing, at a first communication device, an optical communication beam in a polarization pattern. The optical communication beam carries an optical signal. The polarization pattern encodes information by varying between a first polarization direction and at least one second polarization direction. The polarized optical communication beam is then transmitted from the first communication device to a second communication device. At the second communication device, the polarized optical communication beam is processed to extract the encoded information, and the encoded information is used at the second communication device to track the optical communication beam.

Abstract: Methods and systems for depth sensing are provided. A system includes a first and second optical sensor each including a first plurality of photodetectors configured to capture visible light interspersed with a second plurality of photodetectors configured to capture infrared light within a particular infrared band. The system also includes a computing device configured to (i) identify first corresponding features of the environment between a first visible light image captured by the first optical sensor and a second visible light image captured by the second optical sensor; (ii) identify second corresponding features of the environment between a first infrared light image captured by the first optical sensor and a second infrared light image captured by the second optical sensor; and (iii) determine a depth estimate for at least one surface in the environment based on the first corresponding features and the second corresponding features.