Abstract: The present invention relates to a method of operation and autonomous robotic system for remotely collecting products in stores. The system includes a mobile robot, and navigation, product recognition and multi-objective planning systems. The mobile robot comprises vision sensors to obtain image and distance information, a mobile base, and an actuator or robotic arm arranged on the mobile base and which can perform movements in height, depth and rotation to handle and move products from store shelves to a temporary storage area. Said actuator comprises an end effector with at least two suction cups of different sizes and having rotational and tilting movements about a vertical axis. The product recognition system comprises identification algorithms configured to recognise, based on the vision information, object shapes corresponding to an external shape, and to read logos or texts on the products to identify the products, obtaining location and distance information about the identified products.

Abstract: An object processing system including an input area for receiving a plurality of objects to be processed, an output area including a plurality of destination containers for receiving any of the plurality of objects, a programmable motion device proximate the input area and the output area, the programmable motion device including an end-effector for grasping a selected object of the plurality of objects, and a perception system for detecting the unexpected appearance of any of the plurality of objects that is not associated with the end-effector of the programmable motion device.

Abstract: A robot teaching method allows even a person without knowledge on robots to intuitively and efficiently teach a robot a work motion by a work demonstration while maintaining a normal human motion as much as possible, and reduces man-hours for pre-adjustment of teaching, facilitate the introduction, etc. by generating a motion of a robotic hand mechanism corresponding to a work motion including an operation on an operation object by a hand of a teacher. The method includes acquiring a first measured pose obtained by measuring a pose of the operation object and a second measured pose obtained by measuring a pose of the hand of the teacher during the work motion; detecting the operation on the operation object by the teacher; and generating a teaching pose for generating the robotic motion data based on the first measured pose, the second measured pose, and the detected operation.

Abstract: Automated system comprising a plurality of picking robots, a control entity including a data processor, and a perception system configured to acquire imaging information relating to foodstuff units being conveyed through a working area, the foodstuff units being on a plurality of trays. The control entity being in communication with the plurality of picking robots and the perception system, and is configured to a) determine absolute positional information and relative positional information relating to the foodstuff units using the imaging information, b) for each tray, using the relative positional information, determine a picking sequence for each picking robot, each picking sequence relating to a different subset of individual foodstuff units on the tray, and c) for each picking robot, using the absolute positional information, instruct the plurality of picking robots to pick a next individual foodstuff unit of the respective subset of individual foodstuff units in the determined picking sequence.

Abstract: A lifting vehicle includes: a chassis, a telescopic boom articulated to the chassis and provided at a distal end with a mounting for attaching implements for handling a load, a control cab, at least one cab tilt actuator configured to vary a tilt angle of the cab with respect to the chassis, and an automatic tilt adjustment system configured to control said cab tilt actuator to automatically vary a tilt angle of the control cab with respect to the chassis as a function of the position of the load.

Abstract: A work measuring method for measuring a work including a columnar member and a diaphragm and held by a positioner includes an acquiring step of acquiring point cloud data on a surface of the work held by the positioner and photographed in a predetermined direction, a detecting step of identifying a portion where distribution of the point cloud data changes in a three-dimensional coordinate system of the positioner and detecting the portion as a boundary position between the columnar member and the diaphragm, and a deriving step of deriving the number of columnar members and diaphragms included in the work on the basis of the boundary position detected in the detecting step.

Abstract: A system includes proximal and distal structures and a processor system. The processor system determines a first commanded motion of the proximal structure; determine a second commanded motion for joint(s) of the distal structure or an imaging device, wherein when the first and second commanded motions are performed in conjunction, a field of view of the imaging device is maintained relative to a workspace; and in response to determining that driving the joint(s) in accordance with the second commanded motion would cause the distal structure or the imaging device to violate a constraint: determines an alternate commanded motion for the joint(s) to maintain a defined geometric relationship between a first geometric feature fixed relative to the imaging device and a second geometric feature fixed relative to the workspace, drives the proximal structure in accordance with the first commanded motion, and drives the joint(s) in accordance with the alternate commanded motion.

Abstract: A method and system for operating a shuttle system by a control device are disclosed. The shuttle system comprises a rack with a driveway and a multi-deep storage channel with at least two storage locations. In embodiments, the shuttle system comprises at least two shuttles arranged to store, retrieve, or transfer conveyed goods; the shuttles receive orders from the control device. Once an active order for a conveyed good in a specific storage channel is present, the control device checks whether an open order for storing, retrieving, or transferring in this storage channel is present. If no open order is present, the control device places the active order. If an open order is present, the control device either assigns the active order only after the open order has been completed, or modifies the active order so that a storage channel is selected for which no open order is present.

Abstract: A joint diagnosis method, including steps: collecting data of a current motion trajectory of a robot, solving for a frictional force of a joint, performing temperature compensation on a friction model based on a feedback temperature of the joint, and solving for an output torque of a connecting rod of the joint, to acquire a dynamics model error; performing detection and analysis on the dynamics model error, to acquire modal analysis and joint wear degree results; and determining, based on the modal analysis and joint wear degree results, whether the joint is in an abnormal wear state, and if the joint is in the abnormal wear state, triggering a joint abnormity alarm, otherwise, performing calibration on the friction model.

Abstract: Methods, systems, and apparatus for receiving a command for controlling a robot, the command referencing an object, receiving sensor data for a portion of an environment of the robot, identifying, from the sensor data, a gesture of a human that indicates a spatial region located outside of the portion of the environment described by the sensor data, searching map data for the object, determining, based at least on searching the map data for the object referenced in the command, that the object referenced in the command is present in the spatial region, and in response to determining that the object referenced in the command is present in the spatial region, controlling the robot to perform an action with respect to the object referenced in the command.

Abstract: An information processing device includes a communication unit and a control unit. The communication unit is capable of communicating with a plurality of vehicles. The control unit calculates the switching timing of the hand signal based on the traffic amount in the vicinity of the intersection, identifies the head vehicle stopped at the intersection, and controls the in-vehicle device capable of recognizing the operation from the outside of the head vehicle provided in the head vehicle via the communication unit based on the switching timing.

Abstract: A control device of a robot includes a robot control section configured to control the robot so as to sequentially position the robot at a plurality of target positions, which are set based on shape data representing a shape of a workpiece, and cause the robot to execute a work along a work target portion on the workpiece, and cause the robot to continue the work beyond a final target position of the plurality of target positions after the robot reaches the final target position, the final target position being set to correspond to an end of the work target portion in the shape data.

Abstract: A harvesting vehicle including a body. The harvesting vehicle also can include a pick deck including picking systems configured to harvest crops of plans growing in at least one plant bed. The pick deck can be adjustable with respect to the body to adjust a position of the picking systems over the at least one plant bed. Other embodiments are described.

Abstract: There is provided a method and a system to adaptively control a vehicle inverter system that is operable to power a vehicle powertrain, wherein the vehicle powertrain comprises a plurality of operating modes. The method and system comprises adaptively controlling the AC power output of the vehicle inverter system to vary the AC power output of the vehicle inverter system for the vehicle powertrain according to each operating mode of the vehicle powertrain. The method and system further comprises identifying the operating mode of the vehicle powertrain in real-time and adaptively controlling the AC power output of the vehicle inverter system according to the identified real-time operating mode of the vehicle powertrain.

Abstract: Batteries can be disassembled using robotics. One or more robotic agents can use the output of a suite of sensors to identify a battery type, and follow a set of disassembly instructions to disassemble a battery. The set of disassembly battery instructions can include a series of tasks primitives, where each task primitive is a selection of a tool, a motion trajectory for the tool and a disassembly task performable on a battery feature. In some embodiments, the disassembly instructions and/or the task primitives can be constructed from observing the output of sensors attached to the tools operated by a human technician and/or the human technician body. During the disassembly, the prestored task primitives can be modified to better fit the conditions of the battery.

Abstract: Provided is an information processing system for an autonomous system, the information processing system obtaining observation sensor data in the autonomous system and a target of the autonomous system, and including: an agent management unit that stores and manages an agent group; an attention unit configured to select an agent from the agent group based on the target; and an agent cooperation unit configured to generate a new agent in which inputs and outputs of selected agents are integrated and to train a generative model of the new agent based on the observation sensor data.

Abstract: An electrified vehicle includes a first battery, a driving unit, and an auxiliary battery configured to be capable of supplying power to the driving unit. The first battery mounted on electrified vehicle can be replaced with a second battery by a battery replacement station provided outside electrified vehicle. Electrified vehicle supplies electric power from the auxiliary battery to the driving unit, thereby enabling the driving unit to be driven.

Abstract: Methods and systems for determining a grasp proposal for object picking by a robot gripper are descried wherein the method may comprise capturing an image comprising an object to be grasped by the robot gripper; providing the image to a deep neural network system that is trained to generate an object segmentation map for identifying pixels in the image that are associated with the object and to generate a plurality of object property maps, each object property map linking pixels of the object to information about a predetermined object property; and, determining a grasp proposal for a controller of the robot based on the one or more generated object property maps.

Abstract: A handling system according to an embodiment includes: a handling device configured to transfer an object from a transfer source space to a transfer destination space with the object gripped; a transfer destination measuring device configured to measure a transfer destination shape that is a shape of the transfer destination space; and a control device configured to control the handling device and the transfer destination measuring device. The control device described above records a measurement history of the transfer destination shapes acquired from the transfer destination measuring device and a calculation history of placement positions of the objects transferred to the transfer destination space and generates a complemented transfer destination shape acquired by complementing the transfer destination shape on the basis of the measurement history of the transfer destination shapes and the calculation history of the placement positions.

Abstract: An autonomous system can include a depth camera configured to capture a depth image of a bin that contains a plurality of objects from a first direction, so as to define a captured image. Based on the bottom end of the bin and the captured image, the system can generate a cropped region that defines a plane along a second direction and a third direction that are both substantially perpendicular to the first direction. Based on the captured image, the system can make a determination as to whether at least one object of the plurality of objects lies outside the cropped region. Based on the determination, the system can select a final region of interest for determining grasp points on the plurality of objects.