Abstract: Systems and methods for performing a task in an operation environment of an aerial device with an autonomous or semi-autonomous robot are described. In some embodiments, a robot is disposed at an end of a boom of an aerial device. The robot may comprise cameras, actuators, sensors, processors, and manipulators that work together to perform tasks fully autonomously or semi-autonomously. Furthermore, the robot may comprise tools for performing the tasks and computer-executable instructions for performing the tasks may be based on the various sensory inputs, the tools, and the tasks to be performed.

Abstract: A control apparatus includes a force sensation information acquiring unit for acquiring force sensation information representing a magnitude of at least one of a force and a torque at a distal end of a manipulator while a target item is being transported; a mass information acquiring unit for acquiring mass information representing a mass of the item; a plan information acquiring unit for acquiring plan information representing content of a plan of a trajectory; a force sensation estimating unit for estimating a magnitude of at least one of a force and a torque to be detected at the distal end of the manipulator; and a first detecting unit for detecting an abnormality, based on the magnitude of at least one of the force and the torque represented by the force sensation information and the magnitude of at least one of the force and the torque estimated by the estimating unit.

Abstract: A control system includes a control apparatus and a plurality of robots. The control apparatus includes a function acquisition unit that acquires a function, a function form conversion unit that converts the function into a distributed calculable form, and a variable conversion unit that sets, based on the function which form is converted, variables to be stored by each of the robots and a process corresponding to the variables, to the robot. Each of the plurality of robots a consensus control means that updates a variable value stored by the robot itself based on the set variable while sending and receiving variable values among other communicable robots, and a function value inference means that infers a function value from the variable based on the set process.

Abstract: A method to control a robot to perform at least one Cartesian or joint space task comprises using quadratic programming to determine joint forces, in particular joint torques, and/or joint accelerations of said robot based on at least one cost function which depends on said task.

Abstract: A motion control method, a robot, and a computer-readable storage medium are provided. The method includes: calculating a task matrix and expected information of each task of the robot based on reference trajectory information of each task of the robot in a control period and state estimation information of each task of the robot in the control period; calculating a constraint matrix and a boundary of an inequality constraint that the robot needs to satisfy based on the state estimation information; constructing a hierarchical quadratic programming problem with recursive hierarchical projection based on all the information obtained above, a real-time determined weight coefficient of each task, and a real-time determined priority level of each task: and solving the hierarchical quadratic programming problem to obtain a result, and generating a joint control instruction for controlling each joint of the robot to move.

Abstract: A system for assisting an operator in a work station includes a collaborative robot, with a robot electronic controller, configured for conducting an operation in an open, non-protected space, adjacent and in cooperation with the operator, an exoskeleton including one or more actuators, wearable by the operator for receiving assistance in conducting one or more operations, a plurality of sensors associable to the body of the operator and configured for detecting at least one parameter.

Abstract: This control device calculates a parameter, which represents transformation between a first coordinate system for image information obtained by capturing an image of a target to be controlled and a second coordinate system for defining the movement of the target to be controlled, by using position information indicating the position of the target to be controlled in the first coordinate system and position information indicating the position of the target to be controlled in the second coordinate system. Further, the control device uses image information containing the target to be controlled and the calculated parameter to calculate the position information of the target to be controlled for the second coordinate system, and controls the target to be controlled on the basis of the calculated position information of the target to be controlled.

Abstract: A system for singulating objects includes a bin for receiving a collection of objects, a robotic manipulator for grasping objects from the bin, a scale for measuring a weight of the grasped objects, and a computer system for comparing measured weights to acceptable weight ranges to detect double picks. Methods include determining acceptable weight ranges by weighing a plurality of objects.

Abstract: A method for dual arm robot teaching from dual hand detection in human demonstration. A camera image of the demonstrator's hands and workpieces is provided to a first neural network which determines the identity of the left and right hand from the image, and also provides cropped sub-images of the identified hands. The cropped sub-images are provided to a second neural network which detects the poses of both the left and right hand from the images. The dual hand pose data for an entire operation is converted to robot gripper pose data and used for teaching two robot arms to perform the operation on the workpieces, where each hand's motion is assigned to one robot arm. Edge detection from camera images may be used to refine robot motions in order to improve part localization for tasks requiring precision, such as inserting a part into an aperture.

Abstract: There is provided a smart control system including a host, at least one sensor and an informing device. The host identifies the activity of a specific member according to the detection result of the at least one sensor, and informs the specific member to take medicine on time or avoid eating specific ingredients using the informing device.

Abstract: A controller for an inverse optimal control approach robot may control movement of a robot body toward a human target along a trajectory according to a cost function. The cost function may include many terms. A first term may be associated with a duration of the trajectory for the robot. A second term may be associated with a social force and a final distance between the robot and the human target. A third term may be associated with a lateral acceleration for the robot. A fourth term may be associated with an angular acceleration for the robot. A fifth term may be associated with a longitudinal acceleration for the robot. A sixth term may be associated with a reduction of centrifugal force applied to the robot body.

Abstract: A robot obstacle avoidance method, a robot controller using the same, and a storage medium are provided. The method includes: determining an influence value of an obstacle on a motion range of a joint of the robot according to a position of the obstacle in a workspace of the robot; establishing a state transition relationship of the robot by taking a joint velocity of the robot as a control target and a joint angular velocity of the robot as a control input quantity; and avoiding the robot from colliding with the obstacle during a movement process of the robot by performing a model predictive control on the robot according to the state transition relationship and the influence value. In the present disclosure, the influence of the obstacle on the motion range of the joint of the robot is fully considered.

Abstract: To cause multiple field devices to operate together in coordination in accordance with a predetermined program through a network allowing periodic communication, a control device includes an estimator that calculates, based on a position of a first field device in a first cycle, a position of the first field device operable in accordance with a first program in a second cycle following the first cycle, and a processor that determines, based on the first program, a first command value to cause the first field device to operate, transmits the first command value to the first field device through an interface allowing communication with the field devices, determines, based on the estimated position and a second program, a second command value to cause a second field device to operate in coordination with the first field device, and transmits the second command value to the second field device through the interface.

Abstract: A processing system is disclosed for providing processing of objects that include a programmable motion device including an end effector, a perception system for recognizing any of the identity, location, and orientation of an object presented in a plurality of objects at an input location, a grasp acquisition system for acquiring the object using the end effector to permit the object to be moved from the plurality of objects to one of a plurality of destination bins, and a motion planning system for determining a changing portion of a trajectory path of the end effector from the object to a base location proximate to the input location, and determining an unchanging portion of a trajectory path of the end effector from the base location to a destination bin location proximate to a destination bin.

Abstract: A robot control system determines which of a number of discretizations to use to generate discretized representations of robot swept volumes and to generate discretized representations of the environment in which the robot will operate. Obstacle voxels (or boxes) representing the environment and obstacles therein are streamed into the processor and stored in on-chip environment memory. At runtime, the robot control system may dynamically switch between multiple motion planning graphs stored in off-chip or on-chip memory. The dynamically switching between multiple motion planning graphs at runtime enables the robot to perform motion planning at a relatively low cost as characteristics of the robot itself change. Various aspects of such robot motion planning are implemented in particular systems and methods that facilitate motion planning of the robot for various environments and tasks.

Abstract: A method for waste management, including recording an image of content within a waste container; extracting a set of content parameters from the image; characterizing the content within the waste container based on the set of content parameters; and routing a waste removal vehicle based on the content characterization.

Abstract: Embodiments of this application disclose an image processing method and apparatus, an electronic device, and a storage medium. The method includes obtaining a remaining mileage parameter of a vehicle; obtaining a start position of the vehicle on a map display interface; determining a target travel range on the map display interface according to the start position and the remaining mileage parameter; and displaying the target travel range on the map display interface.

Abstract: A pick & place operation picking a non-electric component and placing the picked component onto a component-carrier and a connect operation connecting the placed component with the component-carrier by implementing a connection technology on a hybrid, at least reactive and deliberative machine architecture based on a “machine world model” as a digital twin to formulate correct machine-behavioral sets being used during machine run-time as well as an “machine workflow”, and executing by machine motion generation including a collision-free motion or path planning of a machine within a machine workspace primary kinematic machine-movement-sequences enabling the pick & place operation and secondary kinematic machine-movement-sequences enabling the connect operation, and enabling the execution via the machine motion generation by initializing the “machine world model” according to a configuration file configuring the machine and the machine workspace and instantiating the “machine workflow” and updating the

Abstract: A handling device comprising an extending support, comprising a first projection element which is arranged on the support in a rotationally fixed and/or non-displaceable manner and extends in a first projection plane transversely to the support in a first projection direction, comprising a second projection element which is connected to the first projection element via a first joint so as to be pivotable in a second projection plane, comprising a third projection element which is connected to the second projection element via a second joint so as to be pivotable in a third projection plane, wherein, along the support axis, the first projection plane overlies the second projection plane and the second projection plane overlies the third projection plane, wherein the second projection element can be pivoted under the first projection element and the third projection element can be pivoted under the second projection element and the first projection element.

Abstract: Telerobotic, telesurgical, and/or surgical robotic devices, systems, and methods employ surgical robotic linkages that may have more degrees of freedom than an associated surgical end effector in space. A processor can calculate a tool motion that includes pivoting of the tool about an aperture site. Linkages movable along a range of configurations for a given end effector position may be driven toward configurations which inhibit collisions. Refined robotic linkages and methods for their use are also provided.

Abstract: Aspects of the disclosure relate to a conical-shaped articulated member. The conical-shaped articulated member includes a conical-shaped structure including an inner surface and an outer surface. The conical-shaped articulated member further includes a plurality of rotary actuation units disposed along a length of the conical-shaped structure, where at least two rotary actuation units of the plurality of rotary actuation units are coupled together. The plurality of rotary actuation units are configured to perform one or more motions.

Abstract: A system for parameter tuning for robotic manipulators is provided. The system includes an interface configured to receive a task specification, a plurality of physical parameters, and a plurality of control parameters, wherein the interface is configured to communicate with a real-world robot via a robot controller. The system further includes a memory to store computer-executable programs including a robot simulation module, a robot controller, and an auto-tuning module a processor, in connection with the memory. In this case, the processor is configured to acquire, in communication with the real-world robot, state values of the real-world robot, state values of the robot simulation module, simultaneously update, by use of a predetermined optimization algorithm with the auto-tuning module, an estimate of one or more of the physical, and said control parameters, and store the updated parameters.

Abstract: A robot control system determines which of a number of discretizations to use to generate discretized representations of robot swept volumes and to generate discretized representations of the environment in which the robot will operate. Obstacle voxels (or boxes) representing the environment and obstacles therein are streamed into the processor and stored in on-chip environment memory. At runtime, the robot control system may dynamically switch between multiple motion planning graphs stored in off-chip or on-chip memory. The dynamically switching between multiple motion planning graphs at runtime enables the robot to perform motion planning at a relatively low cost as characteristics of the robot itself change. Various aspects of such robot motion planning are implemented in particular systems and methods that facilitate motion planning of the robot for various environments and tasks.

Abstract: There is provided a smart detection system including multiple sensors and a central server. The central server confirms a model of every sensor and a position thereof in an operation area. The central server confirms an event position and predicts a user action according to event signals sent by the multiple sensors.

Abstract: A computer-implemented method, when executed by data processing hardware of a robot having an articulated arm and a base, causes data processing hardware to perform operations. The operations include determining a first location of a workspace of the articulated arm associated with a current base configuration of the base of the robot. The operations also include receiving a task request defining a task for the robot to perform outside of the workspace of the articulated arm at the first location. The operations also include generating base parameters associated with the task request. The operations further include instructing, using the generated base parameters, the base of the robot to move from the current base configuration to an anticipatory base configuration.

Abstract: Aspects include a robotic device for inspection of components of a belt conveyor comprising a mobile platform and a robotic arm having a first end coupled to the mobile platform and a second end, the robotic arm configured to guide the second end to contact at least one of the components of the belt conveyor. Further included is a method for inspecting components of a belt conveyor using a robotic device, including: obtaining temperature and/or noise data of at least one of the components of the belt conveyor; and, if the data are outside a range, then: driving a second end a robotic arm of the robotic device for contacting at least one of the components; and obtaining vibration data from at least one of the components.

Abstract: A task resumption system including processing circuitry that receives a task resumption specification for task resumption by a device when the device, which sequentially performs multiple tasks, stops during processing, acquires a current state of the device, acquires a resume state corresponding to the task resumption of the device, causes the device to transition from the current state to the resume state, and causes the device to resume the task according to the resume state.

Abstract: An elastic transmission element is part of a strain wave gear. Such strain wave gears are also referred to as Harmonic Drives. The elastic transmission element is also referred to as a flexspline and has an outer toothing (03). The elastic transmission element is equipped with at least one strain gauge (04) for measuring a mechanical strain on the elastic transmission element. The one strain gauge (04) or the plurality of strain gauges (04) extends at least as a whole about a circumference of a lateral surface or an axial lateral face of the elastic transmission element.

Abstract: A picking robot of an embodiment includes an acquisition unit, first and second calculation units, a control unit, and a grip unit. The acquisition unit acquires first area information. The first calculation unit calculates first position/posture information indicating a position/posture of a target object from the first area information. The second calculation unit calculates second position/posture information differing from the first position/posture information. The control unit grips the target object, based on the first position/posture information, controls a first operation of moving the target object to a second area. When a first operation result is inadequate, the control unit controls a second operation of arranging the target object at a position indicated by the second position/posture information in a posture indicated by the second position/posture information. The grip unit grips the target object and moves the gripped target object, based on the control by the control unit.

Abstract: Systems and methods for detecting contact between a link and an external object are provided. In one aspect, there is provided a robotic system, including a manipulatable link, a rigid shell configured to overlay the manipulatable link, and one or more sensors positioned between the rigid shell and the manipulatable link. The one or more sensors are configured to detect contact between the rigid shell and an external object.

Abstract: A method for controlling a robot to perform a task, for which the robot is redundant, includes specifying an adjustment of first and second axes of at least one pair of two movement axes of the robot based on a specified operating mode such that both axes can be adjusted and adjustment of the first axis is prioritized over the second axis if a first operating mode is specified. Adjustment of the second axis is prioritized over the first axis if a second operating mode is specified. Additionally or alternatively, adjustment of at least one selected movement axis is specified based on a specified operating mode such that this axis can be adjusted or is blocked independently of the task if a reduced operating mode is specified, and can be adjusted for the purpose of performing this task if an operating mode differing from this reduced operating mode is specified.

Abstract: A set of one or more potentially graspable features for one or more objects present in a workspace area are determined based on visual data received from a plurality of cameras. For each of at least a subset of the one or more potentially graspable features one or more corresponding grasp strategies are determined to grasp the feature with a robotic arm and end effector. A score associated with a probability of a successful grasp of a corresponding feature is determined with respect to each of a least a subset of said grasp strategies. A first feature of the one or more potentially graspable features is selected to be grasped using a selected grasp strategy based at least in part on a corresponding score associated with the selected grasp strategy with respect to the first feature. The robotic arm and the end effector are controlled to attempt to grasp the first feature using the selected grasp strategy.

Abstract: There is provided a smart control system including a host, at least one sensor and an informing device. The host identifies the activity of a specific member according to the detection result of the at least one sensor, and informs the specific member to take medicine on time or avoid eating specific ingredients using the informing device.

Abstract: The present disclosure is related to methods and systems for controlling a snake-arm robot. The method includes receiving real-time image data associated with an operating environment or a location of a workpiece from optical sensor(s) mounted on a robot head of the robot; receiving input data describing a desired pose of the robot head; computing and translating a desired displacement of the robot head; computing a position of each of the links of the snake-arm robot to follow motion of the robot head, a current position of each the links, and data required to move joints connecting the links to move the robot to the desired pose; generating movement instructions; and transmitting the movement instructions to a drive motor associated with an introduction device or controllers associated with servo-motors operably connected to joints connecting the links of the snake-arm causing the robot head to move to the desired pose.

Abstract: Systems and methods for fall detection on uneven surfaces utilizing radar are disclosed. For example, an electronic device may receive reflected energy from surfaces in an environment. Corresponding sensor data associated with an object moving on an uneven surface may be utilized to determine a velocity of the object and a height change of the object. When the velocity indicates that the object has stopped moving toward or away from the sensing device, and the height values indicate a sudden decrease in height, a fall event may be detected.

Abstract: A mobile robot is configured for operation in a commercial or industrial setting, such as an office building or retail store. The robot can patrol one or more routes within a building, and can detect violations of security policies by objects, building infrastructure and security systems, or individuals. In response to the detected violations, the robot can perform one or more security operations. The robot can include a removable fabric panel, enabling sensors within the robot body to capture signals that propagate through the fabric. In addition, the robot can scan RFID tags of objects within an area, for instance coupled to store inventory. Likewise, the robot can generate or update one or more semantic maps for use by the robot in navigating an area and for measuring compliance with security policies.

Abstract: Provided is a route planning apparatus including a search unit 2 configured to search for a first route that connects each moving object and a lay-by area, when a deadlock is detected in a route plan of one or more moving objects 20, and a re-planning unit 3 configured to re-plan a second route from each moving object 20 to a target site such that the first routes which have been respectively found for the moving objects 20 do not collide with each other.

Abstract: A surgical method is provided for use with a teleoperated surgical system (surgical system), the method comprising: recording surgical instrument kinematic information indicative of surgical instrument motion produced within the surgical system during the occurrence of the surgical procedure; determining respective kinematic signatures associated with respective surgical instrument motions; producing an information structure in a computer readable storage device that associates respective kinematic signatures with respective control signals; comparing, during a performance of the surgical procedure surgical instrument kinematic information during the performance with at least one respective kinematic signature; launching, during a performance of the surgical procedure an associated respective control signal in response to a match between surgical instrument kinematics during the performance and a respective kinematic signature.

Abstract: A processing system is disclosed for providing processing of objects that includes a programmable motion device including an end effector, a perception system for recognizing any of the identity, location, and orientation of an object presented in a plurality of objects at an input location, a grasp acquisition system for acquiring the object using the end effector to permit the object to be moved from the plurality of objects to one of a plurality of destination bins, and a motion planning system for determining a changing portion of a trajectory path of the end effector from the object to a base location proximate to the input location, and determining an unchanging portion of a trajectory path of the end effector from the base location to a destination bin location proximate to a destination bin.

Abstract: The different advantageous embodiments further provide a system for hierarchical mission management comprising a number of mission planners, a data processing system, and a communication system. The number of mission planners are associated with a number of agent groups. The data processing system is configured to execute the number of mission planners. The communication system is configured to provide communication between the number of mission planners.

Abstract: A method for controlling movement of a robot having a plurality of links connected by rotatably driven joints includes the steps of: a) defining a target speed vector of a reference point of the robot in Cartesian space; b) determining rotation speeds ({dot over (q)}ref) of the joints which minimize a weighted sum, the weighted sum having for summands i) a discrepancy (?{dot over (x)}refk?J{dot over (q)}refk?Wx) between the target speed vector ({dot over (x)}ref) and an actual speed vector ({dot over (x)}act) calculated from actual rotation speeds of the joints; and ii) a rate of change ( 1 T S ? ? q . ref k - q . ref k - 1 ? W a ) of the target rotation speeds; and c) setting the rotation speeds ({dot over (q)}ref) determined in step (b) as target rotation speeds of the joints.

Abstract: A method for dual hand detection in robot teaching from human demonstration. A camera image of the demonstrator's hands and workpieces is provided to a first neural network which determines the identity of the left and right hand of the human demonstrator from the image, and also provides cropped sub-images of the identified hands. The first neural network is trained using images in which the left and right hands are pre-identified. The cropped sub-images are then provided to a second neural network which detects the pose of both the left and right hand from the images, where the sub-image for the left hand is horizontally flipped before and after the hand pose detection if second neural network is trained with right hand images. The hand pose data is converted to robot gripper pose data and used for teaching a robot to perform an operation through human demonstration.

Abstract: A robot control system includes a state candidate generation unit that generates a state candidate that is a state transition destination of a robot at next time, a control amount estimation unit that estimates a control amount for transitioning to the state candidate, a state candidate evaluation unit that calculates a distance between the target state of the robot and the state candidate, calculates a coincidence degree between (i) a state at next time estimated from a state at current time of the robot and the control amount and (ii) the state candidate, and sets a sum of the distance and the coincidence degree to be an evaluation value, and a selection unit that selects a state candidate with a minimum evaluation value from state candidates and generate a motion corresponding to the selected state candidate.

Abstract: A link actuation apparatus that actuates a parallel link mechanism where a spherical drive mechanism is constructed includes a controller configured to calculate, based on spherical trigonometry, an attitude of a second link hub from angles ?A1 and ?A2 that represent the attitude of a first end link member with respect to a first link hub in two of at least three link mechanisms. The link actuation apparatus capable of performing forward transformation in real time is thus provided.

Abstract: A modular robotic device is provided. The modular robotic device includes a robot base and a robotic manipulator connected to the robot base and operable to articulate a tool device connected to an end of the robotic manipulator. The robotic manipulator includes a plurality of modular rigid segments, wherein each of the plurality of modular rigid segments includes a joint portion and each operable to be selectably connected to the robotic manipulator. The plurality of modular rigid segments is interchangeable and operable to be assembled in various combinations.

Abstract: A surgical system including a surgical tool and a navigation system for tracking the position of the surgical tool. The surgical tool comprising a housing including a variable speed motor and control module disposed within the housing. The navigation system comprising a navigation console in communication with the control module of the surgical tool, the navigation console may be configured to communicate instructions to the control module of the surgical tool based on the position of the surgical tool relative to a defined zone. The navigation console may be configured to deactivate the surgical tool based on the position of the surgical tool relative to the defined zone. The navigation console may also be configured to provide a user-selectable override option to allow continued operation of the surgical tool within the defined zone.

Abstract: A teleoperated surgical system is provided that includes a surgical instrument that includes an end effector mounted for rotation about a slave pivot axis; a master control input includes a mount member, first and second master grip rotatably secured at the mount member for rotation about a master pivot axis; sensor to produce a sensor signal indicative of a slave grip counter-force about the slave pivot axis; one or more motors to impart a shear force to the mount member, perpendicular to the master pivot axis; one or more processors to convert the sensor signal to motor control signals to cause the motors to impart the feedback shear force to the first and second master grip members.

Abstract: Provided are systems and methods for decomposing learned robotic activities into smaller sub-activities that can be used independently. In one example, a method may include storing simulation data comprising an activity of a robot during a training simulation performed via a robotic simulator, decompose the activity into a plurality of sub-activities that are performed by the robot during the training simulation based on changes in behavior of the robot identified within the simulation data, and generating and storing a plurality of programs for executing the plurality of sub-activities, respectively, in the storage.

Abstract: In various examples, a computer-implemented method of generating instructions for a welding robot. The computer-implemented method comprises identifying an expected position of a candidate seam on a part to be welded based on a Computer Aided Design (CAD) model of the part, scanning a workspace containing the part to produce a representation of the part, identifying the candidate seam on the part based on the representation of the part and the expected position of the candidate seam, determining an actual position of the candidate seam, and generating welding instructions for the welding robot based at least in part on the actual position of the candidate seam.

Abstract: To provide a robot controller and a robot control method that do not need a logic command to be associated with a teaching position for a robot, and that are thus capable of executing the logic command at a desired position and a desired timing. A robot controller includes: an operation command interpretation unit that interprets an operation command program describing a teaching operation and a teaching position for a robot, and that generates an operation command; a logic command interpretation unit that interprets a logic command program describing a logic command instructing a machining process to be performed by the robot and an execution position for the logic command, independently from the teaching operation and the teaching position, and that generates the logic command that includes the execution position; and a command execution unit that executes the operation command and the logic command.