Abstract: A method for controlling a robot assembly having at least one robotic arm. The method includes determining a trajectory in the axis space of the robot assembly on the basis of a path having a plurality of previously specified Cartesian poses of at least one robot-assembly-fixed reference, and determining control values in the axis space on the basis of said trajectory. The robot assembly is controlled on the basis of the control values.

Abstract: Systems and methods monitor a workspace for safety purposes using sensors distributed about the workspace. The sensors are registered with respect to each other, and this registration is monitored over time. Occluded space as well as occupied space is identified, and this mapping is frequently updated. Based on the mapping, a constrained motion plan of machinery can be generated to ensure safety.

Abstract: A teleoperational medical system comprises a teleoperational assembly including an operator control system, a first teleoperational manipulator, a first medical instrument, and a processing unit including one or more processors. The first teleoperational manipulators is configured for operation by an operator control device of the operator control system. The first teleoperational manipulator is configured to control the operation of the first medical instrument in a surgical environment. The processing unit is configured to display an image of a field of view of the surgical environment and display a menu proximate to an image of the first medical instrument in the image of the field of view. The menu includes at least one state indicator representing a state of a component of the first medical instrument.

Abstract: A robotic system is disclosed that includes an articulated arm with an end effector. The robotic system is for use in a robotic environment requiring interaction with persons in the robotic environment, and includes a plurality of lights that are illuminated responsive to known near-future movements of the articulated arm to convey the known near-future movements of the articulated arm to the persons in the robot environment.

Abstract: Implementations are provided for operably coupling multiple robot controllers to a single virtual environment, e.g., to generate training examples for training machine learning model(s). In various implementations, a virtual environment may be simulated that includes an interactive object and a plurality of robot avatars that are controlled independently and contemporaneously by a corresponding plurality of robot controllers that are external from the virtual environment. Sensor data generated from a perspective of each robot avatar of the plurality of robot avatars may be provided to a corresponding robot controller. Joint commands that cause actuation of one or more joints of each robot avatar may be received from the corresponding robot controller. Joint(s) of each robot avatar may be actuated pursuant to corresponding joint commands. The actuating may cause two or more of the robot avatars to act upon the interactive object in the virtual environment.

Abstract: Methods and apparatus for an end-of-arm tool having multiple robotic grippers, such as two or more grippers, and coordination of motion of the multiple grippers, so as to allow for automated testing and packaging of sealable bags conveyed to an inspection station.

Abstract: A robotic system to control multiple robots to perform a task cooperatively is disclosed. A first robot determines to perform a task cooperatively with a second robot, moves independently to a first grasp position to grasp an object associated with the task, receives an indication that the second robot is prepared to perform the task cooperatively, and moves the object independently of the second robot in a leader mode along a trajectory determined by the first robot. The second robot assists the first robot in performing the task cooperatively, at least in part by moving independently to a second grasp position, grasping the object, and cooperating with the first robot to move the object, at least in part by operating in a follower mode of operation to maintain engagement with the object as the first robot moves the object along the trajectory.

Abstract: Parties having different responsibilities and interests at a monitored location can be given a partial view of the totality of the sensor channels of data generated by the various sensors installed at the monitored location. The partial views deliver customized sets of data streams to customers. The selective distribution of sensor information accommodates the divergent interests and needs of parties responsible for tracking the various characteristics of a monitored location.

Abstract: Methods and systems are described that enable radar detection prioritization based on downstream feedback. As a vehicle is traveling in a travel corridor, radar detections are received by a processor and feedback related to a downstream function is received from another processor that is executing the downstream function. For the radar detections that are determined to be within the travel corridor, respective priorities are assigned based on locations of the radar detections and the feedback related to the downstream function. The radar detections with the assigned priorities are then stored in a detection buffer along with indications of their respective assigned priorities. In this way, the detection buffer may be optimized for the downstream function by filtering out certain detections and prioritizing others. Consequently, computational loads on the downstream function are reduced while ensuring that important detections are received by the downstream function early.

Abstract: A method is provided for providing process protocols for processes carried out by a number of physical devices. A sensor assigned to a physical device detects measured values. Time stamps are assigned to the detected measured values, and the process protocol is generated from the measured values detected by the sensor, from an assignment of the detected measured values to the sensor and/or to the at least one device, and from the time stamp assigned to the measured values. The process protocol has a number of data sets, and each data set of the process protocol has a first attribute, where a unique identification of a process is stored and by which the process step is assigned to the process, a second attribute, where an identification of the process step is stored, and a third attribute, where a sequence of the process steps within a process is stored.

Abstract: A robot system includes a robot configured to perform a work to a workpiece, and a user interface configured to remotely manipulate the robot. The robot includes a robotic arm, a robot hand attached to the robotic arm and configured to perform the work to the workpiece, and an acceleration sensor attached to the robot hand. The robot system further includes a speaker configured to output an acceleration signal from the acceleration sensor as perceptual information.

Abstract: Apparatuses, systems, and techniques determine a set of grasp poses that would allow a robot to successfully grasp an object that is proximate to at least one additional object. In at least one embodiment, the set of grasp poses is modified based on a determination that at least one of the grasp poses in the set of grasp poses would interfere with at least one additional object that is proximate to the object.

Abstract: Provided is a tangible, non-transitory, machine readable medium storing instructions that when executed by one or more processors of a robotic device effectuate operations including capturing, with a camera of the robotic device, spatial data of surroundings of the robotic device; generating, with the one or more processors of the robotic device, a movement path based on the spatial data of the surroundings; capturing, with at least one sensor of the robotic device, at least one measurement relative to the surroundings of the robotic device; obtaining, with the one or more processors of the robotic device, the at least one measurement; and inferring, with the one or more processors of the robotic device, a location of the robotic device based on the at least one measurement.

Abstract: A method for improving a cycle time of a process of a product is provided. The method includes: collecting process profile data from a plurality of tool groups running the process, and calculating values of a plurality of key-performance-indicators (KPIs) of each tool group including calculating a standard deviation of an output of a stage of a bottleneck tool group of the tool groups; feeding the values of the KPIs and a work-in-progress (WIP) of each tool group into a neural network model in order to output an impact on the WIP for each KPI of each tool group by the neural network model; selecting a set of major KPIs of each tool group from the KPIs according to the impact of each tool group; and controlling the tool groups according to the impact of the set of major KPIs of each tool group in order to reduce a total WIP.

Abstract: A method of operating a robot including a vacuum port for engaging an item, e.g. a wafer, is disclosed. The method includes operating, by a computer system, the robot in a first state, detecting using a vacuum sensor, a transition of a vacuum parameter from a first vacuum parameter zone to a second parameter zone in a plurality of vacuum parameter zones. Based on detecting the transition of the vacuum parameter from the first vacuum parameter zone to the second vacuum parameter zone, the operating state of the robot is altered from the first state to a second state. Also disclosed is an item transfer robot as part of an item transfer system.

Abstract: An autonomous device and method for controlling an autonomous device are disclosed. The autonomous device is configured for performing at least one task, selected from a household task, a commercial task and an industrial task. The autonomous device comprises at least one spatial sensor for generating location information and at least one further sensor for determining at least one further parameter. The autonomous device further comprises at least one task unit arranged to perform the household and/or commercial and/or industrial task, and at least one electronics unit, wherein the electronics unit is configured to generate a map using the location information, wherein the electronics unit further is configured for connecting the further parameter to the location information and adding the location of the further parameter to the map, thereby creating a parameter map containing location-correlated values of the at least one further parameter.

Abstract: A method for controlling an autonomous mobile robot for carrying out a task in a local region of an area of application of the robot. According to one embodiment, the method comprises the following steps: positioning the robot in starting position within the area of application of the robot; detecting information relating to the surroundings of the robot by means of at least one sensor; selecting a region with a determined geometric basic shape; and automatically determining, based on the detected information relating to the surroundings, at least one of the two following parameters: size and position (also including the orientation/alignment) of the selected region.

Abstract: Training and/or using a recurrent neural network model for visual servoing of an end effector of a robot. In visual servoing, the model can be utilized to generate, at each of a plurality of time steps, an action prediction that represents a prediction of how the end effector should be moved to cause the end effector to move toward a target object. The model can be viewpoint invariant in that it can be utilized across a variety of robots having vision components at a variety of viewpoints and/or can be utilized for a single robot even when a viewpoint, of a vision component of the robot, is drastically altered. Moreover, the model can be trained based on a large quantity of simulated data that is based on simulator(s) performing simulated episode(s) in view of the model. One or more portions of the model can be further trained based on a relatively smaller quantity of real training data.

Abstract: A cleaning robot including: a main body; a drive device; and a cleaning device equipped for wet-cleaning floors to be cleaned, wherein: the main body, on the side facing the floor to be cleaned, is assigned a receptacle unit, a first mop pad configured for wet-cleaning is fastened to the receptacle unit, and the cleaning robot is configured to autonomously exchange the first mop pad fastened to the receptacle unit for a second mop pad.

Abstract: Asynchronous robotic control utilizing a trained critic network. During performance of a robotic task based on a sequence of robotic actions determined utilizing the critic network, a corresponding next robotic action of the sequence is determined while a corresponding previous robotic action of the sequence is still being implemented. Optionally, the next robotic action can be fully determined and/or can begin to be implemented before implementation of the previous robotic action is completed. In determining the next robotic action, most recently selected robotic action data is processed using the critic network, where such data conveys information about the previous robotic action that is still being implemented. Some implementations additionally or alternatively relate to determining when to implement a robotic action that is determined in an asynchronous manner.

Abstract: A self-learning intelligent driving device including: a first neural network module for performing a corresponding action evaluation operation on an input image to generate at least one set of trajectory coordinates: a switching unit controlled by a switching signal, where when the switching signal is active, data received at a first port is sent to a second port, and when the switching signal is inactive, data received at the first port is sent to a third port; a second neural network module for performing a corresponding image evaluation operation on the at least one set of trajectory coordinates when the switching signal is active to generate at least one simulated trajectory image; and a driving unit having a robotic arm for generating at least one corresponding motion trajectory according to the at least one set of trajectory coordinates when the switching signal is inactive.

Abstract: A cleaning system is provided. The cleaning system includes a robot cleaner and a station. The robot cleaner includes a pad fixing part on which a cleaning pad is detachably mounted, a lifter to lift a part of the robot cleaner at which the pad fixing part is positioned, and a pad detacher to detach the cleaning pad mounted on the pad fixing part. The station includes a pad storage box in which a cleaning pad that is to be provided to the robot cleaner is stored, a pad coupling part on which a cleaning pad that is to be coupled to the robot cleaner is rested, and a pad supplier to supply the cleaning pad stored in the pad storage box to the pad coupling part.

Abstract: Provided is a method including emitting, with a laser light emitter disposed on a robot, a collimated laser beam projecting a light point on a surface opposite the laser light emitter; capturing, with each of at least two image sensors disposed on the robot, images of the projected light point; overlaying, with a processor of the robot, the images captured by the at least two image sensors to produce a superimposed image showing both captured images in a single image; determining, with the processor of the robot, a first distance between the projected light points in the superimposed image; and determining, with the processor, a second distance based on the first distance using a relationship that relates distance between light points with distance between the robot or a sensor thereof and the surface on which the collimated laser beam is projected.

Abstract: Provided is a tangible, non-transitory, machine readable medium storing instructions that when executed by a processor of a robot effectuates operations including: capturing, with at least one sensor, first data used in indicating a position of the robot; capturing, with at least one sensor, second data indicative of movement of the robot; recognizing, with the processor of the robot, a first area of the workspace based on at least one of: a first part of the first data and a first part of the second data; generating, with the processor of the robot, a first movement path covering at least part of the first recognized area; actuating, with the processor of the robot, the robot to move along the first movement path; and generating, with the processor of the robot, a map of the workspace based on at least one of: the first data and the second data.

Abstract: An example method may include i) detecting a disturbance to a gait of a robot, where the gait includes a swing state and a step down state, the swing state including a target swing trajectory for a foot of the robot, and where the target swing trajectory includes a beginning and an end; and ii) based on the detected disturbance, causing the foot of the robot to enter the step down state before the foot reaches the end of the target swing trajectory.

Abstract: An example implementation for determining mechanically-timed footsteps may involve a robot having a first foot in contact with a ground surface and a second foot not in contact with the ground surface. The robot may determine a position of its center of mass and center of mass velocity, and based on these, determine a capture point for the robot. The robot may also determine a threshold position for the capture point, where the threshold position is based on a target trajectory for the capture point after the second foot contacts the ground surface. The robot may determine that the capture point has reached this threshold position and based on this determination, and cause the second foot to contact the ground surface.

Abstract: A method for controlling a robot includes applying a setpoint force to a contact point; measuring a contact stiffness at the contact point; and slowing down the moving robot using its drives and/or braking the robot to apply the setpoint force to the contact point by the slowing down and/or slowed down robot depending on the measured contact stiffness, wherein the robot is slowed down before the setpoint force is reached.

Abstract: The present disclosure is provides a method, an apparatus and a terminal device for constructing parts together. The method includes: determining an assembly progress of an object constructed of parts; determining a currently required part according to the assembly progress; identifying, in a part photo of the object, the currently required part using a pre-trained first neural network model and marking the one or more identified currently required parts in the part photo; and displaying, via a display, a 3D demonstration animation with the marked part photo as a background image. The method is based on the existing 3D demonstration animation, which identifies the currently required part in the captured part photo and marks the identified currently required part in the part photo, and then displays the marked part photo as the background image of the 3D demonstration animation, thereby adding a prompt for the real part.

Abstract: A computing device performs computation for controlling operations of a mobile manipulator configured to hold a plurality of target objects with a manipulator and move the target objects to predetermined positions. The computing device includes a storage and a calculator. The storage stores a trained machine learning model trained by inputting a plurality of training data sets, which are combinations of state variables and pieces of determination data associated with the state variables. The training data sets are acquired in advance. The calculator outputs a movement-target object to be moved to a predetermined position at current time by inputting the state variable to the trained machine learning model read from the storage. The state variable contains relative positions of the target objects to a specific portion of the mobile manipulator. The determination data associated with the state variable represents the movement-target object.

Abstract: The present disclosure discloses a navigation map updating method as well as an apparatus, and a robot using the same. The method includes: controlling a robot to move along a designated path after a successful relocalization of the robot, and recording key frame data of each frame on the designated path and a corresponding pose; creating a new navigation map, and copying information in an original navigation map into the new navigation map; and covering the key frame data of each frame on the designated path onto the new navigation map to obtain an updated navigation map. In this manner, there is no need for the user to manipulate the robot to recreate the map at the environment where the robot is operated, which saves a lot of time and manpower.

Abstract: A medical system includes a control system and an instrument manipulator. The instrument manipulator is configured to receive an instrument and includes a first drive output and a first actuating element configured to drive movement of the first drive output. The first drive output is configured to drive a first input coupling of the instrument. The control system is configured to receive an indication that the first input coupling of the instrument is positioned adjacent to the first drive output of the manipulator, in response to receiving the indication, command the first actuating element to cause movement of the first drive output, receive a feedback associated with a force experienced by the first actuating element during the movement of the first drive output, determine an instruction signal for the first actuating element based on the feedback, and transmit the instruction signal to the first actuating element.

Abstract: A tendency of an action of a robot may vary based on learning data used for training. The learning data may be generated by an agent performing an identical or similar task to a task of the robot. An apparatus and method for updating a policy for controlling an action of a robot may update the policy of the robot using a plurality of learning data sets generated by a plurality of heterogeneous agents, such that the robot may appropriately act even in an unpredicted environment.

Abstract: A user console for a surgical robotic system has a seat having an armrest and an electromagnetic (EM) transmitter coupled to the armrest to generate an EM field in an EM tracking space around the armrest. A user input device having a handheld housing is to be positioned within the EM tracking by an operator who is seated in the seat, during a surgical procedure. Other aspects are also described and claimed.

Abstract: A map updating method may include calculating a relative pose relationship between consecutive images; calculating an absolute pose of each image based on the relative pose relationship between the consecutive images; and updating a map used for visual localization (VL) based on the absolute pose.

Abstract: A method of deriving autonomous control information involves receiving one or more sets of associated environment sensor information and device control instructions. Each set of associated environment sensor information and device control instructions includes environment sensor information representing an environment associated with an operator controllable device and associated device control instructions configured to cause the operator controllable device to simulate at least one action taken by at least one operator experiencing a representation of the environment generated from the environment sensor information.

Abstract: A control device outputs an operation signal of a work equipment and a swing body for moving a work equipment to a loading point when receiving a loading command signal. The control device does not output a dumping operation signal for causing the bucket to dump earth in a case where an azimuth direction in which the swing body faces is within a first region from a starting point azimuth direction to a predetermined reference azimuth direction, the starting point azimuth direction being an azimuth direction in which the swing body faces when the loading command signal is received. The control device outputs the dumping operation signal in a case where the azimuth direction is within a second region from the reference azimuth direction to an end point azimuth direction in which the swing body faces when the work equipment is positioned at the loading point.

Abstract: A robotic surgical system includes a first automated surgical system with a first user control console; a first robotic actuator; and a first surgical system controller comprising a first processor and a first memory component configured to store a first set of processor instructions and a first set of processor data. The robotic surgical system further includes a first surgical system communication interface; and a second automated surgical system that has a second user control console; a second robotic actuator; a second surgical system controller comprising a second processor and a second memory component configured to store a second set of processor instructions and a second set of processor data; and a second surgical system communication interface in data communication with the first surgical system communication interface. The second automated surgical system is controllable through the first user control console.

Abstract: A workflow management system is described to manage tasks to be performed with vehicles. The workflow management system includes a workflow management server and a computer located in a vehicle. The workflow management server generates and sends to the computer a record that describes a task to be performed with a vehicle. The task may include collecting sensor data from one or more sensors on the vehicle, or performing a vehicle driving test using an updated operating system to be used by the vehicle. The record can include a starting location and a destination of a route on which the vehicle is to perform the task. The computer receives the record, executes an operating system of the vehicle to perform the task, determines that the task is completed, and sends to a database a record status information that indicates that the task is completed.

Abstract: A method of training a robot system for manipulation of objects, the robot system being able to perform a set of skills, wherein each skill is learned as a skill model, the method comprising: receiving physical input from a human trainer, regarding the skill to be learned by the robot; determining for the skill model a set of task parameters including determining for each task parameter of the set of task parameters if a task parameter is an attached task parameter, which is related to an object being part of said kinesthetic demonstration or if a task parameter is a free task parameter, which is not related to a physical object; obtaining data for each task parameter of the set of task parameters from the set of kinesthetic demonstrations, and training the skill model with the set of task parameters and the data obtained for each task parameter.

Abstract: A method of operating a mobile cleaning robot can include receiving a privacy mode setting from a user interface, where the privacy mode setting is based on a user selection between at least two different privacy mode settings for determining whether to operate the mobile cleaning robot in an image-capture-restricted mode. An image stream of an image capture device of the mobile cleaning robot is permitted in an absence of a user-selection of a more restrictive one of the privacy settings. At least a portion of the image stream is restricted or disabled based at least in part on a user-selection of a more restrictive one of the privacy settings.

Abstract: A substrate transport device includes an arm, an end effector coupled to the arm, a driver configured to lift the arm so that the end effector receives a substrate, and a controller configured to control an output of the driver to set a lifting speed of the arm. A difference in height between the end effector and the arm is a position difference. A period from when the end effector contacts the substrate until the end effector completes reception of the substrate is a transition period. The controller sets an upper limit value of the lifting speed that decreases an amplitude of one of acceleration or jerk of the position difference in the transition period as compared to before the transition period to an upper limit value of the lifting speed for the transition period.

Abstract: The present disclosure provides a stair climbing gait planning method and an apparatus and a robot using the same. The method includes: obtaining first visual measurement data through a visual sensor of the robot; converting the first visual measurement data to second visual measurement data; and performing a staged gait planning on a process of the robot to climb the staircase based on the second visual measurement data. Through the method, the visual measurement data is used as a reference to perform the staged gait planning on the process of the robot to climb the staircase, which greatly improves the adaptability of the robot in the complex scene of stair climbing.

Abstract: A robot system and method for conditionally stopping a robot, wherein a maximum stopping time and/or distance are defined by a user or integrator through a user interface as safety limits based on the risk assessment. The method provides the continuous calculation of the time and/or distance, which the robot would need to stop under maximum motor torque and/or brake appliance. The robot is stopped or the speed of the robot is reduced, if the calculated time and/or distance exceeds the maximum limit values set by the user or integrator. The method may also be used to program or generate the trajectories of the robot as not to exceed the speed of the movement under the condition of keeping the set maximum stopping time and/or distance as defined by a use.

Abstract: A mobility surrogate includes a humanoid form supporting at least one camera that captures image data from a first physical location in which the first mobility surrogate is disposed to produce an image signal and a mobility base. The mobility base includes a support mechanism, with the humanoid form affixed to the support on the mobility base and a transport module that includes mechanical drive mechanism and a transport control module including a processor and memory that are configured to receive control messages from a network and process the control messages to control the transport module according to the control messages received from the network.

Abstract: A robot system includes a robot that self-travels along a traveling shaft and is provided with a position detection sensor at a distal end, a support member that has a plurality of reference positions juxtaposed and supports a workpiece, a plurality of calibration members that are juxtaposed along the traveling shaft, and a control device, in which the calibration members each have a calibration position, and the control device is configured to cause the robot to move by a predetermined first distance along the traveling shaft, calibrate position coordinates of the robot based on position coordinates of the calibration positions detected by the position detection sensor, and subsequently calibrate position coordinates of the workpiece based on position coordinates of the reference positions detected by the position detection sensor.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for providing user feedback for robotic demonstration learning. One of the methods includes initiating a local demonstration learning process to collect respective local demonstration data for each of one or more demonstration subtasks defined by a skill template to be executed by a robot. Local demonstration data is repeatedly collected for each of the one or more demonstration subtasks of the skill template while a user manipulates a robot to perform each of the one or more demonstration subtasks defined by the skill template. A respective progress value for each of the one or more demonstration subtasks defined by the skill template is maintained. A user interface presentation is generated that presents a suggested demonstration to be performed by the user based on a respective progress value for each demonstration subtask.

Abstract: Setting of parameters that determine filter characteristics is facilitated. A machine learning device performs machine learning of optimizing coefficients of at least one filter provided in a servo control device that controls rotation of a motor. The filter is a filter for attenuating a specific frequency component. The coefficients of the filter are optimized on the basis of measurement information of a measurement device that measures at least one of an input/output gain and an input/output phase delay of the servo control device on the basis of an input signal of which the frequency changes and an output signal of the servo control device.

Abstract: The present teaching relates to method, system, medium, and implementation for activating an animatronic device. Information about a user is obtained for whom an animatronic device is to be configured to carry out a dialogue with the user. The animatronic device includes a head portion and a body portion and the head portion is configured based on one of a plurality of selectable head portions. One or more preferences of the user are identified from the obtained information and used to select, from the plurality of selectable head portions, a first selected head portion. A configuration of the head portion of the animatronic device is then configured based on the first selected head portion for carrying out the dialogue.

Abstract: A method of determining one or more characteristic values for an environment automatically trafficable by vehicles comprises the steps: providing a spatially resolving, electronically usable representation of the environment; providing parameters that describe properties of vehicles and of the traffic in the environment; simulating the traffic in the environment with reference to the electronically usable representation of the environment and with reference to the parameters provided; in the simulation, detecting and counting events of interest, detecting and counting events of interest, determining the characteristic values with reference to the counter result, and outputting and/or storing the characteristic value.

Abstract: Scans of a selected product on shelves of a retail store are obtained and the scans are transmitted over a network via a transceiver circuit. A perpetual inventory (PI) value is stored for a selected product in a database. A data structure includes a first category and first actions programmatically linked to the first category. When the selected product is out-of-stock and when the PI value is greater than a predetermined threshold, one or more of the first actions associated with the first category are performed.