Abstract: A method includes maneuvering a robot in (i) a following mode in which the robot is controlled to travel along a path segment adjacent an obstacle, while recording data indicative of the path segment, and (ii) in a coverage mode in which the robot is controlled to traverse an area. The method includes generating data indicative of a layout of the area, updating data indicative of a calculated robot pose based at least on odometry, and calculating a pose confidence level. The method includes, in response to the confidence level being below a confidence limit, maneuvering the robot to a suspected location of the path segment, based on the calculated robot pose and the data indicative of the layout and, in response to detecting the path segment within a distance from the suspected location, updating the data indicative of the calculated pose and/or the layout.

Abstract: Systems and methods of the present disclosure provide a control solution for a robotic actuator. The actuator can have one or two degrees of freedom of control, and can connect with a platform using an arm. The arm can have at least two degrees of freedom of control, and the platform can have at least two degrees of freedom of control. The platform can be subjected to unpredictable forces requiring a control response. The control solution can be generated using operational space control, using the degrees of freedom of the arm, platform and actuator.

Abstract: A method for tuning the force control parameters for a general robotic assembly operation. The method uses numerical optimization to evaluate different combinations of the parameters for a robot force controller in a simulation environment that is built based on a real-world robotic setup. This method performs autonomous tuning for assembly tasks based on closed loop force control simulation, where random samples from a distribution of force control parameter values are evaluated, and the optimization routine iteratively redefines the parameter distribution to find optimal values of the parameters. Each simulated assembly is evaluated using multiple simulations including random part positioning uncertainties. The performance of each simulated assembly is evaluated by the average of the simulation results, thus ensuring that the selected control parameters will perform well in most possible conditions.

Abstract: A surgical robotic system has a surgical robotic arm, and a programmed processor that determines a longest principal axis of a velocity ellipsoid for a first configuration of the arm, applies a maximum task space velocity (that is in the direction of the longest principal axis) to an inverse kinematics equation which computes a potential joint space velocity, computes a ratio of i) the potential joint space velocity and ii) a joint space velocity limit of the arm, and applies the ratio to an initial joint space velocity, to produce a regulated joint space velocity. Other aspects are also described and claimed.

Abstract: The present invention belongs to the technical field of food processing, and in particular, relates to an adaptive quantitative sub-packaging method for fried rice with multiple side dishes in a central kitchen and an apparatus therefor. The present invention mainly includes self-construction of a key side dish recognition model, self-evaluation of the key side dish recognition model, adaptive quantification of batch fried rice, and the apparatus matched with the three-step operation.

Abstract: A machine learning system is provided to enhance various aspects of machine learning models. In some aspects, a substantially photorealistic three-dimensional (3D) graphical model of an object is accessed and a set of training images of the 3D graphical mode are generated, the set of training images generated to add imperfections and degrade photorealistic quality of the training images. The set of training images are provided as training data to train an artificial neural network.

Abstract: Systems and methods to design part weld processes are disclosed. An example system for monitoring welding of components of a workpiece with multiple arc welds in a fixture includes: one or more weld sensors configured to collect data associated with the multiple arc welds; and a computing device configured to: access a weld program; provide weld instructions defined in the weld program and associated with a sequence of welds for the workpiece, the weld instructions comprising a visual slide including an image of the workpiece and a visual indication of a first location of a first weld; based on the weld program, display the visual slide at a first zoom level; based on the weld program, display the visual slide at a second zoom level; and monitor first weld data from the one or more sensors during a first weld to determine a status of the first weld.

Abstract: An exemplary method of using a virtual assistant may include receiving an unstructured natural-language user request for a service from a virtual assistant; determining whether the user request corresponds to at least one of a plurality of plan templates accessible to the virtual assistant, based on the content of the user request and the content of the plan templates; in accordance with a determination that the user request corresponds to at least one of the plurality of plan templates, selecting one of the plurality of plan templates; and in accordance with a determination the user request fails to correspond to at least one of the plurality of plan templates, foregoing selection of a plan template; and in response to selection of one of the plan templates, beginning to respond to the user request according to the selected plan template.

Abstract: A reversing assistant system for a vehicle comprising a first path memory for storing a continuously recorded current forward segment, and a second path memory for storing a recorded preceding forward segment. The system is configured to transfer the content of the first path memory to the second path memory when the vehicle resumes forward motion after reversing, and it further comprises a path merger observer configured to repeatedly assess whether the current forward segment is mergeable with the preceding forward segment and, if so, to trigger a path merging operation. The system further comprises a path merger configured to execute a path merging operation and to substitute its output into the first path memory and a drive assistance unit configured to determine drive actions causing the vehicle to reverse along a recorded forward segment or a merged segment.

Abstract: The present disclosure provides a method for realizing a dynamic running gait of a biped robot on a rough terrain road, which sets a state machine for an entire running cycle to perform a balance control and movement trajectory planning of the robot in each state. At the time that the robot switches from the in-air phase into a landing phase, a SLIP model is used to control the posture balance and landing cushion; and when the robot is stable after landing, an LIP model is used to control a center of mass of the robot to a set height. An in-air phase of the robot in running is generated through movement trajectory planning and state switching of a supporting leg and a swinging leg to realize a running of the robot.

Abstract: A mobility surrogate includes a humanoid form supporting at least one camera that captures image data from a first physical location in which the first mobility surrogate is disposed to produce an image signal and a mobility base. The mobility base includes a support mechanism, with the humanoid form affixed to the support on the mobility base and a transport module that includes mechanical drive mechanism and a transport control module including a processor and memory that are configured to receive control messages from a network and process the control messages to control the transport module according to the control messages received from the network.

Abstract: An optical transmission and reception system includes an optical transmitter including an optical modulator that optically modulates a transmission signal containing a known signal inserted at predetermined intervals and transmits it to an optical transmission line, and an optical receiver including an optical RC circuit that converts an optical modulation signal received from the optical transmission line into a complex time series signal, a photoelectric conversion element that converts the complex time series signal into an electrical intensity signal, and a digital signal processing unit that performs learning using the known signal as a teaching signal and performs demodulation, based on learning results, using the electrical intensity signal received from the photoelectric conversion element.

Abstract: A quick change end effector system for use with a robot includes a quick change end effector configured for application to a task to be completed by a robot, the quick change end effector further comprising an end effector magnet, and a robotic manipulator configured to lock to the end effector, the robotic manipulator further configured to use the end effector to complete the task, the robotic manipulator comprising a manipulator magnet, the manipulator magnet being configured to magnetically attract the end effector magnet, thereby locking the manipulator in a mechanically strong connection to the quick change end effector, wherein upon disengagement of the magnetic attraction locking the manipulator to the quick change end effector, the quick change end effector can be quickly removed from the manipulator.

Abstract: An embodiment path planning apparatus includes a sensing device configured to detect obstacles in an electronic map stored in a memory, wherein a location of a robot and a destination are marked on the electronic map, and a controller configured to independently generate a robot tree in which the location of the robot is a first root node and a destination tree in which the destination is a second root node, in consideration of the obstacles in the electronic map, to search for an initial path based on the robot tree and the destination tree, and to optimize the initial path such that a final path from the location of the robot to the destination has a shortest distance.

Abstract: Methods, systems and apparatus, including computer programs encoded on computer storage media, for training an action selection neural network. One of the methods includes receiving an observation characterizing a current state of the environment; determining a target network output for the observation by performing a look ahead search of possible future states of the environment starting from the current state until the environment reaches a possible future state that satisfies one or more termination criteria, wherein the look ahead search is guided by the neural network in accordance with current values of the network parameters; selecting an action to be performed by the agent in response to the observation using the target network output generated by performing the look ahead search; and storing, in an exploration history data store, the target network output in association with the observation for use in updating the current values of the network parameters.

Abstract: A method for controlling a robot assembly having at least one robotic arm. The method includes determining a trajectory in the axis space of the robot assembly on the basis of a path having a plurality of previously specified Cartesian poses of at least one robot-assembly-fixed reference, and determining control values in the axis space on the basis of said trajectory. The robot assembly is controlled on the basis of the control values.

Abstract: Systems and methods monitor a workspace for safety purposes using sensors distributed about the workspace. The sensors are registered with respect to each other, and this registration is monitored over time. Occluded space as well as occupied space is identified, and this mapping is frequently updated. Based on the mapping, a constrained motion plan of machinery can be generated to ensure safety.

Abstract: A teleoperational medical system comprises a teleoperational assembly including an operator control system, a first teleoperational manipulator, a first medical instrument, and a processing unit including one or more processors. The first teleoperational manipulators is configured for operation by an operator control device of the operator control system. The first teleoperational manipulator is configured to control the operation of the first medical instrument in a surgical environment. The processing unit is configured to display an image of a field of view of the surgical environment and display a menu proximate to an image of the first medical instrument in the image of the field of view. The menu includes at least one state indicator representing a state of a component of the first medical instrument.

Abstract: Implementations are provided for operably coupling multiple robot controllers to a single virtual environment, e.g., to generate training examples for training machine learning model(s). In various implementations, a virtual environment may be simulated that includes an interactive object and a plurality of robot avatars that are controlled independently and contemporaneously by a corresponding plurality of robot controllers that are external from the virtual environment. Sensor data generated from a perspective of each robot avatar of the plurality of robot avatars may be provided to a corresponding robot controller. Joint commands that cause actuation of one or more joints of each robot avatar may be received from the corresponding robot controller. Joint(s) of each robot avatar may be actuated pursuant to corresponding joint commands. The actuating may cause two or more of the robot avatars to act upon the interactive object in the virtual environment.

Abstract: A robotic system is disclosed that includes an articulated arm with an end effector. The robotic system is for use in a robotic environment requiring interaction with persons in the robotic environment, and includes a plurality of lights that are illuminated responsive to known near-future movements of the articulated arm to convey the known near-future movements of the articulated arm to the persons in the robot environment.

Abstract: Methods and apparatus for an end-of-arm tool having multiple robotic grippers, such as two or more grippers, and coordination of motion of the multiple grippers, so as to allow for automated testing and packaging of sealable bags conveyed to an inspection station.

Abstract: A robotic system to control multiple robots to perform a task cooperatively is disclosed. A first robot determines to perform a task cooperatively with a second robot, moves independently to a first grasp position to grasp an object associated with the task, receives an indication that the second robot is prepared to perform the task cooperatively, and moves the object independently of the second robot in a leader mode along a trajectory determined by the first robot. The second robot assists the first robot in performing the task cooperatively, at least in part by moving independently to a second grasp position, grasping the object, and cooperating with the first robot to move the object, at least in part by operating in a follower mode of operation to maintain engagement with the object as the first robot moves the object along the trajectory.

Abstract: Parties having different responsibilities and interests at a monitored location can be given a partial view of the totality of the sensor channels of data generated by the various sensors installed at the monitored location. The partial views deliver customized sets of data streams to customers. The selective distribution of sensor information accommodates the divergent interests and needs of parties responsible for tracking the various characteristics of a monitored location.

Abstract: Methods and systems are described that enable radar detection prioritization based on downstream feedback. As a vehicle is traveling in a travel corridor, radar detections are received by a processor and feedback related to a downstream function is received from another processor that is executing the downstream function. For the radar detections that are determined to be within the travel corridor, respective priorities are assigned based on locations of the radar detections and the feedback related to the downstream function. The radar detections with the assigned priorities are then stored in a detection buffer along with indications of their respective assigned priorities. In this way, the detection buffer may be optimized for the downstream function by filtering out certain detections and prioritizing others. Consequently, computational loads on the downstream function are reduced while ensuring that important detections are received by the downstream function early.

Abstract: A method is provided for providing process protocols for processes carried out by a number of physical devices. A sensor assigned to a physical device detects measured values. Time stamps are assigned to the detected measured values, and the process protocol is generated from the measured values detected by the sensor, from an assignment of the detected measured values to the sensor and/or to the at least one device, and from the time stamp assigned to the measured values. The process protocol has a number of data sets, and each data set of the process protocol has a first attribute, where a unique identification of a process is stored and by which the process step is assigned to the process, a second attribute, where an identification of the process step is stored, and a third attribute, where a sequence of the process steps within a process is stored.

Abstract: A robot system includes a robot configured to perform a work to a workpiece, and a user interface configured to remotely manipulate the robot. The robot includes a robotic arm, a robot hand attached to the robotic arm and configured to perform the work to the workpiece, and an acceleration sensor attached to the robot hand. The robot system further includes a speaker configured to output an acceleration signal from the acceleration sensor as perceptual information.

Abstract: A method for improving a cycle time of a process of a product is provided. The method includes: collecting process profile data from a plurality of tool groups running the process, and calculating values of a plurality of key-performance-indicators (KPIs) of each tool group including calculating a standard deviation of an output of a stage of a bottleneck tool group of the tool groups; feeding the values of the KPIs and a work-in-progress (WIP) of each tool group into a neural network model in order to output an impact on the WIP for each KPI of each tool group by the neural network model; selecting a set of major KPIs of each tool group from the KPIs according to the impact of each tool group; and controlling the tool groups according to the impact of the set of major KPIs of each tool group in order to reduce a total WIP.

Abstract: Provided is a tangible, non-transitory, machine readable medium storing instructions that when executed by one or more processors of a robotic device effectuate operations including capturing, with a camera of the robotic device, spatial data of surroundings of the robotic device; generating, with the one or more processors of the robotic device, a movement path based on the spatial data of the surroundings; capturing, with at least one sensor of the robotic device, at least one measurement relative to the surroundings of the robotic device; obtaining, with the one or more processors of the robotic device, the at least one measurement; and inferring, with the one or more processors of the robotic device, a location of the robotic device based on the at least one measurement.

Abstract: Apparatuses, systems, and techniques determine a set of grasp poses that would allow a robot to successfully grasp an object that is proximate to at least one additional object. In at least one embodiment, the set of grasp poses is modified based on a determination that at least one of the grasp poses in the set of grasp poses would interfere with at least one additional object that is proximate to the object.

Abstract: A method of operating a robot including a vacuum port for engaging an item, e.g. a wafer, is disclosed. The method includes operating, by a computer system, the robot in a first state, detecting using a vacuum sensor, a transition of a vacuum parameter from a first vacuum parameter zone to a second parameter zone in a plurality of vacuum parameter zones. Based on detecting the transition of the vacuum parameter from the first vacuum parameter zone to the second vacuum parameter zone, the operating state of the robot is altered from the first state to a second state. Also disclosed is an item transfer robot as part of an item transfer system.

Abstract: An autonomous device and method for controlling an autonomous device are disclosed. The autonomous device is configured for performing at least one task, selected from a household task, a commercial task and an industrial task. The autonomous device comprises at least one spatial sensor for generating location information and at least one further sensor for determining at least one further parameter. The autonomous device further comprises at least one task unit arranged to perform the household and/or commercial and/or industrial task, and at least one electronics unit, wherein the electronics unit is configured to generate a map using the location information, wherein the electronics unit further is configured for connecting the further parameter to the location information and adding the location of the further parameter to the map, thereby creating a parameter map containing location-correlated values of the at least one further parameter.

Abstract: A method for controlling an autonomous mobile robot for carrying out a task in a local region of an area of application of the robot. According to one embodiment, the method comprises the following steps: positioning the robot in starting position within the area of application of the robot; detecting information relating to the surroundings of the robot by means of at least one sensor; selecting a region with a determined geometric basic shape; and automatically determining, based on the detected information relating to the surroundings, at least one of the two following parameters: size and position (also including the orientation/alignment) of the selected region.

Abstract: Training and/or using a recurrent neural network model for visual servoing of an end effector of a robot. In visual servoing, the model can be utilized to generate, at each of a plurality of time steps, an action prediction that represents a prediction of how the end effector should be moved to cause the end effector to move toward a target object. The model can be viewpoint invariant in that it can be utilized across a variety of robots having vision components at a variety of viewpoints and/or can be utilized for a single robot even when a viewpoint, of a vision component of the robot, is drastically altered. Moreover, the model can be trained based on a large quantity of simulated data that is based on simulator(s) performing simulated episode(s) in view of the model. One or more portions of the model can be further trained based on a relatively smaller quantity of real training data.

Abstract: A cleaning robot including: a main body; a drive device; and a cleaning device equipped for wet-cleaning floors to be cleaned, wherein: the main body, on the side facing the floor to be cleaned, is assigned a receptacle unit, a first mop pad configured for wet-cleaning is fastened to the receptacle unit, and the cleaning robot is configured to autonomously exchange the first mop pad fastened to the receptacle unit for a second mop pad.

Abstract: Asynchronous robotic control utilizing a trained critic network. During performance of a robotic task based on a sequence of robotic actions determined utilizing the critic network, a corresponding next robotic action of the sequence is determined while a corresponding previous robotic action of the sequence is still being implemented. Optionally, the next robotic action can be fully determined and/or can begin to be implemented before implementation of the previous robotic action is completed. In determining the next robotic action, most recently selected robotic action data is processed using the critic network, where such data conveys information about the previous robotic action that is still being implemented. Some implementations additionally or alternatively relate to determining when to implement a robotic action that is determined in an asynchronous manner.

Abstract: A self-learning intelligent driving device including: a first neural network module for performing a corresponding action evaluation operation on an input image to generate at least one set of trajectory coordinates: a switching unit controlled by a switching signal, where when the switching signal is active, data received at a first port is sent to a second port, and when the switching signal is inactive, data received at the first port is sent to a third port; a second neural network module for performing a corresponding image evaluation operation on the at least one set of trajectory coordinates when the switching signal is active to generate at least one simulated trajectory image; and a driving unit having a robotic arm for generating at least one corresponding motion trajectory according to the at least one set of trajectory coordinates when the switching signal is inactive.

Abstract: Provided is a method including emitting, with a laser light emitter disposed on a robot, a collimated laser beam projecting a light point on a surface opposite the laser light emitter; capturing, with each of at least two image sensors disposed on the robot, images of the projected light point; overlaying, with a processor of the robot, the images captured by the at least two image sensors to produce a superimposed image showing both captured images in a single image; determining, with the processor of the robot, a first distance between the projected light points in the superimposed image; and determining, with the processor, a second distance based on the first distance using a relationship that relates distance between light points with distance between the robot or a sensor thereof and the surface on which the collimated laser beam is projected.

Abstract: A cleaning system is provided. The cleaning system includes a robot cleaner and a station. The robot cleaner includes a pad fixing part on which a cleaning pad is detachably mounted, a lifter to lift a part of the robot cleaner at which the pad fixing part is positioned, and a pad detacher to detach the cleaning pad mounted on the pad fixing part. The station includes a pad storage box in which a cleaning pad that is to be provided to the robot cleaner is stored, a pad coupling part on which a cleaning pad that is to be coupled to the robot cleaner is rested, and a pad supplier to supply the cleaning pad stored in the pad storage box to the pad coupling part.

Abstract: An example method may include i) detecting a disturbance to a gait of a robot, where the gait includes a swing state and a step down state, the swing state including a target swing trajectory for a foot of the robot, and where the target swing trajectory includes a beginning and an end; and ii) based on the detected disturbance, causing the foot of the robot to enter the step down state before the foot reaches the end of the target swing trajectory.

Abstract: An example implementation for determining mechanically-timed footsteps may involve a robot having a first foot in contact with a ground surface and a second foot not in contact with the ground surface. The robot may determine a position of its center of mass and center of mass velocity, and based on these, determine a capture point for the robot. The robot may also determine a threshold position for the capture point, where the threshold position is based on a target trajectory for the capture point after the second foot contacts the ground surface. The robot may determine that the capture point has reached this threshold position and based on this determination, and cause the second foot to contact the ground surface.

Abstract: Provided is a tangible, non-transitory, machine readable medium storing instructions that when executed by a processor of a robot effectuates operations including: capturing, with at least one sensor, first data used in indicating a position of the robot; capturing, with at least one sensor, second data indicative of movement of the robot; recognizing, with the processor of the robot, a first area of the workspace based on at least one of: a first part of the first data and a first part of the second data; generating, with the processor of the robot, a first movement path covering at least part of the first recognized area; actuating, with the processor of the robot, the robot to move along the first movement path; and generating, with the processor of the robot, a map of the workspace based on at least one of: the first data and the second data.

Abstract: A method for controlling a robot includes applying a setpoint force to a contact point; measuring a contact stiffness at the contact point; and slowing down the moving robot using its drives and/or braking the robot to apply the setpoint force to the contact point by the slowing down and/or slowed down robot depending on the measured contact stiffness, wherein the robot is slowed down before the setpoint force is reached.

Abstract: A computing device performs computation for controlling operations of a mobile manipulator configured to hold a plurality of target objects with a manipulator and move the target objects to predetermined positions. The computing device includes a storage and a calculator. The storage stores a trained machine learning model trained by inputting a plurality of training data sets, which are combinations of state variables and pieces of determination data associated with the state variables. The training data sets are acquired in advance. The calculator outputs a movement-target object to be moved to a predetermined position at current time by inputting the state variable to the trained machine learning model read from the storage. The state variable contains relative positions of the target objects to a specific portion of the mobile manipulator. The determination data associated with the state variable represents the movement-target object.

Abstract: The present disclosure is provides a method, an apparatus and a terminal device for constructing parts together. The method includes: determining an assembly progress of an object constructed of parts; determining a currently required part according to the assembly progress; identifying, in a part photo of the object, the currently required part using a pre-trained first neural network model and marking the one or more identified currently required parts in the part photo; and displaying, via a display, a 3D demonstration animation with the marked part photo as a background image. The method is based on the existing 3D demonstration animation, which identifies the currently required part in the captured part photo and marks the identified currently required part in the part photo, and then displays the marked part photo as the background image of the 3D demonstration animation, thereby adding a prompt for the real part.

Abstract: A medical system includes a control system and an instrument manipulator. The instrument manipulator is configured to receive an instrument and includes a first drive output and a first actuating element configured to drive movement of the first drive output. The first drive output is configured to drive a first input coupling of the instrument. The control system is configured to receive an indication that the first input coupling of the instrument is positioned adjacent to the first drive output of the manipulator, in response to receiving the indication, command the first actuating element to cause movement of the first drive output, receive a feedback associated with a force experienced by the first actuating element during the movement of the first drive output, determine an instruction signal for the first actuating element based on the feedback, and transmit the instruction signal to the first actuating element.

Abstract: A tendency of an action of a robot may vary based on learning data used for training. The learning data may be generated by an agent performing an identical or similar task to a task of the robot. An apparatus and method for updating a policy for controlling an action of a robot may update the policy of the robot using a plurality of learning data sets generated by a plurality of heterogeneous agents, such that the robot may appropriately act even in an unpredicted environment.

Abstract: The present disclosure discloses a navigation map updating method as well as an apparatus, and a robot using the same. The method includes: controlling a robot to move along a designated path after a successful relocalization of the robot, and recording key frame data of each frame on the designated path and a corresponding pose; creating a new navigation map, and copying information in an original navigation map into the new navigation map; and covering the key frame data of each frame on the designated path onto the new navigation map to obtain an updated navigation map. In this manner, there is no need for the user to manipulate the robot to recreate the map at the environment where the robot is operated, which saves a lot of time and manpower.

Abstract: A method of deriving autonomous control information involves receiving one or more sets of associated environment sensor information and device control instructions. Each set of associated environment sensor information and device control instructions includes environment sensor information representing an environment associated with an operator controllable device and associated device control instructions configured to cause the operator controllable device to simulate at least one action taken by at least one operator experiencing a representation of the environment generated from the environment sensor information.

Abstract: A map updating method may include calculating a relative pose relationship between consecutive images; calculating an absolute pose of each image based on the relative pose relationship between the consecutive images; and updating a map used for visual localization (VL) based on the absolute pose.

Abstract: A user console for a surgical robotic system has a seat having an armrest and an electromagnetic (EM) transmitter coupled to the armrest to generate an EM field in an EM tracking space around the armrest. A user input device having a handheld housing is to be positioned within the EM tracking by an operator who is seated in the seat, during a surgical procedure. Other aspects are also described and claimed.