Abstract: A metallurgical technology probe insertion calibration method employing visual measurement and an insertion system thereof are provided. A vision sensor (5), a cylindrical rod (1), and a metallurgical technology probe (2) are used to construct an agreed region (6). In the agreed region (6), the vision sensor (5) acquires relative positions and orientations of the cylindrical rod (1) and the metallurgical technology probe (2), and an acquired position and orientation result is used to control a driving device (3) to insert the cylindrical rod (1) into the metallurgical technology probe (2). To improve the accuracy and reliability of the insertion, a standard probe (7) and a fixing device (4) are used together to perform effective calibration on an initial position, orientation, and axis in the insertion.

Abstract: Grasping remains a complex topic for simulation. Embodiments provide a method to automatically determine grasping cues for tools. An example embodiment scans a CAD model representing a real-world tool to generate a series of sections from the CAD model. In turn, properties of each section are extracted and one or more regions of the CAD model are identified based upon the extracted properties and a tool family to which the tool represented by the CAD model belongs. To continue, a respective classification for each of the one or more identified regions is identified and grasping cues for the CAD model are generated based upon the determined respective classification for each of the one or more regions.

Abstract: A substrate transport apparatus including a transport chamber, a drive section, a robot arm having an end effector at a distal end configured to support a substrate and being connected to the drive section generating at least arm motion in a radial direction extending and retracting the arm, an imaging system with a camera mounted in a predetermined location to image at least part of the robot arm, and a controller connected to the imaging system to image the arm moving to a predetermined repeatable position, the controller effecting capture of a first image of the robot arm proximate to the repeatable position decoupled from encoder data of the drive axis, wherein the controller calculates a positional variance of the robot arm from comparison of the first image with a calibration image, and from the positional variance determines a motion compensation factor changing the extended position of the robot arm.

Abstract: A system includes a memory storing computer-readable instructions and at least one processor to execute the instructions to receive a shot sheet comprising data and metadata associated with an animation project, parse the shot sheet to generate instructions associated with at least one shot in the animation project, send the instructions to an animation program using an application programming interface (API), generate the animation project based on the instructions using the animation program, render the animation project into a video, and store the video in a database and generate a uniform resource locator (URL) for the video.

Abstract: A LIDAR system includes a laser emitter configured to emit a laser pulse in a sample direction of a sample area of a scene. A sensor element of the LIDAR system is configured to sense a return pulse, which is a reflection from the sample area corresponding to the emitted laser pulse. The LIDAR system may compare a width of the emitted laser pulse to a width of the return pulse in the time-domain. The comparison of the width of the emitted pulse to the width of the return pulse may be used to determine an orientation or surface normal of the sample area relative to the sample direction. Such a comparison leads to a measurement of the change of pulse width, referred to as pulse broadening or pulse stretching, from the emitted pulse to the return pulse.

Abstract: Traditionally, robots may learn to perform tasks by observation in clean or sterile environments. However, robots are unable to accurately learn tasks by observation in real environments (e.g., cluttered, noisy, chaotic environments). Methods and systems are provided for teaching robots to learn tasks in real environments based on input (e.g., verbal or textual cues). In particular, a verbal-based Focus-of-Attention (FOA) model receives input, parses the input to recognize at least a task and a target object name. This information is used to spatio-temporally filter a demonstration of the task to allow the robot to focus on the target object and movements associated with the target object within a real environment. In this way, using the verbal-based FOA, a robot is able to recognize “where and when” to pay attention to the demonstration of the task, thereby enabling the robot to learn the task by observation in a real environment.

Abstract: One embodiment provides a robotic system comprising: a robot, the robot further comprising a moveable robotic arm that moves within the robot's reference space; a depth-sensing camera, the camera having a reference frame that is in substantial view of the robot's reference space; a controller, the controller further comprising a processor and a computer readable memory that comprises instructions such that, when read by the controller, the controller inputs image data from the camera and sends signals to the moveable robotic arm, the instructions further comprising the steps of: calibrating the camera to the robot by instructing the robot to engage in a number of robot poses; extracting the location of the robot poses to obtain the robot poses in the camera reference frame; and creating a transformation that transforms robot points afterwards to camera points.

Abstract: A robot controller configured to assist an operation of a user, by effectively utilizing both techniques of augmented reality and mixed reality. The robot controller includes: a display device configured to display information generated by a computer so that the information is overlapped with an actual environment, etc.; a position and orientation obtaining section configured to obtain relative position and orientation between the display device and a robot included in the actual environment; a display controlling section configured to display a virtual model of the robot, etc., on the display device; an operation controlling section configured to operate the virtual model displayed on the display device; and a position and orientation determining section configured to determine the position and/or orientation of the robot by using the position and/or orientation of the operated virtual model and using the relative position and orientation between the robot and the display device.

Abstract: A surface evaluation system that includes one or more vision systems that generate target surface data during evaluation of a surface, the one or more vision systems comprising two or more of: at least one light, a camera, a structured light camera, a laser scanner and a 3D scanner.

Abstract: A robotic vehicle may include one or more functional components configured to execute lawn care function, a sensor network comprising one or more sensors configured to detect conditions proximate to the robotic vehicle, a positioning module configured to determine robotic vehicle position while the robotic vehicle traverses a parcel, and a boundary management module configured to enable the robotic vehicle to be operated within a bounded area. The bounded area may include a variable boundary, and the boundary management module may be configured to receive instructions from an operator to adjust the variable boundary.

Abstract: A workpiece picking device includes a sensor that measures the workpieces, a hand that grasps the workpieces, a robot that moves the hand, and a control device thereof. The control device has a position orientation calculation part that calculates position, orientation and the like of the workpieces, a grasping orientation calculation part that calculates a grasping orientation of the workpieces by the hand, a route calculation part that calculates a route through which the hand moves to the grasping orientation, a sensor control part, a hand control part, a robot control part, a situation determination part that determines the situation of the workpieces on the basis of measurement result or the like of the three-dimensional position, and a parameter modification part that modifies at least one of a measurement parameter and various calculation parameters, when the determination result of the situations of the workpieces satisfies a predetermined condition.

Abstract: Described herein are systems, devices, and methods for controlling a mobile cleaning robot to escape from a stuck state using a learned robot escape behavior model. The model is trained using reinforcement learning at a cloud-computing device or networked devices. A mobile cleaning robot comprises a drive system, a sensor circuit to collect sensor data associated with a detected stuck state, and a controller circuit that can receive the trained robot escape behavior model, and apply the sensor data associated with the detected stuck state to the trained robot escape behavior model to determine an escape policy. The drive system or one or more actuators of the mobile robot can remove the mobile robot from the stuck state according to the determined escape policy.

Abstract: Systems and methods are provided for acquiring images of objects. Light of different types (e.g., different polarization orientations) can be directed onto an object from different respective directions (e.g., from different sides of the object). A single image acquisition can be executed in order to acquire different sub-images corresponding to the different light types. An image of a surface of the object, including representation of surface features of the surface, can be generated based on the sub-images.

Abstract: A robot control apparatus includes a controller to control operation of a robot, a storage to store operation logs with different preservation periods for the operation of the robot, a collector to, when a specific event occurs, select and collect an information element corresponding to a type of the event from the operation logs, a record generate to create a record from the information element collected by the collector, and a record preserver to preserve the record.

Abstract: There is provided a method for picking up an object from a bin to be implemented by a robotic arm including a controller and a picking-up module. The method includes: recognizing, by the controller, at least one object in the bin based on an image of an interior of the bin so as to determine a type of each object; determining, by the controller, a score for each object based on the type thereof; determining, by the controller, whether a greatest score among the score(s) of the at least one TBT object is greater than a predetermined value; and by the picking-up module, picking up one of the at least one TBT object that has the greatest score when it is determined that the greatest score is greater than the predetermined value.

Abstract: A robotic device management service obtains, from a client device operating in a first network, a request to obtain data from a robotic device operating in a second network. In response to the request, the robotic device management service issues a token to the client device that can be provided in future queries to obtain the data. The robotic device management service provides parameters of the request to the robotic device to cause the robotic device to generate and provide the data to the robotic device management service. In response to another request to obtain the data, where the other request includes the token, the robotic device management service queries a database to determine whether the data is available from a storage location of the service. If the data is available, the service provides the data to the client device to fulfill the other request.

Abstract: A machine integrated positioning system shows an operator where to place a raw part in the press brake or other machinery. Further, the operator is informed if the dimensions associated with the raw part are, or are not, correct to produce the planned finished part. The operator is visually shown how the raw part is to be oriented. The operator is informed if the raw part is right-side-up, along with other pre-final placement information. If these and other conditions are not met, the machine integrated positioning system may prevent the press brake and other machinery from cycling.

Abstract: A virtual reality system providing a virtual robotic surgical environment, and methods for using the virtual reality system, are described herein. Within the virtual reality system, various user modes enable different kinds of interactions between a user and the virtual robotic surgical environment. For example, one variation of a method for facilitating navigation of a virtual robotic surgical environment includes displaying a first-person perspective view of the virtual robotic surgical environment from a first vantage point, displaying a first window view of the virtual robotic surgical environment from a second vantage point and displaying a second window view of the virtual robotic surgical environment from a third vantage point. Additionally, in response to a user input associating the first and second window views, a trajectory between the second and third vantage points can be generated sequentially linking the first and second window views.

Abstract: A method for controlling a robotic device is presented. The method includes positioning the robotic device within a task environment. The method also includes mapping descriptors of a task image of a scene in the task environment to a teaching image of a teaching environment. The method further includes defining a relative transform between the task image and the teaching image based on the mapping. Furthermore, the method includes updating parameters of a set of parameterized behaviors based on the relative transform to perform a task corresponding to the teaching image.

Abstract: A robot programming system according to an aspect of the present disclosure includes: a robot program storage section; a press program storage section; a template program setting section that causes the robot program storage section to store, as an initial version of a robot program, a template program that instructs a robot how to move basically; a model placing section that places three-dimensional models of a workpiece, the robot, and a press machine in a virtual space; a robot movement processing section that causes the three-dimensional model of the robot to move; a press movement processing section that causes the three-dimensional model of the press machine to move; an interference detection section that detects interference between the three-dimensional models; and a robot program modification section that modifies a robot program stored in the robot program storage section to prevent interference detected by the interference detection section.

Abstract: Deep machine learning methods and apparatus related to manipulation of an object by an end effector of a robot. Some implementations relate to training a deep neural network to predict a measure that candidate motion data for an end effector of a robot will result in a successful grasp of one or more objects by the end effector. Some implementations are directed to utilization of the trained deep neural network to servo a grasping end effector of a robot to achieve a successful grasp of an object by the grasping end effector. For example, the trained deep neural network may be utilized in the iterative updating of motion control commands for one or more actuators of a robot that control the pose of a grasping end effector of the robot, and to determine when to generate grasping control commands to effectuate an attempted grasp by the grasping end effector.

Abstract: A vehicle control device includes a communication unit configured to be communicable with an autonomous driving vehicle that autonomously travels, a determination unit configured to determine whether there is a possibility that communication between the autonomous driving vehicle and the vehicle control device is disconnected, based on information indicating a communication status between the autonomous driving vehicle and the vehicle control device, and a travel instruction unit configured to transmit, when there is the possibility that the communication between the autonomous driving vehicle and the vehicle control device is disconnected, a travel instruction to the autonomous driving vehicle via the communication unit before the communication between the autonomous driving vehicle and the vehicle control device is disconnected. The travel instruction matches conditions associated with travel control of the autonomous driving vehicle.

Abstract: According to an embodiment, an article posture changing device includes: a first end effector configured to grasp a projected tag of an article by adsorption; an arm unit configured to support the first end effector and move the first end effector along at least a vertical direction; and a controller configured to control the arm unit and the first end effector to grasp the tag, lift the article upward, separate the article from a placement surface, change an angle of the article by weight thereof, move the article downward, place the article on the placement surface, and release the grasp of the tag.

Abstract: An information processing device includes processing circuitry. The processing circuitry obtain target information that indicates at least one of a distance to a target object or a position of the target object. The processing circuitry generate, based on the target information, map information of a space including a plurality of areas, the map information indicating presence or absence of the target object in a first area included in the plurality of areas, and a detailed position of the target object in the first area.

Abstract: A dirtiness level determining method applied to an electronic device comprising an image sensor. The method comprises: (a) capturing a first image at a first time point according to first type of light; (b) capturing a second image at a second time point after the first time point according to the first type of light; (c) calculating a first fixed pattern according to a first difference between the first image and the second image; and (d) calculating a first dirtiness level of the image sensor according to the first fixed pattern; (e) generating a first notifying message if the first dirtiness level is higher than a dirtiness threshold.

Abstract: The present disclosure provides a method and an apparatus for controlling a robot, a method and an apparatus for providing service and an electronic device. The method comprises: creating, by a local robot, a file system snapshot of an application in a local operating system, and synchronizing file system data of the application to a cloud robot; running, by the cloud robot, on a cloud virtual machine pre-running the same operating system as that of the local robot, the same application as that of the local robot (101); and reversely synchronizing a running result of the application to the local robot (102).

Abstract: A method to adjust the height of a display is provided. One terminal of the telescopic trolley is connected to a first surface of the display and is separated from the lower edge of the display by a first distance. The lower edge of the display is away from the ground by a second distance. The method includes: obtaining a first height value indicating a user's height, an eye height or a shoulder height, searching for a second height value corresponding to the first height value in the look-up table according to the first height value, calculating the sum of the first distance and the second distance, comparing the sum with the second height value to obtain a comparison result, and adjusting the length of the telescopic trolley according to the comparison result, so that the sum is equal to the second height value.

Abstract: Provided is a method for the computerized control of an end element of a machine tool. The method includes a method step of sensing a plurality of optical markers in a work environment of the machine tool by means of an optical measuring system. The method includes a method step of determining a first relative pose between the end element and a workpiece on the basis of the plurality of sensed optical markers. The method includes a method step of determining a first correction value on the basis of a comparison of the first relative pose with a reference pose. The method includes a method step of controlling the end element for machining the workpiece taking the first correction value into consideration.

Abstract: A communication robot includes: an operation part; and a communication arbitration unit configured to exhibit a robot mode for autonomously operating the operation part by applying a first operational criterion and an avatar mode for operating the operation part based on an operation instruction sent from a remote operator by applying a second operational criterion to arbitrate communication among three parties, that is, the robot mode, the avatar mode, and a service user.

Abstract: There is provided a method and an apparatus for controlling a robot arm. In this control scheme, a position error indicating a deviation between a command position, which is a control target position, and a current position, which is a position where the arm of the robot is currently located, is acquired. When the acquired position error exceeds a threshold, a new corrected command position between the current position and the command position is set. After the arm of the robot is moved to the corrected command position, a new corrected command position reset between the corrected command position serving as a new current position and the command position. Reconfiguration of a corrected command position is iterated until a current position of the robot arm becomes equal to the command position so that movement of the robot arm is achieved from the current position to the command position.

Abstract: A communication robot includes: an operation part; and a communication arbitration unit configured to exhibit one of a robot mode for autonomously operating the operation part by applying a first operational criterion and an avatar mode for operating the operation part based on an operation instruction sent from a remote operator by applying a second operational criterion to arbitrate communication with a service user, in which the communication arbitration unit operates, when it is intended to exhibit the avatar mode in accordance with an operation request from the remote operator, the operation part in the robot mode and asks the service user whether to allow the mode to be switched to the avatar mode.

Abstract: An article transfer apparatus includes a holding portion, a driving portion that moves the holding portion, a control unit, and a reference detection portion that detects a reference position of a target article held by the holding portion. The control unit performs reference detection control to detect, by the reference detection portion, the reference position in a state in which the target article is lifted, determination control to determine a positional relationship between the holding portion and the reference position based on a result of detection by the reference detection control, and position calculation control to calculate, based on the positional relationship determined by the determination control, a movement destination position that is a position, of the holding portion at the movement destination, at which an outer edge of the target article held by the holding portion fits within a movement region.

Abstract: Provided is provide a robotic device, including: a chassis; a set of wheels; a control system; a battery; one or more sensors; a processor; a tangible, non-transitory, machine readable medium storing instructions that when executed by the processor effectuates operations including: capturing, with the one or more sensors, data of an environment of the robotic device and data indicative of movement of the robotic device; generating or updating, with the processor, a map of the environment based on at least a portion of the captured data; inferring, with the one or more processors of the robotic device, a current location of the robotic device, and generating or updating, with the processor, a movement path of the robotic device based on at least the map of the environment, at least a portion of the captured data, and the inferred current location of the robotic device.

Abstract: In some embodiments, a hand controller apparatus for controlling a tool in a robotic surgery system can include a body including a proximal end and a distally located interface end configured to be coupled to an input apparatus configured to control a surgical tool. The hand controller apparatus can include a control lever attached to a pivot joint proximate a side surface of the body and extending along the body and away from the proximal end, the control lever being laterally moveable relative to the side surface of the body about the pivot joint. The control lever can include a tail region adjacent to the pivot joint and a paddle region connected to the tail region and extending toward the distally located interface end. The tail region can include an inner surface facing the body and an outer surface opposing the inner surface, and at least part of the outer surface of the tail region can be outwardly curved.

Abstract: The present document relates to a user intention-based gesture recognition method and apparatus, and an electronic device comprises one or more sensors, a memory, and a processor, wherein the processor can be configured to check a distance between the electronic device and the user by using the one or more sensors, detect a user gesture by operating in a first gesture mode on the basis of the checked distance satisfying a designated range by using the one or more sensors, detect the user gesture by operating in a second gesture mode on the basis of the checked distance deviating from the designated range, and perform an operation corresponding to a valid gesture on the basis of the detected gesture being a valid gesture. Other various embodiments are possible.

Abstract: Provided is a movement robot configured so that various types of operation can be executed according to motion of other objects or a movement body and a utilization area can be expanded accordingly. The movement robot includes a robot body 1, a control unit 2, a traveling unit 3, and a detection unit 4.

Abstract: A teaching apparatus includes circuitry. The circuitry is configured to obtain result information corresponding to a position of a worked region on a workpiece. The circuitry is configured to generate first teaching information based on the result information. The first teaching information specifies a motion of an examination robot configured to examine the workpiece that has undergone work.

Abstract: Embodiments described herein relate to systems and methods for manipulating the position and/or orientation of an object while it is held in a robotic gripper. In one such embodiment, one or more physically possible and stable displacements for moving an object relative to a gripper using one or more frictional pushes may be determined and applied to the object to move the object from a first position and orientation to a second position and orientation while the object is held by the gripper. In certain embodiments, the physically possible and stable displacements may be determined using an appropriate motion cone approximation.

Abstract: A method and system for calibration of an augmented reality (AR) device's position and orientation based on a robot's positional configuration. A conventional visual calibration target is not required for AR device calibration. Instead, the robot itself, in any pose, is used as a three dimensional (3D) calibration target. The AR system is provided with a CAD model of the entire robot to use as a reference frame, and 3D models of the individual robot arms are combined into a single object model based on joint positions known from the robot controller. The 3D surface model of the entire robot in the current pose is then used for visual calibration of the AR system by analyzing images from the AR device camera in comparison to the surface model of the robot in the current pose. The technique is applicable to initial AR device calibration and to ongoing device tracking.

Abstract: An operating system according to an embodiment includes a target surface detection unit, a position calculation unit, a direction calculation unit, and a movement control unit. The target surface detection unit detects a target surface of a target object from a depth image obtained by a depth sensor. The position calculation unit calculates a first position for the detected target surface. The direction calculation unit calculates a first direction for the detected target surface. The movement control unit controls an actuator so as to reduce a positional deviation between a second position fixed with respect to the movable member and the first position and to reduce a directional deviation between a second direction fixed with respect to the movable member and the first direction.

Abstract: In a method for training a first neural network a superposed classification is back-propagated through a second neural network. An output value of the second neural network is utilized to determine whether the input of the first neural network is adversarial.

Abstract: According to an embodiment of the present disclosure, a robot comprises: a case configured to form an external shape; a front cover configured to cover an internal space of the case on a front of the case; a projector arranged in the internal space and configured to project an image or a video to a display region of the front cover; a head display arranged in an opening formed at the front cover, and including a display; and a controller configured to output a visual content via at least one of the projector or the display, wherein the display region surrounds at least a portion around the opening.

Abstract: A coordinate measuring machine has a measurement head having a point measurement device which measures first coordinates of only a single point on the surface of a workpiece at a given time. An area measurement device records images of a reference surface. A displacement device displaces the measurement head and/or the workpiece such that they assume different relative positions with respect to one another. An evaluation device calculates a shift between images that the area measurement device has recorded of the reference surface at different times at different relative positions, with a stitching algorithm. Based on this, second coordinates of the measurement head, which are defined relative to the reference surface, are determined. By linking the first coordinates with the second coordinates, third coordinates are determined, which define the points on the surface of the workpiece measured by the point measurement device relative to the reference surface.

Abstract: The purpose of the invention is to provide a method for charging a robot and apparatus thereof. The invention according to the environment map and robot self-positioning information which is the position and orientation of the robot in the environment map, moves the robot to a position near a potential or registered charging pile; uses acquisition apparatuses such as laser to carry out line extraction of the structural data of the identification when the robot moves to short-range pile-searching connecting area, and combines with the preset structural data of the identification template, to carry out the recognition of the charging pile, after the collected structural data of the identification and the structural data of the identification template satisfy the preset matching degree, then the charging pile can be connected to the robot for charging.

Abstract: A simulation device according to the present disclosure includes: a model arrangement unit which arranges three-dimensional models of a feeder, a robot and a receiving device in virtual space; a workpiece supply unit which arranges the three-dimensional model of the workpiece on the conveyor surface; and a robot operation control unit which causes the robot to operate so as to move the workpiece on the conveyor surface to over the receiving surface, in which the workpiece supply unit includes: a reference position calculation part which calculates a position and orientation of the workpiece to be newly arranged, according to set conditions; a workpiece area setting part which sets a workpiece area occupied by the workpiece; an interference area setting part which sets an interference area adjacent to the workpiece area; a display control part which displays a screen indicating the workpiece area and the interference area; and a supply position adjustment part which adjusts a relative position of the workpiece

Abstract: A robot system according to the present invention comprises a control apparatus for controlling a robot, and a video display apparatus connected to the control apparatus. The video display apparatus comprises a display unit which displays an image of a real space containing the robot, in real time as the image is taken by a camera, and an augmented reality image processing unit which causes a virtual image of an end effector or robot peripheral equipment of the robot to be displayed on the display unit in superimposed fashion on a real image of the robot taken by the camera. According to the robot system, even when the end effector or the robot peripheral equipment is not present, a robot teaching task can be performed by assuming that they are present.

Abstract: A calibration system for robot tool including a robot arm adopting a first coordinate system, a tool arranged on a flange of the robot arm, and an imaging device adopting a second coordinate system is disclosed, wherein an image sensing area is established by the image device. A calibration method is also disclosed and includes steps of: controlling the robot arm to move for leading a tool working point (TWP) of the tool enters the image sensing area; recording a current gesture of the robot arm as well as a specific coordinate of the TWP currently in the second coordinate system; obtaining a transformation matrix previously established for describing a relationship between the first and the second coordinate systems; and importing the specific coordinate and the current gesture to the transformation matrix for calculating an absolute position of the TWP in the first coordinate system.

Abstract: A gripping system includes a hand that grips a workpiece, a robot that supports the hand and changes at least one of a position and a posture of the hand, and an image sensor that acquires image information from a viewpoint interlocked with at least one of the position and the posture of the hand. Additionally, the gripping system includes a construction module that constructs a model by machine learning based on collection data. The model corresponds to at least a part of a process of specifying an operation command of the robot based on the image information acquired by the image sensor and hand position information representing at least one of the position and the posture of the hand. An operation module executes the operation command of the robot based on the image information, the hand position information, and the model, and a robot control module operates the robot based on the operation command of the robot operated by the operation module.

Abstract: An ADV includes a method to combine data from multiple sensors. The method compresses video data from a camera to generate compressed video data. The compressed video data are segmented. The method time synchronizes each segment of the compressed video data with data from other sensors. The method then combines each segment of the compressed video data with the corresponding time-synchronized sensor data for the other sensors. In one embodiment, each segment of the compressed video data is independently decodable. In another embodiment, each segment of the compressed video data includes a compressed video unit that is prepended with a buffered portion of the compressed video data that immediately precede the compressed video unit. The length of the compressed video unit is smaller than the length of the independently decodable segment to offer finer granularity in time synchronizing the compressed video data with the other sensor data with a tradeoff.

Abstract: A robot apparatus which does assembly by tilting a workpiece which is to be a fitting component, and bringing a part of a surface of the workpiece which is the fitting component and a part of a surface of a workpiece which is to be a fitted component, into contact with each other a plurality of times, when inserting the workpiece which is the fitting component into the workpiece which is the fitted component.