Abstract: Provided is a globally optimal robot visual positioning method and device based on point-line features. The method comprises the following steps: acquiring a priori three-dimensional map of a current scene constructed in advance; acquiring a current image of the robot and the inertial measurement data; calculating a pitch angle and a roll angle of the current robot pose according to the current inertial sensor data and the inertial sensor data in the priori map; matching the two-dimensional point-line features detected in the current image with three-dimensional point-line features in a priori map; separating the rotation and translation of the pose to be solved according to the matched feature pairs, solving the rotation and then solving the translation so as to complete the dimensionality reduction of the search space.

Abstract: A robot controlling method includes following operations. A depth image is obtained by the depth camera. A processing circuit receives the depth image and obtains an obstacle parameter of an obstacle and a tool parameter of a tool according to the depth image. The tool is set on the end of a robot. The processing circuit obtains a distance vector between the end and the obstacle parameter. The processing circuit obtains a first endpoint vector and a second endpoint vector between the tool parameter and the obstacle parameter. The processing circuit establishes a virtual torque according to the distance vector, the first endpoint vector, and the second endpoint vector. The processing circuit outputs control signal to the robot according to the tool parameter, the obstacle parameter and the virtual torque to drive the robot to move or rotate the tool to a target.

Abstract: Aspects of the disclosure are directed towards artificial intelligence-based modeling of target objects, such as aircraft parts. In an example, a system initially trains a machine learning (ML) model based on synthetic images generated based on multi-dimensional representation of target objects. The same system or a different system subsequently further trains the ML model based on actual images generated by cameras positioned by robots relative to target objects. The ML model can be used to process an image generated by a camera positioned by a robot relative to a target object based on a multi-dimensional representation of the target object. The output of the ML model can indicate, for a detected target, position data, a target type, and/or a visual inspection property. This output can then be used to update the multi-dimensional representation, which is then used to perform robotics operations on the target object.

Abstract: Embodiments of the present disclosure relates to an electronic device, a vision-based operation method and system for a robot. The electronic device includes at least one processing unit; and a memory coupled to the at least one processing unit and storing computer program instructions therein, the instructions, when executed by the at least one processing unit, causing the electronic device to perform acts including: obtaining an image containing a tool of a robot and an object to be operated by the tool, the image being captured by a camera with a parameter, obtaining a command for operating the tool, the command generated based on the image; and controlling the robot based on the command and the parameter. Embodiments of the present disclosure can greatly improve the accuracy, efficiency and safety of an operation of a robot.

Abstract: A distance-measuring system includes: a first ranging sensor; a second ranging sensor that covers a detection range more limited than a detection range covered by the first ranging sensor and has resolution higher than resolution of the first ranging sensor; and an image processing device. The image processing device includes: a machine detector that detects a position of a mobile machine, based on a first sensed result obtained by the first ranging sensor; a sensor controller that controls a detection position to be detected by the second ranging sensor to detect the position of the mobile machine which has been detected; and a safety determiner that controls the mobile machine, based on a second sensed result obtained by the second ranging sensor.

Abstract: An apparatus capable of smoothly injecting contents in an object into another object, an injection method, and an injection program. The apparatus includes a robotic arm device configured to grip a first container, and circuitry configured to recognize a flowrate of contents while injecting an amount of the contents from the first container into a second container, and control a tilt of the first container using the robotic arm device to inject the contents into the second container according to the recognized flowrate of the contents.

Abstract: The present disclosure relates to a method for creating a robot control program for operating a machine tool, in particular a bending machine, having the steps of generating image material of a machining operation of a workpiece on the machine tool by means of at least one optical sensor; extracting at least one part of the workpiece and/or at least one part of a hand of an operator handling the workpiece from the image material; generating a trajectory and/or a sequence of movement points of at least one part of the workpiece and/or at least one part of a hand of an operator from the extracted image material; and creating a robot control program by reverse transformation of the trajectory and/or the sequence of movement points.

Abstract: An apparatus for servicing personalized information based on user interest includes: a communication device that performs communication with a vehicle terminal of a vehicle; storage that stores context information for respective fields of interest of users; and a processor that extracts a field of interest of the user of the vehicle based on similarity obtained by matching context information received from the vehicle terminal at time of interest and the stored context information for the respective fields of interest. In particular, the processor provides a cluster of similar interest information to the vehicle terminal, based on the extracted field of interest.

Abstract: Image-based trajectory planning for a mobile machine having a camera is disclosed. A trajectory for the mobile machine to move to a referenced target is planned by obtaining, a desired image of the referenced target captured at a desired pose of the trajectory and an initial image of the referenced target captured at an initial pose of the trajectory through the camera of the mobile machine, calculating a homography of the desired image and the initial image; decomposing the homography into an initial translation component and an initial rotation matrix, obtaining optimized translation component(s) corresponding to constraint(s) for the mobile machine based on the initial translation component, obtaining optimized homography(s) based on the optimized translation component(s) and the initial rotation matrix, and obtaining objective image features corresponding to the trajectory based on the optimized homography(s).

Abstract: A method for controlling the operation of an attachment includes coupling the attachment to a tractor via a power lift comprising two lower link arms and detecting a pull point as a geometrical intersection of imaginary extensions of both lower link arms based on reference angles. The method further includes determining the reference angles by an optical capture of the lower link arms, and controlling the operation based on the detected pull point.

Abstract: Provided are a manipulation system and a driving method of the manipulation system capable of performing manipulation efficiently and suitably while suppressing damage to a minute object at the time of manipulation regardless of the degree of skill and technique of an operator. A sample stage configured such that a minute object is placed thereon, a first manipulator including a first pipette for holding the minute object, a second manipulator including a second pipette for operating the minute object that is held on the first pipette, an imaging unit for imaging the minute object, and a controller that controls the sample stage, the first pipette, the second pipette, and the imaging unit are provided.

Abstract: A control method and system for a robot. The robot control method includes allocating a task to a robot, the task associated with a place and a target user, determining a location of the target user based on an image received from a camera, the camera being arranged in a space including the place, and controlling a performance time of the task based on the location of the target user and the place.

Abstract: A picking robot of an embodiment includes an acquisition unit, first and second calculation units, a control unit, and a grip unit. The acquisition unit acquires first area information. The first calculation unit calculates first position/posture information indicating a position/posture of a target object from the first area information. The second calculation unit calculates second position/posture information differing from the first position/posture information. The control unit grips the target object, based on the first position/posture information, controls a first operation of moving the target object to a second area. When a first operation result is inadequate, the control unit controls a second operation of arranging the target object at a position indicated by the second position/posture information in a posture indicated by the second position/posture information. The grip unit grips the target object and moves the gripped target object, based on the control by the control unit.

Abstract: A method of operating a robot includes detecting the occurrence of an abnormal operating condition of the robot during operation from hardware state data relating to the operation of the robot system. In response, current hardware state data of the robot at the time of the detection is captured, including robot positional information. A counter corresponding to the abnormal operating condition may then be incremented and, if the counter exceeds a threshold value or exceeds a threshold value in a certain time, a report may be generated including the captured hardware state data. The abnormal condition may for example be a fluctuation in vacuum level or a data transmission error.

Abstract: Provided is a process including: receiving inspection path information indicating a path for a robot to travel, and a plurality of locations along the path to inspect; determining, based on information received via a location sensor, that a distance between a location of the robot and a first location of the plurality of locations is greater than a threshold distance; in response, causing a refrigeration system of an optical gas imaging (OGI) camera to decrease cooling; moving along the path; in response to determining that the robot is at a first location of the plurality of locations, sending a second command to the sensor system, wherein the second command causes the refrigeration system of the OGI camera to increase cooling; causing the sensor system to record a first video with an OGI camera; and causing the sensor system to store the first video in memory.

Abstract: A system and method for operating a robotic system to dynamically adjust a planned trajectory or a planned implementation thereof is disclosed. The robotic system may derive updated waypoints to replace planned waypoints of the planned trajectory for implementing a task. Using the updated waypoints, the robotic system may implement the task differently than initially planned according to the planned trajectory.

Abstract: A system comprises a processor and a memory storing instructions which when executed by the processor configure the processor to estimate a rack force for a steering system of a vehicle based on current driving and environmental conditions and estimate a health of an actuator of the steering system of the vehicle. The instructions configure the processor to estimate maximum achievable angle, velocity, and acceleration for the actuator of the steering system based on the estimated rack force and the estimated health of the actuator. The instructions configure the processor to provide to the steering system a path planned for the vehicle based on the estimated maximum achievable angle, velocity, and acceleration for the actuator of the steering system.

Abstract: A method for controlling a robot assembly having at least one robotic arm. The method includes determining a trajectory in the axis space of the robot assembly on the basis of a path having a plurality of previously specified Cartesian poses of at least one robot-assembly-fixed reference, and determining control values in the axis space on the basis of said trajectory. The robot assembly is controlled on the basis of the control values.

Abstract: A system and/or method comprising providing a robotic control structure having a support structure, said support structure being adapted and configured to be selectively positionable along a prescribed path by said robotic control structure; providing a viscous material deposition system adapted and configured to control deposition of a viscous material from said viscous material deposition system; providing a load sensor associated with said robotic control structure adapted and configured to determine a load of said viscous material supported by said support structure; and positioning said support structure along said prescribed path, wherein said positioning is controlled at least in part based upon said load.

Abstract: A method for controlling movement of a robot includes inputting a first linear velocity parameter and a first angular velocity parameter, which are specified as the robot moves, into a first limit model for limiting a centripetal acceleration to correct the first linear velocity parameter and the first angular velocity parameter, thereby calculating a second linear velocity parameter and a second angular velocity parameter, inputting the second linear velocity parameter and the second angular velocity parameter into at least one of a second limit model for limiting a linear velocity and a third limit model for limiting an angular velocity to correct the second linear velocity parameter and the second angular velocity parameter, thereby calculating a third linear velocity parameter and a third angular velocity parameter, and controlling the movement of the robot based on the third linear velocity parameter and the third angular velocity parameter.