Abstract: An object picking device, which is inexpensive and capable of speedily and accurately picking one object at a time from a random pile state. A target detecting part of an image processing part processes an image captured by a camera and detects objects. A target selecting part selects an object among the detected objects based on a certain rule. A view line direction calculating part calculates the direction of a view line extending to the selected object. A target position estimating part estimates the position including the height of the selected object based on size information of the object in the image. Then, a grip correction calculating part calculates an amount of correction of the movement of a robot so as to grip the object by using the robot.

Abstract: A hand as an end effector. The hand includes a base, a hook element associated with the base and capable of hooking and lifting an object, a holding element associated with the base and cooperating with the hook element to hold the object therebetween, and a drive section causing a relative movement between the hook element and the holding element. For example, the hook element is arranged movably in a direction toward and away from the holding element on the base, and the drive section drives the hook element. Alternatively, the holding element is arranged movably in a direction toward and away from the hook element on the base, and the drive section drives the holding element. A handling robot includes an arm and the above-described hand attached to the arm.

Abstract: An object picking device, which is inexpensive and capable of speedily and accurately picking one object at a time from a random pile state. A target detecting part of an image processing part processes an image captured by a camera and detects objects. A target selecting part selects an object among the detected objects based on a certain rule. A view line direction calculating part calculates the direction of a view line extending to the selected object. A target position estimating part estimates the position including the height of the selected object based on size information of the object in the image. Then, a grip correction calculating part calculates an amount of correction of the movement of a robot so as to grip the object by using the robot.

Abstract: A tracking and handling device capable of effectively handling workpieces, at low cost, even when a motion path of a robot or a conveying interval of the workpieces is varied. A first controller for a first robot on the most upstream side judges whether each workpiece supplied from a source should be handled by the first robot. Data of the workpiece not to be handled by the first robot is sent to a second controller for a second robot next to the first robot. The second controller judges whether each workpiece should be handled by the second robot based on data from the first controller. Data of the workpiece not to be handled by the second robot is sent to a third controller for a third robot on the most downstream side. The third controller judges whether a remaining workpiece should be handled by the third robot based on data from the second controller.

Abstract: A workpiece W serving as an object for detection is fixed in place. A camera 20 is mounted to the end of a robot RB. The camera is turned about an axis, which passes through the center position of the workpiece W and is perpendicular to the optical axis of the camera, to take an image of the workpiece W at a plurality of positions in different directions. A teaching model is generated on the basis of each produced image data. The relative position and posture of the workpiece to the camera 20 is also stored in association with the teaching model. Thus, it is possible to easily generate the teaching model of the workpiece regardless of three-dimensional variations in posture.

Abstract: A robot system having an image processing function capable of detecting position and/or posture of individual workpieces randomly arranged in a stack to determine posture, or posture and position of a robot operation suitable for the detected position and/or posture of the workpiece. Reference models are created from two-dimensional images of a reference workpiece captured in a plurality of directions by a first visual sensor and stored. Also, the relative positions/postures of the first visual sensor with respect to the workpiece at the respective image capturing, and relative position/posture of a second visual sensor to be situated with respect to the workpiece are stored. Matching processing between an image of a stack of workpieces captured by the camera and the reference models are performed and an image of a workpiece matched with one reference model is selected.

Abstract: A robot control unit 42 and an image processing control unit (control unit of the image processing apparatus) 43 are incorporated into a robot controller 40. A camera CM is connected to the image processing control unit 43. A main body 1 of a robot is connected to the robot control unit 42 through an amplifier 41. A portable robot teaching pendant 80 connected to the robot control unit 42 is provided with a monitor display, and functions also as a teaching pendant of the image processing apparatus. Therefore, by using the teaching pendant 80, manipulation of image processing, and issuing of an instruction to a program for processing an image can be performed. Furthermore, an image obtained by a camera CM, and information relevant to the manipulation of the image processing apparatus such as an operation menu, etc. can be displayed on the monitor display. Therefore, an operator can efficiently perform all operations relevant to the robot, the camera, processing an image, etc. while watching a monitor screen.

Abstract: An off-line teaching device, for adjusting a vision sensor and carrying out set-up work off-line, which used to be done in the field, so as to reduce the operation time in the field. The off-line teaching device has a storing device for storing data including the shapes and the dimensions of a workpiece, a robot and a vision sensor, and a display for indicating images of the workpiece, the robot and the vision sensor. The teaching device also has a simulation program for generating the images of the workpiece, the robot and the vision sensor on the display and for calculating measurement data of the vision sensor based on the arrangement of the images on the display, and a sensor program for carrying out measurement on the display by the vision sensor based on the measurement data.

Abstract: A hand as an end effector. The hand includes a base, a hook element associated with the base and capable of hooking and lifting an object, a holding element associated with the base and cooperating with the hook element to hold the object therebetween, and a drive section causing a relative movement between the hook element and the holding element. For example, the hook element is arranged movably in a direction toward and away from the holding element on the base, and the drive section drives the hook element. Alternatively, the holding element is arranged movably in a direction toward and away from the hook element on the base, and the drive section drives the holding element. A handling robot includes an arm and the above-described hand attached to the arm.

Abstract: An image processing apparatus capable of detecting position and posture of individual workpieces randomly arranged in a stack and having identical shapes. Reference models are created from two-dimensional images of a reference workpeace captured in a plurality of directions by a camera and stored. Also, the relative positions/postures of the workpiece with respect to the camera at the respective image capturing are stored. An image of a stack of workpieces is captured by the camera to obtain a two-dimensional image and the position/posture of the camera at the image capturing is stored. An image of a workpiece matched with one reference model is selected by matching processing of the reference model with the captured image. A three-dimensional position/posture of the workpiece with respect to the camera is obtained from the image of the selected workpiece, the selected reference model and position/posture information associated with the reference model.

Abstract: There is provided a measurement device being capable of obtaining an image being free from a distortion even if the position of a measurement object varies in image pickup and being capable of performing a precise measurement according to the image. Camera calibration is executed by using a dot pattern or the like, and parameters of a camera model are stored (S1). The image of a reference object is fetched (S2), a corrected reference image being free from a lens distortion and a distortion caused by image pickup in a diagonal direction is formed on the basis of the equation of the camera model (S3), and parameters for detecting the measurement object are set in accordance with the image (S4). In a system operation, the image of the measurement object, the position of which varies, is acquired (S5), and the corrected reference image being free from a distortion as in S3 is formed (S6).

Abstract: A tool mounted on the wrist end of a robot is placed in a predetermined photographing position, and the front and side faces of the tool are photographed by cameras to obtain three-dimensional shape data of the tool. The extent of deformation of the tool is detected by comparing the obtained shape data and reference shape data, and a programmed movement path for the robot is corrected depending on the extent of deformation.

Abstract: A tool (2) mounted on the wrist end of a robot (1) is placed in a predetermined photographing position (P1), and the front and side faces of the tool (2) are photographed by cameras (41, 42) to obtain three-dimensional shape data of the tool (2). The extent of deformation of the tool (2) is detected by comparing the obtained shape data and reference shape data, and a programmed movement path for the robot is corrected depending on the extent of deformation.

Abstract: A robot visual-tracking method in which the precision of a tracking movement of a robot is improved using a visual sensor. A count value N (0) of a pulse coder is stored when a sensor detects a workpiece. Then, arrival of the workpiece at a taught photographing position is detected based on an incremental quantity from the count value N (0) of the pulse coder, and the workpiece is photographed by a camera. A deviation is obtained between positions of two points Wa and Wb on the workpiece and the reference positions thereof. When the workpiece arrives at a tracking start position L1, a tracking coordinate system .SIGMA.tr starts to move and tracking operations of the robot are started. In the tracking operation, the robot position is corrected to compensate the detected deviation amount. The robot approaches the workpiece W to meet with it and grips the workpiece W by a hand when the workpiece W reaches a position Q0.

Abstract: A taught data setting method in a visual sensor system, capable of automatically and rapidly setting optimum taught data. An image of a single circular sample is subject to image processing to determine formal setting values of first to sixth parameters (P1-P6), respectively corresponding to circle diameter, circumference, area and deformation degree, and types of a smoother filter and an emphasizing filter. Many sample images are then subject to image processing which utilizes the formal setting values, to thereby determine set center positions of the respective images. An optimum value of the first parameter enough to minimize the sum of the squares of the errors between the set center positions and image center positions is automatically determined (100), the image center positions being detected while the first parameter is changed, with the second to fourth parameters kept fixed at their formal setting values. Similarly, optimum values of the second to fourth parameters are determined (100-103).

Abstract: After a calibration process has been carried out once for a sensor with respect to a certain position, the position of an object can be detected by the sensor in any other positions, so that the object can positionally be detected in a wide range. Specifically, calibration data (CDA) (32) is produced by calibration process in a position A before a camera moves, and calibration data (CDB) (33) for the camera after it is moved is calculated based on distance data CM (12) with respect to the position and attitude of the camera (3). Then, the position of an object (30) is detected on the basis of the calibration data (CDB) (33) and image data (WDB) (31) of the object (30) imaged by the camera (3) which is in the position B.

Abstract: A operation program of a robot is simply changed by using a workpiece body without using a master body. The operation program of the robot is corrected by correction data obtained from cameras. When a point of the operation program is desired to be changed to another point, a point on the workpiece body is changed to a changed point. A robot control unit reads the changed point as the coordinate values of the respective axes and changes the same to space coordinate values. Further, the space coordinate values are converted to reference space coordinate values on the master body by an inverse conversion matrix of the correction data. The reference space coordinate values are inversely converted to the coordinate values of respective reference axes. Since the operation program is commanded by the coordinate values of the respective reference axes, the point of the operation program is converted to the another point by using the coordinate values of the respective reference axes.

Abstract: A fixed point for confirmation is photographed by a camera prior to the start of a robot job, to obtain photographing data (S1, S2), a position data is determined from the photographing data (S3), and an error (.DELTA..epsilon.) between the position data and a reference position data (S4) is determined. When this error (.DELTA..epsilon.) exceeds a predetermined tolerance (.epsilon.a), a camera positional dislocation alarm is issued (S6). With this arrangement, the positional dislocation of the camera can be confirmed prior to the start of a job, whereby the job can be safely carried out.