Abstract: A robotic vehicle may include one or more functional components configured to execute lawn care function, a sensor network comprising one or more sensors configured to detect conditions proximate to the robotic vehicle, a positioning module configured to determine robotic vehicle position while the robotic vehicle traverses a parcel, and a boundary management module configured to enable the robotic vehicle to be operated within a bounded area. The bounded area may include a variable boundary, and the boundary management module may be configured to receive instructions from an operator to adjust the variable boundary.

Abstract: A workpiece picking device includes a sensor that measures the workpieces, a hand that grasps the workpieces, a robot that moves the hand, and a control device thereof. The control device has a position orientation calculation part that calculates position, orientation and the like of the workpieces, a grasping orientation calculation part that calculates a grasping orientation of the workpieces by the hand, a route calculation part that calculates a route through which the hand moves to the grasping orientation, a sensor control part, a hand control part, a robot control part, a situation determination part that determines the situation of the workpieces on the basis of measurement result or the like of the three-dimensional position, and a parameter modification part that modifies at least one of a measurement parameter and various calculation parameters, when the determination result of the situations of the workpieces satisfies a predetermined condition.

Abstract: Described herein are systems, devices, and methods for controlling a mobile cleaning robot to escape from a stuck state using a learned robot escape behavior model. The model is trained using reinforcement learning at a cloud-computing device or networked devices. A mobile cleaning robot comprises a drive system, a sensor circuit to collect sensor data associated with a detected stuck state, and a controller circuit that can receive the trained robot escape behavior model, and apply the sensor data associated with the detected stuck state to the trained robot escape behavior model to determine an escape policy. The drive system or one or more actuators of the mobile robot can remove the mobile robot from the stuck state according to the determined escape policy.

Abstract: Systems and methods are provided for acquiring images of objects. Light of different types (e.g., different polarization orientations) can be directed onto an object from different respective directions (e.g., from different sides of the object). A single image acquisition can be executed in order to acquire different sub-images corresponding to the different light types. An image of a surface of the object, including representation of surface features of the surface, can be generated based on the sub-images.

Abstract: A robot control apparatus includes a controller to control operation of a robot, a storage to store operation logs with different preservation periods for the operation of the robot, a collector to, when a specific event occurs, select and collect an information element corresponding to a type of the event from the operation logs, a record generate to create a record from the information element collected by the collector, and a record preserver to preserve the record.

Abstract: There is provided a method for picking up an object from a bin to be implemented by a robotic arm including a controller and a picking-up module. The method includes: recognizing, by the controller, at least one object in the bin based on an image of an interior of the bin so as to determine a type of each object; determining, by the controller, a score for each object based on the type thereof; determining, by the controller, whether a greatest score among the score(s) of the at least one TBT object is greater than a predetermined value; and by the picking-up module, picking up one of the at least one TBT object that has the greatest score when it is determined that the greatest score is greater than the predetermined value.

Abstract: A robotic device management service obtains, from a client device operating in a first network, a request to obtain data from a robotic device operating in a second network. In response to the request, the robotic device management service issues a token to the client device that can be provided in future queries to obtain the data. The robotic device management service provides parameters of the request to the robotic device to cause the robotic device to generate and provide the data to the robotic device management service. In response to another request to obtain the data, where the other request includes the token, the robotic device management service queries a database to determine whether the data is available from a storage location of the service. If the data is available, the service provides the data to the client device to fulfill the other request.

Abstract: A machine integrated positioning system shows an operator where to place a raw part in the press brake or other machinery. Further, the operator is informed if the dimensions associated with the raw part are, or are not, correct to produce the planned finished part. The operator is visually shown how the raw part is to be oriented. The operator is informed if the raw part is right-side-up, along with other pre-final placement information. If these and other conditions are not met, the machine integrated positioning system may prevent the press brake and other machinery from cycling.

Abstract: A virtual reality system providing a virtual robotic surgical environment, and methods for using the virtual reality system, are described herein. Within the virtual reality system, various user modes enable different kinds of interactions between a user and the virtual robotic surgical environment. For example, one variation of a method for facilitating navigation of a virtual robotic surgical environment includes displaying a first-person perspective view of the virtual robotic surgical environment from a first vantage point, displaying a first window view of the virtual robotic surgical environment from a second vantage point and displaying a second window view of the virtual robotic surgical environment from a third vantage point. Additionally, in response to a user input associating the first and second window views, a trajectory between the second and third vantage points can be generated sequentially linking the first and second window views.

Abstract: A method for controlling a robotic device is presented. The method includes positioning the robotic device within a task environment. The method also includes mapping descriptors of a task image of a scene in the task environment to a teaching image of a teaching environment. The method further includes defining a relative transform between the task image and the teaching image based on the mapping. Furthermore, the method includes updating parameters of a set of parameterized behaviors based on the relative transform to perform a task corresponding to the teaching image.

Abstract: A robot programming system according to an aspect of the present disclosure includes: a robot program storage section; a press program storage section; a template program setting section that causes the robot program storage section to store, as an initial version of a robot program, a template program that instructs a robot how to move basically; a model placing section that places three-dimensional models of a workpiece, the robot, and a press machine in a virtual space; a robot movement processing section that causes the three-dimensional model of the robot to move; a press movement processing section that causes the three-dimensional model of the press machine to move; an interference detection section that detects interference between the three-dimensional models; and a robot program modification section that modifies a robot program stored in the robot program storage section to prevent interference detected by the interference detection section.

Abstract: Deep machine learning methods and apparatus related to manipulation of an object by an end effector of a robot. Some implementations relate to training a deep neural network to predict a measure that candidate motion data for an end effector of a robot will result in a successful grasp of one or more objects by the end effector. Some implementations are directed to utilization of the trained deep neural network to servo a grasping end effector of a robot to achieve a successful grasp of an object by the grasping end effector. For example, the trained deep neural network may be utilized in the iterative updating of motion control commands for one or more actuators of a robot that control the pose of a grasping end effector of the robot, and to determine when to generate grasping control commands to effectuate an attempted grasp by the grasping end effector.

Abstract: A vehicle control device includes a communication unit configured to be communicable with an autonomous driving vehicle that autonomously travels, a determination unit configured to determine whether there is a possibility that communication between the autonomous driving vehicle and the vehicle control device is disconnected, based on information indicating a communication status between the autonomous driving vehicle and the vehicle control device, and a travel instruction unit configured to transmit, when there is the possibility that the communication between the autonomous driving vehicle and the vehicle control device is disconnected, a travel instruction to the autonomous driving vehicle via the communication unit before the communication between the autonomous driving vehicle and the vehicle control device is disconnected. The travel instruction matches conditions associated with travel control of the autonomous driving vehicle.

Abstract: According to an embodiment, an article posture changing device includes: a first end effector configured to grasp a projected tag of an article by adsorption; an arm unit configured to support the first end effector and move the first end effector along at least a vertical direction; and a controller configured to control the arm unit and the first end effector to grasp the tag, lift the article upward, separate the article from a placement surface, change an angle of the article by weight thereof, move the article downward, place the article on the placement surface, and release the grasp of the tag.

Abstract: An information processing device includes processing circuitry. The processing circuitry obtain target information that indicates at least one of a distance to a target object or a position of the target object. The processing circuitry generate, based on the target information, map information of a space including a plurality of areas, the map information indicating presence or absence of the target object in a first area included in the plurality of areas, and a detailed position of the target object in the first area.

Abstract: A dirtiness level determining method applied to an electronic device comprising an image sensor. The method comprises: (a) capturing a first image at a first time point according to first type of light; (b) capturing a second image at a second time point after the first time point according to the first type of light; (c) calculating a first fixed pattern according to a first difference between the first image and the second image; and (d) calculating a first dirtiness level of the image sensor according to the first fixed pattern; (e) generating a first notifying message if the first dirtiness level is higher than a dirtiness threshold.

Abstract: The present disclosure provides a method and an apparatus for controlling a robot, a method and an apparatus for providing service and an electronic device. The method comprises: creating, by a local robot, a file system snapshot of an application in a local operating system, and synchronizing file system data of the application to a cloud robot; running, by the cloud robot, on a cloud virtual machine pre-running the same operating system as that of the local robot, the same application as that of the local robot (101); and reversely synchronizing a running result of the application to the local robot (102).

Abstract: A method to adjust the height of a display is provided. One terminal of the telescopic trolley is connected to a first surface of the display and is separated from the lower edge of the display by a first distance. The lower edge of the display is away from the ground by a second distance. The method includes: obtaining a first height value indicating a user's height, an eye height or a shoulder height, searching for a second height value corresponding to the first height value in the look-up table according to the first height value, calculating the sum of the first distance and the second distance, comparing the sum with the second height value to obtain a comparison result, and adjusting the length of the telescopic trolley according to the comparison result, so that the sum is equal to the second height value.

Abstract: Provided is a method for the computerized control of an end element of a machine tool. The method includes a method step of sensing a plurality of optical markers in a work environment of the machine tool by means of an optical measuring system. The method includes a method step of determining a first relative pose between the end element and a workpiece on the basis of the plurality of sensed optical markers. The method includes a method step of determining a first correction value on the basis of a comparison of the first relative pose with a reference pose. The method includes a method step of controlling the end element for machining the workpiece taking the first correction value into consideration.

Abstract: A communication robot includes: an operation part; and a communication arbitration unit configured to exhibit a robot mode for autonomously operating the operation part by applying a first operational criterion and an avatar mode for operating the operation part based on an operation instruction sent from a remote operator by applying a second operational criterion to arbitrate communication among three parties, that is, the robot mode, the avatar mode, and a service user.

Abstract: There is provided a method and an apparatus for controlling a robot arm. In this control scheme, a position error indicating a deviation between a command position, which is a control target position, and a current position, which is a position where the arm of the robot is currently located, is acquired. When the acquired position error exceeds a threshold, a new corrected command position between the current position and the command position is set. After the arm of the robot is moved to the corrected command position, a new corrected command position reset between the corrected command position serving as a new current position and the command position. Reconfiguration of a corrected command position is iterated until a current position of the robot arm becomes equal to the command position so that movement of the robot arm is achieved from the current position to the command position.

Abstract: A communication robot includes: an operation part; and a communication arbitration unit configured to exhibit one of a robot mode for autonomously operating the operation part by applying a first operational criterion and an avatar mode for operating the operation part based on an operation instruction sent from a remote operator by applying a second operational criterion to arbitrate communication with a service user, in which the communication arbitration unit operates, when it is intended to exhibit the avatar mode in accordance with an operation request from the remote operator, the operation part in the robot mode and asks the service user whether to allow the mode to be switched to the avatar mode.

Abstract: An article transfer apparatus includes a holding portion, a driving portion that moves the holding portion, a control unit, and a reference detection portion that detects a reference position of a target article held by the holding portion. The control unit performs reference detection control to detect, by the reference detection portion, the reference position in a state in which the target article is lifted, determination control to determine a positional relationship between the holding portion and the reference position based on a result of detection by the reference detection control, and position calculation control to calculate, based on the positional relationship determined by the determination control, a movement destination position that is a position, of the holding portion at the movement destination, at which an outer edge of the target article held by the holding portion fits within a movement region.

Abstract: Provided is provide a robotic device, including: a chassis; a set of wheels; a control system; a battery; one or more sensors; a processor; a tangible, non-transitory, machine readable medium storing instructions that when executed by the processor effectuates operations including: capturing, with the one or more sensors, data of an environment of the robotic device and data indicative of movement of the robotic device; generating or updating, with the processor, a map of the environment based on at least a portion of the captured data; inferring, with the one or more processors of the robotic device, a current location of the robotic device, and generating or updating, with the processor, a movement path of the robotic device based on at least the map of the environment, at least a portion of the captured data, and the inferred current location of the robotic device.

Abstract: The present document relates to a user intention-based gesture recognition method and apparatus, and an electronic device comprises one or more sensors, a memory, and a processor, wherein the processor can be configured to check a distance between the electronic device and the user by using the one or more sensors, detect a user gesture by operating in a first gesture mode on the basis of the checked distance satisfying a designated range by using the one or more sensors, detect the user gesture by operating in a second gesture mode on the basis of the checked distance deviating from the designated range, and perform an operation corresponding to a valid gesture on the basis of the detected gesture being a valid gesture. Other various embodiments are possible.

Abstract: In some embodiments, a hand controller apparatus for controlling a tool in a robotic surgery system can include a body including a proximal end and a distally located interface end configured to be coupled to an input apparatus configured to control a surgical tool. The hand controller apparatus can include a control lever attached to a pivot joint proximate a side surface of the body and extending along the body and away from the proximal end, the control lever being laterally moveable relative to the side surface of the body about the pivot joint. The control lever can include a tail region adjacent to the pivot joint and a paddle region connected to the tail region and extending toward the distally located interface end. The tail region can include an inner surface facing the body and an outer surface opposing the inner surface, and at least part of the outer surface of the tail region can be outwardly curved.

Abstract: Provided is a movement robot configured so that various types of operation can be executed according to motion of other objects or a movement body and a utilization area can be expanded accordingly. The movement robot includes a robot body 1, a control unit 2, a traveling unit 3, and a detection unit 4.

Abstract: Embodiments described herein relate to systems and methods for manipulating the position and/or orientation of an object while it is held in a robotic gripper. In one such embodiment, one or more physically possible and stable displacements for moving an object relative to a gripper using one or more frictional pushes may be determined and applied to the object to move the object from a first position and orientation to a second position and orientation while the object is held by the gripper. In certain embodiments, the physically possible and stable displacements may be determined using an appropriate motion cone approximation.

Abstract: A method and system for calibration of an augmented reality (AR) device's position and orientation based on a robot's positional configuration. A conventional visual calibration target is not required for AR device calibration. Instead, the robot itself, in any pose, is used as a three dimensional (3D) calibration target. The AR system is provided with a CAD model of the entire robot to use as a reference frame, and 3D models of the individual robot arms are combined into a single object model based on joint positions known from the robot controller. The 3D surface model of the entire robot in the current pose is then used for visual calibration of the AR system by analyzing images from the AR device camera in comparison to the surface model of the robot in the current pose. The technique is applicable to initial AR device calibration and to ongoing device tracking.

Abstract: An operating system according to an embodiment includes a target surface detection unit, a position calculation unit, a direction calculation unit, and a movement control unit. The target surface detection unit detects a target surface of a target object from a depth image obtained by a depth sensor. The position calculation unit calculates a first position for the detected target surface. The direction calculation unit calculates a first direction for the detected target surface. The movement control unit controls an actuator so as to reduce a positional deviation between a second position fixed with respect to the movable member and the first position and to reduce a directional deviation between a second direction fixed with respect to the movable member and the first direction.

Abstract: A teaching apparatus includes circuitry. The circuitry is configured to obtain result information corresponding to a position of a worked region on a workpiece. The circuitry is configured to generate first teaching information based on the result information. The first teaching information specifies a motion of an examination robot configured to examine the workpiece that has undergone work.

Abstract: In a method for training a first neural network a superposed classification is back-propagated through a second neural network. An output value of the second neural network is utilized to determine whether the input of the first neural network is adversarial.

Abstract: According to an embodiment of the present disclosure, a robot comprises: a case configured to form an external shape; a front cover configured to cover an internal space of the case on a front of the case; a projector arranged in the internal space and configured to project an image or a video to a display region of the front cover; a head display arranged in an opening formed at the front cover, and including a display; and a controller configured to output a visual content via at least one of the projector or the display, wherein the display region surrounds at least a portion around the opening.

Abstract: A coordinate measuring machine has a measurement head having a point measurement device which measures first coordinates of only a single point on the surface of a workpiece at a given time. An area measurement device records images of a reference surface. A displacement device displaces the measurement head and/or the workpiece such that they assume different relative positions with respect to one another. An evaluation device calculates a shift between images that the area measurement device has recorded of the reference surface at different times at different relative positions, with a stitching algorithm. Based on this, second coordinates of the measurement head, which are defined relative to the reference surface, are determined. By linking the first coordinates with the second coordinates, third coordinates are determined, which define the points on the surface of the workpiece measured by the point measurement device relative to the reference surface.

Abstract: The purpose of the invention is to provide a method for charging a robot and apparatus thereof. The invention according to the environment map and robot self-positioning information which is the position and orientation of the robot in the environment map, moves the robot to a position near a potential or registered charging pile; uses acquisition apparatuses such as laser to carry out line extraction of the structural data of the identification when the robot moves to short-range pile-searching connecting area, and combines with the preset structural data of the identification template, to carry out the recognition of the charging pile, after the collected structural data of the identification and the structural data of the identification template satisfy the preset matching degree, then the charging pile can be connected to the robot for charging.

Abstract: A robot system according to the present invention comprises a control apparatus for controlling a robot, and a video display apparatus connected to the control apparatus. The video display apparatus comprises a display unit which displays an image of a real space containing the robot, in real time as the image is taken by a camera, and an augmented reality image processing unit which causes a virtual image of an end effector or robot peripheral equipment of the robot to be displayed on the display unit in superimposed fashion on a real image of the robot taken by the camera. According to the robot system, even when the end effector or the robot peripheral equipment is not present, a robot teaching task can be performed by assuming that they are present.

Abstract: A simulation device according to the present disclosure includes: a model arrangement unit which arranges three-dimensional models of a feeder, a robot and a receiving device in virtual space; a workpiece supply unit which arranges the three-dimensional model of the workpiece on the conveyor surface; and a robot operation control unit which causes the robot to operate so as to move the workpiece on the conveyor surface to over the receiving surface, in which the workpiece supply unit includes: a reference position calculation part which calculates a position and orientation of the workpiece to be newly arranged, according to set conditions; a workpiece area setting part which sets a workpiece area occupied by the workpiece; an interference area setting part which sets an interference area adjacent to the workpiece area; a display control part which displays a screen indicating the workpiece area and the interference area; and a supply position adjustment part which adjusts a relative position of the workpiece

Abstract: A calibration system for robot tool including a robot arm adopting a first coordinate system, a tool arranged on a flange of the robot arm, and an imaging device adopting a second coordinate system is disclosed, wherein an image sensing area is established by the image device. A calibration method is also disclosed and includes steps of: controlling the robot arm to move for leading a tool working point (TWP) of the tool enters the image sensing area; recording a current gesture of the robot arm as well as a specific coordinate of the TWP currently in the second coordinate system; obtaining a transformation matrix previously established for describing a relationship between the first and the second coordinate systems; and importing the specific coordinate and the current gesture to the transformation matrix for calculating an absolute position of the TWP in the first coordinate system.

Abstract: A robot apparatus which does assembly by tilting a workpiece which is to be a fitting component, and bringing a part of a surface of the workpiece which is the fitting component and a part of a surface of a workpiece which is to be a fitted component, into contact with each other a plurality of times, when inserting the workpiece which is the fitting component into the workpiece which is the fitted component.

Abstract: A gripping system includes a hand that grips a workpiece, a robot that supports the hand and changes at least one of a position and a posture of the hand, and an image sensor that acquires image information from a viewpoint interlocked with at least one of the position and the posture of the hand. Additionally, the gripping system includes a construction module that constructs a model by machine learning based on collection data. The model corresponds to at least a part of a process of specifying an operation command of the robot based on the image information acquired by the image sensor and hand position information representing at least one of the position and the posture of the hand. An operation module executes the operation command of the robot based on the image information, the hand position information, and the model, and a robot control module operates the robot based on the operation command of the robot operated by the operation module.

Abstract: An ADV includes a method to combine data from multiple sensors. The method compresses video data from a camera to generate compressed video data. The compressed video data are segmented. The method time synchronizes each segment of the compressed video data with data from other sensors. The method then combines each segment of the compressed video data with the corresponding time-synchronized sensor data for the other sensors. In one embodiment, each segment of the compressed video data is independently decodable. In another embodiment, each segment of the compressed video data includes a compressed video unit that is prepended with a buffered portion of the compressed video data that immediately precede the compressed video unit. The length of the compressed video unit is smaller than the length of the independently decodable segment to offer finer granularity in time synchronizing the compressed video data with the other sensor data with a tradeoff.

Abstract: A parcel supply method and apparatus, an electronic device and a storage medium, which relate to the technical field of automation. The method comprises: recognizing information about a parcel on a transport belt (S110); obtaining state information about transport vehicles used for transporting the parcel (S120); according to the information about the parcel, the state information about the transport vehicles and state information of a mechanical arm used for grasping the parcel, determining a dispatch task for grasping and placing the parcel (S130); and dispatching, according to the dispatch task, the mechanical arm to grasp the parcel and place the parcel on a corresponding transport vehicle, so that the transport vehicle transports the parcel (S140). In the method, it can be ensured that a parcel is accurately grasped and placed, and accordingly, it can be ensured that automatic parcel supply can be implemented.

Abstract: A method of operating a mobile robot includes displaying, on a display unit, a photographing menu including a first photographing item for allowing the mobile robot to perform a specific motion for photographing and a second photographing item for allowing the mobile robot to photograph a user, displaying a screen for guiding a motion setting of the mobile robot on the display unit when the first photographing item is selected, performing, by the mobile robot, a corresponding motion based on an input motion setting for a first reference time when the motion setting of the mobile robot is input, and displaying a result screen on the display unit after the first reference time has elapsed.

Abstract: A method for liveness detection includes: acquiring a first depth map captured by a depth sensor and a first target image captured by an image sensor; performing quality detection on the first depth map to obtain a quality detection result of the first depth map; and determining a liveness detection result of a target object in the first target image based on the quality detection result of the first depth map. The present disclosure can improve the accuracy of liveness detection.

Abstract: A control device includes a processor which, when an accessory is fitted onto an apparatus, controls a driver such that the accessory interferes with operation of a movable part of the apparatus, acquires data indicating a position of the movable part at which the accessory interferes with the operation of the movable part, and controls the driver such that the movable part is driven within a movable range which is set based on the acquired data indicating the position of the movable part.

Abstract: Provided are an apparatus and method for managing a feature point map. The method includes generating an initial travel path through which an environmental information collecting entity moves, determining the generated initial travel path as a travel path for detection and controlling the environmental information collecting entity along the determined travel path for detection, receiving environmental information from the environmental information collecting entity, extracting feature point information from the environmental information, generating a feature point map from the feature point information, and storing the feature point map.

Abstract: A monitor device includes a camera for capturing a motion image of a motion of a robot device and an acceleration sensor for detecting an operational status of the robot device. A storage control unit for a robot controller performs control for storing, in a storage unit, a motion image captured by the camera and attached with a time, and control for storing, in the storage unit, an acceleration acquired from an acceleration sensor and attached with a time. When the operational status of the robot device deviates from a reference operational status, an extraction unit extracts, from the storage unit, a motion image in a period preceding the deviation from the reference operational status and stores the extracted motion image in the storage unit.

Abstract: A system and method is provided for determining grasping positions for two-handed grasps of industrial objects. The system may include a processor configured to determine a three dimensional (3D) voxel grid for a 3D model of a target object. In addition, the processor may be configured to determine at least one pair of spaced apart grasping positions on the target object at which the target object is capable of being grasped with two hands at the same time based on processing the 3D voxel grid for the target object with a neural network trained to determine grasping positions for two-handed grasps of target objects using training data. Such training data may include 3D voxel grids of a plurality of 3D models of training objects and grasping data including corresponding pairs of spaced-apart grasping positions for two-handed grasps of the training objects. Also, the processor may be configured to provide output data that specifies the determined grasping positions on the target object for two-handed grasps.

Abstract: Provided are a method and a device that can efficiently generate a training dataset.

Abstract: The present invention is provided to achieve smooth devanning or depalletizing of rectangular packages while managing various situations. Package identification codes 10a, 10b, 10c, 10d are displayed at a predetermined position of each of four surfaces of front, back, left and right or on each of all surfaces of a package 5A having a rectangular shape, and code data-of the identification codes is identified by a predetermined controller via a reading unit. The code data includes size information of a height size and a width size of a code display surface of the package 5A. The controller of a robot having the reading unit and a robot hand is configured to position the robot hand with the package 5A based on a code display position and the size information.