Abstract: The invention relates to a hand-held operating device for operating an industrial robot, the device including a graphical operator interface having a touch-sensitive display for displaying at least one virtual operating element, which represents a function for operating the robot, and which can be operated by touching the operating element with a finger of an operating person or a pen, a control unit for controlling the graphical operator interface and for communicating with a robot controller, a haptic mark associated with at least one virtual operating element and designed as a guide, which haptic mark is arranged in a display frame; that surrounds the touch-sensitive display at least in some areas and/or is arranged in frame segments of the display frame and by means of which haptic mark the finger of an operating person or the pin can be guided in the direction of the at least one operating element.

Abstract: The invention relates to an operating method for a positioning system 1, in particular for the structural assembly of aircraft, wherein the positioning system 1 comprises a plurality of positioners 2a, 2b, 2c, each of which has at least one manipulator M. The manipulators M grasp a component B and manipulate it in a synchronized manner, while it is jointly grasped by the manipulators M.

Abstract: A teaching device and a teaching method for a robotic arm are disclosed. The teaching device comprises a robotic arm, a control device and a gesture recognition module. The gesture recognition module detects a control gesture signal and transmits the detected control gesture signal to the control device. After receiving the control gesture signal, the control device teaches the robotic arm to move and switches between an arm movement mode and a hand movement mode. In an arm movement mode, the control device, aided by an arm ambient image shown on an eye frame and an arm control gesture, teaches an arm unit to move to a target at a high velocity. In the hand movement mode, the control device, aided by a hand vicinity image shown on an eye-in-hand frame and a hand control gesture, teaches a hand unit to move the processing target at a low velocity.

Abstract: The present application discloses implementations that involve shutdowns of a robotic system. An example may include controlling, by a robotic system, a plurality of motors of the robotic system with a central processing unit (CPU). The example may also include determining, by the robotic system, an error condition of the robotic system, where the error condition prevents the CPU from controlling at least one of the plurality of motors. The example may also include causing a plurality of motor driver boards to control the plurality of motors of the robotic system in response to determining the error condition of the robotic system. The example may also include receiving, by the plurality of motors, one or more commands from the plurality of motor driver boards to move the robotic system to a stationary position and park the robotic system in the stationary position.

Abstract: In a control apparatus for a robot arm, the feedback rule generating section generates a feedback rule in accordance with relationship between a time point of generation of a stimulus and variation in behavior after elapse of a reaction time in taught data as detected by the information variation point detecting section and the behavior variation point detecting section. The motion generating section generates a motion of the robot arm based on motion information, an information variation point, a behavior variation point, and the feedback rule. The controller controls the motion of the robot arm.

Abstract: An automatically generating program and device are provided which can easily and accurately create an operation program with no need of providing an image data input device. The program, causes a work head to move relative to a work object and to carry out desired work, includes the steps of displaying a reference data input window which allows input of shape data of the work object or a work region (STEP 201), taking in image data of the work object or the work region (STEP 202), compensating for distortion in the taken-in image data (STEP 203), displaying a movement path input window which allows designation of a movement path with the compensated image data displayed as a background (STEP 204), and automatically generating the operation program based on the movement path that is designated on the movement path input window (STEP 205).

Abstract: Methods and systems for proactively preventing hazardous or other situations in a robot-cloud interaction are provided. An example method includes receiving information associated with task logs for a plurality of robotic devices. The task logs may include information associated with tasks performed by the plurality of robotic devices. The method may also include a computing system determining information associated with hazardous situations based on the information associated with the task logs. For example, the hazardous situations may comprise situations associated with failures of one or more components of the plurality of robotic devices. According to the method, information associated with a contextual situation of a first robotic device may be determined, and when the information associated with the contextual situation is consistent with information associated with the one or more hazardous situations, an alert indicating a potential failure of the first robotic device may be provided.

Abstract: Systems and methods for cloud-based surveillance are disclosed. At least one mobile Input Capture Device (ICD) and the at least one computing device are communicatively connected to the cloud-based analytics platform. The at least one mobile ICD captures and transmits input data to the cloud-based analytics platform. The cloud-based analytics platform processes and analyzes input data from the at least one mobile ICD; and generates commands and updates to the at least one mobile ICD based on the processing and analyzing of the input data. Authorized users are operable to access to the cloud-based analytics platform via a user interface over the at least one computing device.

Abstract: Systems and methods for cloud-based surveillance for a target surveillance area are disclosed. At least two mobile input capture devices (ICDs) are communicatively connected to a cloud-based analytics platform via a data communication device. At least one user device can access to the cloud-based analytics platform. The cloud-based analytics platform automatically analyzes received 2-Dimensional (2D) video and/or image inputs for generating 3-Dimensional (3D) surveillance data and providing 3D display for a target surveillance area. In one embodiment, the at least two mobile ICDs are Unmanned Aerial Vehicles (UAVs).

Abstract: A method for operating an industrial robot by means of an operating device, including a step of touching a virtual operating element on a touch-sensitive display of a graphical user interface, said display being surrounded by a frame, wherein a function associated with the operating element is triggered when the virtual operating element is touched. In order to increase the safety of the operation of the industrial robot and to be able to adjust the position of the industrial robot in the desired range, the speed or distance of a deflection of a finger of an operating person during the touching of the virtual operating element of the touch display is detected.

Abstract: A method for operating an industrial robot by means of an operating device, including a step of touching a virtual operating element of a touch display of a graphical user interface. A function associated with the operating element is triggered when the virtual operating element is touched, the movement of the industrial robot being carried out relative to a robot coordinate system and the movement on the touch display being carried out relative to a display coordinate system. In order to be able to simply align the coordinate systems of the operating device and of the industrial robot with each other, the display coordinate system is recalibrated after a relative movement of the operating device with respect to the robot coordinate system.

Abstract: A robotic system includes a robot, sensors which measure status information including a position and orientation of the robot and an object within the workspace, and a controller. The controller, which visually debugs an operation of the robot, includes a simulator module, action planning module, and graphical user interface (GUI). The simulator module receives the status information and generates visual markers, in response to marker commands, as graphical depictions of the object and robot. An action planning module selects a next action of the robot. The marker generator module generates and outputs the marker commands to the simulator module in response to the selected next action. The GUI receives and displays the visual markers, selected future action, and input commands. Via the action planning module, the position and/or orientation of the visual markers are modified in real time to change the operation of the robot.

Abstract: The invention relates to a method for operating an industrial robot by means of an operating device comprising a graphical user interface having a touch display. To improve the operating safety of the industrial robot, at least one virtual operating element representing a function of the industrial robot is displayed on the touch display, a control signal associated with said virtual operating element is sent to a safety controller, and an image is produced by means of the safety controller, which image is then displayed on the touch display. If the image is touched on the touch display, feedback is given to the safety controller so that a function of the industrial robot can be carried out if the displayed image and touching of said image on the touch display match.

Abstract: In a robot system according to the present invention, an operation panel includes a biometric information acquisition unit configured to acquire biometric information of an operator who uses the operation panel. The robot system includes a biometric information storage unit configured to store biometric information of a plurality of operators, an operator determination unit configured to determine an operator who uses the operation panel by matching the biometric information acquired by the biometric information acquisition unit with the biometric information stored by the biometric information storage unit when the operation panel is activated or when a predetermined operation is executed for the operation panel, and a limitation unit configured to individually limit executable functions for the operator determined by the operator determination unit.

Abstract: The present application discloses implementations that involve shutdowns of a robotic system. An example may include controlling, by a robotic system, a plurality of motors of the robotic system with a central processing unit (CPU). The example may also include determining, by the robotic system, an error condition of the robotic system, where the error condition prevents the CPU from controlling at least one of the plurality of motors. The example may also include causing a plurality of motor driver boards to control the plurality of motors of the robotic system in response to determining the error condition of the robotic system. The example may also include receiving, by the plurality of motors, one or more commands from the plurality of motor driver boards to move the robotic system to a stationary position and park the robotic system in the stationary position.

Abstract: A system that incorporates teachings of the present disclosure may, for example, receive a request for a telepresence seat at an event, obtain media content comprising event images of the event that are captured by an event camera system, receive images that are captured by a camera system at a user location, and provide the media content and video content representative of the images to a processor for presentation at a display device utilizing a telepresence configuration that simulates the first and second users being present at the event, where the providing of the first and second video content establishes a communication session between the first and second users. Other embodiments are disclosed.

Abstract: The invention relates to an industrial robot and a method for programming an industrial robot, for which the industrial robot is guided manually to a virtual surface (25) in the room, at which point the industrial robot is selected such that it cannot be guided any further manually. Next, that force (F) and/or torque acting on the industrial robot when an attempt is made to guide the industrial robot further manually is ascertained and stored, despite reaching the virtual surface (25).

Abstract: A teaching data generator includes a storage device. An arithmetic device includes a first window display section to cause a display device to display a first window displaying first images respectively corresponding to some pieces of work unit job data stored in the storage device and included in teaching data. The first images are arranged in an execution order of pieces of work respectively corresponding to the some pieces of the work unit job data. A first job editing section performs an editing operation including replacing the some pieces of the work unit job data with other pieces of the work unit job data stored in the storage device, and changing the execution order. A teaching data generation section generates the teaching data based on a display content of the first window changed in accordance with the editing operation.

Abstract: A driving flipper with a robotic arm and a method for protecting the robotic arm. A robotic platform having a main frame and at least one obstacle climbing flipper with a robotic arm. The robotic arm has a folded mode substantially parallel to the longitudinal axis of the obstacle climbing flipper. The robotic arm has an operational mode protruding away from the longitudinal axis in an angle of at least 45 degrees.

Abstract: Disclosed herein are various embodiments of systems and methods for visualizing, analyzing, and managing telepresence devices operating in a telepresence network of healthcare facilities. A user may selectively view a global view of all telepresence devices, telepresence devices within a particular region, the details of a particular telepresence device, and/or the details of a particular healthcare facility. At one viewing level, a user may view a plan view map of a healthcare facility and visualize the navigational history of a telepresence device. At another viewing level, a user may view a plan view map of a healthcare facility and visualize telemetry data of a patient associated with a selected room. At another viewing level, a user may selectively view various graphical representations of telepresence device statistics and usage information with respect to health ratings for each of a plurality of patients.

Abstract: Systems and methods for cloud-based social surveillance are disclosed. At least one mobile robot patrol a certain surveillance area and capture data content through various function modules. A computing device coupled with each robot collects and sends the data to a cloud-based analytics platform via network for surveillance real-time or near-real-time analysis. A cloud-based analytics platform is comprised of at least one cloud server, at least one cloud database, communication network, and user interface. Authorized users access the information related to their corresponding predetermined surveillance environment inputs and/or analytics of the inputs within the system via a user interface and/or override commands or updates generated based on the analysis.

Abstract: A manipulator system includes a master manipulator configured to send an input command, a slave manipulator configured to operate according to the input command, an image capturing unit configured to acquire an image of an object, a display device placed in front of the operator and configured to display the image acquired by the image capturing unit, a detection device configured to detect the direction of an operator's face of the operator with respect to the display device, and a control unit configured to determine whether the direction of the operator's face is within a predetermined angle with respect to the display device based on the detection result in the detection device, and to shift an operation mode of the slave manipulator between a first control mode and a second control mode in which an operation is limited more than in the first control mode based on a determination result.

Abstract: A robot teaching system according to an embodiment includes a robot, a sensor, a screen generator, an adjuster, and a job generator. The sensor measures measured values relating to operations of the robot. The screen generator generates a teaching operation screen that includes guidance information intended for the teacher. The adjuster adjusts parameters for generating a job based on specified values relating to the operations of the robot and input in the teaching operation screen, and the measured values of the sensor associated with the specified values, the parameters defining an operation command including corrections of the operations of the robot. The job generator generates the job in which the parameters adjusted by the adjuster are incorporated.

Abstract: A surgical instrument is provided, including: at least one articulatable arm having a distal end, a proximal end, and at least one joint region disposed between the distal and proximal ends; an optical fiber bend sensor provided in the at least one joint region of the at least one articulatable arm; a detection system coupled to the optical fiber bend sensor, said detection system comprising a light source and a light detector for detecting light reflected by or transmitted through the optical fiber bend sensor to determine a position of at least one joint region of the at least one articulatable arm based on the detected light reflected by or transmitted through the optical fiber bend sensor; and a control system comprising a servo controller for effectuating movement of the arm.

Abstract: A surgical manipulator for manipulating a surgical instrument and an energy applicator extending from the surgical instrument. The surgical manipulator further includes a switch and at least one controller configured to control operation of the surgical manipulator in a first operating mode or a second operating mode. The at least one controller is also configured to determine a commanded pose to which the energy applicator is advanced based on a summation of a plurality of input forces and torques and transition between the operating modes by adjusting the plurality of input forces and torques in response to actuation of the switch.

Abstract: A portable remote controller includes a display color setting unit, a display color information storage unit, and a teaching data display unit. The display color setting unit sets display colors for instructions for making a robot execute a predetermined behavior. The display color information storage unit stores the display colors set by the display color setting unit in association with the instructions. The teaching data display unit displays teaching data created by teaching on a display unit on the basis of the display colors.

Abstract: Provided is a device for wirelessly controlling robots suitable for competition or educational purposes, the device including: an input module configured to receive commands from a human user interface, the human user interface sending signals indicative of inputs by a user to control a robot; a protocol translator configured to translate the received commands into a protocol to which the robot is responsive; a wireless output module configured to wirelessly transmit the translated commands to the robot such that the robot executes the commands.

Abstract: A method of controlling an operation of a robotically-controlled surgical instrument can include receiving a first input signal at a controller indicative of a user's readiness to actuate the surgical instrument to perform a surgical procedure, outputting an output signal from the controller to provide feedback to the user in response to the received first input signal, receiving a second input signal at the controller confirming the user's readiness to actuate the surgical instrument, outputting an actuation signal from the controller in response to receiving the second input signal, and actuating the surgical instrument to perform the surgical procedure based on the actuation signal.

Abstract: A medical device used in a medical robotic system has a conduit and an orientable tip. An optical fiber coupled to a laser source and/or a catheter coupled to one or more biomaterial sources extends through the conduit and tip so that the tip of the medical device may be robotically directed towards a target tissue for laser and/or biomaterial application as part of a medical procedure performed at a surgical site within a patient. A protective sheath covers the fiber as it extends through the conduit and tip. A first coupler adjustably secures at least the sheath to the medical device and a second coupler adjustably secures the fiber to at least the sheath. A similar dual coupler mechanism may be used to secure the sheathed catheter to the medical device.

Abstract: A system for operation of a robot including a substantially transparent display configured such that an operator can see a portion of the robot and data and/or graphical information associated with the operation of a robot. Preferably, a controller in communication with the robot and the transparent display is configured to allow the operator to control the operation of the robot.

Abstract: A robotic crawler having a non-dedicated smart control system is disclosed. Such a crawler can include a first drive subsystem, a second drive subsystem, a multi-degree of freedom linkage subsystem coupling the first and second drive subsystems, and a non-dedicated, smart control device removably supported about one of the first drive subsystem, the second drive subsystem, and the linkage subsystem. The smart control device is configured to initiate and control operational functionality within the robotic crawler upon being connected to the robotic crawler. The crawler can also include a communication subsystem functionally coupled between the smart control device and the serpentine robotic crawler, the communication subsystem facilitating control by the smart control device of at least one of the first drive subsystem, the second drive subsystem, and the linkage subsystem.

Abstract: A robotic arm is mounted on a personal mobility device, such as a wheelchair, scooter or the like, and is controlled with a user input interface, also mounted on the personal mobility device. The user input interface has a grip operable by the user to move in a plurality of orthogonal directions, both spatially and angularly, having articulating arms supporting a housing with a pivot member.

Abstract: The apparatus control method includes the steps of designating at least one notification apparatus, determining notification information, judging a status of the designated notification apparatus, and transmitting the notification information to the designated notification apparatus in accordance with a judgment result obtained in the status judging step.

Abstract: In an axis angle determination method, an angle or a position of each axis of a six-axis robot is determined. The robot is capable of taking an attitude of a singular point being a state in which rotation axes of fourth and sixth axes match. Based on teaching results of a position and attitude of a hand by point-to-point teaching, the method judges whether an attitude of the robot in which the angle or the position of each angle is to be determined next is a singular point. If judged that the attitude is the singular point, angles of the fourth and sixth axes required for the six-axis robot to move to the singular point are determined such that an angle of one of the fourth and sixth axes is fixed to a current value and an angle of the other axis is determined based on the fixed angle.

Abstract: An end effector controller that is gripped by an operator in one hand, including a pistol-grip housing configured to fit in the palm of an operator's hand when gripped and having mounted thereon a plurality of switching mechanisms with pivoting, dual-acting switch triggers each configured for independent actuation by multiple fingers of the hand when said controller is gripped, and a method for controlling a robotic end effector remotely using the operator hand-gripped controller, the method including switching between preset operating modes of the end effector using a single, control input element, easily actuated by a finger in the operator's gripping hand; and providing continuous fine adjustment between preset modes using a second, control input element also easily actuated by a finger on the operator's gripping hand.

Abstract: A method of scheduling a robotic device enables the device to run autonomously based on previously loaded scheduling information. The method consists of a communication device, such as a hand-held remote device, that can directly control the robotic device, or load scheduling information into the robotic device such that it will carry out a defined task at the desired time without the need for further external control. The communication device can also be configured to load a scheduling application program into an existing robotic device, such that the robotic device can receive and implement scheduling information from a user.

Abstract: Mobile robotic system allows multiple users to visit authentic places without physically being there. Users with variable requirements are able to take part in controlling a single controllable device simultaneously; users take part in controlling robot's movement according to their interest. A system administrator selects and defines criteria for robot's movement; the mobile robot with video and audio devices on it is remotely controlled by a server which selects the robot's movement according to the users and system administrator criteria. The server provides information to users; the robot's location influences the content of the information. Such robotic system may be used for shopping, visiting museums and other public touristic attractions over the Internet.

Abstract: A cleaning robot (1) is provided with: a main body housing (2) that moves along a floor in a self-propelled manner with a suction port (6) and an exhaust port (7) open; a motor fan (22) positioned inside the main body housing (2); a dust collection part (30) driven by the motor fan (22) so as to collect airflow dust that has been suctioned from the suction port (6); an infrared remote controller (60) that specifies an arbitrarily-defined location in space for setting up the main body housing (2) by emitting infrared rays; and an infrared sensor (18) that detects the specified location specified by the infrared remote controller (60). The cleaning robot moves to the specified location detected by the infrared sensor (18) and then carries out a cleaning operation, or carries out a cleaning operation while moving to the specified location.

Abstract: A user interface device of a remote control system for a robot and a method using the same are provided. The user interface device includes: a radio frequency (RF) unit for receiving, from a remote control robot, camera data and at least one sensor data detecting a distance; a display unit having a main screen and at least one auxiliary screen; and a controller having an environment evaluation module for determining whether the received camera data are in a normal condition, and having a screen display mode change module for displaying, if the received camera data are in a normal condition, the camera data on the main screen and displaying, if the received camera data are in an abnormal condition, the sensor data on the main screen.

Abstract: An apparatus for inputting teaching data for a robot includes a first input interface configured to input teaching data of a path layer; and a second input interface configured to input teaching data of a task layer.

Abstract: Adaptive controller apparatus of a robot may be implemented. The controller may be operated in accordance with a reinforcement learning process. A trainer may observe movements of the robot and provide reinforcement signals to the controller via a remote clicker. The reinforcement may comprise one or more degrees of positive and/or negative reinforcement. Based on the reinforcement signal, the controller may adjust instantaneous cost and to modify controller implementation accordingly. Training via reinforcement combined with particular cost evaluations may enable the robot to move more like an animal.

Abstract: In a minimally invasive surgical system, a hand tracking system tracks a location of a sensor element mounted on part of a human hand. A system control parameter is generated based on the location of the part of the human hand. Operation of the minimally invasive surgical system is controlled using the system control parameter. Thus, the minimally invasive surgical system includes a hand tracking system. The hand tracking system tracks a location of part of a human hand. A controller coupled to the hand tracking system converts the location to a system control parameter, and injects into the minimally invasive surgical system a command based on the system control parameter.

Abstract: A method for controlling a robot includes the step of controlling operation of the robot with a robot controller executing a control program having a plurality of process instructions. Associated process data for each of predetermined ones of the process instructions executed by the robot controller is then collected. The collected process data is subsequently stored in a form uniquely identified by at least one unique identifier. The at least one unique identifier may include both the program identifier and the process instruction identifier. The collected process data may be stored on the robot controller.

Abstract: End effectors with closing mechanisms, and related tools and methods to facilitate clamping, are provided. An example surgical tool comprises a first and second jaw movable between a closed grasped or clamped configuration and an open configuration. The tool further comprises a soft grip mode for grasping the tissue at a first force during which a separation parameter between the jaws is measured, and a therapeutic clamping mode in which the jaws clamp on the body tissue at a force greater than the grasping force. The methods comprise grasping the body tissue between jaw members, measuring the separation parameter between jaws, indicating on a user interface the separation parameter for comparison to a desired separation parameter, and then releasing the body tissue for repositioning or therapeutically clamping the body tissue in response to the separation parameter indication.

Abstract: A method for operating an industrial robot by means of an operating device, including a step of touching a virtual operating element on a touch-sensitive display of a graphical user interface, said display being surrounded by a frame, wherein a function associated with the operating element is triggered when the virtual operating element is touched. In order to increase the safety of the operation of the industrial robot and to be able to adjust the position of the industrial robot in the desired range, the speed or distance of a deflection of a finger of an operating person during the touching of the virtual operating element of the touch display is detected.

Abstract: The present invention provides a medical diagnostic device with an automatic moving mechanism. The device comprises an input interface for receiving instructions from an operator or from a remote device. A motion controller is coupled to the input interface for controlling movements of the diagnostic device based on the instructions received through the input interface. A moving assembly is coupled to the motion controller for moving the diagnostic device under control of the motion controller. In an embodiment, a method of guiding a portable imaging system through various locations in a hospital is disclosed. Also the invention discloses a self-guided portable imaging system.

Abstract: A mobile human interface robot including a drive system having at least one drive wheel driven by a corresponding drive motor, a localization system in communication with the drive system, and a power source in communication with the drive system and the localization system. The robot further including a touch response input supported above the drive system. Activation of the touch response input modifies delivery of power to the drive system to reduce a drive load of the corresponding drive motor of the at least one drive wheel white allowing continued delivery of power to the localization system.

Abstract: A controllable robotic arm system comprises a base unit and a moveable torso coupled to the base unit. The moveable torso is capable of moving in at least one degree of freedom independently of movement of the base unit. At least one robotic slave arm is moveably coupled to the torso. A master control system is operable to control the robotic slave arm and the moveable torso. The master control system includes an input interface by which a user can cause control signals to be communicated to the robotic slave arm and the moveable torso.

Abstract: The invention relates to a method for operating an industrial robot by means of an operating device comprising a graphical user interface having a touch display. To improve the operating safety of the industrial robot, at least one virtual operating element representing a function of the industrial robot is displayed on the touch display, a control signal associated with said virtual operating element is sent to a safety controller, and an image is produced by means of the safety controller, which image is then displayed on the touch display. If the image is touched on the touch display, feedback is given to the safety controller so that a function of the industrial robot can be carried out if the displayed image and touching of said image on the touch display match.

Abstract: Methods and systems for selecting a velocity profile for controlling a robotic device are provided. An example method includes receiving via an interface a selection of a robotic device to control, and receiving via the interface a request to modify a velocity profile of the robotic device. The velocity profile may include information associated with changes in velocity of the robotic device over time. The method may further include receiving a selected velocity profile, receiving an input via the interface, and determining a velocity command based on the selected velocity profile and the input. In this manner, changes in velocity of the robotic device may be filtered according to a velocity profile selected via the interface.