Abstract: In one embodiment, a system includes: a robotic arm assembly; a plurality of components arranged around the robotic arm assembly and positioned within reach of the robotic arm assembly; and a controller configured to control operation of the robotic arm assembly within the system. Each of the plurality of components is configured to either: store ingredients under predetermined environmental conditions; store food preparation tools; dispense ingredients; blend, cook, or assemble ingredients into a completed food item; provide cleaning functionality to the system and/or components thereof; provide user access to completed food items; or display information relevant to a food item or preparation thereof to users.

Abstract: One variation of a method for monitoring cooling units in a store includes: at a robotic system, during a first scan routine, autonomously navigating toward a cooling unit in the store, recording a color image of the cooling unit, and scanning a set of temperatures within the cooling unit; identifying a set of products stocked in the cooling unit based on features detected in the color image; mapping the set of temperatures to the set of products at a first time during the first scan routine based on positions of products in the set of products identified in the color image; and generating a record of temperatures of the set of products stocked in the cooling unit at the first time.

Abstract: A robot configured to use a gripper to grasp one or more tools is disclosed. In various embodiments, the robot comprises a robotic arm having a gripper disposed at a free moving end of the robotic arm, and a set of two or more tools configured to grasped or otherwise engaged by the gripper. Each tool in the set of two or more tools may be disposed in a corresponding tool holder, optionally attached to the robot or situated near the robot. The robot is configured to use the gripper to retrieve a selected tool from its tool holder to perform a task; use the tool to perform the task; and return the tool to its tool holder.

Abstract: Embodiments of the present disclosure are directed to methods, computer program products, and computer systems of a robotic apparatus with robotic instructions replicating a food preparation recipe.

Abstract: The automatic operation system includes a plurality of learned imitation models and a model selecting unit. The learned imitation models are constructed by machine learning of operation history data, the operation history data being classified into several groups by an automatic classification system algorithm, the operation history data of each group being learned by the imitation model corresponding to the group. The operation history data include data indicating a surrounding environment and data indicating an operation of an operator in the surrounding environment. The model selecting unit selects one imitation model from several imitation models based on a result of classifying data indicating a given surrounding environment by the automatic classification algorithm of the classification system.

Abstract: A distributed robotic delivery system includes a mobile application, a server, a dispatch module, and a plurality of robotic delivery vehicles. The mobile application receives suggested items for purchase, the suggested items selected by having a set of properties suitable for delivery by a selected one of the plurality of robotic delivery vehicles, where the set of properties includes product dimensions and weight; receives item costs to be provided to a user for the suggested items; displays the item costs; and transmits a message directing the dispatch module to deploy the selected one of the plurality of robotic delivery vehicles to deliver one or more items of the suggested items selected by the user.

Abstract: A robot teaching device capable of simplifying a work involved in teaching a robot. The robot teaching device includes a position data storing section configured to store target position data for a robot; an operation instruction storing section configured to store an operation instruction for arranging the robot at a target position, the operation instruction not including the target position data; and a position data writing section configured to acquire current position data of the robot when the operation instruction is input, the position data writing section further configured to write, to the position data storing section, the current position data as the target position data together with a unique identifier, in which the identifier of the target position data is automatically given to the operation instruction being input to teach an operation to the robot.

Abstract: A robot system includes a slave unit including a slave-side force detector configured to detect a direction and a magnitude of a reaction force acting on a workpiece held by a work end of a slave arm, a master unit including a master-side force detector configured to detect a direction and a magnitude of an operating force applied by an operator to an operation end of a master arm, and a system controller configured to generate a slave operational command and a master operational command based on the operating force and the reaction force. The system controller includes a regulator configured to correct a moving direction of the work end so that the movement of the work end in a pressing direction of an object is regulated when the reaction force exceeds an acceptable value set beforehand.

Abstract: Example systems and methods allow for runtime control of robotic devices during a construction process. One example method includes determining at least one sequence of robot operations corresponding to at least one robot actor, causing the at least one robot actor to execute a portion of the at least one sequence of robot operations during a first time period, receiving an interrupt signal from a mobile computing device indicating a modification to the at least one sequence of robot operations, where the mobile computing device is configured to display a digital interface including one or more robot parameters describing the at least one robot actor and one or more tool parameters describing operating characteristics of at least one physical tool, and causing the at least one robot actor to execute a portion of the at least one modified sequence of robot operations during a second time period.

Abstract: A teaching method of driving a robot arm by a drive unit based on a detection result of a force detection unit and storing a position and a posture of the driven robot arm in a memory unit, includes determining whether or not the posture of the robot arm is close to a singular posture, and, when determining that the posture of the robot arm is close to the singular posture, selecting and executing one escape posture from a plurality of escape posture candidates escaping from the posture close to the singular posture according to an external force detected by the force detection unit.

Abstract: A distributed robotic delivery system includes a mobile application, a server, a dispatch module, and a plurality of robotic delivery vehicles. The mobile application receives an item cost, robotic delivery shipping options, and acquisition factors. The mobile device displays the item cost, robotic delivery shipping options, and the acquisition factors in a user interface. Upon a selection of robotic delivery option, the mobile application notifies the dispatch module to deploy the robotic delivery vehicle with the item to the specified delivery point.

Abstract: The present disclosure provides methods, apparatuses, and storage media for storing and loading visual localization maps. The methods for storing the visual localization maps may include acquiring a visual localization map; extracting key frame abstract information of each key frame from the visual localization map; grouping the key frame abstract information of all key frames of the visual localization map; for each group, generating and storing a sub-map-file of the group using the key frame abstract information of the group; generating key frame space index information based on the key frame abstract information of all groups; and generating and storing a master map file according to the key frame space index information for indexing the sub-map-file.

Abstract: A floor processing device automatically moves within an environment, with a driving attachment, a floor processing unit, an obstacle detection unit, a control unit and a detection unit for detecting device parameters and/or environment parameters control unit is set up to determine an error of the floor processing device based upon the detected parameters that prevents the floor processing device from moving and/or the floor processing device from processing a surface to be processed in such a way that the floor processing device is unable to automatically extricate itself from the error situation. The control unite is set up to analyze the parameters detected by the detection unit with respect to recurring patterns that have a repeatedly encountered combination of an error and at least one chronologically preceding environment and/or device parameter.

Abstract: A method of operating an autonomous cleaning robot includes receiving, at a handheld computing device, a first input representing a first set of cleaning schedule parameters for a first cleaning schedule for the autonomous cleaning robot, the first cleaning schedule corresponding to a first area. The method includes presenting, on a display of the handheld computing device, the first cleaning schedule. The method includes receiving, at the handheld computing device, a second input representing a second set of cleaning schedule parameters for a second cleaning schedule for the autonomous cleaning robot, the second cleaning schedule corresponding to a second area different from the first area. The method includes presenting, on the display, the first and second cleaning schedules, and initiating a transmission to the autonomous cleaning robot, based on the first or second cleaning schedules, the transmission including data for causing the robot to initiate a cleaning mission.

Abstract: Device for plugging a plug-in region of an expansion board into a plug-in coupling including: a first interface providing the coupling; a second interface providing the board; a robot manipulator having an effector; and a controller controlling the robot manipulator to plug the region into the coupling, the controller configured to execute a program for the robot manipulator to perform operations including: picking up the board at the second interface using the effector; guiding the board along a trajectory and target orientation of the region to the coupling; carrying out tilting motions of the region until reaching or exceeding a limit value condition G1 for a torque acting on the effector and/or a limit value condition G2 of a force acting on the effector, and/or reaching or exceeding a force/torque signature and/or a position/velocity/acceleration signature at the effector, indicating completion of plugging the region into the coupling within predefined tolerances.

Abstract: A program transfer system includes: a communication unit communicating with a robot and outputting a result of the communication; a determination unit checking a work program provided in the robot, based on the result of the communication, and determining whether to import a different target work program from the work program or not; a program import unit importing the target work program to the robot when the determination unit determines the importing; a collection unit collecting work data of complete work from the robot; and a program update unit performing machine learning using the work data collected by the collection unit, and updating the target work program, based on a result of the machine learning.

Abstract: This specification describes systems, methods, devices, and other techniques for planning workspaces for automated fabrication processes. A computing system facilitates planning by receiving a set of parameters for planning a layout of a workspace for an automated fabrication process, and generating a plurality of candidate workspace layouts, including selecting, for each candidate workspace layout, (i) one or more robots for performing tasks in the automated fabrication process and (ii) corresponding locations for the one or more robots within the workspace. The system determines an optimal workspace layout based on the plurality of candidate workspace layouts, generates a workspace layout specification for the optimal workspace layout, and provides the workspace layout specification to one or more second computing systems.

Abstract: Methods and systems for enhancing robot's ability to collaborate with human operators by constructing models of objects and processes which are manipulatable by a robot (situation models) and sharing such models with operators. Sharing situation models allows robot to explain its actions to operators in the format they can readily understand. Reciprocally, operators can formulate their instructions to the robot in the format that is both easy to produce for the human and straightforward to interpret in the machine. In this way, the disclosed method and system for constructing situation models in the robot facilitate both adaptation of human operators to robots and adaptation of robots to human operators, thus enhancing collaboration between them.

Abstract: The present disclosure relates to a method and a device for controlling floor cleaning robots. The method includes obtaining cleaning task information that includes an overall cleaning task; determining cleaning control information for a plurality of floor cleaning robots based on the cleaning task information, wherein the cleaning control information includes control information for each one of the plurality of floor cleaning robots; and transmitting the cleaning control information to each one of the plurality of floor cleaning robots, so that each one of the floor cleaning robots performs a cleaning task based on the corresponding cleaning control information.

Abstract: A method includes detecting an object in a real environment of a robot. The method further includes inferring an expected property of the object based upon a representation of the object within a representation of the real environment of the robot. The method also includes sensing, via a sensor of the robot, a presently-detected property of the object in the real environment corresponding to the expected property. The method still further includes detecting a conflict between the expected property of the object and the presently-detected property of the object.

Abstract: A sensing system provided with a target detecting unit which applies predetermined processing to data obtained by a detecting device and thereby detects a target object, the sensing system including an augmented-reality-image creating unit which creates an image corresponding to a candidate in a plurality of candidates that appear in the processed data to which the predetermined processing has been applied, a predetermined parameter of the candidate being equal to or greater than a detection threshold, and creates a candidate image corresponding to a candidate in the plurality of candidates, the predetermined parameter of the candidate for the candidate image is less than the detection threshold and equal to or greater than a detection candidate threshold, and a display device that displays the image and the candidate image.

Abstract: A method of operating an autonomous cleaning robot is provided. The method includes receiving, at a handheld computing device, data representing a status of a debris collection bin of the autonomous cleaning robot, the status of the bin including a bin fullness reading. The method also includes receiving, at the handheld computing device, data representing a status of a filter bag of an evacuation station, the status of the filter bag including a bag fullness reading. The method also includes presenting, on a display of the handheld computing device, a first status indicator representing the bin fullness reading, and presenting, on the display of the handheld computing device, a second status indicator representing the bag fullness reading.

Abstract: Monitored control system includes an action device and a monitoring device for monitoring the operation of the action device. The action device includes actuator modules, a sensor module and a control module to command the actuator modules to perform a predefined task using the sensor data. The monitoring device receive monitored data from the action device and compute an action device operation indicator indicative of a correct or abnormal operation of the action device on the basis of the monitored data. The action device operation indicator is computed on the basis of a learned value of an adjustable monitoring parameter. The learned value is determined from a set of labelled data generated from trial datasets recorded by the action device during an iterative learning procedure.

Abstract: Systems, methods and apparatus of control delivery of audio content into a vehicle cabin where occupants of vehicles are located/seated. For example, a vehicle includes: at least one microphone configured to generate signals representing audio content presented in the cabin of the vehicle; an infotainment system having access to multiple sources of audio content; and an artificial neural network configured to receive input parameters relevant to audio control in the vehicle and generate, based on the input parameters as a function of time, predictions of audio pattern. The input parameters can include data representing the signals from the at least one microphone, data from the infotainment system, and/or at least one operating parameter of the vehicle. The vehicle is configured to adjust a setting of the infotainment system based at least in part on the predictions generated by the artificial neural network.

Abstract: A programming assistance apparatus includes circuitry. The circuitry generates a first display data to be displayed in a first input area in which to input, for each of a plurality of task groups including a plurality of tasks, a first condition under which at least one robot executes the tasks. The circuitry generates a second display data to be displayed in a second input area in which to input a second condition for an execution order of the plurality of task groups. The circuitry sets the first condition based on an input into the first input area. The circuitry sets the second condition based on an input into the second input area. The circuitry generates, based on the first condition and the second condition, a motion program for causing the at least one robot to execute the plurality of task groups.

Abstract: A movable electronic device includes at least one camera module, a driving module configured to support movement on a specified path of the electronic device, and a processor electrically connected to the camera module and the driving module. The processor is configured to control the electronic device to perform capture while moving on a specified first path and to set the first path to a second path based on state information about at least one Internet of Things (IoT) device obtained based on a capture image on the first path.

Abstract: A gyroscope-based system and method is disclosed. Image information data is collected; a mechanical arm working environment image is modeled; a heat source supply apparatus and a gyroscope are provided at the mechanical arm proximal end; the position of the proximal end is accurately measured by accurately tracking the heat source at the proximal end; the relative position of the mechanical arm distal end is accurately calculated by using high-precision angle information measured by the high-precision gyroscope in combination with a number-theoretic formula. The disclosure provides separately determining the position of the distal end, or for assisting other algorithms or apparatuses that track the position of the mechanical arm distal end in error correction and calibration of the position of the mechanical arm distal end. The position of the mechanical arm distal end can be continuously and dynamically tracked in real time, and virtualized in the corresponding image system.

Abstract: A method for operating a robotic system includes determining a discretized object model based on source sensor data; comparing the discretized object model to a packing plan or to master data; determining a discretized platform model based on destination sensor data; determining height measures based on the destination sensor data; comparing the discretized platform model and/or the height measures to an expected platform model and/or expected height measures; and determining one or more errors by (i) determining at least one source matching error by identifying one or more disparities between (a) the discretized object model and (b) the packing plan or the master data or (ii) determining at least one destination matching error by identifying one or more disparities between (a) the discretized platform model or the height measures and (b) the expected platform model or the expected height measures, respectively.

Abstract: A mobile robot system and a related control method sets a virtual wall as a specific area so that a mobile robot cannot approach within a cleaning area to restrict a traveling of the mobile robot, registers the virtual wall on a map when the virtual wall for restrict the approach of the mobile robot is set by a terminal, calculates a location of the virtual wall for the cleaning area to avoid the virtual wall, and restricts the approach of the mobile robot by matching the virtual wall to the cleaning area, controlling the mobile robot as if an actual physical obstacle exists by setting the virtual wall on the map through the terminal and matching to an actual cleaning area, and achieving an easy cleaning setting and effectively controlling the mobile robot as it can be plurally set at a desired location irrespective of the number.

Abstract: Systems and methods are provided for receiving image data via a camera of a computing device, the image data comprising a plurality of image frames; displaying a 3D reconstruction of the image data on a graphical user interface (GUI) displayed on a computing device as the image data is received and the 3D reconstruction of the image data is generated; detecting at least one object corresponding to one or more of a plurality of predefined object types in the image data; determining dimensions of the at least one object in 3D space based on the 3D reconstruction of the image data; and displaying in the GUI the at least one detected object.

Abstract: The method for assisting a person in operating in a dynamic environment may form part of a mobility assistance system. The method comprises a step of acquiring sensor data comprising a time sequence of at least two consecutive images of the dynamic environment from at least one sensor, for example a camera. Optical flows are calculated based on the at least two consecutive images. Feature scores associated to spatial positions for selected regions in an image space are determined in order to generate a feature score field. An output signal including directional stimulus information is generated based on the generated feature score field, wherein the directional stimulus information comprises information on relative spatial relations between the selected regions. The generated output signal is provided to at least one actuator, which signals the directional stimulus information to the person.

Abstract: A method of engaging a medical instrument with a medical instrument manipulator comprises receiving an indication that a first input coupling of the medical instrument is positioned adjacent to a first drive output of the manipulator. The first drive output is driven by a first actuating element. In response to receiving the indication, the first drive output is rotated in a first rotational direction. A determination is made, by one or more processors, as to whether a resistance torque is experienced by the first actuating element after rotating the first drive output in the first rotational direction. If the resistance torque is not experienced by the first actuating element after rotating of the first drive output in the first rotational direction, the first drive output is rotated in a second rotational direction.

Abstract: A map generation device includes: a communication unit that acquires position information about a vehicle at a time when an image is photographed from the vehicle; and a control unit that estimates a dispersion state of pollen, based on the position information about the vehicle acquired by the communication unit and detection information indicating a result of a first detection in the image, and generates map information indicating the estimated dispersion state, the first detection in the image being a detection of a person that wears an anti-pollen article.

Abstract: A method for devising an optimum control policy of a controller for controlling a system includes optimizing at least one parameter that characterizes the control policy. A Gaussian process model is used to model expected dynamics of the system. The optimization optimizes a cost function which depends on the control policy and the Gaussian process model with respect to the at least one parameter. The optimization is carried out by evaluating at least one gradient of the cost function with respect to the at least one parameter. For an evaluation of the cost function a temporal evolution of a state of the system is computed using the control policy and the Gaussian process model. The cost function depends on an evaluation of an expectation value of a cost function under a probability density of an augmented state at time steps.

Abstract: A control device and a machine learning device enable control for gripping an object having small reaction force. The machine learning device included in the control device includes a state observation unit that observes gripping object shape data related to a shape of the gripping object as a state variable representing a current state of an environment, a label data acquisition unit that acquires gripping width data, which represents a width of the hand of the robot in gripping the gripping object, as label data, and a learning unit that performs learning by using the state variable and the label data in a manner to associate the gripping object shape data with the gripping width data.

Abstract: A docking system for a mechanical telemanipulator is provided, optionally to be used with a mechanical telemanipulator with a master-slave configuration. The docking system is configured to allow for safe and secure immobilization of a handle or master manipulator of a mechanical telemanipulator with a master-slave configuration so as to prevent movement of a slave manipulator or instrument. While the docking element can be deployed on any mechanical telemanipulator, it can advantageously be used on a surgical platform comprising a mechanical telemanipulator with a master-slave configuration. In this context, the docking system can be used to secure the handle portion or master manipulator of the surgical platform to safely prevent undesirable movement of a slave manipulator or surgical instrument.

Abstract: A rice cooker assembly uses machine learning models to identify and classify different types of food stored. The rice cooker has a chamber including different compartments for storing different types of food. A camera is positioned to view an interior of the chamber. The camera captures images of the contents of the chamber. From the images, the machine learning model classifies the different types of food stored. The rice cooker determines a mixture of different types of food based on nutrition value and/or taste. The rice cooker creates the mixture and controls the cooking process accordingly. The one or more machine learning models may be resident in the rice cooker or it may be accessed via a network.

Abstract: A method for connecting a household appliance to a wireless home network, wherein a user terminal connects to a temporary communication network of the household appliance and transmits network access information for the home network to the household appliance, wherein the temporary communication network is ended subsequently and the household appliance logs into the wireless home network by using the received network access information, and wherein the user terminal obtains information from the household appliance about the fact that the log-in of the household appliance into the home network has failed. The household appliance opens a temporary communication network again if the log-in fails, wherein the user terminal recognizes the renewed opening of the temporary communication network and classifies it as information about the failure of the household appliance to log into the home network.

Abstract: In one embodiment, the present disclosure includes an automated food production kiosk. Embodiments of a kiosk may comprise a robotic system having a reach. A plurality of food ingredient dispensers may be configured around the robotic system. Each dispenser may have a physical interface within a reach of the robotic system to receive an item. One or more physical processing units have a physical interface within the reach of the robotic system to receive the item. The kiosk may prepare food items under control of a local server, a cloud server, or both, for example.

Abstract: A method is provided for absolute position determination of the end effector of a robotic device with a kinematic chain of movable components. At least one current torque or one value corresponding to the torque is measured on at least one movable component of the kinematic chain of the robotic device by a torque sensor arranged on the movable component. At least one torque is calculated on the basis of model data of the robotic device for the movable component. A difference between the measured torque and the calculated torque is determined. If the difference exceeds a prespecified threshold value, the at least one measured torque is used instead of the calculated torque to determine an absolute position of the end effector of the robotic device.

Abstract: In a method for processing a workpiece (2) using a tool (9), in particular for repairing a surface (4) using a laser, the tool (9) being piloted by a control element (10), the tool (9) is to be controlled via a position of the control element (10) and a pressure which is applied either to the control element (10) or by the control element (10).

Abstract: Systems, devices, articles, and methods as disclosed, described, illustrated, and claimed herein. The systems, devices, articles, and methods generally relates to the field of robotics.

Abstract: Systems and methods for remote operating and/or monitoring of a robot are disclosed. In some exemplary implementations, a robot can be communicatively coupled to a remote network. The remote network can send and receive signals with the robot. In some exemplary implementations, the remote network can receive sensor data from the robot, allowing the remote network to determine the context of the robot. In this way, the remote network can respond to assistance requests and also provide operating commands to the robot.

Abstract: A smart pantry system is able to build a data store of the food items that a user or household has on hand, and maintain the data store in light of corroborated point of consumption (POC) data. The data store may also include information about those food items, such as names of food items, brands of food items, number of units of food items, quantity of food items, expiration dates, dates that food items were purchased, nutrition information, etc. The system may also leverage the data store to provide recipe recommendations and/or notifications to a user.

Abstract: A position/force controller includes a function-dependent force/speed distribution conversion unit that, on the basis of speed, position and force information relating to a position based on an action of an actuator and control reference information, performs a conversion to distribute control energy to at least one of speed or position energy and force energy according to a function that is being realized. A control amount calculation unit calculates at least one of a speed or position control amount and a force energy on the basis of at least one of the speed or position energy and the force energy distributed by the force/speed distribution conversion unit. An integration unit integrates speed or position control amount with force control amount and, to return an output to the actuator, performs a reverse conversion on the speed or position control amount and the force control amount and determines an input to the actuator.

Abstract: A medical manipulator system includes a slave manipulator, a master manipulator receiving a manipulation information from an operator; a driver generating a driving force for operating the slave manipulator; a processor; and a master-manipulator-side detector disposed at the master manipulator and detecting the manipulation information. The processor generates an operating command based on the manipulation information and transmits the operating command to the driver, the processor determines whether a blur information is included in the manipulation information.

Abstract: An aircrew automation system relates to the field of flight control systems, methods, and apparatuses; even more particularly, to a system, method, and apparatus for providing aircraft state monitoring and/or an automated aircrew employing a robotic arm with integrated imaging and force sensing modalities.

Abstract: A robot includes: a restricting member configured to restrict a horizontal movement of a predetermined workpiece; and a workpiece moving member configured to generate an action for horizontally moving the workpiece. The controller performs a control operation of positioning the workpiece at a stop position in such a manner that: based on predetermined size information of the workpiece and preset stop position information of the workpiece, the restricting member is positioned at a predetermined restricting position included in the stop position for the workpiece, and the workpiece moving member acts on the workpiece and is moved toward the restricting position to horizontally move the workpiece; and the workpiece is brought into contact with the restricting member.

Abstract: The disclosure relates generally to an electronic device and an operation method therefor. The operation method for an electronic device may include: determining whether a cleaning function is activated; searching for at least one external device; and performing a cleaning function according to a result of the searching.

Abstract: The invention relates to a method for programming a robot, in particular a robot comprising a robotic arm, in which method a movement to be performed by the robot is set up preferably in a robot programme by means of a predefined motion template, the motion template is selected from a database comprising a plurality of motion templates, the motion template comprises one or more execution modules that can be parameterized and at least one learning module, the one or more execution modules are used for planning and/or performing the robot movement or part of the robot movement, the leaning module records one or more configurations of the robot during an initialization process, in particular in the form of a teaching process, and the learning module calculates parameters for the one or more execution modules on the basis of the recorded configurations, preferably using an automatic learning process. Also disclosed is a corresponding system for programming a robot.