Abstract: A method performed by an electronic device, includes: obtaining an image of a set of markers; based on the image, detecting an arrangement of the set of markers; based on the arrangement of the set of markers, performing a measurement about a deformation of the set of markers; based on the measurement about the deformation of the set of markers, generating a plurality of signals; transforming the plurality of signals to a plurality of input commands. The plurality of input commands are used to control the electronic device.

Abstract: A method for controlling a robot including a manipulator is provided. The method may include: acquiring an image of a scene including a target object; inputting the image into a control policy model to obtain an object placement pose of the manipulator, as an output of the control policy model, wherein the control policy model is generated using data collected by a data collection system that is configured to acquire an object retrieval trajectory by observing a robot movement for object retrieval, and reverse the object retrieval trajectory into an object placement trajectory; and commanding the robot to position the manipulator according to the object placement pose, to place the target object at a designated location.

Abstract: A method is provided for calibrating a manipulator and an external sensor. The method includes generating a first cloud map using depth information collected using a depth sensor, and generating a second cloud map using contact information collected using a contact sensor, which is coupled to an end effector of the manipulator. Thereafter, the first cloud map and the second cloud map are aligned to recover extrinsic parameters using the iterative closest point algorithm. The depth sensor is stationary relative to a base frame of the manipulator, and the depth information corresponding to a rigid structure is collected by capturing depth information from multiple vantage points by navigating the manipulator. The contact information is collected by moving an end effector of the manipulator over the rigid structure.